Machine Learning Engineer System Design Interview Questions

Practice 40 real System Design interview questions for Machine Learning Engineer roles. From companies including Meta, OpenAI, Amazon, Snapchat, Microsoft.

40 Questions 64 Companies08.05.2026
Showing 20 results
Role
Apple logo
Apple
Medium
Machine Learning EngineerNew Grad

Design a multimodal RAG assistant

Prompt Design a Retrieval-Augmented Generation (RAG) system that can answer user questions using an internal knowledge base containing multiple modali...

System Design
17
0
174 people solved
Dec 15, 2025
LinkedIn logo
LinkedIn
Hard
Machine Learning Engineer

Design a distributed key-value store

Design a distributed key-value store Design a Distributed Key–Value Store (Technical Screen) Context You're designing a cloud-native, multi-tenant key...

System Design
8
0
107 people solved
Jul 16, 2025
Anthropic logo
Anthropic
Hard
Machine Learning Engineer

Design a scalable MapReduce pipeline

Design a scalable MapReduce pipeline Design a Large-Scale MapReduce-Style Data Processing System Context You are designing a batch pipeline, using a M...

System Design
31
0
237 people solved
Aug 1, 2025
OpenAI logo
OpenAI
Hard
Machine Learning Engineer

Design a regional surge pricing strategy

Scenario You operate a ride-hailing platform. You need to design a system that sets surge multipliers (dynamic pricing) for a given region. Task Desig...

System Design
36
0
258 people solved
Dec 15, 2025
Atlassian logo
Atlassian
Medium
Machine Learning Engineer Locked

Design a scalable chatbot platform

This question evaluates a candidate's ability to design a scalable, production-grade chatbot platform that integrates ML-based inference, multi-turn c...

System Design
8
0
61 people solved
Jan 22, 2026
Apple logo
Apple
Medium
Machine Learning Engineer

Design Apple News without ML

Design an initial search and content-discovery system for a news application similar to Apple News, assuming you do not have a trained ranking model y...

System Design
9
0
86 people solved
Dec 17, 2025
Meta logo
Meta
Medium
Machine Learning Engineer Locked

Design a recommendation system from scratch

This question evaluates expertise in recommender systems and related competencies including machine learning-based candidate generation and ranking, d...

System Design
8
0
109 people solved
Feb 12, 2026
Meta logo
Meta
Medium
Machine Learning Engineer Locked

Design versioned in-memory key-value store

This question evaluates understanding of in-memory data structures, versioning semantics, rollback mechanisms, and performance trade-offs between time...

System Design
11
0
77 people solved
Nov 28, 2025
Anthropic logo
Anthropic
Hard
Machine Learning Engineer

Design a scalable service and model performance

System Design: Multi-Region, 50k QPS, p95 < 100 ms Context Design an online, read-heavy key-value service (for example, a user profile or feature look...

System Design
13
0
268 people solved
Aug 14, 2025
Meta logo
Meta
Medium
Machine Learning Engineer Locked

Design a system to detect weapon posts

This question evaluates system design and machine learning engineering competencies, including multi-modal content detection, real-time model serving,...

System Design
8
0
66 people solved
Feb 11, 2026
LinkedIn logo
LinkedIn
Hard
Machine Learning Engineer

Design a scalable metrics monitoring system

Design a scalable metrics monitoring system Design a Metrics Monitoring System for Large-Scale Services Context You are designing a metrics monitoring...

System Design
6
0
93 people solved
Jul 16, 2025
Microsoft logo
Microsoft
Medium
Machine Learning Engineer Locked

Design chat and online chess

This question evaluates a candidate's ability to design large-scale, real-time consumer systems, testing competencies in scalable architecture, data m...

System Design
8
0
72 people solved
Feb 23, 2026
Meta logo
Meta
Easy
Machine Learning EngineerSenior+ Locked

Design an Online Coding Judge

This question evaluates system design and scalability skills for building a high-throughput, low-latency online coding judge, covering distributed arc...

System Design
2
0
39 people solved
Feb 27, 2026
Amazon logo
Amazon
Hard
Machine Learning Engineer

Design async job orchestration and notification service

Design async job orchestration and notification service System Design: Batch Orchestration Over an External Asynchronous Cluster Context You are desig...

System Design
2
0
48 people solved
Jul 15, 2025
DoorDash logo
DoorDash
Medium
Machine Learning Engineer

Design a scalable recommendation serving system

Scenario You are designing the online serving infrastructure for a large-scale recommendation system (e.g., a delivery app or e-commerce feed). The in...

System Design
8
0
153 people solved
Oct 17, 2025
Meta logo
Meta
Medium
Machine Learning EngineerSenior+ Locked

Design a weapon-ad harmful content detection system

This question evaluates skills in end-to-end system design and applied machine learning for multi-modal harmful content detection, covering scalabilit...

System Design
6
0
69 people solved
Jan 22, 2026
Meta logo
Meta
Hard
Machine Learning Engineer

Design a recommendation system

System Design: Large-Scale Home-Feed Recommendation System Problem Design a large-scale recommendation system for a consumer app's home feed. Describe...

System Design
8
0
60 people solved
Sep 6, 2025
Meta logo
Meta
Hard
Machine Learning Engineer

Design scalable media storage and delivery

System Design: Global UGC Photos and Short Videos Store/Delivery Context Design a globally distributed system to store and deliver user-generated phot...

System Design
7
0
51 people solved
Sep 6, 2025
Salesforce logo
Salesforce
Medium
Machine Learning EngineerSenior+

Design a collaborative spreadsheet backend

Design a web-based spreadsheet service similar to Google Sheets, with emphasis on backend architecture and data models. Focus areas: - Multiple users ...

System Design
6
0
67 people solved
Jan 12, 2026
Startups.Com logo
Startups.Com
Medium
Machine Learning Engineer Locked

Design NL-to-SQL performance optimization assistant

This question evaluates a candidate's ability to design a secure, reliable, and cost-conscious natural-language-to-SQL performance diagnostic system t...

System Design
4
0
37 people solved
Jan 6, 2026

Explore more Machine Learning Engineer System Design interview questions

Real questions from candidate reports, grouped by company, topic and role.

Other categories for Machine Learning Engineer
System Design questions for other roles
Browse all