Machine Learning Engineer System Design Interview Questions

Practice 40 real System Design interview questions for Machine Learning Engineer roles. From companies including Meta, OpenAI, Amazon, Snapchat, Microsoft.

40 Questions 64 Companies08.05.2026
Showing 20 results
Role
Anthropic logo
Anthropic
Hard
Machine Learning Engineer

Deploy a Large Model to GPU Workers

Deploy a Large Model to GPU Workers Design a system that distributes a 500 GB model artifact to a fleet of 100 to 1,000 GPU workers. External ingress ...

System Design
69
0
491 people solved
Jul 8, 2026
J.P. Morgan logo
J.P. Morgan
Medium
Machine Learning Engineer

Design an Entitlement-Aware Agentic Portfolio Workflow

Design an Entitlement-Aware Agentic Portfolio Workflow Design an agentic workflow that accepts a portfolio-related request, obtains only the data the ...

System Design
2
0
31 people solved
Aug 5, 2026
Anthropic logo
Anthropic
Hard
Machine Learning Engineer

Design a Dynamically Batched Inference API

Design a Dynamically Batched Inference API Design a high-concurrency HTTP API for language-model inference. Clients submit individual requests, but GP...

System Design
26
0
236 people solved
Jul 8, 2026
Mercor logo
Mercor
Medium
Machine Learning Engineer

Design a High-Demand Event Ticket Marketplace

Design a High-Demand Event Ticket Marketplace Design an online marketplace for event tickets. Users search events, view seat availability and prices, ...

System Design
4
0
52 people solved
Jul 8, 2026
Mercor logo
Mercor
Easy
Machine Learning Engineer Locked

Design a Social Feed

Design a personalized social feed that balances fresh and ranked content while supporting posts, follows, deletions, privacy, and stable pagination. T...

System Design
5
0
64 people solved
May 30, 2026
Amazon logo
Amazon
Medium
Machine Learning Engineer

Design an S3-like object storage service

Design a cloud object storage service similar to Amazon S3. The service should allow clients to upload, store, and download large files reliably and e...

System Design
37
0
347 people solved
Dec 8, 2025
OpenAI logo
OpenAI
Medium
Machine Learning Engineer Locked

Design Duplicate File Detection

This question evaluates system design and storage engineering skills, including scalable file-processing, efficient I/O and resource management, corre...

System Design
46
0
340 people solved
Apr 3, 2026
Jane Street logo
Jane Street
Hard
Machine Learning Engineer

Design and implement a tiny language runtime

Design and implement a tiny language runtime Minimal Imperative Language — Design and Implementation Task Context You are asked to design and implemen...

System Design
36
1
424 people solved
Aug 1, 2025
Jane Street logo
Jane Street
Hard
Machine Learning Engineer

Implement compiler for custom language

Implement compiler for custom language Design and implement a simple compiler/interpreter Goal Design and implement a small compiler/interpreter for a...

System Design
47
0
389 people solved
Aug 4, 2025
OpenAI logo
OpenAI
Medium
Machine Learning Engineer Locked

Design Real-Time Collaborative Editing

This question evaluates competence in distributed systems, real-time synchronization, concurrency control, data modeling, and automated conflict-resol...

System Design
11
0
177 people solved
Mar 11, 2026
Google logo
Google
Hard
Machine Learning Engineer Locked

Design large-scale near-duplicate video detection

This question evaluates a Machine Learning Engineer's competency in scalable similarity search and representation learning for multimedia, including e...

System Design
17
0
126 people solved
Jan 6, 2026
Shopify logo
Shopify
Medium
Machine Learning Engineer

Design and implement a word-guessing game

Word-Guessing Game (Wordle-like) — Design and Implement Context Build a small, standalone command-line application that lets a user guess a secret wor...

System Design
51
0
345 people solved
Aug 12, 2025
Apple logo
Apple
Medium
Machine Learning Engineer

Design CI/CD for AI Services

Design a CI/CD platform for a large AI product organization. The platform must support backend services, model-serving APIs, data and feature pipeline...

System Design
9
0
127 people solved
Feb 13, 2026
Snapchat logo
Snapchat
Medium
Machine Learning Engineer Locked

Design a search-to-ads ranking pipeline

This question evaluates knowledge of designing a low-latency search-plus-ads ranking pipeline and related competencies in retrieval, filtering, multi-...

System Design
4
0
59 people solved
Feb 11, 2026
OpenAI logo
OpenAI
Hard
Machine Learning Engineer

Design an in-memory database

Design an in-memory database System Design: In-Memory Key–Value Database for Ultra–Low Latency Context You are designing an in-memory, per-node key–va...

System Design
23
0
155 people solved
Jul 15, 2025
Capital One logo
Capital One
Medium
Machine Learning Engineer

Validate virtual credit card transactions from encoded IDs

You are designing logic for a virtual credit card product. Part 1: Product reasoning Explain key benefits and drawbacks of virtual credit cards for: -...

System Design
18
0
286 people solved
Dec 15, 2025
Whatnot logo
Whatnot
Medium
Machine Learning Engineer

Improve and debug the shopping app

You are evaluating a live-shopping mobile app from a product-minded engineering perspective. Answer the following as one integrated exercise: 1. What ...

System Design
13
0
157 people solved
Jan 17, 2026
Anthropic logo
Anthropic
Medium
Machine Learning Engineer

Optimize MapReduce performance

Optimize MapReduce for Parallel Efficiency and Network Utilization You are designing a large-scale batch processing job (e.g., feature extraction, log...

System Design
28
0
490 people solved
Aug 4, 2025
Apple logo
Apple
Medium
Machine Learning EngineerNew Grad

Design a multimodal RAG assistant

Prompt Design a Retrieval-Augmented Generation (RAG) system that can answer user questions using an internal knowledge base containing multiple modali...

System Design
17
0
174 people solved
Dec 15, 2025
OpenAI logo
OpenAI
Hard
Machine Learning Engineer

Design a search query autocomplete system

Question Design a search autocomplete system that suggests completions as the user types. Requirements - Sub-100ms latency per keystroke. - Suggestion...

System Design
23
0
254 people solved
Dec 15, 2025

Explore more Machine Learning Engineer System Design interview questions

Real questions from candidate reports, grouped by company, topic and role.

Other categories for Machine Learning Engineer
System Design questions for other roles
Browse all