Machine Learning Engineer ML System Design Interview Questions

Practice 194 real ML System Design interview questions for Machine Learning Engineer roles. From companies including OpenAI, Meta, Amazon, Snapchat, Google.

194 Questions 62 Companies07.31.2026
Showing 20 results
Role
Shopify logo
Shopify
Medium
Machine Learning Engineer

Design search autocomplete ML system

Design an ML-powered search autocomplete system that suggests query completions as the user types (e.g., after typing a prefix like "ipho" suggest "ip...

ML System Design
42
0
292 people solved
Feb 18, 2026
Microsoft logo
Microsoft
Medium
Machine Learning EngineerIntern

Design a RAG system with agentic tools

Design a Retrieval-Augmented Generation (RAG) question-answering system for an enterprise knowledge base. Requirements: - Users ask natural-language q...

ML System Design
13
0
199 people solved
Feb 9, 2026
OpenAI logo
OpenAI
Hard
Machine Learning Engineer

Design and optimize a RAG system

Scenario You are building a Retrieval-Augmented Generation (RAG) system for question answering over an internal document corpus (engineering wikis, de...

ML System Design
40
0
466 people solved
Dec 15, 2025
Runway logo
Runway
Hard
Machine Learning Engineer

Design a scalable video search system

Design a scalable video search system Design a Text-to-Video and Video-to-Video Search System Context You are tasked with designing an end-to-end mult...

ML System Design
12
0
234 people solved
Aug 8, 2025
OpenAI logo
OpenAI
Easy
Machine Learning Engineer Locked

How would you build an image classifier with dirty data?

This question evaluates a candidate's ability to design end-to-end image classification systems and manage noisy image datasets, testing competencies ...

ML System Design
49
0
481 people solved
Jan 6, 2026
Pinterest logo
Pinterest
Hard
Machine Learning EngineerSenior+ Locked

Design a real-time home feed ranker

This question evaluates an engineer's ability to design scalable, low-latency real-time recommendation and ranking systems that integrate personalizat...

ML System Design
15
0
119 people solved
Jan 12, 2026
Snapchat logo
Snapchat
Medium
Machine Learning EngineerSenior+

Design a Family-Friendly Listing Classifier

Design a machine learning system for a short-term rental marketplace that classifies whether a property listing is suitable for families. Users should...

ML System Design
3
0
46 people solved
Apr 28, 2026
Google logo
Google
Medium
Machine Learning Engineer

Design a Product or Video Recommendation System

Design a recommendation system for a large consumer platform. The platform may recommend either products in an e-commerce feed or videos in a media fe...

ML System Design
21
1
147 people solved
Dec 24, 2025
Jane Street logo
Jane Street
Hard
Machine Learning Engineer

Design an end-to-end training framework

Design an end-to-end training framework Design an End-to-End Time-Series Forecasting Framework (PyTorch) You are tasked with designing a production-gr...

ML System Design
34
0
330 people solved
Aug 1, 2025
Anthropic logo
Anthropic
Medium
Machine Learning Engineer Locked

Design a model downloader

This question evaluates a candidate's competency in ML system design and distributed systems, covering model lifecycle management, versioning, integri...

ML System Design
44
0
309 people solved
Feb 27, 2026
Pinterest logo
Pinterest
Medium
Machine Learning Engineer Locked

Design notification and feed recommenders

This question evaluates an engineer's ability to design scalable, production-ready recommendation systems for notifications and home feeds, encompassi...

ML System Design
13
0
125 people solved
Mar 8, 2026
Anthropic logo
Anthropic
Hard
Machine Learning Engineer

Design an inference routing and scheduling layer

System Design: Routing Layer for Heterogeneous Inference Backends (GPU/CPU) Context You are asked to design a routing layer that sits between a user-f...

ML System Design
40
0
376 people solved
Sep 6, 2025
Meta logo
Meta
Medium
Machine Learning Engineer Locked

Prevent Private Code Leakage in Coding Agents

This question evaluates competency in ML system design, data privacy and security, model training and inference safeguards, and mechanisms for detecti...

ML System Design
6
0
103 people solved
Apr 9, 2026
OpenAI logo
OpenAI
Hard
Machine Learning Engineer

Design a recommendation system end-to-end

Design a Recommendation System End-to-End You are asked to design a large-scale recommendation system that powers a personalized feed — for example, a...

ML System Design
20
0
222 people solved
Dec 15, 2025
Jane Street logo
Jane Street
Hard
Machine Learning Engineer

Predict future time-series values

Predict future time-series values End-to-End Time-Series Forecasting (PyTorch) Context You are given one or more regularly sampled numeric time series...

ML System Design
24
0
259 people solved
Aug 4, 2025
Meta logo
Meta
Medium
Machine Learning Engineer Locked

Design a Short-Video Recommendation System

This question evaluates competency in designing large-scale short-video recommendation systems, including machine learning model selection, candidate ...

ML System Design
8
0
92 people solved
Feb 28, 2026
OpenAI logo
OpenAI
Hard
Machine Learning Engineer

Design an ML search system with RAG

Design an ML search system with RAG System Design: ML-Powered Enterprise Search with RAG Design an ML-powered enterprise search system using Retrieval...

ML System Design
60
0
402 people solved
Jul 15, 2025
Roblox logo
Roblox
Medium
Machine Learning Engineer Locked

Design a game genre classifier

This question evaluates system design and machine learning competencies, including multi-modal modeling (text, images, tabular), data and label qualit...

ML System Design
12
0
108 people solved
Feb 27, 2026
Reddit logo
Reddit
Medium
Machine Learning EngineerSenior+

Design a video recommendation system

Scenario You are designing an ML-driven video recommendation product (home feed + “up next”) for a consumer app. The interviewer focuses heavily on in...

ML System Design
30
0
306 people solved
Feb 12, 2026
Waymo logo
Waymo
Medium
Machine Learning Engineer

Design Large-Scale Inference Serving

Design a production inference serving system for a machine learning model used by 100 million daily active users. Your answer should cover: traffic as...

ML System Design
10
0
96 people solved
Nov 27, 2025

Explore more Machine Learning Engineer ML System Design interview questions

Real questions from candidate reports, grouped by company, topic and role.

By company
Other categories for Machine Learning Engineer
ML System Design questions for other roles
Browse all