Machine Learning Engineer ML System Design Interview Questions

Practice 194 real ML System Design interview questions for Machine Learning Engineer roles. From companies including OpenAI, Meta, Amazon, Snapchat, Google.

194 Questions 62 Companies07.31.2026
Showing 20 results
Role
Scale AI logo
Scale AI
Easy
Machine Learning Engineer

Design an Embedding and Classification API

Design an Embedding and Classification API Design a service that accepts text items, generates vector embeddings, and optionally classifies each item ...

ML System Design
14
0
165 people solved
Jul 27, 2026
Mercor logo
Mercor
Medium
Machine Learning Engineer

Design Work Orchestration for Machine-Learning Data Pipelines

Design Work Orchestration for Machine-Learning Data Pipelines Design an orchestration system for data-production workflows used by machine-learning te...

ML System Design
18
0
128 people solved
Jul 8, 2026
Spotify logo
Spotify
Hard
Machine Learning Engineer

Predict Next-Week Streaming Engagement at Event Scale

Predict Next-Week Streaming Engagement at Event Scale Design an ML system that predicts whether a streaming user will be active next week. Discuss lab...

ML System Design
1
0
10 people solved
Jul 31, 2026
Mistral AI logo
Mistral AI
Medium
Machine Learning Engineer

Build a Small Agent or RAG Tool with the Mistral API

In a live coding interview, you receive an API token for an LLM backend and are asked to build a small agent or retrieval-augmented generation tool. D...

ML System Design
17
0
136 people solved
Jul 2, 2026
Plaid logo
Plaid
Medium
Machine Learning Engineer Locked

Design RAG Evaluation and Debugging

This question evaluates a candidate's ability to design evaluation and debugging frameworks for production RAG systems, testing practical ML engineeri...

ML System Design
188
0
1470 people solved
Jun 19, 2026
Pinterest logo
Pinterest
Medium
Machine Learning Engineer

Design User and Item Embeddings from Long Histories

Design User and Item Embeddings from Long Histories Design an embedding system that represents users and visual-content items for retrieval or recomme...

ML System Design
8
0
97 people solved
Jul 2, 2026
OpenAI logo
OpenAI
Medium
Machine Learning Engineer

Design a RAG system with evaluation

Scenario Design a Retrieval-Augmented Generation (RAG) system that answers user questions over a private corpus (internal docs, PDFs, knowledge-base a...

ML System Design
178
1
1711 people solved
Jan 6, 2026
Meta logo
Meta
Hard
Machine Learning Engineer Locked

Design an LLM-Based Coding Assistant

This question evaluates a candidate's ability to design an end-to-end machine learning system, covering model architecture, training data pipelines, e...

ML System Design
17
0
133 people solved
Jun 27, 2026
Pinterest logo
Pinterest
Medium
Machine Learning Engineer

Rank Newly Launched Ads Under Cold Start

Rank Newly Launched Ads Under Cold Start Design a ranking model dedicated to ads launched within the last seven days, where direct performance history...

ML System Design
10
0
74 people solved
Jul 2, 2026
Mercor logo
Mercor
Medium
Machine Learning Engineer AI Locked

Build a Candidate Search System

This question evaluates the ability to design and implement an end-to-end candidate search system, assessing competencies in information retrieval, ra...

ML System Design
72
0
520 people solved
May 2, 2026
Reddit logo
Reddit
Medium
Machine Learning EngineerSenior+ Locked

Design Comment Prediction Ranking System

This question evaluates proficiency in end-to-end machine learning system design for predicting user engagement, specifically the probability of a use...

ML System Design
17
0
203 people solved
Jun 4, 2026
Axon logo
Axon
Medium
Machine Learning EngineerSenior+ Locked

Design Video Intelligence for Investigations

This question evaluates a candidate's competency in designing scalable, multimodal video intelligence systems that integrate machine learning, informa...

ML System Design
18
0
140 people solved
May 26, 2026
OpenAI logo
OpenAI
Medium
Machine Learning Engineer

Design an Agent Harness and Evaluation System

Design an Agent Harness and Evaluation System Design a harness and evaluation platform for a tool-using AI agent. The agent receives a user task, may ...

ML System Design
8
0
95 people solved
Apr 19, 2026
Meta logo
Meta
Hard
Machine Learning Engineer Locked

Design an LLM-Based Conversational Assistant (Chatbot)

This question evaluates the ability to design an end-to-end LLM-based conversational assistant, covering pretraining, alignment, retrieval, and servin...

ML System Design
6
0
59 people solved
Jun 27, 2026
Glean logo
Glean
Medium
Machine Learning Engineer

Design Employee-to-Employee Distance

Design an employee-to-employee distance system for a large company. The system takes two employees as input and returns a meaningful "distance" (or, e...

ML System Design
12
0
192 people solved
Apr 23, 2026
Box logo
Box
Hard
Machine Learning Engineer Locked

Improve Keyword Search Ranking

This question evaluates an ML engineer's search system design competency, including information retrieval and ranking principles, feature and model se...

ML System Design
20
0
140 people solved
Jun 5, 2026
Stripe logo
Stripe
Medium
Machine Learning EngineerSenior+

Design payment fraud detection

Design a machine learning system for fraud detection in an online payment platform. The system should score transactions before or shortly after autho...

ML System Design
11
0
147 people solved
Apr 18, 2026
OpenAI logo
OpenAI
Medium
Machine Learning Engineer

Mine Novel Images from Unlabeled Data

Design a machine learning system that mines novel or interesting images from a massive, unlabeled image corpus. The corpus is far too large for exhaus...

ML System Design
14
0
217 people solved
Apr 3, 2026
Mercor logo
Mercor
Medium
Machine Learning Engineer AI

Build an Ollama Eval Harness

Design and implement a lightweight evaluation harness for a language model served locally through Ollama. The harness should: - Read a dataset of eval...

ML System Design
18
0
173 people solved
Mar 19, 2026
Plaid logo
Plaid
Medium
Machine Learning Engineer

Design a Fraud Detection System

Design a machine learning system for a fintech data-connectivity platform such as Plaid that detects fraudulent activity across the user lifecycle — b...

ML System Design
17
0
171 people solved
Apr 30, 2026

Explore more Machine Learning Engineer ML System Design interview questions

Real questions from candidate reports, grouped by company, topic and role.

By company
Other categories for Machine Learning Engineer
ML System Design questions for other roles
Browse all