Machine Learning Engineer ML System Design Interview Questions

Practice 194 real ML System Design interview questions for Machine Learning Engineer roles. From companies including OpenAI, Meta, Amazon, Snapchat, Google.

194 Questions 62 Companies07.31.2026
Showing 20 results
Role
TikTok logo
TikTok
Medium
Machine Learning Engineer Locked

Design training for multimodal embedding model

This question evaluates proficiency in end-to-end multimodal embedding system design, including model architecture, supervision and loss strategies, e...

ML System Design
4
0
56 people solved
Jan 22, 2026
Meta logo
Meta
Medium
Machine Learning Engineer Locked

Design an ads ranking system with calibration

This question evaluates a candidate's ability to design scalable, low-latency online machine learning systems for ads ranking, covering competencies i...

ML System Design
11
0
164 people solved
Jan 21, 2026
Roblox logo
Roblox
Hard
Machine Learning Engineer

Design a real-time game recommendation system

Design a real-time game recommendation system System Design: Real‑Time Game Recommendation System (Architecture Focus) You are designing a real‑time r...

ML System Design
10
0
189 people solved
Jul 16, 2025
Meta logo
Meta
Hard
Machine Learning EngineerSenior+

Design image and multimodal generation systems

System Design: Image Generation and Multimodal Generation Part 1 — End-to-End Image Generation System Design an end-to-end image generation system. Co...

ML System Design
9
0
106 people solved
Aug 11, 2025
Walmart Labs logo
Walmart Labs
Easy
Machine Learning Engineer Locked

Design an item category prediction system

This question evaluates a candidate's ability to design end-to-end machine learning systems for multi-class or hierarchical item categorization, encom...

ML System Design
5
0
48 people solved
Dec 7, 2025
DoorDash logo
DoorDash
Hard
Machine Learning Engineer

Discuss ML infrastructure fundamentals

Discuss ML infrastructure fundamentals ML System Design: Infra Stack, Feature Store, Reproducibility, and Monitoring Context: You are designing and op...

ML System Design
21
0
146 people solved
Jul 29, 2025
OpenAI logo
OpenAI
Hard
Machine Learning Engineer

Design LLM search handling long token inputs

Design an LLM-powered search and question-answering system over a large corpus of documents such as internal wikis, PDFs, logs, contracts, and web pag...

ML System Design
17
0
175 people solved
Apr 6, 2025
Amazon logo
Amazon
Medium
Machine Learning Engineer Locked

Debug online worse than offline model performance

This question evaluates the ability to diagnose discrepancies between offline and online model performance by reasoning about data distributions, feat...

ML System Design
5
0
63 people solved
Jan 6, 2026
Shopify logo
Shopify
Medium
Machine Learning Engineer

Design Personalized Product Feeds

Design an ML system for personalized product feeds in an e-commerce application. For each user request, the system should return a ranked feed of prod...

ML System Design
8
0
92 people solved
Apr 1, 2026
Medium
Machine Learning EngineerSenior+ Locked

Design a Recommendation Ranking System

This question evaluates expertise in designing scalable, low-latency machine learning recommendation and ranking systems, covering multi-stage ranking...

ML System Design
3
0
21 people solved
Mar 31, 2026
Creditkarma logo
Creditkarma
Medium
Machine Learning EngineerSenior+ Locked

Design Personalized Promotion Recommendations

This question evaluates a candidate's ability to design end-to-end machine learning recommendation systems, covering competencies such as data collect...

ML System Design
2
0
23 people solved
May 26, 2026
Atlassian logo
Atlassian
Medium
Machine Learning Engineer

Design a Jira+Confluence RAG assistant

You are asked to design a simple Retrieval-Augmented Generation (RAG) system that answers employee questions using content from two internal products:...

ML System Design
7
0
56 people solved
Nov 21, 2025
Tubitv logo
Tubitv
Medium
Machine Learning Engineer

ML System Design: Thumbnail Selection for a Streaming Catalog

ML System Design: Thumbnail Selection for a Streaming Catalog You work at a video streaming service. For each title in the catalog (movie or show), th...

ML System Design
1
0
20 people solved
Feb 10, 2026
Atlassian logo
Atlassian
Medium
Machine Learning Engineer Locked

Design a product-feed recommendation system

This question evaluates a candidate's competency in end-to-end machine learning system design for recommendation engines within the ML System Design d...

ML System Design
3
0
66 people solved
Oct 15, 2025
Apple logo
Apple
Hard
Machine Learning Engineer

Design an ML keyword recommendation pipeline

Design an ML keyword recommendation pipeline ML System Design: Typed Search Keyword Recommendations for an App Marketplace Goal Design an end-to-end M...

ML System Design
8
0
109 people solved
Jul 26, 2025
Capital One logo
Capital One
Medium
Machine Learning Engineer

Design model deployment, monitoring, and low-latency inference

You have trained a fraud detection model and need to productionize it. Part A: Deployment - How would you deploy an ML model to production? - What art...

ML System Design
16
0
124 people solved
Dec 15, 2025
Whatnot logo
Whatnot
Medium
Machine Learning Engineer

Design trending livestream discovery

Design a system for a live-commerce platform that surfaces trending livestreams to users. Assume an ML model for scoring trendiness or relevance alrea...

ML System Design
7
0
117 people solved
Jan 17, 2026
Shopify logo
Shopify
Hard
Machine Learning Engineer

Design a baseline loan recommendation system

System Design: Baseline Loan Recommendation System Context Design a baseline system that recommends loan offers to users on a digital platform. The sy...

ML System Design
14
0
192 people solved
Sep 6, 2025
Applied Intuition logo
Applied Intuition
Hard
Machine Learning Engineer

Implement KV cache for inference

Design Task: Key–Value Cache for Transformer Decoder Inference Context You are building an autoregressive inference engine for a Transformer decoder-o...

ML System Design
9
0
187 people solved
Sep 6, 2025
Bytedance logo
Bytedance
Medium
Machine Learning EngineerIntern

Design an Enterprise Tool-Using Agent

Design an enterprise LLM agent that can use external tools to complete multi-step business tasks. Assume the agent may call tools such as document ret...

ML System Design
5
0
74 people solved
Jan 8, 2026

Explore more Machine Learning Engineer ML System Design interview questions

Real questions from candidate reports, grouped by company, topic and role.

By company
Other categories for Machine Learning Engineer
ML System Design questions for other roles
Browse all