Machine Learning Engineer ML System Design Interview Questions

Practice 194 real ML System Design interview questions for Machine Learning Engineer roles. From companies including OpenAI, Meta, Amazon, Snapchat, Google.

194 Questions 62 Companies07.31.2026
Showing 20 results
Role
Atlassian logo
Atlassian
Medium
Machine Learning Engineer Locked

Design a recommendation system for Jira issues

This question evaluates end-to-end ML system design competencies for recommendation services in an issue-tracking platform, covering data and labeling...

ML System Design
4
0
68 people solved
Oct 11, 2025
LinkedIn logo
LinkedIn
Medium
Machine Learning Engineer

Design a system for LinkedIn Skills

Design an ML system for “LinkedIn Skills”. The system should infer and/or recommend skills for members, and support downstream use cases like search/r...

ML System Design
4
0
74 people solved
Feb 18, 2026
LinkedIn logo
LinkedIn
Medium
Machine Learning Engineer

Design LinkedIn Learning course recommendations

Design a mini ML system to recommend LinkedIn Learning courses to a user. Product goal: - Recommend courses that help the user succeed in their job se...

ML System Design
8
0
75 people solved
Feb 18, 2026
PayPal logo
PayPal
Hard
Machine Learning Engineer

Design RL-based spending limit policy

RL System Design: Per‑User Spending Limits You are designing a reinforcement learning (RL) system to set per-user spending limits in a payments/risk c...

ML System Design
3
0
60 people solved
Sep 6, 2025
OpenAI logo
OpenAI
Hard
Machine Learning Engineer

Design an ML search system

Design an ML‑Powered Enterprise Document Search System Context You are designing a multi‑tenant enterprise search system that indexes documents from m...

ML System Design
9
0
130 people solved
Sep 6, 2025
TikTok logo
TikTok
Medium
Machine Learning Engineer

Design a model to choose dynamic K

Problem You are building a recommender system with a two-stage ranking pipeline: 1. Candidate retrieval (recall): fetch top-K candidates for a request...

ML System Design
11
0
83 people solved
Feb 11, 2026
Microsoft logo
Microsoft
Medium
Machine Learning Engineer Locked

Design a video VLM end-to-end

This question evaluates a candidate's competency in end-to-end design of video vision-language models (VLMs), covering data strategy, model architectu...

ML System Design
9
0
75 people solved
Feb 11, 2026
LinkedIn logo
LinkedIn
Medium
Machine Learning Engineer Locked

Design a Skills inference system

This question evaluates the ability to design an end-to-end machine learning system for skills inference, including data source integration, labeling ...

ML System Design
10
0
98 people solved
Feb 11, 2026
Snapchat logo
Snapchat
Medium
Machine Learning Engineer Locked

Design an ads ranking ML system

This question evaluates a candidate's ability to design a low-latency ads ranking machine learning system, including feature engineering and freshness...

ML System Design
10
0
82 people solved
Feb 11, 2026
Lila logo
Lila
Medium
Machine Learning Engineer Locked

Design a DNA-sequence optimization loop

This question evaluates a candidate's ability to design an end-to-end ML-driven experimental optimization loop for DNA sequence engineering, including...

ML System Design
4
0
48 people solved
Jan 9, 2026
Amazon logo
Amazon
Medium
Machine Learning Engineer

Explain parallelism and collectives in training

Parallelism strategies and communication in large-scale training You are designing a distributed training setup for very large neural networks that ca...

ML System Design
8
0
87 people solved
Dec 8, 2025
Cognitiv logo
Cognitiv
Medium
Machine Learning Engineer

Design a Real-Time Feature Store

Design a real-time feature store for machine learning systems used in ads or recommendation ranking. Your design should support both: - Online inferen...

ML System Design
4
0
50 people solved
Feb 9, 2026
Microsoft logo
Microsoft
Medium
Machine Learning EngineerSenior+ Locked

Design a RAG-based assistant service

This question evaluates system-design and machine-learning engineering competencies related to Retrieval-Augmented Generation, including architecture ...

ML System Design
4
0
47 people solved
Jan 6, 2026
Microsoft logo
Microsoft
Medium
Machine Learning EngineerSenior+ Locked

Optimize vector semantic search for an assistant

This question evaluates a candidate's competency in designing production-grade vector semantic search systems, including embedding model selection and...

ML System Design
6
0
89 people solved
Jan 6, 2026
Meta logo
Meta
Medium
Machine Learning Engineer Locked

Design a weapon-sale ad detection system

This question evaluates a candidate's competence in end-to-end machine learning system design, covering multimodal signal integration (text, images, b...

ML System Design
14
0
135 people solved
Jan 5, 2026
xAI logo
xAI
Hard
Machine Learning Engineer

Implement a trie-based tokenizer

Design and Implement a Trie-Based Subword Tokenizer for LLM Pretraining Context You are building a subword tokenizer for a large-scale LLM pretraining...

ML System Design
38
1
302 people solved
Sep 6, 2025
Microsoft logo
Microsoft
Easy
Machine Learning EngineerIntern

Explain Transformers and deploy an LLM safely

Answer the following LLM-focused questions. 1) Transformer basics - What problem does the Transformer architecture solve compared with RNNs? - Explain...

ML System Design
9
0
119 people solved
Dec 27, 2025
Xometry logo
Xometry
Medium
Machine Learning EngineerSenior+

Optimize Model Serving Under 200ms

A data science team gives you a trained model and asks you to deploy it as an online inference service. The requirement is that a single prediction mu...

ML System Design
1
0
29 people solved
Mar 7, 2026
Apple logo
Apple
Medium
Machine Learning Engineer Locked

Design a grounded voice assistant

This question evaluates understanding of grounding strategies for large language models, causes and mitigation of hallucinations, response quality eva...

ML System Design
5
0
69 people solved
Jan 25, 2026
Amazon logo
Amazon
Medium
Machine Learning Engineer Locked

Approach an ambiguous business problem

This question evaluates a candidate's ability to handle ambiguity in ML system design by assessing skills in stakeholder communication, problem scopin...

ML System Design
3
0
39 people solved
Dec 20, 2025

Explore more Machine Learning Engineer ML System Design interview questions

Real questions from candidate reports, grouped by company, topic and role.

By company
Other categories for Machine Learning Engineer
ML System Design questions for other roles
Browse all