Software Engineer ML System Design Interview Questions

Practice 117 real ML System Design interview questions for Software Engineer roles. From companies including Anthropic, OpenAI, Amazon, NVIDIA, Meta.

117 Questions 54 Companies08.10.2026
Showing 20 results
Role
Intuit logo
Intuit
Hard
Software Engineer

Design AI feature launch and data collection

System Design: From AI Prototype to Production Context Assume you are designing a user-facing AI-powered feature for a web/mobile product. Some decisi...

ML System Design
7
0
73 people solved
Sep 6, 2025
Amazon logo
Amazon
Hard
Software Engineer

Design an e-commerce recommendation system

Design an Amazon-Scale E‑Commerce Product Recommendation System Context You are designing a large-scale recommendation system that powers multiple use...

ML System Design
14
0
139 people solved
Sep 6, 2025
Adobe logo
Adobe
Hard
Software Engineer

Design a multimodal embedding service

System Design: Multimodal Embedding Pipeline for Documents, Images, and Videos You are designing a production service that computes embeddings for use...

ML System Design
8
0
135 people solved
Sep 6, 2025
Giga logo
Giga
Medium
Software Engineer

Design an Agentic Ticket Support System

Design an AI-powered ticket support system. The system must integrate with two existing external systems: 1. Ticket system: Displays all support ticke...

ML System Design
9
0
68 people solved
Apr 9, 2026
OpenAI logo
OpenAI
Medium
Software Engineer Locked

Design a GPU-Efficient Video Service

This question evaluates competency in designing GPU-constrained, production-grade ML serving platforms, emphasizing resource management, job schedulin...

ML System Design
10
0
98 people solved
Feb 23, 2026
OpenAI logo
OpenAI
Hard
Software Engineer

Design an enterprise RAG assistant for internal docs

Scenario Design an enterprise GPT-style assistant that allows employees to ask questions about internal company documents (policies, wikis, specs, tic...

ML System Design
7
0
116 people solved
Dec 7, 2025
OpenAI logo
OpenAI
Hard
Software Engineer

Design a response-ranking ML system

Design a response-ranking ML system System Design: Ranking Candidate Text Responses to Maximize User Satisfaction You are designing an end-to-end mach...

ML System Design
9
0
90 people solved
Jul 28, 2025
Oracle logo
Oracle
Hard
Software Engineer

Design scalable, highly available GenAI serving

System Design: Highly Scalable, Highly Available Generative AI Inference Platform Context Design a production-grade deployment for a generative AI tex...

ML System Design
2
1
53 people solved
Sep 6, 2025
Roblox logo
Roblox
Hard
Software Engineer

Outline the ML inference and labeling pipeline

Outline the ML inference and labeling pipeline Audio Detection System: ML Inference and Data Pipeline (Model Architecture Out of Scope) Context and As...

ML System Design
9
0
126 people solved
Jul 31, 2025
Hive.Ai logo
Hive.Ai
Easy
Software EngineerSenior+

Design a Synchronous Text Classification API

Design a Synchronous Text Classification API A trained machine-learning model classifies text. Design the system that exposes this model through synch...

ML System Design
1
0
9 people solved
May 17, 2026
xAI logo
xAI
Medium
Software Engineer

Design a Retrieval-Augmented Generation (RAG) System

Design a retrieval-augmented generation (RAG) system for a production question-answering product. Users ask natural-language questions, and the system...

ML System Design
1
0
26 people solved
Aug 7, 2025
Reddit logo
Reddit
Hard
Software Engineer

Design a feature store with CI/CD and reliability

System Design: Feature Store for Offline Training and Low‑Latency Online Inference Context You are designing a feature store to support machine learni...

ML System Design
11
0
113 people solved
Sep 6, 2025
Meta logo
Meta
Hard
Software EngineerSenior+

Build a Mistral-powered RAG agent

Build a Minimal RAG Tool Using the Mistral API Context You have an API token and need to implement a small retrieval-augmented generation (RAG) tool i...

ML System Design
8
0
85 people solved
Sep 6, 2025
NVIDIA logo
NVIDIA
Medium
Software Engineer

Explain ML compilation optimizations and hardware fit

ML Compiler Optimizations and Platform Targeting Context You are designing a compiler/runtime stack for deep learning workloads that must run efficien...

ML System Design
8
0
78 people solved
Sep 6, 2025
Citadel logo
Citadel
Hard
Software Engineer

Build models for housing and wind power prediction

Two-Part Machine Learning Take-Home Part 1 — Binary Classification: "Can Buy" vs "Cannot Buy" Given applicant and market data, design a binary classif...

ML System Design
9
0
105 people solved
Sep 6, 2025
NVIDIA logo
NVIDIA
Easy
Software Engineer

Design real-time fraud detection under 50ms

Design a real-time fraud detection system for a payments company that processes millions of transactions per day. Requirements: - For each incoming tr...

ML System Design
12
0
90 people solved
Jan 15, 2026
NVIDIA logo
NVIDIA
Medium
Software Engineer

Design and benchmark optimized inference pipelines

Design and benchmark optimized inference pipelines Accelerating PyTorch Inference: TorchDynamo, Techniques, and Benchmark Design Context You are asked...

ML System Design
5
0
76 people solved
Jul 15, 2025
TikTok logo
TikTok
Medium
Software Engineer

Design system to detect privacy-leak records

You are given a very large database that contains user data (both structured fields and unstructured text such as logs, messages, and documents). The ...

ML System Design
4
0
50 people solved
Dec 8, 2025
NVIDIA logo
NVIDIA
Hard
Software Engineer

Explain ML framework trends

Explain ML framework trends ML Framework Trends, Compilation Pipeline to GPU, and Hardware-Aware Deployment Context You are asked to explain how moder...

ML System Design
3
0
43 people solved
Aug 4, 2025
Cribl logo
Cribl
Medium
Software Engineer

Design an LLM Log Parsing Workflow

Design a production workflow that uses an LLM, optionally combined with deterministic parsers, to convert heterogeneous raw log messages into structur...

ML System Design
2
0
17 people solved
Jan 28, 2026

Explore more Software Engineer ML System Design interview questions

Real questions from candidate reports, grouped by company, topic and role.

Other categories for Software Engineer
ML System Design questions for other roles
Browse all