Software Engineer ML System Design Interview Questions

Practice 117 real ML System Design interview questions for Software Engineer roles. From companies including Anthropic, OpenAI, Amazon, NVIDIA, Meta.

117 Questions 54 Companies08.10.2026
Showing 20 results
Role
Grammarly logo
Grammarly
Medium
Software Engineer

Build AI chat for spreadsheets

Design an AI chat interface for the spreadsheet product. A user can type natural-language commands such as: - "Sum all values in column K and write th...

ML System Design
9
0
122 people solved
Feb 13, 2026
Perplexity AI logo
Perplexity AI
Hard
Software Engineer

Implement resilient LLM provider pool

System Design Task: Resilient Multi‑Provider LLM Client Library Context You are designing a client library used by backend services to call external L...

ML System Design
9
0
152 people solved
Aug 13, 2025
Datadog logo
Datadog
Hard
Software Engineer

Design an image detection system

System Design: End-to-End Image Object-Detection Service Context Design a production-grade service that ingests user-uploaded images, runs object dete...

ML System Design
34
0
236 people solved
Sep 6, 2025
Perplexity logo
Perplexity
Medium
Software Engineer Locked

Design trending queries ranking system

This question evaluates the ability to design scalable, low-latency ML-driven systems for detecting and ranking trending queries, covering competencie...

ML System Design
13
0
117 people solved
Sep 4, 2025
Amazon logo
Amazon
Hard
Software Engineer

Design an email spam detection system

Design an email spam detection system System Design: End-to-End Email Spam Detection Context Design an end-to-end system that detects and handles spam...

ML System Design
19
0
163 people solved
Aug 10, 2025
Perplexity logo
Perplexity
Medium
Software Engineer Locked

Design personalized discovery recommendations

This question evaluates understanding of recommender systems and personalization, covering skills in data collection and event logging, candidate retr...

ML System Design
5
0
80 people solved
Sep 4, 2025
Airbnb logo
Airbnb
Hard
Software Engineer

Design a customer LTV prediction system

System Design: End-to-End ML for Customer Lifetime Value (LTV) Context You are designing an end-to-end machine learning system to estimate customer li...

ML System Design
15
0
154 people solved
Aug 12, 2025
Workday logo
Workday
Medium
Software EngineerSenior+ Locked

Design AI-Powered Document Search

This question evaluates system-design and machine-learning engineering skills for building a scalable AI-enabled document ingestion pipeline, covering...

ML System Design
3
0
58 people solved
Apr 1, 2026
Google logo
Google
Hard
Software Engineer

Design autonomous cloud monitoring and remediation

Design an AI-Assisted Monitoring and Auto-Remediation Service Context Design a service that monitors cloud applications across multiple providers, col...

ML System Design
9
0
122 people solved
Sep 6, 2025
Databricks logo
Databricks
Medium
Software Engineer Locked

Design RAG Retrieval for Data Assets

This question evaluates skills in designing hybrid retrieval pipelines over enterprise metadata, including competencies in information retrieval, exac...

ML System Design
37
0
378 people solved
May 2, 2026
Anthropic logo
Anthropic
Hard
Software Engineer Locked

Estimate VRAM and compare model parallelism

This question evaluates understanding of GPU memory budgeting for large matrix multiplications and the comparative trade-offs between pipeline and ten...

ML System Design
34
0
278 people solved
Nov 19, 2025
Ancestry logo
Ancestry
Medium
Software Engineer

Design a feedback-text personalization data system

System/ML design scenario: personalize using user feedback text You are building an embeddings + personalization pipeline for a consumer product (e.g....

ML System Design
4
0
32 people solved
Feb 11, 2026
Anthropic logo
Anthropic
Hard
Software Engineer Locked

Design a batched inference API

This question evaluates competency in designing scalable, low-latency ML inference systems with dynamic batching, covering system architecture, reques...

ML System Design
8
0
89 people solved
Feb 8, 2026
TikTok logo
TikTok
Hard
Software EngineerIntern Locked

What skills are needed for AI infra roles?

This question evaluates familiarity with AI infrastructure and LLM serving, including systems and performance engineering, model inference mechanisms,...

ML System Design
10
0
78 people solved
Jan 6, 2026
Anthropic logo
Anthropic
Hard
Software Engineer

Design a prompt processing backend

Design a prompt processing backend System Design: Background Processing Backend for LLM Prompts Context Design a multi-tenant backend that processes l...

ML System Design
13
0
175 people solved
Jul 26, 2025
Lambda logo
Lambda
Hard
Software Engineer

Design a cloud AI inference platform

System Design: Cloud AI Inference Platform for Real-Time and Batch Context Design a multi-tenant cloud platform that serves machine learning models fo...

ML System Design
10
0
179 people solved
Sep 6, 2025
OpenAI logo
OpenAI
Hard
Software Engineer

Design an End-to-End ML System

Design an End-to-End ML System System Design: Real-Time Recommendation ML System Context You are tasked with designing an end-to-end machine-learning ...

ML System Design
9
0
111 people solved
Aug 4, 2025
OpenAI logo
OpenAI
Hard
Software Engineer

Design ChatGPT homepage with streaming choices

Design ChatGPT homepage with streaming choices System Design: ChatGPT‑Style Homepage with Streaming Goal Design a ChatGPT‑style web homepage end to en...

ML System Design
8
0
100 people solved
Jul 27, 2025
OpenAI logo
OpenAI
Hard
Software Engineer Locked

Design a Retrieval-Augmented Generation (RAG) system

This question evaluates a candidate's ability to design production-grade Retrieval-Augmented Generation systems, testing competencies in information r...

ML System Design
6
0
102 people solved
Dec 15, 2025
Amazon logo
Amazon
Hard
Software Engineer

Design a fraud detection system

Design a Real-Time Payment Fraud Detection System Design an ML-powered system that scores each online card-not-present (CNP) payment during authorizat...

ML System Design
15
0
126 people solved
Aug 10, 2025

Explore more Software Engineer ML System Design interview questions

Real questions from candidate reports, grouped by company, topic and role.

Other categories for Software Engineer
ML System Design questions for other roles
Browse all