Software Engineer ML System Design Interview Questions

Practice 117 real ML System Design interview questions for Software Engineer roles. From companies including Anthropic, OpenAI, Amazon, NVIDIA, Meta.

117 Questions 54 Companies08.10.2026
Showing 17 results
Role
Google logo
Google
Hard
Software Engineer

Design anomaly detection and response platform

Design an AI-Driven OS Snapshot Anomaly Detection Service Context You are designing a cloud service that ingests operating system (OS) snapshots from ...

ML System Design
8
0
87 people solved
Sep 6, 2025
Netflix logo
Netflix
Hard
Software Engineer

Build a Recommendation System and Conversational Interface from Scratch

Build a Recommendation System and Conversational Interface from Scratch Design an initial recommendation system, then extend it with a chatbot that ca...

ML System Design
0
0
2 people solved
Jan 7, 2026
Adobe logo
Adobe
Hard
Software Engineer

Design file-embedding storage system

Design file-embedding storage system System Design: Multimodal Embedding Service for User Uploads Context You are designing a backend service that, fo...

ML System Design
16
0
65 people solved
Aug 4, 2025
Salesforce logo
Salesforce
Hard
Software Engineer

Design an end-to-end recommendation system

Design an end-to-end recommendation system System Design Prompt: End-to-End Movie Recommendation System You are tasked with designing an end-to-end mo...

ML System Design
10
0
71 people solved
Aug 1, 2025
NVIDIA logo
NVIDIA
Medium
Software Engineer

Describe model-to-GPU execution pipeline

Describe model-to-GPU execution pipeline From Model Definition to GPU Execution: Pipeline and Optimizations You are asked to explain the end-to-end pa...

ML System Design
7
0
107 people solved
Jul 31, 2025
Meta logo
Meta
Hard
Software Engineer

Design place-of-interest ML system

Design place-of-interest ML system Design a POI (Places of Interest) Recommendation System Context Design a global POI recommender for a mobile maps/f...

ML System Design
13
1
118 people solved
Jul 17, 2025
Intuit logo
Intuit
Medium
Software Engineer

Design prompts for JSON-only LLM responses

Design an LLM request that returns strict JSON only Context You are designing a backend call to an LLM for a technical screen (System Design & Enginee...

ML System Design
7
0
71 people solved
Sep 6, 2025
Disney logo
Disney
Hard
Software Engineer

Design a personalized recommendation system

System Design: Personalized Recommendations for a Consumer App Context Assume you are building the home-feed recommendations for a large consumer app ...

ML System Design
6
0
104 people solved
Sep 6, 2025
Amazon logo
Amazon
Hard
Software Engineer

Optimize attention for long sequences

Optimize attention for long sequences System Design: Efficient Attention for Long Sequences Context You are designing or optimizing sequence models th...

ML System Design
4
0
44 people solved
Jul 15, 2025
Palo Alto Networks logo
Palo Alto Networks
Hard
Software Engineer

Design an ML inference orchestration platform

System Design: ML Inference Orchestration Platform Context You are designing a multi-tenant platform that exposes several ML models as independent ser...

ML System Design
10
0
86 people solved
Sep 6, 2025
Salesforce logo
Salesforce
Medium
Software Engineer

Design a recommendation system

Design a recommendation system Design a User–Item Recommendation System Context You are asked to design an end-to-end recommendation service that sugg...

ML System Design
5
0
90 people solved
Aug 4, 2025
Amazon logo
Amazon
Hard
Software Engineer

Deep dive a resume project

Deep dive a resume project End-to-End ML Project Walkthrough (System Design Focus) Pick one ML project from your experience and walk through it end-to...

ML System Design
5
0
36 people solved
Jul 15, 2025
Credit Genie logo
Credit Genie
Hard
Software Engineer

Integrate Chroma and design semantic search API

System Design: Add Semantic Search to an Existing CRUD Service Using Chroma Context You own a document CRUD service (create/read/update/delete) that s...

ML System Design
4
0
77 people solved
Sep 6, 2025
HubSpot logo
HubSpot
Hard
Software Engineer

Design a GPU inference API

System Design: GPU-Backed Inference Platform and API You are designing a production inference platform to serve deep learning models (vision, ranking,...

ML System Design
9
0
71 people solved
Sep 6, 2025
Airbnb logo
Airbnb
Hard
Software Engineer

Design a dynamic rental pricing system

System Design: ML-Driven Nightly Pricing for Short-Term Rentals Context Design a production ML system that recommends (and optionally auto-sets) night...

ML System Design
16
0
155 people solved
Aug 12, 2025
Airtable logo
Airtable
Medium
Software Engineer

Design NL-to-Formula assistant for Airtable

Question Design an ML-powered assistant for a no-code table product like Airtable that converts a user's natural-language request into a formula expre...

ML System Design
64
0
582 people solved
Nov 4, 2025
Meta logo
Meta
Hard
Software EngineerSenior+

Design a secure ML data platform

System Design: Secure, Ethical, Multi‑Tenant ML Data and Inference Platform Context Design a cloud-based ML platform used by multiple internal product...

ML System Design
5
0
40 people solved
Sep 6, 2025

Explore more Software Engineer ML System Design interview questions

Real questions from candidate reports, grouped by company, topic and role.

Other categories for Software Engineer
ML System Design questions for other roles
Browse all