OpenAI Machine Learning Engineer ML System Design Interview Questions
Master your tech interview with our curated database of real questions from top companies.
Design a chatbot fallback for unknown questions
Scenario You run a ChatGPT-like assistant. Users sometimes ask questions the model cannot answer reliably (unknown/uncertain/needs up-to-date facts). ...
Design an AWS fine-tuning platform for LLMs
Scenario You need to build a system that lets customers fine-tune their own large language model (LLM) on AWS. Task Design a managed platform where us...
Design and optimize a RAG system
Scenario You are building a Retrieval-Augmented Generation (RAG) system for question answering over an internal document corpus. Task Design the end-t...
Design a recommendation system end-to-end
Question Design a large-scale recommendation system (e.g., short videos or e-commerce items). Requirements - Personalized feed ranking for hundreds of...
Design an image/video near-duplicate detection system
Question Design a system to detect near-duplicate images/videos (e.g., reuploads, minor edits, different encodes) at large scale. Requirements - Suppo...
Design a harmful video content moderation system
Question Design an end-to-end system to detect and moderate harmful videos on a large platform. Requirements - Detect multiple policy categories (viol...
Select high-quality math documents from crawls
Scenario You have a web crawler that collects raw HTML/PDF documents. You want to build a pipeline that identifies high-quality math documents suitabl...
Design an OOD detection system
Prompt You are building a product that uses an ML classifier in production (e.g., for routing, ranking, safety, fraud, or categorization). Over time, ...
Design an enterprise RAG system
System Design Task: Retrieval-Augmented Generation (RAG) for Enterprise Users You are designing a multi-tenant enterprise RAG system that answers user...
Design an ML search system
Design an ML‑Powered Enterprise Document Search System Context You are designing a multi‑tenant enterprise search system that indexes documents from m...
Design a production RAG system
Design a Production RAG System for Enterprise Document QA Context You are designing a Retrieval-Augmented Generation (RAG) system to answer questions ...
Design enterprise RAG search system
Design an End-to-End Enterprise RAG Search System Background You are tasked with designing a Retrieval-Augmented Generation (RAG) search system for en...
Design an enterprise RAG system
System Design: Retrieval-Augmented Generation (RAG) for Enterprise Context Design a production-grade, multi-tenant RAG platform for enterprise users. ...
Design a low-latency RAG system
System Design: Production-Grade RAG for Customer Support (p99 ≤ 1.5 s) Goal Design a production-ready retrieval-augmented generation (RAG) system for ...
Design an ML search system with RAG
System Design: ML-Powered Enterprise Search with RAG Design an ML-powered enterprise search system using Retrieval-Augmented Generation (RAG) under th...
Design LLM search handling long token inputs
You are asked to design an LLM-powered search system that lets users query a large corpus of documents (e.g., internal wikis, PDFs, logs, and web page...