OpenAI Software Engineer ML System Design Interview Questions
Master your tech interview with our curated database of real questions from top companies.
Design a Retrieval-Augmented Generation (RAG) system
Prompt Design a Retrieval-Augmented Generation (RAG) system that answers user questions using an organization’s internal documents (PDFs, wiki pages, ...
Design an enterprise RAG assistant for internal docs
Scenario Design an enterprise GPT-style assistant that allows employees to ask questions about internal company documents (policies, wikis, specs, tic...
Design an AI chatbot with browser storage
System Design: Browser-Only Chatbot With Streaming and No Server-Side Conversation Storage Context Design an AI chatbot where all user messages and co...
Design a GPU credit system and scheduler
Design a GPU Credit Accounting and Scheduling Service (Technical Screen) Context You are designing a backend service for an ML platform that runs trai...
Design an End-to-End ML System
System Design: Real-Time Recommendation ML System Context You are tasked with designing an end-to-end machine-learning system that serves real-time re...
Design AI chat bot system
System Design: In-Browser AI Chat With Streaming Requirements Design a web-based AI chatbot system that satisfies all of the following: 1. User messag...
Design a response-ranking ML system
System Design: Ranking Candidate Text Responses to Maximize User Satisfaction You are designing an end-to-end machine learning system that, given a us...
Design ChatGPT homepage with streaming choices
System Design: ChatGPT‑Style Homepage with Streaming Goal Design a ChatGPT‑style web homepage end to end. Users should type a prompt and see the model...