Design and optimize a RAG system

Q: Design and optimize a RAG system

This is a ML System Design interview question from OpenAI for Machine Learning Engineer roles. View the full question and solution on PracHub.

Q: How do I approach ML System Design interview questions?

ML System Design questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master ml system design interviews.

Question

Scenario

You are building a Retrieval-Augmented Generation (RAG) system for question answering over an internal document corpus.

Task

Design the end-to-end architecture and describe optimization strategies.

Requirements

Ingest documents continuously (new/updated docs).
High answer quality with citations.
Low latency for interactive use.
Handle long documents and heterogeneous formats (PDF/HTML/wiki pages).

Deliverables

Components (ingestion, chunking, embeddings, index, retriever, reranker, generator).
How you improve relevance and reduce hallucinations.
Evaluation plan (offline + online) and monitoring for drift.

Design and optimize a RAG system

Scenario

Task

Requirements

Deliverables

Solution

Comments (0)