Design of a ChatGPT System

Lesson 181 of 25610 min readPremium lesson preview
In this lesson1 sections

Design of a ChatGPT System

The design has two paths: serving a versioned conversation request and improving the system through later evaluation. Keep them separate so recording feedback or rebuilding an index does not block an active conversation.

High-level design of ChatGPT

The high-level design illustrates how the system handles real-time conversations. The following workflow outlines the component interactions.

The high-level design of the ChatGPT system
The high-level design of the ChatGPT system

The workflow for the high-level design is provided below:

The rest of this lesson is for Premium members

Premium opens every lesson in this course, along with all questions and solutions on PracHub.