ChatGPT

Design a hypothetical conversational AI service with streamed replies and persistent conversations. The ChatGPT title identifies the type of product to practice; this exercise does not describe its internal architecture. State your assumptions before choosing components.

Design prompt

Users send messages, receive streamed replies, and return to earlier conversations. Choose an initial traffic level, define supported features, and sketch the path from a message to a delivered result. Include the state that must survive a client disconnect and the state that can expire.

Questions to work through