Design an AI chatbot with browser storage

Q: Design an AI chatbot with browser storage

This question evaluates a candidate's system-design and ML-integration skills for privacy-preserving, browser-only AI chatbots, including client-side state and session management, streaming response delivery, security of credentials and API keys, rate limiting, failure modes, and trade-off analysis.

Q: How do I approach ML System Design interview questions?

ML System Design questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master ml system design interviews.

Question

System Design: Browser-Only Chatbot With Streaming and No Server-Side Conversation Storage

Context

Design an AI chatbot where all user messages and conversation history exist only in the user's browser. No server-side database stores conversations. The bot's responses must stream to the UI. Page refresh starts a new conversation. User credential handling occurs on the client.

Requirements

Describe and justify:

Architecture boundaries (client, edge, backend/LLM)
End-to-end data flow
Streaming implementation (SSE vs. WebSockets) and how to implement it
Session management without a server database
Security for user credentials and API access keys
Rate limiting without a server database
Failure modes, timeouts, and retry strategies
Trade-offs of the no-database approach and mitigations

Design an AI chatbot with browser storage

System Design: Browser-Only Chatbot With Streaming and No Server-Side Conversation Storage

Context

Requirements

Solution

Comments (0)

Design an AI chatbot with browser storage

Overview

System Design: Browser-Only Chatbot With Streaming and No Server-Side Conversation Storage

Context

Requirements

Solution

Comments (0)