Manage Prompt and Model Behavior in Production
Company: Luma AI
Role: Software Engineer
Category: ML System Design
Difficulty: hard
Interview Round: Technical Screen
Overview: Design production controls for prompts, models, retrieval policy, tools, and decoding settings in an AI application. Use immutable configuration versions, representative evaluations, staged rollout, per-request attribution, observability, rollback, and privacy-safe incident analysis to prevent silent behavior drift.