Design a GPU-Efficient Video Service
Company: OpenAI
Role: Software Engineer
Category: ML System Design
Difficulty: medium
Interview Round: Technical Screen
Overview: This question evaluates competency in designing GPU-constrained, production-grade ML serving platforms, emphasizing resource management, job scheduling and prioritization, admission control, durable storage, failure handling, and observability within distributed systems.