Design a Scheduler for ML Training and Batch Inference Jobs
Company: Netflix
Role: Software Engineer
Category: System Design
Difficulty: medium
Interview Round: Onsite
Overview: Design a scheduler for training, batch inference, and lower-priority evaluation jobs across shared compute resources. Model workload-specific needs, allocation policy, resource monitoring, crash and retry behavior, multi-tenant fairness, quotas, isolation, and operations.
Read the full Netflix Software Engineer interview experience this question came from