Debug Oscillating GPU Utilization During Training
Company: Tower
Role: Data Scientist
Category: ML System Design
Difficulty: hard
Interview Round: Technical Screen
Overview: A distributed neural-network training job shows GPU utilization repeatedly swinging from about 90% down to 20%. Connect data and model choices to serving architecture, latency and throughput, evaluation, monitoring, failure modes, and iteration.