Explain Pipeline Parallelism in GRPO Training
Company: Google
Role: Machine Learning Engineer
Category: ML System Design
Difficulty: hard
Interview Round: Technical Screen
Overview: Understand how pipeline stages and microbatches interact with GRPO rollouts, relative advantages, policy versions, throughput, and staleness.