Explain Importance Sampling in LLM Training
Company: Google
Role: Machine Learning Engineer
Category: Machine Learning
Difficulty: hard
Interview Round: Technical Screen
Overview: Study importance sampling through likelihood ratios, support assumptions, off-policy LLM data, variance growth, clipping, and diagnostics.