Design and analyze an ads ranking experiment
Company: Roblox
Role: Data Scientist
Category: Analytics & Experimentation
Difficulty: hard
Interview Round: Technical Screen
Overview: This question evaluates a data scientist's experimental-design and causal-inference skills applied to ad ranking, including sample-size estimation, variance-reduction methods, interference reasoning (auctions, budget pacing, frequency caps), and marketplace distortion diagnostics.