Design and analyze an ads ranking experiment

Company: Roblox

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: hard

Interview Round: Technical Screen

Quick Answer: This question evaluates a data scientist's experimental-design and causal-inference skills applied to ad ranking, including sample-size estimation, variance-reduction methods, interference reasoning (auctions, budget pacing, frequency caps), and marketplace distortion diagnostics.