Estimate Incremental Search-Ad Revenue Without an A/B Test
Company: Reddit
Role: Data Scientist
Category: Analytics & Experimentation
Difficulty: hard
Interview Round: Onsite
Overview: Practice estimating incremental search-ad revenue when 100 eligible users are randomly assigned to treatment outside a conventional A/B platform. Define the intent-to-treat estimand, analyze user-level revenue with uncertainty, use pre-period data for precision, and assess cannibalization and rollout risk.
Read the full Reddit Data Scientist interview experience this question came from