Evaluate an ads algorithm change

Company: Meta

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: medium

Interview Round: Onsite

Quick Answer: This question evaluates competency in experiment design, causal inference, metric selection, product analytics, and evaluation of ad-ranking systems, including handling interference, auction effects, novelty and delayed conversions, segmentation, and reconciling offline and online model signals.