How would you evaluate upranking shop ads?
Company: Meta
Role: Data Scientist
Category: Analytics & Experimentation
Difficulty: easy
Interview Round: Technical Screen
Overview: Evaluate a proposal to boost in-app Shop Ads relative to Website Ads that send users to an advertiser’s site, from the product hypothesis to the A/B test. Cover stakeholders, success and guardrail metrics, how to decide when small and large advertisers see mixed results, and what could mislead a purely historical comparison.