Design A/B Test for Short-Video Recommendation Algorithm
Company: Meta
Role: Data Scientist
Category: Analytics & Experimentation
Difficulty: medium
Interview Round: Onsite
##### Scenario
Short-video app (TikTok-like) – A/B testing a new recommendation algorithm.
##### Question
List the top three metrics you’d use to measure user engagement in a short-video feed.
Design an A/B test for the new recommender: specify sample-size calculation, experiment duration, and stopping criteria.
##### Hints
Consider watch time per DAU, session starts, likes per view; use power analysis for size, minimum-detectable effect for duration.
Quick Answer: This question evaluates a data scientist's competency in experimental design, statistical power analysis, precise metric definition, and evaluation of recommendation algorithms for short‑video feeds, and is categorized under Analytics & Experimentation.