Design A/B Test for Short-Video Recommendation Algorithm

Q: Design A/B Test for Short-Video Recommendation Algorithm

This question evaluates a data scientist's competency in experimental design, statistical power analysis, precise metric definition, and evaluation of recommendation algorithms for short‑video feeds, and is categorized under Analytics & Experimentation.

Q: How do I approach Analytics & Experimentation interview questions?

Analytics & Experimentation questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master analytics & experimentation interviews.

Question

A/B Test: New Short‑Video Recommendation Algorithm

Context

You are evaluating a new recommendation algorithm for a TikTok‑like short‑video feed. The goal is to measure whether the new algorithm increases user engagement without harming experience quality.

Tasks

List the top three user‑engagement metrics you would track and define them precisely.
Design the A/B test, including:
- Experiment unit and randomization.
- Sample‑size calculation (show the power analysis).
- Experiment duration (connect to your minimum detectable effect).
- Stopping criteria (statistical and practical).

Design A/B Test for Short-Video Recommendation Algorithm

A/B Test: New Short‑Video Recommendation Algorithm

Context

Tasks

Solution

Comments (0)