Other Analytics & Experimentation Interview Questions
Master your tech interview with our curated database of real questions from top companies.
Design metrics resilient to data quality
Design a robust metric and compute it using only window functions (no JOINs) to show how data-quality issues change conclusions. Schema: payments_raw(...
Design and power an A/B on question mix
Experiment Design: Replacing 10% "Other" Verbal With Grammar in a 15-Min, 19-Question Section You need to test whether replacing the 10% "other" verba...
Design an A/B test with guardrails
A/B Test Plan for a New Checkout Flow (Onsite Data Scientist) Context: You will run an online experiment of a new checkout flow. The baseline conversi...
Find and fix metric drops systematically
Investigating a YoY Drop in Weekly Average Likes per User Context You are a Data Scientist evaluating a social app where the weekly average likes per ...
Separate demand from supply for jeans
Scenario You are a Data Scientist at a multi-category marketplace. The Jeans category is underperforming. You must diagnose whether the primary bottle...
Design an A/B test for a Celebrate reaction
Experiment Design: Adding a "Celebrate" Reaction to WeChat Moments Context WeChat Moments is a friend-based social feed with posting, viewing, and rea...
Translate goals into robust product metrics
Analytics & Experimentation: Metric Design and Validation Context You are a Data Scientist working on analytics and experimentation. You are given bus...
Decide launch with asymmetric costs
Launch Decision Under Asymmetric Costs (Experiment p=0.10) Context You ran an A/B test on a churn‑reduction feature. The test's p‑value was 0.10 (sugg...
Design metrics and experiment
Context You are the data scientist designing success metrics and an experiment for a new subscriber-only feature in a consumer subscription product (e...