Data Scientist Analytics & Experimentation Interview Questions

Practice 895 real Analytics & Experimentation interview questions for Data Scientist roles. From companies including Meta, Capital One, DoorDash, Uber, TikTok.

895 Questions 84 Companies07.27.2026
Showing 20 results
Role
Meta logo
Meta
Medium
Data Scientist

Design and analyze a group-calls experiment

You are considering launching Group Video Calls. Answer all parts precisely; justify choices with pros/cons and formulas where relevant. 1) Clarify CT...

Analytics & Experimentation
2
0
33 people solved
Oct 13, 2025
Meta logo
Meta
Medium
Data Scientist

Evaluate brand ads effectiveness on social media causally

Hypothesis: 'Social media (e.g., Facebook) is not effective for brand advertising compared with other channels.' You have historical multi-channel dat...

Analytics & Experimentation
2
0
46 people solved
Oct 13, 2025
Etsy logo
Etsy
Hard
Data Scientist Locked

Run a clean A/B test for autocomplete

This question evaluates experimental-design and causal-inference competency for online A/B testing of ML-ranked autocomplete, covering metric formulat...

Analytics & Experimentation
3
0
30 people solved
Oct 13, 2025
Meta logo
Meta
Medium
Data Scientist Locked

Increase posts receiving one comment

This question evaluates a data scientist's competency in product analytics and experimentation, specifically metric definition and guardrails, segment...

Analytics & Experimentation
2
0
46 people solved
Oct 13, 2025
Meta logo
Meta
Medium
Data Scientist Locked

Measure and mitigate notification spam

This question evaluates a data scientist's competency in defining precise success and guardrail metrics, designing counterfactual-aware experiments an...

Analytics & Experimentation
3
0
33 people solved
Oct 13, 2025
Instacart logo
Instacart
Hard
Data Scientist

Compute duration and stopping rules correctly

Experiment Runtime Planning: Same‑Day Delivery Attach Rate You are planning an A/B test on the same‑day delivery attach rate (the proportion of eligib...

Analytics & Experimentation
13
0
132 people solved
Oct 13, 2025
TikTok logo
TikTok
Medium
Data Scientist Locked

Design a creator posting-frequency experiment

This question evaluates experimental design and causal inference competencies for a Data Scientist, including precise metric definition, randomization...

Analytics & Experimentation
4
0
38 people solved
Oct 13, 2025
Meta logo
Meta
Medium
Data Scientist

Diagnose a sudden KPI drop and validate causes

A core KPI (comments_per_DAU) suddenly drops materially. Outline a structured root-cause analysis and validation plan. a) Scoping and sanity: Quantify...

Analytics & Experimentation
2
0
29 people solved
Oct 13, 2025
Meta logo
Meta
Medium
Data Scientist

Design and validate ad model launch

You are on the Ads team and just trained a new ad recommendation model meant to replace the current model in production. Design a rigorous plan to dec...

Analytics & Experimentation
2
0
33 people solved
Oct 13, 2025
Meta logo
Meta
Hard
Data Scientist Locked

Define success metrics beyond time spent

This question evaluates a data scientist's competency in product analytics and experimentation, focusing on metrics design, cohort-based retention mea...

Analytics & Experimentation
2
0
23 people solved
Oct 13, 2025
Robinhood logo
Robinhood
Hard
Data Scientist

Diagnose sustained drop in executed trades

Brokerage Analytics Troubleshooting: Trades Per Active User Down 22% Context You are the analyst for a brokerage product that spans onboarding through...

Analytics & Experimentation
11
0
91 people solved
Oct 13, 2025
TikTok logo
TikTok
Hard
Data Scientist Locked

Prove conversion ads value via incrementality

This question evaluates a candidate's competency in causal inference and experimentation design for advertising measurement, covering metrics and attr...

Analytics & Experimentation
2
0
53 people solved
Oct 13, 2025
DoorDash logo
DoorDash
Hard
Data Scientist Locked

Evaluate and test a Top Dasher program

This question evaluates skills in causal inference, experiment design under interference, decision framework development, anti-gaming and selection-bi...

Analytics & Experimentation
19
0
131 people solved
Oct 13, 2025
Uber logo
Uber
Hard
Data Scientist

Design an A/B test for promo-targeting models

Experiment Design: Compare Two Ranking Models (M1 vs M0) for $5 Promotions Context You have two models, M0 (current) and M1 (new), that rank users for...

Analytics & Experimentation
7
0
102 people solved
Oct 13, 2025
Meta logo
Meta
Hard
Data Scientist Locked

Design experiments and observational alternatives

This question evaluates causal inference, experimental design, metric definition and measurement, power analysis, segmentation, and observational stud...

Analytics & Experimentation
2
0
30 people solved
Oct 13, 2025
Disney logo
Disney
Hard
Data Scientist

Diagnose and decide on watch-time drop

Hulu iOS Homepage Ranking Model Rollout: Causal Read and Decision Within 48 Hours Context - On 2025-08-25, a new homepage ranking model was shipped to...

Analytics & Experimentation
6
0
48 people solved
Oct 13, 2025
Freddie Mac logo
Freddie Mac
Hard
Data Scientist

Design a quasi-experiment for FHFA policy

Causal Impact of FHFA's April 15, 2024 Multifamily Underwriting Tightening Context On April 15, 2024, FHFA tightened underwriting standards for multif...

Analytics & Experimentation
5
0
49 people solved
Oct 13, 2025
Meta logo
Meta
Medium
Data Scientist

Analyze regression to mean in heavy-tailed shares

Cohort Dynamics of a Right-Skewed Daily Shares Metric Context - You have a right-skewed metric: daily shares per user, with a long tail. - On Day 1, y...

Analytics & Experimentation
3
0
42 people solved
Oct 13, 2025
Medium
Data Scientist

Separate demand from supply for jeans

Scenario You are a Data Scientist at a multi-category marketplace. The Jeans category is underperforming. You must diagnose whether the primary bottle...

Analytics & Experimentation
3
0
28 people solved
Oct 13, 2025
Attentive logo
Attentive
Hard
Data Scientist

Investigate SMS delivery-rate drop at Attentive

Triage and Validation Plan: US SMS Delivery-Rate Drop Context On March 10 from 20:00–22:00 ET, the US SMS delivery rate (Delivered/Attempted) dropped ...

Analytics & Experimentation
2
0
49 people solved
Oct 13, 2025

Explore more Data Scientist Analytics & Experimentation interview questions

Real questions from candidate reports, grouped by company, topic and role.

By company
Other categories for Data Scientist
Analytics & Experimentation questions for other roles
Browse all