Data Scientist Analytics & Experimentation Interview Questions

Practice 895 real Analytics & Experimentation interview questions for Data Scientist roles. From companies including Meta, Capital One, DoorDash, Uber, TikTok.

895 Questions 84 Companies07.27.2026
Showing 20 results
Role
Capital One logo
Capital One
Medium
Data Scientist

Segment 500k users into three groups

Churn-Risk Segmentation to Maximize Expected 90-Day Revenue You must segment 500,000 users into three contiguous groups along a churn-risk score, orde...

Analytics & Experimentation
3
0
55 people solved
Oct 13, 2025
Thumbtack logo
Thumbtack
Hard
Data Scientist

Design a robust pro-ranking A/B test

Experiment Design: Evaluating a New Pro Ranking Algorithm (Ranker) in a Two‑Sided Marketplace You are designing an experiment to evaluate a new pro ra...

Analytics & Experimentation
6
0
60 people solved
Oct 13, 2025
Meta logo
Meta
Hard
Data Scientist

Evaluate shopping tab pre- and post-launch

Instagram Shopping Tab — Measuring Off‑App Purchases, Opportunity Sizing, and Launch Readout Context Instagram is planning a new Shopping tab. Users o...

Analytics & Experimentation
5
0
46 people solved
Oct 13, 2025
Pinterest logo
Pinterest
Hard
Data Scientist

Design metrics and experiment for Shopping launch

Experiment and Metric Plan: New Shopping Module Embedded in the Pins Feed Context You are introducing a Shopping module directly into the Pins feed. T...

Analytics & Experimentation
10
0
140 people solved
Oct 13, 2025
TikTok logo
TikTok
Hard
Data Scientist

Design robust metrics for a feature launch

A/B Test Metrics and Guardrails for Quick Reply (1-week) Context You are adding a Quick Reply feature (suggested reply chips in the DM composer) to a ...

Analytics & Experimentation
3
0
49 people solved
Oct 13, 2025
DoorDash logo
DoorDash
Hard
Data Scientist

Design an experiment for thermal bags

Experiment Design: Thermal Bags for Couriers to Reduce Cold-Food Refunds Background We want to evaluate whether providing couriers with thermal bags r...

Analytics & Experimentation
12
0
91 people solved
Oct 13, 2025
Twitch logo
Twitch
Hard
Data Scientist

Design an A/B test for pre-roll ads

A/B Test: Reduce Mobile Live‑Stream Pre‑Roll Ad Frequency by 20% Context: You are designing an experiment on mobile live streams to evaluate reducing ...

Analytics & Experimentation
6
0
45 people solved
Oct 13, 2025
Hard
Data Scientist

Decide launch with asymmetric costs

Launch Decision Under Asymmetric Costs (Experiment p=0.10) Context You ran an A/B test on a churn‑reduction feature. The test's p‑value was 0.10 (sugg...

Analytics & Experimentation
3
0
41 people solved
Oct 13, 2025
Intuit logo
Intuit
Medium
Data Scientist Locked

Build cohort 30-day retention from signup date

This question evaluates a data scientist's competency in cohort analysis, retention metric computation, handling right-censoring and edge-case treatme...

Analytics & Experimentation
8
0
68 people solved
Oct 13, 2025
Microsoft logo
Microsoft
Hard
Data Scientist Locked

Design and analyze email deliverability experiment

This question evaluates a data scientist's competency in experimental design, causal inference, sequential testing (frequentist and Bayesian), instrum...

Analytics & Experimentation
6
1
70 people solved
Oct 13, 2025
Apple logo
Apple
Hard
Data Scientist

Evaluate a model and choose metrics

Fraud-screening model evaluation under class imbalance and asymmetric costs Context You operate a binary classifier that flags e‑commerce orders for m...

Analytics & Experimentation
11
0
121 people solved
Oct 13, 2025
TikTok logo
TikTok
Hard
Data Scientist

Drive product decisions with causal product sense

Experimenting on a New Paywall with Likely Spillovers Context You are designing an experiment to evaluate a new paywall on a social/content app where ...

Analytics & Experimentation
7
0
67 people solved
Oct 13, 2025
Netflix logo
Netflix
Hard
Data Scientist

Design and power a frequency-cap experiment

Experiment Design: Raising a 7‑Day Frequency Cap from 3→4 Impressions Context A large video ad campaign plans to raise the per‑user rolling 7‑day freq...

Analytics & Experimentation
17
0
118 people solved
Oct 13, 2025
Meta logo
Meta
Medium
Data Scientist Locked

Evaluate fake accounts and ad creation

This question evaluates a data scientist's competencies in measurement and experimentation, covering prevalence estimation and detection system evalua...

Analytics & Experimentation
2
0
43 people solved
Feb 9, 2026
Meta logo
Meta
Easy
Data Scientist

Define engagement metrics and analyze comment distribution

You are a Data Scientist for a video platform. A PM asks you to: 1) Define metrics for “engagement” (they want a clear metric framework they can use i...

Analytics & Experimentation
11
0
89 people solved
Dec 6, 2025
Instacart logo
Instacart
Easy
Data Scientist

How to debug an apparent D14 retention drop

Scenario A dashboard shows D14 retention (users retained on day 14 after signup/first activity). In the last week, the chart shows a sharp decline. As...

Analytics & Experimentation
7
0
95 people solved
Feb 6, 2026
Instacart logo
Instacart
Easy
Data Scientist

Should you roll out if NSM decreases?

Scenario You ran an experiment. The north star metric (NSM) is profit per order. Observed results - Average order volume increased in treatment vs con...

Analytics & Experimentation
6
0
85 people solved
Feb 6, 2026
DoorDash logo
DoorDash
Medium
Data Scientist

Assess Adding Bicycle Dashers

DoorDash is considering allowing bicycle couriers (bike dashers) to fulfill deliveries in a city that is currently served mostly by car/scooter dasher...

Analytics & Experimentation
5
0
93 people solved
Feb 2, 2026
Capital One logo
Capital One
Easy
Data Scientist Locked

Should a Restaurant Partner with Groupon?

This question evaluates the ability to analyze unit economics, marginal profitability, and cannibalization effects using quantitative assumptions and ...

Analytics & Experimentation
8
0
60 people solved
Feb 1, 2026
LinkedIn logo
LinkedIn
Hard
Data Scientist

LinkedIn Product Case Opportunity Sizing

LinkedIn Product Case: Segmentation, Opportunity Sizing, and Adoption Prediction You are interviewing for a Data Scientist role focused on analytics a...

Analytics & Experimentation
12
0
98 people solved
Apr 30, 2025

Explore more Data Scientist Analytics & Experimentation interview questions

Real questions from candidate reports, grouped by company, topic and role.

By company
Other categories for Data Scientist
Analytics & Experimentation questions for other roles
Browse all