Data Scientist Analytics & Experimentation Interview Questions

Practice 895 real Analytics & Experimentation interview questions for Data Scientist roles. From companies including Meta, Capital One, DoorDash, Uber, TikTok.

895 Questions 84 Companies07.27.2026
Showing 20 results
Role
Gusto logo
Gusto
Medium
Data Scientist

How do you test two variants vs control?

You ran an A/B/n experiment with 1 control and 2 treatment variants. The primary metric is conversion rate (each user either converts or not within th...

Analytics & Experimentation
10
0
95 people solved
Nov 30, 2025
Airbnb logo
Airbnb
Hard
Data Scientist Locked

Design and assess an A/B test

This question evaluates a data scientist's competency in experimental design, statistical power and sample-size estimation, metric definition and guar...

Analytics & Experimentation
7
0
103 people solved
Sep 6, 2025
Fetch logo
Fetch
Medium
Data Scientist

Evaluate Overlapping Shelf Ranking Experiments

Fetch is running two A/B experiments in its mobile app. Product context The app displays product shelves. Each shelf contains multiple products, and t...

Analytics & Experimentation
2
0
32 people solved
Apr 27, 2026
Capital One logo
Capital One
Medium
Data Scientist Locked

Decide Which Show to Renew

This question evaluates financial modeling, expected-value calculation, probabilistic reasoning, and risk assessment skills as applied to content rene...

Analytics & Experimentation
5
0
67 people solved
Feb 11, 2026
Google logo
Google
Hard
Data Scientist

Design long-tail search evaluation under label budget

Estimating ΔNDCG@10 With Limited Labels Under a Heavy-Tailed Query Mix You serve ~100M queries/day. Query frequencies follow a Pareto distribution wit...

Analytics & Experimentation
4
0
68 people solved
Oct 13, 2025
Capital One logo
Capital One
Medium
Data Scientist

Design metrics and an A/B test for an app

Pick a consumer digital app you love. Assume the interviewer knows nothing about it. 1) Explain the product, core jobs-to-be-done, target audience seg...

Analytics & Experimentation
4
0
54 people solved
Oct 13, 2025
Lyft logo
Lyft
Medium
Data Scientist

Design experiments for marketplace balance

You propose a new supplier prioritization (ranking) policy intended to increase order completion in a two-sided marketplace with known interference be...

Analytics & Experimentation
23
0
161 people solved
Oct 13, 2025
Pinterest logo
Pinterest
Hard
Data Scientist

Decide if ad load is optimized

Pinterest Home Feed Ad Load Optimization You are asked to design an analysis and experiment to determine whether the current home-feed ad load (ads pe...

Analytics & Experimentation
25
0
158 people solved
Oct 13, 2025
TikTok logo
TikTok
Hard
Data Scientist

Diagnose a sudden metric spike or drop

Investigate a 3-Day Jump in Checkout Conversion Rate (CCR) Context On 2025-06-12, the daily Checkout Conversion Rate (CCR) increased from 3.2% to 4.5%...

Analytics & Experimentation
9
0
126 people solved
Oct 13, 2025
Capital One logo
Capital One
Medium
Data Scientist

Design theme-park profit model and bid decision

Theme Park Pricing and Land-Acquisition Case Context You manage pricing analytics for a Disney-like theme park. Baseline demand is steady. A land auct...

Analytics & Experimentation
14
0
90 people solved
Oct 13, 2025
Roblox logo
Roblox
Easy
Data Scientist Locked

How to estimate feature impact on usage time

This question evaluates causal inference and observational analytics skills—specifically defining an estimand, designing primary, diagnostic, and guar...

Analytics & Experimentation
21
0
258 people solved
Jan 17, 2026
Instacart logo
Instacart
Easy
Data Scientist

How would you investigate a metric decline?

Scenario You are a Data Scientist supporting a consumer marketplace product. A key business metric (e.g., orders/day, conversion rate, revenue, profit...

Analytics & Experimentation
19
0
142 people solved
Feb 6, 2026
OpenAI logo
OpenAI
Hard
Data Scientist Locked

Measure free-month promotion impact

This question evaluates causal inference and experimentation skills, including randomized design and estimand framing, metric and ROI attribution, han...

Analytics & Experimentation
15
0
137 people solved
Jan 15, 2026
Whatnot logo
Whatnot
Medium
Data Scientist Locked

Turn a Marketplace Data Insight into an Actionable Product Plan

Practice turning a marketplace data observation into an interview-ready product and analytics plan. The question tests problem framing, stakeholder al...

Analytics & Experimentation
1
0
13 people solved
May 23, 2026
Airbnb logo
Airbnb
Medium
Data Scientist

Analyze A/B Test Results to Inform Stakeholder Decisions

Analyze A/B Test Results to Inform Stakeholder Decisions You receive raw log-level event data from an A/B test on a consumer booking funnel. You must ...

Analytics & Experimentation
26
0
138 people solved
Jul 12, 2025
TikTok logo
TikTok
Hard
Data Scientist

Measure Billboard Campaign Effectiveness and Engagement Quantification

Measure Billboard Campaign Effectiveness and Engagement Quantification A consumer social platform places billboards in train stations to drive traffic...

Analytics & Experimentation
76
0
291 people solved
Jul 12, 2025
Uber logo
Uber
Medium
Data ScientistNew Grad Locked

Evaluate marketplace interventions

This question evaluates a data scientist's competency in product analytics, causal inference, and experimentation design for two-sided marketplaces, f...

Analytics & Experimentation
13
0
98 people solved
Mar 22, 2026
Google logo
Google
Medium
Data Scientist

Design A/B Test for Google Maps UI Change

Design A/B Test for Google Maps UI Change A/B Test Design: Moving the Google Maps Search Bar to the Bottom Context Google Maps is considering a UI cha...

Analytics & Experimentation
9
0
69 people solved
Aug 4, 2025
Walmart Labs logo
Walmart Labs
Medium
Data Scientist

Calculate Sample Size for Effective A/B Test Design

Calculate Sample Size for Effective A/B Test Design A/B Test Planning: Sample Size and Power Scenario You are planning an online A/B test to evaluate ...

Analytics & Experimentation
5
0
60 people solved
Aug 4, 2025
Google logo
Google
Medium
Data Scientist

Design pricing and multivariate button experiments

You join a B2B SaaS firm with three public tiers (Basic $25/month, Pro $50/month, Enterprise = sales-quoted). The PM asks for a 2‑week A/B test to rai...

Analytics & Experimentation
10
0
121 people solved
Oct 13, 2025

Explore more Data Scientist Analytics & Experimentation interview questions

Real questions from candidate reports, grouped by company, topic and role.

By company
Other categories for Data Scientist
Analytics & Experimentation questions for other roles
Browse all