Data Scientist Analytics & Experimentation Interview Questions

Practice 895 real Analytics & Experimentation interview questions for Data Scientist roles. From companies including Meta, Capital One, DoorDash, Uber, TikTok.

895 Questions 84 Companies07.27.2026
Showing 20 results
Role
Meta logo
Meta
Hard
Data Scientist

Design experiment for fake accounts impact

Experiment Design: Removing Detected Fake Accounts and Measuring Causal Impact Context: You are designing an end-to-end experiment on a large, interac...

Analytics & Experimentation
2
0
51 people solved
Oct 13, 2025
Capital One logo
Capital One
Medium
Data Scientist Locked

Compute capacity, staffing trade-offs, and break-even

This question evaluates capacity-planning, bottleneck identification, labor-cost trade-offs, contractor vs overtime comparisons, break-even computatio...

Analytics & Experimentation
5
0
53 people solved
Oct 13, 2025
Meta logo
Meta
Medium
Data Scientist

Compare Instagram vs. Facebook using causal experiments

Compare Instagram and Facebook for consumer time and engagement: a) Define a single-objective OEC that captures healthy cross-app ecosystem value with...

Analytics & Experimentation
3
0
38 people solved
Oct 13, 2025
SIG (Susquehanna) logo
SIG (Susquehanna)
Medium
Data Scientist Locked

Design Biker metrics and A/B test plan

This question evaluates a data scientist's competency in experimental design, metric engineering, causal inference, and operational analytics, focusin...

Analytics & Experimentation
2
0
30 people solved
Oct 13, 2025
Meta logo
Meta
Medium
Data Scientist

Reduce variance with covariate adjustment

Experiment Design and CUPED/Regression Adjustment You are running a randomized A/B test with outcome Y. You also have a pre-period covariate X (measur...

Analytics & Experimentation
4
0
54 people solved
Oct 13, 2025
Meta logo
Meta
Hard
Data Scientist

Design experiments under network interference

A/B Test Design for Search-Ranking in a Two-Sided Marketplace with Interference Context You need to evaluate a change to the search-ranking algorithm ...

Analytics & Experimentation
4
0
31 people solved
Oct 13, 2025
Roku logo
Roku
Medium
Data Scientist

Measure speaker impact without A/B testing

Your company launched an optional smart speaker on 2025-01-10. Adoption is voluntary; 6% of existing app users purchase within 60 days, and you cannot...

Analytics & Experimentation
8
0
77 people solved
Oct 13, 2025
Gemini logo
Gemini
Medium
Data Scientist

Design offline backtest and online experiment

You are given an ACH transaction-level dataset to identify and control fraud and will present a plan. Today is 2025-09-01. Deliverables - Offline anal...

Analytics & Experimentation
3
0
45 people solved
Oct 13, 2025
Meta logo
Meta
Medium
Data Scientist

Estimate shuttle impact with robust causal design

You have individual-level data from 1,000+ sites, several hundred of which adopt a free employee shuttle at different times. Design a causal analysis ...

Analytics & Experimentation
2
0
36 people solved
Oct 13, 2025
Meta logo
Meta
Medium
Data Scientist

Design and analyze a group-calls experiment

You are considering launching Group Video Calls. Answer all parts precisely; justify choices with pros/cons and formulas where relevant. 1) Clarify CT...

Analytics & Experimentation
2
0
34 people solved
Oct 13, 2025
Meta logo
Meta
Medium
Data Scientist

Evaluate brand ads effectiveness on social media causally

Hypothesis: 'Social media (e.g., Facebook) is not effective for brand advertising compared with other channels.' You have historical multi-channel dat...

Analytics & Experimentation
2
0
47 people solved
Oct 13, 2025
Amazon logo
Amazon
Hard
Data Scientist

Quantify build-vs-buy training decision

Quantitative Decision Framework for Selecting a New Employee Training Program Context Your company must choose one of three ways to launch a new emplo...

Analytics & Experimentation
2
0
36 people solved
Oct 13, 2025
Meta logo
Meta
Medium
Data Scientist

Design a clustered notification experiment with guardrails

You work on a mobile travel app (think TripAdvisor-like) that will test a new push-notification policy recommending nearby attractions. Design a rigor...

Analytics & Experimentation
2
0
36 people solved
Oct 13, 2025
Meta logo
Meta
Hard
Data Scientist Locked

Choose KPIs for short-video recommendations

This question evaluates a data scientist's ability to define precise product metrics, set guardrails, design and power A/B tests, and apply weighted d...

Analytics & Experimentation
3
0
25 people solved
Oct 13, 2025
Medium
Data Scientist

Design and power an A/B on question mix

Experiment Design: Replacing 10% "Other" Verbal With Grammar in a 15-Min, 19-Question Section You need to test whether replacing the 10% "other" verba...

Analytics & Experimentation
1
0
25 people solved
Oct 13, 2025
Hard
Data Scientist

Design an A/B test with guardrails

A/B Test Plan for a New Checkout Flow (Onsite Data Scientist) Context: You will run an online experiment of a new checkout flow. The baseline conversi...

Analytics & Experimentation
4
0
44 people solved
Oct 13, 2025
Instacart logo
Instacart
Medium
Data Scientist

Evaluate Miami Ultrafast impact on orders

Instacart launched an Ultrafast delivery feature in Miami two months ago. You have weekly orders per geo for the past 52 weeks; Miami is treated from ...

Analytics & Experimentation
6
0
77 people solved
Oct 13, 2025
Instacart logo
Instacart
Medium
Data Scientist Locked

Diagnose 4% weekly revenue drop using history

This question evaluates time-series forecasting, anomaly detection, decomposition, and attribution skills within analytics and experimentation, focusi...

Analytics & Experimentation
4
0
41 people solved
Oct 13, 2025
Meta logo
Meta
Medium
Data Scientist

Define composite success for search and test it

A new search feature is evaluated with two binary labels per query: relevancy=1/0 and accuracy=1/0. 1) Propose a composite success metric that uses th...

Analytics & Experimentation
2
0
30 people solved
Oct 13, 2025
DoorDash logo
DoorDash
Hard
Data Scientist Locked

Drive app installs from web traffic

This question evaluates experimentation design, funnel and metric specification, attribution and incrementality measurement, segmentation, and causal ...

Analytics & Experimentation
9
0
121 people solved
Oct 13, 2025

Explore more Data Scientist Analytics & Experimentation interview questions

Real questions from candidate reports, grouped by company, topic and role.

By company
Other categories for Data Scientist
Analytics & Experimentation questions for other roles
Browse all