Quantify impact without an A/B test

Q: Quantify impact without an A/B test

This is a Analytics & Experimentation interview question from Stripe for Data Scientist roles. View the full question and solution on PracHub.

Q: How do I approach Analytics & Experimentation interview questions?

Analytics & Experimentation questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master analytics & experimentation interviews.

Question

Stripe-like scenario: You ship a change aimed at increasing payment success rate for APAC merchants, but randomization is infeasible. In ≤6 analyst‑hours over one week, design the analysis to estimate causal revenue lift. Specify: unit of analysis; data you need; identification strategy (choose one and justify: matched difference‑in‑differences, synthetic control, regression discontinuity, or interrupted time series); exact formulas for the estimator; how you will check parallel‑trends or model fit; how you will handle seasonality, merchant growth/selection, and holiday effects; power/MDES considerations given limited time; 2 robustness checks; and a clear decision rule (e.g., ship, roll back, or iterate). Outline 4 slide titles you would present onsite.

Quantify impact without an A/B test

Comments (0)