How do I approach Analytics & Experimentation interview questions?

Analytics & Experimentation questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master analytics & experimentation interviews.

What difficulty level is this interview question?

This is a medium difficulty Analytics & Experimentation question, commonly asked during Onsite rounds at DoorDash.

What role is this question designed for?

This question is commonly asked for Data Scientist candidates at DoorDash during technical interviews.

Evaluate Impact of $1 Fee on Fast-Food Profitability

Quick Overview

This question evaluates proficiency in experimental design and causal inference for marketplace pricing changes, covering competencies such as randomization and interference management, metric selection and guardrails, sample size and power calculations, and analysis frameworks like ITT/TOT and variance-reduction techniques.

Experiment Design: $1 Delivery-Fee Surcharge on Unprofitable Restaurants

Scenario

About 10% of fast-food restaurants on the platform are unprofitable. Product wants to add a $1 delivery-fee surcharge to orders from those restaurants to cover the deficit.

Task

Design an experiment to evaluate the impact of the $1 fee on:

Restaurant-level profitability
Order volume (conversion and frequency)
Customer satisfaction

Include:

Experimental unit and randomization plan (address marketplace spillovers/interference).
Primary/secondary metrics and guardrails, with clear hypotheses.
Sample size and duration guidance (state assumptions if needed).
Analysis plan (e.g., ITT vs. TOT, variance reduction, decomposition of effects).
Concrete techniques to increase statistical power (e.g., stratified randomization, CUPED, covariate blocking, geo-testing, longer horizon), and when to use each.

Assume the $1 fee is only applied to currently unprofitable restaurants. If needed, make minimal additional assumptions explicit.

Evaluate Impact of $1 Fee on Fast-Food Profitability

Quick Overview

Experiment Design: $1 Delivery-Fee Surcharge on Unprofitable Restaurants

Scenario

Task

Solution

Comments (0)