PracHub
QuestionsPremiumCoachesLearningGuidesInterview Prep
|Home/Analytics & Experimentation/DoorDash

Design a Top Dasher experiment with interference

Last updated: Mar 29, 2026

Quick Overview

This question evaluates experimental design, causal inference under interference, metric engineering, and statistical trade-offs for marketplace incentive programs, framed within the Analytics & Experimentation domain for a Data Scientist role.

  • easy
  • DoorDash
  • Analytics & Experimentation
  • Data Scientist

Design a Top Dasher experiment with interference

Company: DoorDash

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: easy

Interview Round: Onsite

## Experimentation: Evaluate a “Top Dasher” incentive program A delivery platform wants to launch or change a **Top Dasher** program (e.g., priority access to orders, higher ranking, or incentives) intended to improve reliability and coverage. However, this is a marketplace with strong **interference/spillovers**: if some couriers get priority, other couriers and customers may be affected. ### Task 1. Define the **goal** of the program and propose a **metric tree**: - Primary outcome metric(s) - Diagnostic metrics - Guardrails 2. Choose an **experimental design** and justify the **randomization unit** (examples: courier, courier-day, zone, zone-time). 3. Discuss when to use: - Individual randomization - Cluster randomization - **Switchback** experiments - Clustered analysis / variance estimation 4. If using a **switchback** design, list the main threats (carryover, noncompliance, seasonality, novelty) and how you would mitigate them. 5. Explain how you would reason about **false positives vs false negatives** (Type I vs Type II error) for this decision, including which risk is worse and why. ### Output Provide a concrete recommended design (including analysis approach) and how you would communicate trade-offs to stakeholders.

Quick Answer: This question evaluates experimental design, causal inference under interference, metric engineering, and statistical trade-offs for marketplace incentive programs, framed within the Analytics & Experimentation domain for a Data Scientist role.

Related Interview Questions

  • Evaluate Biker Feature Success - DoorDash (hard)
  • How would you test product changes? - DoorDash (hard)
  • How to test bike delivery? - DoorDash (medium)
  • Investigate LA successful orders drop - DoorDash (easy)
  • How would you diagnose a completed orders drop? - DoorDash (easy)
DoorDash logo
DoorDash
Jul 1, 2025, 12:00 AM
Data Scientist
Onsite
Analytics & Experimentation
8
0
Loading...

Experimentation: Evaluate a “Top Dasher” incentive program

A delivery platform wants to launch or change a Top Dasher program (e.g., priority access to orders, higher ranking, or incentives) intended to improve reliability and coverage.

However, this is a marketplace with strong interference/spillovers: if some couriers get priority, other couriers and customers may be affected.

Task

  1. Define the goal of the program and propose a metric tree :
    • Primary outcome metric(s)
    • Diagnostic metrics
    • Guardrails
  2. Choose an experimental design and justify the randomization unit (examples: courier, courier-day, zone, zone-time).
  3. Discuss when to use:
    • Individual randomization
    • Cluster randomization
    • Switchback experiments
    • Clustered analysis / variance estimation
  4. If using a switchback design, list the main threats (carryover, noncompliance, seasonality, novelty) and how you would mitigate them.
  5. Explain how you would reason about false positives vs false negatives (Type I vs Type II error) for this decision, including which risk is worse and why.

Output

Provide a concrete recommended design (including analysis approach) and how you would communicate trade-offs to stakeholders.

Solution

Show

Submit Your Answer to Earn 20XP

Sign in to leave a comment

Loading comments...

Browse More Questions

More Analytics & Experimentation•More DoorDash•More Data Scientist•DoorDash Data Scientist•DoorDash Analytics & Experimentation•Data Scientist Analytics & Experimentation
PracHub

Master your tech interviews with 8,000+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.