Evaluate Rider-Incentive Program Impact with Key Metrics

Quick Overview

Uber data scientist analytics prompt on evaluating a rider-incentive program, covering experiment design, rider and driver metrics, matching quality, ROI, marketplace externalities, spillovers, and guardrails.

Evaluate Rider-Incentive Program Impact with Key Metrics

Company: Uber

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: medium

Interview Round: Technical Screen

##### Scenario The team plans to launch a new rider-incentive program and needs to evaluate its effectiveness across the marketplace. ##### Question Propose an analysis/experiment to assess the impact of the rider-incentive feature. List metrics for riders, drivers, and overall matching quality. What additional metrics would you include and why? Outline how you would measure these effects even if you know little about the feature’s internal design. ##### Hints Define treatment vs. control, choose unit of randomization, include engagement, earnings, conversion, wait time, consider externalities and heterogeneous effects.

Overview: Uber data scientist analytics prompt on evaluating a rider-incentive program, covering experiment design, rider and driver metrics, matching quality, ROI, marketplace externalities, spillovers, and guardrails.

|Home/Analytics & Experimentation/Uber
Uber logo
Uber
Jul 12, 2025
mediumData ScientistTechnical ScreenAnalytics & Experimentation
78
0

Evaluate a Rider-Incentive Program in a Ride-Hailing Marketplace

A ride-hailing team plans to launch a new rider-incentive program and needs to evaluate its effectiveness across the marketplace.

Constraints & Assumptions

  • The feature may affect both riders and drivers through marketplace externalities.
  • You may not know the exact internal incentive design, so define a measurement plan that works from assignment, eligibility, redemption, and outcomes.
  • Measure incremental impact, not just redeemed incentives.
  • Include ROI and guardrails.

Clarifying Questions to Ask Guidance

  • What is the incentive goal: acquisition, activation, frequency, reactivation, retention, or market balancing?
  • Who is eligible, and how are incentives delivered?
  • Is the incentive visible before request, after quote, or after trip?
  • Can we randomize by rider, geo, time, or market?
  • What budget and profitability constraints apply?

What a Strong Answer Covers Guidance

  • Experiment or quasi-experiment design with treatment/control, eligibility, assignment logging, intent-to-treat and treatment-on-treated views, and spillover handling.
  • Rider metrics: quote-to-request conversion, completed trips, frequency, retention/reactivation, incentive redemption, spend, satisfaction, and incremental profit.
  • Driver metrics: acceptance, utilization, earnings per online hour, idle time, cancellations, pickup ETA, and supply availability.
  • Matching-quality metrics: wait time, cancellation, completion rate, surge, reliability, marketplace balance, and support contacts.
  • Additional metrics: ROI/iROAS, cannibalization, subsidy cost, fraud/abuse, long-term retention, segment heterogeneity, and budget pacing.
  • Design alternatives when randomization is limited: geo holdout, synthetic control, diff-in-diff, staggered rollout, or matched cohorts.
  • Decision rules for scale, targeting, iteration, or rollback.

Follow-up Questions Guidance

  • How would you tell whether incentives create incremental trips or subsidize trips that would have happened anyway?
  • What if riders improve but drivers experience worse pickup times?
  • How would you prevent incentive abuse?
  • Which segments would you target first?
Loading comments...

Browse More Questions

More Analytics & Experimentation•More Uber•More Data Scientist•Uber Data Scientist•Uber Analytics & Experimentation•Data Scientist Analytics & Experimentation