##### Scenario The team plans to launch a new rider-incentive program and needs to evaluate its effectiveness across the marketplace. ##### Question Propose an analysis/experiment to assess the impact of the rider-incentive feature. List metrics for riders, drivers, and overall matching quality. What additional metrics would you include and why? Outline how you would measure these effects even if you know little about the feature’s internal design. ##### Hints Define treatment vs. control, choose unit of randomization, include engagement, earnings, conversion, wait time, consider externalities and heterogeneous effects.

Uber data scientist analytics prompt on evaluating a rider-incentive program, covering experiment design, rider and driver metrics, matching quality, ROI, marketplace externalities, spillovers, and guardrails.

How do I approach Analytics & Experimentation interview questions?

Analytics & Experimentation questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master analytics & experimentation interviews.

What difficulty level is this interview question?

This is a medium difficulty Analytics & Experimentation question, commonly asked during Technical Screen rounds at Uber.

What role is this question designed for?

This question is commonly asked for Data Scientist candidates at Uber during technical interviews.

Evaluate Rider-Incentive Program Impact with Key Metrics

Evaluate a Rider-Incentive Program in a Ride-Hailing Marketplace

A ride-hailing team plans to launch a new rider-incentive program and needs to evaluate its effectiveness across the marketplace.

Constraints & Assumptions

The feature may affect both riders and drivers through marketplace externalities.
You may not know the exact internal incentive design, so define a measurement plan that works from assignment, eligibility, redemption, and outcomes.
Measure incremental impact, not just redeemed incentives.
Include ROI and guardrails.

Clarifying Questions to Ask Guidance

What is the incentive goal: acquisition, activation, frequency, reactivation, retention, or market balancing?
Who is eligible, and how are incentives delivered?
Is the incentive visible before request, after quote, or after trip?
Can we randomize by rider, geo, time, or market?
What budget and profitability constraints apply?

What a Strong Answer Covers Guidance

Experiment or quasi-experiment design with treatment/control, eligibility, assignment logging, intent-to-treat and treatment-on-treated views, and spillover handling.
Rider metrics: quote-to-request conversion, completed trips, frequency, retention/reactivation, incentive redemption, spend, satisfaction, and incremental profit.
Driver metrics: acceptance, utilization, earnings per online hour, idle time, cancellations, pickup ETA, and supply availability.
Matching-quality metrics: wait time, cancellation, completion rate, surge, reliability, marketplace balance, and support contacts.
Additional metrics: ROI/iROAS, cannibalization, subsidy cost, fraud/abuse, long-term retention, segment heterogeneity, and budget pacing.
Design alternatives when randomization is limited: geo holdout, synthetic control, diff-in-diff, staggered rollout, or matched cohorts.
Decision rules for scale, targeting, iteration, or rollback.

Follow-up Questions Guidance

How would you tell whether incentives create incremental trips or subsidize trips that would have happened anyway?
What if riders improve but drivers experience worse pickup times?
How would you prevent incentive abuse?
Which segments would you target first?

Evaluate a Rider-Incentive Program in a Ride-Hailing Marketplace

A ride-hailing team plans to launch a new rider-incentive program and needs to evaluate its effectiveness across the marketplace.

Constraints & Assumptions

The feature may affect both riders and drivers through marketplace externalities.

You may not know the exact internal incentive design, so define a measurement plan that works from assignment, eligibility, redemption, and outcomes.

Measure incremental impact, not just redeemed incentives.

Include ROI and guardrails.

Clarifying Questions to Ask Guidance

What is the incentive goal: acquisition, activation, frequency, reactivation, retention, or market balancing?

Who is eligible, and how are incentives delivered?

Is the incentive visible before request, after quote, or after trip?

Can we randomize by rider, geo, time, or market?

What budget and profitability constraints apply?

What a Strong Answer Covers Guidance

Experiment or quasi-experiment design with treatment/control, eligibility, assignment logging, intent-to-treat and treatment-on-treated views, and spillover handling.

Rider metrics: quote-to-request conversion, completed trips, frequency, retention/reactivation, incentive redemption, spend, satisfaction, and incremental profit.

Driver metrics: acceptance, utilization, earnings per online hour, idle time, cancellations, pickup ETA, and supply availability.

Matching-quality metrics: wait time, cancellation, completion rate, surge, reliability, marketplace balance, and support contacts.

Additional metrics: ROI/iROAS, cannibalization, subsidy cost, fraud/abuse, long-term retention, segment heterogeneity, and budget pacing.

Design alternatives when randomization is limited: geo holdout, synthetic control, diff-in-diff, staggered rollout, or matched cohorts.

Decision rules for scale, targeting, iteration, or rollback.

Follow-up Questions Guidance

How would you tell whether incentives create incremental trips or subsidize trips that would have happened anyway?

What if riders improve but drivers experience worse pickup times?

How would you prevent incentive abuse?

Which segments would you target first?

Evaluate Rider-Incentive Program Impact with Key Metrics

Quick Overview

Evaluate Rider-Incentive Program Impact with Key Metrics

Evaluate a Rider-Incentive Program in a Ride-Hailing Marketplace

Constraints & Assumptions

Clarifying Questions to Ask Guidance

What a Strong Answer Covers Guidance

Follow-up Questions Guidance

Write your answer

Evaluate Rider-Incentive Program Impact with Key Metrics

Quick Overview

Evaluate Rider-Incentive Program Impact with Key Metrics

Evaluate a Rider-Incentive Program in a Ride-Hailing Marketplace

Constraints & Assumptions

Clarifying Questions to Ask Guidance

What a Strong Answer Covers Guidance

Follow-up Questions Guidance

Write your answer