PracHub
QuestionsCoachesLearningGuidesInterview Prep
|Home/Analytics & Experimentation/Uber

Measure Impact of Updated Rider ETA Algorithm

Last updated: Mar 29, 2026

Quick Overview

Uber data scientist experimentation prompt on measuring an updated rider ETA model, covering demand and supply metrics, ETA calibration, marketplace interference, A/B tests, synthetic controls, guardrails, and rollout interpretation.

  • hard
  • Uber
  • Analytics & Experimentation
  • Data Scientist

Measure Impact of Updated Rider ETA Algorithm

Company: Uber

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: hard

Interview Round: Technical Screen

##### Scenario A ride-hailing company just updated its rider ETA-prediction algorithm and wants to quantify the marketplace impact. ##### Question Design an experiment to measure how the new rider-ETA model affects the business. Which primary success metrics would you track on the demand and supply sides? What intermediate or leading indicators would you monitor? Would you pick a classic A/B test or a synthetic-control approach? Explain the design, randomization unit, duration, and how you would interpret results. ##### Hints Map customer → marketplace funnel, define guardrail KPIs, consider network interference, seasonality, and statistical power before choosing between parallel A/B and geo-level synthetic control.

Quick Answer: Uber data scientist experimentation prompt on measuring an updated rider ETA model, covering demand and supply metrics, ETA calibration, marketplace interference, A/B tests, synthetic controls, guardrails, and rollout interpretation.

Related Interview Questions

  • Design a Maps Address Search Bar - Uber (medium)
  • Evaluate a cold-start rating launch - Uber (medium)
  • Design Pricing Model Experiment - Uber (medium)
  • Evaluate marketplace interventions - Uber (medium)
  • Evaluate UberEATS priority delivery and membership - Uber (medium)
|Home/Analytics & Experimentation/Uber

Measure Impact of Updated Rider ETA Algorithm

Uber logo
Uber
Jul 12, 2025, 6:59 PM
hardData ScientistTechnical ScreenAnalytics & Experimentation
51
0

Measure the Impact of an Updated Rider ETA Algorithm

A ride-hailing company updated the rider ETA prediction shown before a rider requests a trip. The team wants to quantify the marketplace impact on both demand and supply.

Constraints & Assumptions

  • The change is the ETA shown to riders; dispatch and pricing should be held constant where feasible.
  • ETA affects rider trust, request conversion, cancellations, pickup behavior, and driver marketplace outcomes.
  • Marketplace interference is likely because rider decisions affect driver availability and other riders.
  • Compare classic A/B testing with geo or synthetic-control approaches.

Clarifying Questions to Ask

  • Does the model change only displayed ETA, or does it affect matching/dispatch?
  • Are ETAs more accurate, more conservative, or differently calibrated?
  • Can we randomize by user, session, market, or geo/time cell?
  • What markets have enough volume and stable seasonality for testing?

What a Strong Answer Covers

  • Demand-side primary metrics: request conversion, completed-trip rate, rider cancellation, gross bookings, trips per active rider, and retention.
  • Supply-side metrics: driver acceptance, cancellation, pickup time/distance, utilization, earnings per online hour, idle time, and dispatch reliability.
  • Intermediate metrics: ETA accuracy/calibration, quote-to-request funnel, cancellation by ETA error, pickup wait, support contacts, and rider trust signals.
  • Guardrails: price perception, surge, driver experience, marketplace balance, latency, app crashes, complaints, and fairness by market or rider segment.
  • Experiment design: user-level A/B for direct rider display effects when interference is limited; geo/cluster randomization or synthetic control when spillovers dominate.
  • Duration, power, ramping, seasonality controls, pre-period balance, and interpretation of intent-to-treat effects.

Follow-up Questions

  • What if the new ETA is more accurate but less attractive to riders?
  • How would you detect marketplace spillovers?
  • Why might user-level randomization be risky?
  • What would you do if demand metrics improve but driver metrics worsen?
Loading comments...

Browse More Questions

More Analytics & Experimentation•More Uber•More Data Scientist•Uber Data Scientist•Uber Analytics & Experimentation•Data Scientist Analytics & Experimentation

Write your answer

Your first approved answer each day earns 20 XP.

Sign in to write your answer.
PracHub

Master your tech interviews with 8,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • AI Coding Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.