PracHub
QuestionsPremiumLearningGuidesCheatsheetNEWCoaches
|Home/Analytics & Experimentation/Uber

Design an RCT for app-open discount

Last updated: Mar 29, 2026

Quick Overview

This question evaluates a data scientist's competency in experimental design and causal inference, including metric definition, statistical power/sample-size reasoning, instrumentation, and managing interference and spillovers in two-sided marketplaces.

  • hard
  • Uber
  • Analytics & Experimentation
  • Data Scientist

Design an RCT for app-open discount

Company: Uber

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: hard

Interview Round: Technical Screen

Your company plans a 'X dollars off on app open' promotion in a two‑sided marketplace. Design a randomized controlled experiment to test success: (1) pick one primary success metric aligned to long‑term profit (e.g., 28‑day incremental gross profit per user) and list guardrails (refund rate, support tickets, seller cancellations, cannibalization of full‑price orders); (2) choose and justify the unit of randomization (user vs device vs account vs session) considering repeated sessions per user, cross‑device logins, households sharing devices, and seller‑side spillovers; (3) specify exposure/eligibility rules, sticky assignment, holdout enforcement, and contamination controls; (4) describe how you will detect/mitigate network effects (geo or cluster randomization, graph clustering, exposure mappings) and how you’d quantify spillovers; (5) provide sample size and test duration with assumptions and MDE, ramp and throttle plan, and stopping rules; (6) list instrumentation/logging needed to compute ITT and TOT (e.g., assignment id, exposure timestamp, eligibility flags, device id, session id).

Quick Answer: This question evaluates a data scientist's competency in experimental design and causal inference, including metric definition, statistical power/sample-size reasoning, instrumentation, and managing interference and spillovers in two-sided marketplaces.

Related Interview Questions

  • Design a Maps Address Search Bar - Uber
  • Evaluate a cold-start rating launch - Uber (medium)
  • Design Pricing Model Experiment - Uber (medium)
  • Evaluate marketplace interventions - Uber (medium)
  • Evaluate UberEATS priority delivery and membership - Uber (medium)
Uber logo
Uber
Oct 13, 2025, 9:49 PM
Data Scientist
Technical Screen
Analytics & Experimentation
5
0

Design an RCT for an "X dollars off on app open" promotion in a two‑sided marketplace

Context

You operate a two‑sided marketplace mobile app (e.g., riders/eaters on the demand side; drivers/couriers/merchants on the supply side). Product wants to show a one‑time, immediate “X dollars off” offer when a user opens the app. You need to design a randomized controlled experiment to evaluate whether the promotion increases long‑term profit without harming marketplace health.

Assume:

  • Users may have repeated sessions and can log in across multiple devices.
  • Households may share devices.
  • Supply is shared across nearby users, so network effects and spillovers are plausible (e.g., surge, wait times, cancellations).

Tasks

  1. Pick one primary success metric aligned to long‑term profit (e.g., 28‑day incremental gross profit per user) and list key guardrails (e.g., refund/chargeback rate, support tickets, seller cancellations, cannibalization of full‑price orders).
  2. Choose and justify the unit of randomization (user vs device vs account vs session), considering repeated sessions per user, cross‑device logins, households that share devices, and seller‑side spillovers.
  3. Specify exposure/eligibility rules, sticky assignment, holdout enforcement, and contamination controls.
  4. Describe how you will detect/mitigate network effects (e.g., geo or cluster randomization, graph clustering, exposure mappings) and how you’d quantify spillovers.
  5. Provide sample size and test duration with assumptions and MDE, a ramp and throttle plan, and stopping rules.
  6. List instrumentation/logging needed to compute ITT and TOT (e.g., assignment id, exposure timestamp, eligibility flags, device id, session id).

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Analytics & Experimentation•More Uber•More Data Scientist•Uber Data Scientist•Uber Analytics & Experimentation•Data Scientist Analytics & Experimentation
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.