Evaluate Push Notification Impact on Rideshare Supply Shortages

Q: Evaluate Push Notification Impact on Rideshare Supply Shortages

This question evaluates a data scientist's ability to design and analyze experiments for causal impact measurement, assessing competency in metric selection, appropriate randomization units, spillover and contamination management, and statistical inference.

Q: How do I approach Analytics & Experimentation interview questions?

Analytics & Experimentation questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master analytics & experimentation interviews.

Question

Experiment Design: Push Notifications for Airport Surge Shortage Resolution

Context

When rider demand at the airport exceeds available driver supply, surge pricing activates. The product team wants to send push notifications to nearby eligible drivers prompting them to go to the airport to alleviate the shortage. You need to measure the causal impact of these notifications on resolving shortages.

Task

Design an experiment to evaluate the effectiveness of the push notification on resolving airport supply shortages. Address the following:

Success metrics (primary, secondary, and guardrails).
Driver-level A/B setup and the recommended randomization unit.
How to handle spillover and contamination effects across geographies and time.
How you will establish causality and analyze results (e.g., CUPED, difference-in-differences, cluster-robust inference).

Evaluate Push Notification Impact on Rideshare Supply Shortages

Experiment Design: Push Notifications for Airport Surge Shortage Resolution

Context

Task

Solution

Comments (0)