Marketplace Analytics Case: 10% Delivery Decline in Los Angeles
Background
A food-delivery marketplace observes that completed deliveries in Los Angeles fell by 10% week-over-week (WoW). The metric refers to completed orders in the LA market during the most recent full week relative to the prior full week.
Task
-
List plausible root causes for a 10% WoW decline in LA deliveries. Organize them by supply, demand, merchant, marketplace/product, and external factors (plus measurement error).
-
For each hypothesis, outline a concrete analytical plan to test it: key cuts, metrics, data needed, and the statistical/causal approach.
-
If controlled experiments are infeasible, describe how you would validate and attribute impact using observational methods (e.g., difference-in-differences, synthetic controls), including guardrails and robustness checks.
Notes
-
Assume access to standard marketplace data: demand funnel (traffic → sessions → checkouts → orders placed), supply metrics (active couriers, online hours, acceptance/assignment/ETA), merchant availability (open hours, outages, item stockouts, prep times), pricing/fees/promotions, operations incidents, and external data (weather, traffic, events, gas prices).
-
Segment by time-of-day and sub-region within LA (e.g., ZIPs/neighborhoods). Cohort new vs. returning users and merchant types.
-
You cannot run an immediate A/B test in LA this week.