Scenario
You are asked to compare price inflation on the DoorDash platform versus in-store menu prices over time for the same merchants and items. The goal is to:
-
Quantify the inflation difference between platform and in-store prices.
-
Monitor it over time with statistical confidence.
-
Build a forecasting model for future differences.
-
Determine the required sample size and confidence intervals when no A/B test is possible.
Assume you have access to transaction-level platform data and periodic in-store (offline) price observations for the same merchant–item pairs.
Task
Describe, in detail, how you would:
-
Collect and clean data to make an apples-to-apples comparison.
-
Construct and monitor an inflation metric that captures the platform-versus-in-store differential over time.
-
Build a forecasting model for this differential.
-
Estimate variance and confidence intervals, and determine sample size/minimum detectable effect (MDE) without an A/B test.
Include guidance on: data collection, time-series analysis, variance estimation, confidence intervals, and MDE.