Define and Measure Product–Market Fit (PMF) for Alexa Shopping
Context
You are designing a measurement plan to assess PMF for Alexa Shopping, where customers can use voice to shop on Amazon. The plan must span metrics, instrumentation, identity, cohorting, seasonality controls, thresholds, longitudinal analysis, conflict resolution across signals, and causal validation of PMF drivers.
Task
Create a PMF metric framework and analysis plan that includes:
-
PMF definition and success criteria for Alexa Shopping.
-
Metric framework with:
-
Activation: first successful voice purchase with payment set up.
-
Engagement: weekly voice shopping intents per active household; voice share of total Amazon purchases.
-
Retention: W1, W4, W12 household retention on any voice shopping action.
-
Satisfaction: PMF survey (% extremely disappointed if removed); task success rate.
-
Event instrumentation: events, schemas, and properties needed to compute the metrics and diagnose friction.
-
Identity: household vs device identity, and how to deduplicate across devices and profiles.
-
Cohorting rules: cohort by first activation month and define analysis windows.
-
Seasonality controls: handling Prime Day and holidays to avoid false PMF signals.
-
Leading indicators: repeat purchase intent, saved reorder lists, and other precursors to durable use.
-
PMF thresholds: how you would set targets for each metric and interpret them.
-
Longitudinal cohort analysis: curve shapes to expect, diagnostics, and summaries to track.
-
Reconciling conflicting signals: for example, high survey PMF but low repeat usage.
-
Causal validation: experiments or causal inference to validate whether improvements in intent understanding drive PMF.