Identify Causes and Validate Web Product Performance Drop
Company: Amazon
Role: Data Scientist
Category: Analytics & Experimentation
Difficulty: medium
Interview Round: Technical Screen
##### Scenario
Daily active users and conversion rates for a web product unexpectedly drop.
##### Question
If product performance suddenly degrades, list plausible root causes and the analyses you would run to validate each.
Describe how you would design an A/B experiment to test a proposed fix.
Which primary, secondary, and guardrail metrics would you track and why?
##### Hints
Think instrumentation issues, release roll-outs, external events; outline experiment power, duration, metric sensitivity.
Quick Answer: This question evaluates root-cause analysis, data validation, causal inference, and experimentation design skills for diagnosing unexpected drops in DAU and conversion rates within the Analytics & Experimentation domain.
