Scenario
You are a data scientist tasked with quantitatively comparing the success of Instagram Stories versus Facebook Stories.
Question
-
Define what “success” means for Stories across both apps and articulate the units of comparison (e.g., per eligible DAU, per poster, per story, per viewer session).
-
Specify the key metrics you would track for:
-
Creators (supply)
-
Viewers (demand/quality)
-
Business/monetization
-
Ecosystem health and cannibalization
-
Propose experimental designs to estimate causal differences (e.g., A/B tests, geo experiments, matched-pairs), noting interference/spillover concerns between apps.
-
If controlled experiments are limited, propose analytical methods (e.g., matched pairs using cross-posted stories, difference-in-differences, fixed-effects models) to compare performance.
-
List guardrails, assumptions, and pitfalls to ensure a fair, apples-to-apples comparison.
Hints: Consider DAU posting, views per story, completion rate, time spent; consider matched-pairs or A/B tests across markets.