{"blocks": [{"key": "fde91308", "text": "Scenario", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "382d42b3", "text": "Designing and evaluating an A/B test for a new streaming feature that may create social-network spill-overs.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "fdf81b24", "text": "Question", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "cf15c508", "text": "How would you choose primary and guardrail metrics for this experiment? What threats do network effects pose and how would you address them? Explain SUTVA and why it matters here. Describe how you would run and interpret a multivariate test on title artwork. How would you measure heterogeneous treatment effects across user segments?", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "a85bc83f", "text": "Hints", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "25ed167a", "text": "Cover metric definition, experiment unit, variance reduction, and validity assumptions.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}], "entityMap": {}}