{"blocks": [{"key": "b5d089a6", "text": "Scenario", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "7508f59d", "text": "Designing and analyzing an online A/B test for a new product feature.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "7163cbd4", "text": "Question", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "16e4611f", "text": "Explain end-to-end how you would set up, run and analyze an A/B test for launching a recommendation widget. What pitfalls could invalidate the experiment and how would you detect them? How would you determine sample size and choose primary metrics? Describe how you would communicate the results to stakeholders.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "77e8ca81", "text": "Hints", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "d39f0654", "text": "Cover experiment design, randomization, power, metric definition, guardrails, debugging, and post-analysis decisions.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}], "entityMap": {}}