{"blocks": [{"key": "4df0243e", "text": "Scenario", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "0476e716", "text": "A social media company is launching a short-video feed similar to TikTok and wants to evaluate a newly added feature affecting how users engage with the feed.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "5bd106ce", "text": "Question", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "543e6bc4", "text": "Design an A/B test to measure the impact of the new video-feed feature. Cover experiment unit, randomization, success metrics, sample-size needs, guardrails and how you would monitor and conclude the test. Which primary and secondary metrics would you track and why? How would you handle possible novelty and seasonal effects?", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "43e90c82", "text": "Hints", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "8fa59a08", "text": "Think about activation, retention, engagement and negative metrics; outline experiment design and decision criteria.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}], "entityMap": {}}