{"blocks": [{"key": "e714cb5d", "text": "Scenario", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "c5c8713c", "text": "Hiring manager wants to understand the candidate's approach to experimentation and measuring search feature effectiveness.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "f9aaadda", "text": "Question", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "3ac8362a", "text": "Describe how you would design and run an A/B test.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "163d6bcb", "text": "For a search button, what key metrics would you track?", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "c5e3f800", "text": "How would you determine whether the search results are high quality?", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "e52ec590", "text": "Hints", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "99b5259e", "text": "State hypothesis, define success metrics (CTR, conversion, latency, relevance), plan sample size, analyze significance, incorporate user feedback and offline relevance scores.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}], "entityMap": {}}