{"blocks": [{"key": "4621d2cf", "text": "Scenario", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "92d0e272", "text": "The platform has a machine-learning model that automatically detects harmful content and flags it for removal or down-ranking.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "bcbe03fc", "text": "Question", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "9dbe6a4b", "text": "Describe how you would evaluate this detection model offline (e.g., on a labeled validation set). Design an online experiment to test the model in production—define hypotheses, variants, success metrics, and guardrails.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "63b4a4b1", "text": "Hints", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "2e6d4685", "text": "Cover precision/recall, ROC/PR curves, calibration offline; for online, outline A/B setup, traffic split, primary and guardrail metrics, duration, and significance.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}], "entityMap": {}}