{"blocks": [{"key": "bce5ec10", "text": "Scenario", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "c5bccff6", "text": "Facebook Ads team built a new recommendation model and plans to deprecate the old one.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "e69aad6f", "text": "Question", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "0d6e14f3", "text": "a) What factors must be evaluated before fully replacing the existing model?", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "8630a89e", "text": "b) CTR falls but revenue or other metrics increase—how would you decide which model to ship?", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "a9f250e4", "text": "c) Outline the A/B-testing procedure you would follow.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "188f1305", "text": "d) How would you visualise and present the final results to the CFO?", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "b79d17f5", "text": "Hints", "type": "header-two", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}, {"key": "89667551", "text": "Cover offline evaluation, guardrails, rollback plans, stakeholder dashboards, statistical significance.", "type": "unstyled", "depth": 0, "inlineStyleRanges": [], "entityRanges": [], "data": {}}], "entityMap": {}}