This question evaluates experimental design, causal inference, metric selection, bias mitigation, ROI estimation, and stakeholder communication skills within the Analytics & Experimentation domain for a Data Scientist role.
An online subscription product is considering a promotion that gives eligible new users their first month free instead of charging immediately.
Design an experiment and an analysis plan to estimate the causal impact of the promotion. Your answer should address:
You may assume the company can run a randomized controlled experiment on eligible users, but the dataset available to you is imperfect and does not contain every field you would ideally want.