Diagnose a Drop in Applications from Job Recommendation Emails

# Diagnose a Drop in Applications from Job Recommendation Emails Applications attributed to job-recommendation emails suddenly decline on one day. Describe how you would investigate the email-to-application funnel and distinguish a measurement issue, a delivery issue, and a change in recommendation relevance. Explain how you would assess a recent change in ranking weights as a possible cause. ### What a Strong Answer Covers - Validation of attribution, data freshness, and the scope of the one-day change. - A funnel from email delivery or impression through open, click, and application. - Segmentation and release checks that identify the stage and population driving the decline. - Evidence connecting ranking changes and promoted-job mix to user response without assuming causality from timing alone. ```hint Decompose volume and rates A decline in applications can arise from fewer emails, fewer clicks per opened email, or fewer applications per click. ``` ### Follow-up Questions - What if clicks fall while applications per click stay stable? - How would you separate changed job inventory from changed ranking behavior?