Quantify Harmful Content's Severity and Platform Impact
Overview
This question evaluates a candidate's ability to design measurement frameworks and metric definitions for harmful content, testing skills in analytics, experimentation, metric engineering, and product-focused data science.
Meta
Aug 4, 2025, 10:55 AM
Data Scientist
Technical Screen
Analytics & Experimentation
0
0
Measuring Severity and Platform Impact of Harmful Content
Context
You are a product analyst at a large social platform. You must quantify how serious inappropriate or harmful content is and how much it impacts users and the platform.
Task
- Propose a measurement framework for harmful content. Define and justify key metrics such as view prevalence, content prevalence, and reach prevalence.
- Recommend a primary (north-star) metric and supporting/guardrail metrics. Explain why.
- Discuss the pros and cons of relying on view prevalence alone.
Hints
- Consider exposure intensity, unique users reached, severity weighting, content types (feed, stories, video, comments), and user segments (age, region, language, vulnerable cohorts).
- Address time dynamics (e.g., time-to-removal), enforcement quality, and uncertainty in measurement (model error, sampling).
Solution
Login required
Show