Measuring Harmful Content: Severity and Prevalence
Scenario
A social-media platform needs to quantify the business impact of harmful or inappropriate user-generated content.
Task
How would you measure the severity and prevalence of harmful content issues on the platform? Which specific metric(s)—for example, View Prevalence—would you choose, and why? Discuss advantages, limitations, and any complementary metrics you would track.
Clarifications and Assumptions
-
Harmful content is defined by a policy taxonomy with severity buckets (e.g., Severe A: safety/illegal; Medium B: hate/bullying; Low C: borderline/age-inappropriate).
-
Goal: capture user exposure and business risk, not just volume of takedowns.
-
Metrics should be actionable for ranking/enforcement and comparable over time.