Scenario
-
100 reviewers each rate the same 100 YouTube ads on a 1–10 scale.
-
Ratings may be systematically higher or lower for some reviewers (leniency/severity bias).
Goal
Produce unbiased ad scores (comparable on a common scale) by removing reviewer bias.
Task
Propose a modeling framework to adjust for reviewer bias and justify why a mixed-effects linear regression is appropriate.
Assumptions
-
Each rating is on an interval-like scale (1–10). Treating it as approximately continuous is acceptable; see alternatives for ordinal modeling.
-
We want ad-specific scores (so ads are fixed effects) and to treat reviewers as a sample from a larger reviewer population (random effects).