PracHub
QuestionsPremiumLearningGuidesInterview PrepNEWCoaches
|Home/Machine Learning/Meta

Classify Reviewers Using Bayesian Probability for Accuracy Analysis

Last updated: Mar 29, 2026

Quick Overview

This question evaluates Bayesian inference and statistical decision-making for latent class classification, specifically using posterior probabilities to distinguish reviewer types and derive false-positive (Type I) and false-negative (Type II) rates.

  • medium
  • Meta
  • Machine Learning
  • Data Scientist

Classify Reviewers Using Bayesian Probability for Accuracy Analysis

Company: Meta

Role: Data Scientist

Category: Machine Learning

Difficulty: medium

Interview Round: Onsite

##### Scenario Classifying reviewers as lazy or careful with limited labels ##### Question Propose a classification rule based on P(lazy | data) > 0.5 using Bayes’ theorem. Given the true mixture and review accuracies, derive the false-positive and false-negative rates of this rule. If every reviewer is required to write the same large number of reviews (e.g., 100), how will type I and type II error rates change? ##### Hints Treat reviewer type as the latent class and use a Bayesian optimal decision boundary; error rates shrink as review count grows.

Quick Answer: This question evaluates Bayesian inference and statistical decision-making for latent class classification, specifically using posterior probabilities to distinguish reviewer types and derive false-positive (Type I) and false-negative (Type II) rates.

Related Interview Questions

  • Design and evaluate an ads ranking algorithm - Meta (easy)
  • How would you design a Shop Ads ranking algorithm? - Meta (easy)
  • Derive Linear Regression Solution - Meta (medium)
  • Explain key ML metrics and techniques - Meta (medium)
  • Design an ad recommendation ranking approach - Meta (easy)
Meta logo
Meta
Jul 12, 2025, 6:59 PM
Data Scientist
Onsite
Machine Learning
90
0

Scenario

Classifying reviewers as lazy or careful with limited labels

Context (completed)

You are auditing a pool of reviewers who can be either:

  • Lazy (L): lower accuracy
  • Careful (C): higher accuracy

Assume a known prior mixture π = P(L) and per-review accuracies a_L and a_C with a_C > a_L. For each reviewer, you observe their performance on n gold items (with known ground truth), yielding k correct out of n.

Question

  • Use Bayes' theorem to propose the classification rule that predicts "lazy" when P(L | data) > 0.5.
  • Given the true mixture and review accuracies, derive the false-positive and false-negative rates of this rule.
  • If every reviewer is required to write the same large number of reviews (e.g., 100), how will Type I and Type II error rates change?

Hints: Treat reviewer type as the latent class and use a Bayesian optimal decision boundary; error rates shrink as review count grows.

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Machine Learning•More Meta•More Data Scientist•Meta Data Scientist•Meta Machine Learning•Data Scientist Machine Learning
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.