PracHub
QuestionsPremiumCoachesLearningGuidesInterview Prep
|Home/Statistics & Math/Meta

Evaluate Probability of Positive User Comments and Model Performance

Last updated: Mar 29, 2026

Quick Overview

This question evaluates understanding of probability for independent events and statistical inference for comparing model proportions, measuring competency in modeling i.i.d. Bernoulli outcomes and performing hypothesis tests for model performance in the Statistics & Math domain for Data Scientist roles.

  • medium
  • Meta
  • Statistics & Math
  • Data Scientist

Evaluate Probability of Positive User Comments and Model Performance

Company: Meta

Role: Data Scientist

Category: Statistics & Math

Difficulty: medium

Interview Round: Onsite

##### Scenario You are an analyst evaluating user comments and model performance on a social-media platform. ##### Question If the probability that a single user comment is positive is p, what is the probability that two independent comments are both positive? Assuming each response is i.i.d., if the first three responses from a user are positive, what is the probability that the fourth response is also positive? Model A returns a positive response in 80 % of cases while Model B returns a positive response in 90 % of cases. At the 5 % significance level, can you conclude Model B is better? Detail the statistical test, null/alternative hypotheses, test statistic and decision rule. ##### Hints Use the multiplication rule for independent events and a two-proportion z-test with a pooled estimate of p.

Quick Answer: This question evaluates understanding of probability for independent events and statistical inference for comparing model proportions, measuring competency in modeling i.i.d. Bernoulli outcomes and performing hypothesis tests for model performance in the Statistics & Math domain for Data Scientist roles.

Related Interview Questions

  • Compute probability an account is fake - Meta (easy)
  • Compute Bayes probability for fake accounts - Meta (easy)
  • Compute probabilities for chatbot response quality - Meta (easy)
  • Compute posterior fake probability using Bayes' rule - Meta (medium)
  • Estimate bots and CI from DAU spike - Meta (medium)
Meta logo
Meta
Aug 4, 2025, 10:55 AM
Data Scientist
Onsite
Statistics & Math
106
0

Social-Media Positivity: Independence and Model Comparison

Context

You are evaluating user comment sentiment and the performance of two models that classify comments as positive. Assume observations are independent and identically distributed (i.i.d.) unless otherwise stated.

Questions

  1. If the probability that a single user comment is positive is p, what is the probability that two independent comments are both positive?
  2. Assuming each response is i.i.d., if the first three responses from a user are positive, what is the probability that the fourth response is also positive?
  3. Model A returns a positive response in 80% of cases while Model B returns a positive response in 90% of cases. At the 5% significance level, can you conclude Model B is better? Specify:
    • The statistical test to use
    • Null and alternative hypotheses
    • The test statistic (with formula)
    • The decision rule at α = 0.05

Note: Treat the 80% and 90% as sample proportions from test sets of sizes n_A and n_B (not provided), and express the decision rule in terms of these sample sizes.

Solution

Show

Submit Your Answer

Sign in to leave a comment

Loading comments...

Browse More Questions

More Statistics & Math•More Meta•More Data Scientist•Meta Data Scientist•Meta Statistics & Math•Data Scientist Statistics & Math
PracHub

Master your tech interviews with 8,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.