PracHub
QuestionsPremiumCoachesLearningGuidesInterview Prep
|Home/Statistics & Math/Meta

Determine Probability of Fourth Good Response After Three Successes

Last updated: Mar 29, 2026

Quick Overview

This question evaluates understanding of Bernoulli trials and independence along with proficiency in comparative hypothesis testing for proportions, relevant to the Statistics & Math domain and typical for a Data Scientist role.

  • medium
  • Meta
  • Statistics & Math
  • Data Scientist

Determine Probability of Fourth Good Response After Three Successes

Company: Meta

Role: Data Scientist

Category: Statistics & Math

Difficulty: medium

Interview Round: Onsite

##### Scenario Assessing response quality probabilities for chatbot/LLM outputs. ##### Question A bot produces a good response with probability x. Given the first three responses were good, what is the probability the fourth will be good? 2. One LLM shows 70% good responses and another 80%. Perform a hypothesis test to determine if the difference is statistically significant and interpret the result. ##### Hints Assume independence for Q1; for Q2 use two-proportion z-test, report test statistic and p-value.

Quick Answer: This question evaluates understanding of Bernoulli trials and independence along with proficiency in comparative hypothesis testing for proportions, relevant to the Statistics & Math domain and typical for a Data Scientist role.

Related Interview Questions

  • Compute probability an account is fake - Meta (easy)
  • Compute Bayes probability for fake accounts - Meta (easy)
  • Compute probabilities for chatbot response quality - Meta (easy)
  • Compute posterior fake probability using Bayes' rule - Meta (medium)
  • Estimate bots and CI from DAU spike - Meta (medium)
Meta logo
Meta
Aug 4, 2025, 10:55 AM
Data Scientist
Onsite
Statistics & Math
1
0

Evaluating Good-Response Rates for Chatbot Outputs

Context

You are evaluating chatbot/LLM responses. Treat each response as a Bernoulli trial (good vs not good). Unless otherwise noted, assume independence across responses.

Questions

  1. If the probability any response is good is x, and the first three responses were good, what is the probability the fourth response will be good?
  2. Model A shows 70% good responses and Model B shows 80% good responses, based on n1 and n2 evaluated responses, respectively. Using a two-proportion z-test at a 5% significance level:
    • Test whether the difference is statistically significant.
    • Report the test statistic and p-value.
    • If n1 and n2 are not provided, show the general formula and then illustrate with an example (e.g., n1 = n2 = 100).

Solution

Show

Submit Your Answer to Earn 20XP

Sign in to leave a comment

Loading comments...

Browse More Questions

More Statistics & Math•More Meta•More Data Scientist•Meta Data Scientist•Meta Statistics & Math•Data Scientist Statistics & Math
PracHub

Master your tech interviews with 8,000+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.