PracHub
QuestionsPremiumCoachesLearningGuidesInterview Prep
|Home/Statistics & Math/Meta

Compute sample size and test duration

Last updated: Mar 29, 2026

Quick Overview

This question evaluates competency in experimental design and statistical inference for A/B testing, including sample size and power calculations, multiple-comparison correction, hypothesis-test selection (z vs t), confidence-interval interpretation, and randomization/balance diagnostics.

  • Medium
  • Meta
  • Statistics & Math
  • Data Scientist

Compute sample size and test duration

Company: Meta

Role: Data Scientist

Category: Statistics & Math

Difficulty: Medium

Interview Round: Onsite

You will run a two-arm A/B test on a signup funnel. Given: baseline conversion p0 = 4.0%; you care about detecting a 10% relative uplift (p1 = 4.4%); two-sided α = 0.05; power = 80%; Bernoulli outcomes; independent users; simple difference-in-proportions z-test approximation is acceptable. - Compute the minimum per-variant sample size. Show the exact formula you use and the numeric result. - Now assume you have 2 primary metrics (conversion and qualified-lead rate). Apply a Bonferroni correction and recompute the per-variant sample size. Explain trade-offs versus using a gatekeeper metric or a hierarchical test. - Traffic: 1.2M eligible sessions/day, but only 70% meet eligibility checks; you can allocate at most 20% of eligible traffic to the experiment initially. Estimate test duration in days, then propose a safe ramp schedule that preserves statistical validity and operational risk controls. - Explain when you would use a z-test vs. a t-test here, and interpret a 95% CI that barely excludes zero uplift. - Describe how you would verify proper randomization and balance across country and platform before looking at outcomes.

Quick Answer: This question evaluates competency in experimental design and statistical inference for A/B testing, including sample size and power calculations, multiple-comparison correction, hypothesis-test selection (z vs t), confidence-interval interpretation, and randomization/balance diagnostics.

Related Interview Questions

  • Compute probability an account is fake - Meta (easy)
  • Compute Bayes probability for fake accounts - Meta (easy)
  • Compute probabilities for chatbot response quality - Meta (easy)
  • Compute posterior fake probability using Bayes' rule - Meta (medium)
  • Estimate bots and CI from DAU spike - Meta (medium)
Meta logo
Meta
Oct 13, 2025, 9:49 PM
Data Scientist
Onsite
Statistics & Math
8
0

You will run a two-arm A/B test on a signup funnel. Given: baseline conversion p0 = 4.0%; you care about detecting a 10% relative uplift (p1 = 4.4%); two-sided α = 0.05; power = 80%; Bernoulli outcomes; independent users; simple difference-in-proportions z-test approximation is acceptable.

  • Compute the minimum per-variant sample size. Show the exact formula you use and the numeric result.
  • Now assume you have 2 primary metrics (conversion and qualified-lead rate). Apply a Bonferroni correction and recompute the per-variant sample size. Explain trade-offs versus using a gatekeeper metric or a hierarchical test.
  • Traffic: 1.2M eligible sessions/day, but only 70% meet eligibility checks; you can allocate at most 20% of eligible traffic to the experiment initially. Estimate test duration in days, then propose a safe ramp schedule that preserves statistical validity and operational risk controls.
  • Explain when you would use a z-test vs. a t-test here, and interpret a 95% CI that barely excludes zero uplift.
  • Describe how you would verify proper randomization and balance across country and platform before looking at outcomes.

Submit Your Answer to Earn 20XP

Sign in to leave a comment

Loading comments...

Browse More Questions

More Statistics & Math•More Meta•More Data Scientist•Meta Data Scientist•Meta Statistics & Math•Data Scientist Statistics & Math
PracHub

Master your tech interviews with 8,000+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.