PracHub
QuestionsPremiumLearningGuidesCheatsheetNEWCoaches
|Home/Statistics & Math/Amazon

Compute an A/B test p-value by hand

Last updated: Apr 20, 2026

Quick Overview

This question evaluates understanding of hypothesis testing for proportions, specifically the two-proportion z-test, p-value computation and interpretation of statistical significance in an A/B test with binary outcomes.

  • medium
  • Amazon
  • Statistics & Math
  • Data Scientist

Compute an A/B test p-value by hand

Company: Amazon

Role: Data Scientist

Category: Statistics & Math

Difficulty: medium

Interview Round: Technical Screen

In an A/B test on a game feature, you measure **conversion rate** (binary outcome). - Control: n₁ = 1000 users, x₁ = 120 conversions - Treatment: n₂ = 980 users, x₂ = 145 conversions Tasks: 1) Compute the **two-sided p-value** for the null hypothesis H₀: p₁ = p₂ using a **two-proportion z-test** (show formulas and intermediate values). 2) State whether the result is significant at α = 0.05. 3) (Implementation) Describe how you would compute this p-value in Python **without using SciPy** (you may use `math` only).

Quick Answer: This question evaluates understanding of hypothesis testing for proportions, specifically the two-proportion z-test, p-value computation and interpretation of statistical significance in an A/B test with binary outcomes.

Related Interview Questions

  • Compute and interpret quantile loss vs RMSE - Amazon (medium)
  • Compute CIs, power, and multiple testing - Amazon (medium)
  • Plan and analyze an A/B test - Amazon (hard)
  • Compute p-values, CIs, and adjust multiples - Amazon (Medium)
  • Analyze omitted-variable bias in regression - Amazon (medium)
Amazon logo
Amazon
Nov 4, 2025, 12:00 AM
Data Scientist
Technical Screen
Statistics & Math
6
0

In an A/B test on a game feature, you measure conversion rate (binary outcome).

  • Control: n₁ = 1000 users, x₁ = 120 conversions
  • Treatment: n₂ = 980 users, x₂ = 145 conversions

Tasks:

  1. Compute the two-sided p-value for the null hypothesis H₀: p₁ = p₂ using a two-proportion z-test (show formulas and intermediate values).
  2. State whether the result is significant at α = 0.05.
  3. (Implementation) Describe how you would compute this p-value in Python without using SciPy (you may use math only).

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Statistics & Math•More Amazon•More Data Scientist•Amazon Data Scientist•Amazon Statistics & Math•Data Scientist Statistics & Math
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.