PracHub
QuestionsPremiumLearningGuidesCheatsheetNEWCareers
|Home/Product / Decision Making/TikTok

In-App Purchase A/B Test Design & Evaluation

Last updated: Mar 29, 2026

Quick Overview

This question evaluates experimental design, pricing strategy, monetization analytics, and statistical reasoning for in-app purchases, testing a candidate's ability to weigh conversion versus revenue trade-offs and user experience implications.

  • medium
  • TikTok
  • Product / Decision Making
  • Product Manager

In-App Purchase A/B Test Design & Evaluation

Company: TikTok

Role: Product Manager

Category: Product / Decision Making

Difficulty: medium

Interview Round: Onsite

##### Question TikTok is running an A/B test on two in-app purchase pages for a mobile game. State your hypotheses for why Page A (higher price, fewer buyers) could outperform Page B (lower price, more buyers) and vice-versa. List the primary and secondary metrics you would track (e.g., conversion rate, ARPU, LTV, ROI) and explain why. Describe the statistical approach you would use to determine significance and how you would check if the current sample size provides enough power. Explain how you incorporate promotional cost ("spend X, get bonus Y") into your ROI calculation. Propose a follow-up experiment based on the initial results.

Quick Answer: This question evaluates experimental design, pricing strategy, monetization analytics, and statistical reasoning for in-app purchases, testing a candidate's ability to weigh conversion versus revenue trade-offs and user experience implications.

Related Interview Questions

  • Explain portfolio, design language, and delivery - TikTok (medium)
  • Break a Palindrome Algorithm - TikTok (medium)
  • Login Flow Critique, Feature Improvement & Data Privacy - TikTok (medium)
  • TikTok Product Strategy & Case Design - TikTok (hard)
  • Secretary Problem – Selecting the Most Valuable Painting - TikTok (medium)
TikTok logo
TikTok
Jul 4, 2025, 8:28 PM
Product Manager
Onsite
Product / Decision Making
11
0

A/B Test: In‑App Purchase Page Pricing (Page A vs Page B)

Context: You are testing two purchase pages in a mobile game. Page A presents a higher price with fewer buyers; Page B presents a lower price with more buyers. Assume randomization at the user level, a 50/50 split, and a 14–28 day observation window. The goal is to decide which page maximizes long‑term profit while maintaining user experience.

  1. Hypotheses
    • Why Page A (higher price, fewer buyers) could outperform Page B (lower price, more buyers).
    • Why Page B could outperform Page A.
  2. Metrics
    • List primary and secondary metrics (e.g., conversion rate, ARPU, LTV, ROI) and explain why.
  3. Statistical Approach
    • How to determine statistical significance and test design details.
    • How to check whether current sample size has enough power.
  4. ROI with Promotions
    • How to incorporate promotional cost ("spend X, get bonus Y") into ROI and profit calculations.
  5. Follow‑Up Experiment
    • Propose a next experiment based on initial results.

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Product / Decision Making•More TikTok•More Product Manager•TikTok Product Manager•TikTok Product / Decision Making•Product Manager Product / Decision Making
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • Careers
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.