PracHub
QuestionsPremiumLearningGuidesInterview PrepNEWCoaches
|Home/Analytics & Experimentation/Intuit

Design an experiment to evaluate an onboarding progress bar

Last updated: Mar 29, 2026

Quick Overview

This question evaluates a candidate's competency in experiment design, A/B testing, metric selection and trade-offs, causal inference, and product analytics for measuring the impact of a UI element like a progress bar.

  • easy
  • Intuit
  • Analytics & Experimentation
  • Product Analyst

Design an experiment to evaluate an onboarding progress bar

Company: Intuit

Role: Product Analyst

Category: Analytics & Experimentation

Difficulty: easy

Interview Round: Onsite

## Scenario In a QuickBooks-like onboarding flow, the product team adds a **progress bar**. The onboarding has 4 steps: 1. Onboard 2. Send payment 3. Set up bank account 4. File the tax ## Question How would you evaluate whether the progress bar **helps**? Your answer should include: - Hypothesis and what “helps” means - Primary metric + diagnostic metrics + guardrails (with tradeoffs) - Experiment design (randomization unit, sample size/power considerations at a high level, duration) - Key pitfalls (novelty effects, instrumentation, segment heterogeneity) and how you’d address them

Quick Answer: This question evaluates a candidate's competency in experiment design, A/B testing, metric selection and trade-offs, causal inference, and product analytics for measuring the impact of a UI element like a progress bar.

Related Interview Questions

  • Design an experiment for pricing page redesign - Intuit (easy)
  • Extract insights from a multi-entry funnel scorecard - Intuit (easy)
  • Diagnose rising delivery cost precisely - Intuit (hard)
  • Build 30-day retention cohort table - Intuit (medium)
  • Build cohort 30-day retention from signup date - Intuit (medium)
Intuit logo
Intuit
Oct 21, 2025, 12:00 AM
Product Analyst
Onsite
Analytics & Experimentation
1
0

Scenario

In a QuickBooks-like onboarding flow, the product team adds a progress bar.

The onboarding has 4 steps:

  1. Onboard
  2. Send payment
  3. Set up bank account
  4. File the tax

Question

How would you evaluate whether the progress bar helps?

Your answer should include:

  • Hypothesis and what “helps” means
  • Primary metric + diagnostic metrics + guardrails (with tradeoffs)
  • Experiment design (randomization unit, sample size/power considerations at a high level, duration)
  • Key pitfalls (novelty effects, instrumentation, segment heterogeneity) and how you’d address them

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Analytics & Experimentation•More Intuit•More Product Analyst•Intuit Product Analyst•Intuit Analytics & Experimentation•Product Analyst Analytics & Experimentation
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.