PracHub
QuestionsPremiumCoachesLearningGuidesInterview Prep
|Home/Analytics & Experimentation/Citi

How would you A/B test first trade rate?

Last updated: Mar 29, 2026

Quick Overview

This question evaluates A/B testing and experimentation design skills—metric definition, unit and randomization choice, threat-to-validity identification, and power/MDE calculation—for a Data Scientist in the Analytics & Experimentation domain.

  • medium
  • Citi
  • Analytics & Experimentation
  • Data Scientist

How would you A/B test first trade rate?

Company: Citi

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: medium

Interview Round: Technical Screen

Coinbase wants to increase **new user first trade rate**. Design an experiment (A/B test) to evaluate a product change intended to increase the probability that a newly signed-up user places their **first trade**. In your answer, cover: 1. **Hypothesis** and what user behavior you are trying to change. 2. **Primary metric** (pick a clear definition, e.g., “first trade within 7 days of signup”) and at least 2 **secondary/guardrail metrics** (risk, compliance, user harm, revenue quality). 3. **Experiment unit & randomization** (user/account/device), eligibility rules, and when a user is considered “exposed”. 4. Key threats to validity (selection bias, learning/novelty effects, interference, instrumentation issues, sample ratio mismatch). 5. **Power/MDE** approach (how you would size the test, what baseline inputs you need). 6. What you would do if the result is **not statistically significant** but directional, or if key guardrails regress.

Quick Answer: This question evaluates A/B testing and experimentation design skills—metric definition, unit and randomization choice, threat-to-validity identification, and power/MDE calculation—for a Data Scientist in the Analytics & Experimentation domain.

Related Interview Questions

  • How would you analyze retail volume drop? - Citi (medium)
  • Design experiment and analyze volume drop scenario - Citi (easy)
Citi logo
Citi
Mar 25, 2025, 12:00 AM
Data Scientist
Technical Screen
Analytics & Experimentation
2
0

Coinbase wants to increase new user first trade rate.

Design an experiment (A/B test) to evaluate a product change intended to increase the probability that a newly signed-up user places their first trade.

In your answer, cover:

  1. Hypothesis and what user behavior you are trying to change.
  2. Primary metric (pick a clear definition, e.g., “first trade within 7 days of signup”) and at least 2 secondary/guardrail metrics (risk, compliance, user harm, revenue quality).
  3. Experiment unit & randomization (user/account/device), eligibility rules, and when a user is considered “exposed”.
  4. Key threats to validity (selection bias, learning/novelty effects, interference, instrumentation issues, sample ratio mismatch).
  5. Power/MDE approach (how you would size the test, what baseline inputs you need).
  6. What you would do if the result is not statistically significant but directional, or if key guardrails regress.

Solution

Show

Submit Your Answer

Sign in to leave a comment

Loading comments...

Browse More Questions

More Analytics & Experimentation•More Citi•More Data Scientist•Citi Data Scientist•Citi Analytics & Experimentation•Data Scientist Analytics & Experimentation
PracHub

Master your tech interviews with 8,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.