PracHub
QuestionsPremiumLearningGuidesCheatsheetNEWCoaches
|Home/Analytics & Experimentation/OpenAI

Assess free-month promotion impact

Last updated: Mar 29, 2026

Quick Overview

This question evaluates a data scientist's competency in experimental design, causal inference, metric definition and prioritization, bias identification, incremental impact estimation, and business ROI assessment for promotional offers.

  • hard
  • OpenAI
  • Analytics & Experimentation
  • Data Scientist

Assess free-month promotion impact

Company: OpenAI

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: hard

Interview Round: Technical Screen

You are evaluating a free one-month promotion for a subscription product. Eligible users can either see the normal paid signup flow or receive the first month free. The business wants to know whether the promotion should be rolled out more broadly. Assume you have user-level data with: experiment assignment or targeting flags, signup date, activation events, acquisition channel, geo, device, historical engagement, subscription start/end dates, payments, refunds, and a limited follow-up window. Some users may have been targeted non-randomly, and long-term lifetime value is only partially observed. Discuss how you would: 1. Define the primary success metric, secondary metrics, and guardrails. Consider tradeoffs among signup conversion, activation, 30/60/90-day retention, paid conversion after the free month, gross revenue, net revenue, contribution margin, and ROI. 2. Decide whether this should be analyzed as a randomized experiment or as an observational causal inference problem. 3. Identify the major pitfalls and sources of bias, including selection effects, pull-forward or cannibalization, delayed outcomes, survivorship bias, seasonality, and users who churn and later resubscribe. 4. Estimate the incremental impact and ROI when not all desired data are available, stating any assumptions needed to project long-term value. 5. Summarize how you would present a recommendation to non-technical stakeholders if some metrics improve while others worsen.

Quick Answer: This question evaluates a data scientist's competency in experimental design, causal inference, metric definition and prioritization, bias identification, incremental impact estimation, and business ROI assessment for promotional offers.

Related Interview Questions

  • Design a free-month experiment - OpenAI (hard)
  • Measure free-month promotion impact - OpenAI (hard)
  • Design and analyze a free-trial A/B test - OpenAI (hard)
  • How would you evaluate a free-trial A/B test? - OpenAI (medium)
  • Evaluate a free-trial A/B test - OpenAI (easy)
OpenAI logo
OpenAI
Jan 22, 2026, 12:00 AM
Data Scientist
Technical Screen
Analytics & Experimentation
5
0
Loading...

You are evaluating a free one-month promotion for a subscription product. Eligible users can either see the normal paid signup flow or receive the first month free. The business wants to know whether the promotion should be rolled out more broadly.

Assume you have user-level data with: experiment assignment or targeting flags, signup date, activation events, acquisition channel, geo, device, historical engagement, subscription start/end dates, payments, refunds, and a limited follow-up window. Some users may have been targeted non-randomly, and long-term lifetime value is only partially observed.

Discuss how you would:

  1. Define the primary success metric, secondary metrics, and guardrails. Consider tradeoffs among signup conversion, activation, 30/60/90-day retention, paid conversion after the free month, gross revenue, net revenue, contribution margin, and ROI.
  2. Decide whether this should be analyzed as a randomized experiment or as an observational causal inference problem.
  3. Identify the major pitfalls and sources of bias, including selection effects, pull-forward or cannibalization, delayed outcomes, survivorship bias, seasonality, and users who churn and later resubscribe.
  4. Estimate the incremental impact and ROI when not all desired data are available, stating any assumptions needed to project long-term value.
  5. Summarize how you would present a recommendation to non-technical stakeholders if some metrics improve while others worsen.

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Analytics & Experimentation•More OpenAI•More Data Scientist•OpenAI Data Scientist•OpenAI Analytics & Experimentation•Data Scientist Analytics & Experimentation
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.