PracHub
QuestionsPremiumLearningGuidesInterview PrepNEWCoaches
|Home/Statistics & Math/Tubi

Diagnose and fix selection bias in experiments

Last updated: Mar 29, 2026

Quick Overview

This question evaluates a data scientist's competency in causal inference and selection bias diagnosis, focusing on identifying plausible selection mechanisms in an opt-in discount-banner experiment and understanding when observational treated-versus-untreated comparisons are biased.

  • hard
  • Tubi
  • Statistics & Math
  • Data Scientist

Diagnose and fix selection bias in experiments

Company: Tubi

Role: Data Scientist

Category: Statistics & Math

Difficulty: hard

Interview Round: Technical Screen

Define selection bias and diagnose it in this scenario: users can opt into seeing a discount banner (treatment), and treated users show higher conversion. (a) List at least three plausible selection mechanisms and the directions of bias they induce. (b) Propose two fixes that produce unbiased (or less biased) causal estimates—e.g., randomized encouragement, regression discontinuity (thresholded eligibility), front‑door adjustment, or IV with assignment instrument—and state the assumptions each requires and how you would test them. (c) Provide a small numerical example where naive differences are biased but a corrected method recovers an unbiased or less biased estimate.

Quick Answer: This question evaluates a data scientist's competency in causal inference and selection bias diagnosis, focusing on identifying plausible selection mechanisms in an opt-in discount-banner experiment and understanding when observational treated-versus-untreated comparisons are biased.

Related Interview Questions

  • Explain p‑values to a product manager - Tubi (medium)
Tubi logo
Tubi
Oct 13, 2025, 9:49 PM
Data Scientist
Technical Screen
Statistics & Math
2
0

Selection Bias With Opt-in Discount Banner

Context

You observe that users can opt in to see a discount banner (treatment = 1 if they opted in and saw the banner). In observational data, treated users have higher conversion than untreated users.

Tasks

(a) Define selection bias and, for this opt-in scenario, list at least three plausible selection mechanisms. For each mechanism, state the expected direction of bias it induces on the naive difference in conversion between treated and untreated users.

(b) Propose two study designs or estimators that can yield unbiased (or less biased) causal estimates in this setting (for example, randomized encouragement with an IV, regression discontinuity with thresholded eligibility, front-door adjustment, IV with assignment instrument). For each, clearly state:

  • The setup/design.
  • The identifying assumptions.
  • How you would diagnose or test those assumptions in practice.

(c) Provide a small numerical example where the naive treated-minus-untreated difference is biased, but a corrected method recovers an unbiased or less biased estimate.

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Statistics & Math•More Tubi•More Data Scientist•Tubi Data Scientist•Tubi Statistics & Math•Data Scientist Statistics & Math
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.