PracHub
QuestionsPremiumLearningGuidesCheatsheetNEWCoaches
|Home/Statistics & Math/Pinterest

Explain BLS vs CLS; compute t-stats

Last updated: Mar 29, 2026

Quick Overview

This question evaluates causal inference and experimental measurement skills in digital advertising, including distinctions between Brand Lift Studies and Conversion Lift Studies, sources of bias and variance, observational identification methods (Diff‑in‑Diff and Propensity Score Matching), and applied hypothesis testing for proportions and DiD variance estimation. It is commonly asked to gauge an interviewee's ability to reason about trade-offs between survey- and experiment-based metrics, state identification assumptions and robustness checks, and perform practical statistical inference; the domain is Statistics & Math for a data scientist role and the level spans both conceptual understanding and practical application.

  • Medium
  • Pinterest
  • Statistics & Math
  • Data Scientist

Explain BLS vs CLS; compute t-stats

Company: Pinterest

Role: Data Scientist

Category: Statistics & Math

Difficulty: Medium

Interview Round: Onsite

Part A — Concepts: Define Brand Lift Study (BLS) vs Conversion Lift Study (CLS) in ads measurement. List key bias/variance sources for each (e.g., non-response bias in surveys, contamination, auction interference, selection). Describe when BLS and CLS might disagree and how you would reconcile them. Briefly contrast Diff-in-Diff (DiD) and Propensity Score Matching (PSM) for observational ads data; specify identification assumptions for each and one robustness check per method. Part B — Hypothesis test for proportions (CLS): In a randomized CLS holdout, Treatment n1=1200 users, x1=42 conversions; Control n0=1180 users, x0=33 conversions. Compute: (1) point lift (p1−p0), (2) the pooled standard error under H0: p1=p0, and (3) the two-sided t/z-statistic and p-value. State whether the effect is significant at α=0.05. Part C — Manual DiD t-stat (BLS survey): You measure Purchase Intent (binary) pre/post for exposed vs control cohorts: Group sizes: n_T_pre=300, n_T_post=320, n_C_pre=290, n_C_post=310. Sample means: m_T_pre=0.18, m_T_post=0.26, m_C_pre=0.17, m_C_post=0.20. Sample variances (Bernoulli sample variances): s2_T_pre=0.1476, s2_T_post=0.1924, s2_C_pre=0.1411, s2_C_post=0.1600. Tasks: (1) Compute the DiD estimator: (m_T_post−m_T_pre)−(m_C_post−m_C_pre). (2) Assuming independent samples and unequal group sizes, derive and compute an approximate standard error for the DiD using the sum of the four independent sample variances scaled by their n’s, and then (3) compute the t-statistic and conclude at α=0.05. Clearly show the formulas you use.

Quick Answer: This question evaluates causal inference and experimental measurement skills in digital advertising, including distinctions between Brand Lift Studies and Conversion Lift Studies, sources of bias and variance, observational identification methods (Diff‑in‑Diff and Propensity Score Matching), and applied hypothesis testing for proportions and DiD variance estimation. It is commonly asked to gauge an interviewee's ability to reason about trade-offs between survey- and experiment-based metrics, state identification assumptions and robustness checks, and perform practical statistical inference; the domain is Statistics & Math for a data scientist role and the level spans both conceptual understanding and practical application.

Related Interview Questions

  • Design rigorous A/B test and causal analysis - Pinterest (hard)
  • Estimate billboard reach and impressions - Pinterest (hard)
  • Analyze survey with gender imbalance - Pinterest (Hard)
  • Determine Appropriate Statistical Test for Comparing Means - Pinterest (medium)
  • Estimate Highway Billboard Impressions Using Traffic Data - Pinterest (medium)
Pinterest logo
Pinterest
Oct 13, 2025, 9:49 PM
Data Scientist
Onsite
Statistics & Math
9
0

Part A — Concepts: Define Brand Lift Study (BLS) vs Conversion Lift Study (CLS) in ads measurement. List key bias/variance sources for each (e.g., non-response bias in surveys, contamination, auction interference, selection). Describe when BLS and CLS might disagree and how you would reconcile them. Briefly contrast Diff-in-Diff (DiD) and Propensity Score Matching (PSM) for observational ads data; specify identification assumptions for each and one robustness check per method.

Part B — Hypothesis test for proportions (CLS): In a randomized CLS holdout, Treatment n1=1200 users, x1=42 conversions; Control n0=1180 users, x0=33 conversions. Compute: (1) point lift (p1−p0), (2) the pooled standard error under H0: p1=p0, and (3) the two-sided t/z-statistic and p-value. State whether the effect is significant at α=0.05.

Part C — Manual DiD t-stat (BLS survey): You measure Purchase Intent (binary) pre/post for exposed vs control cohorts: Group sizes: n_T_pre=300, n_T_post=320, n_C_pre=290, n_C_post=310. Sample means: m_T_pre=0.18, m_T_post=0.26, m_C_pre=0.17, m_C_post=0.20. Sample variances (Bernoulli sample variances): s2_T_pre=0.1476, s2_T_post=0.1924, s2_C_pre=0.1411, s2_C_post=0.1600. Tasks: (1) Compute the DiD estimator: (m_T_post−m_T_pre)−(m_C_post−m_C_pre). (2) Assuming independent samples and unequal group sizes, derive and compute an approximate standard error for the DiD using the sum of the four independent sample variances scaled by their n’s, and then (3) compute the t-statistic and conclude at α=0.05. Clearly show the formulas you use.

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Statistics & Math•More Pinterest•More Data Scientist•Pinterest Data Scientist•Pinterest Statistics & Math•Data Scientist Statistics & Math
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.