How do I approach Analytics & Experimentation interview questions?

Analytics & Experimentation questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master analytics & experimentation interviews.

What difficulty level is this interview question?

This is a hard difficulty Analytics & Experimentation question, commonly asked during Technical Screen rounds at Airbnb.

What role is this question designed for?

This question is commonly asked for Data Scientist candidates at Airbnb during technical interviews.

Estimate Causal Impact Using Synthetic Control Methods

Last updated: Mar 29, 2026

Quick Overview

This question evaluates a data scientist's competency in causal inference and observational impact estimation within the Analytics & Experimentation domain, emphasizing handling time-series seasonality, cross-sectional heterogeneity, panel and exposure data, and identification challenges.

Airbnb

Jul 12, 2025, 6:59 PM

Data Scientist

Technical Screen

Analytics & Experimentation

Estimating Causal Impact After a 100% Rollout (No Holdout)

Context

A product feature was launched to 100% of traffic simultaneously, so there is no explicit control or holdout group. You need to estimate the causal impact of the launch on a key business metric (e.g., conversion rate, bookings, revenue), in a marketplace with strong seasonality and heterogeneity across geographies, devices, and user segments.

Assume you have historical data (pre- and post-launch), unit-level and geo-level panels, exposure logs (who actually saw/used the feature), and standard product/marketing covariates.

Task

Outline:

Possible causal inference methodologies suitable for this setting.
The data each method requires.
Key identification assumptions and how you would validate them.
How you would quantify and communicate uncertainty.

Hints: Discuss pre–post analysis, synthetic controls, difference-in-differences, and propensity-based approaches; emphasize validation and sensitivity checks.

Solution

Show

Comments (0)

Loading comments...

Browse More Questions

More Analytics & Experimentation•More Airbnb•More Data Scientist•Airbnb Data Scientist•Airbnb Analytics & Experimentation•Data Scientist Analytics & Experimentation