How do I approach Analytics & Experimentation interview questions?

Analytics & Experimentation questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master analytics & experimentation interviews.

What difficulty level is this interview question?

This is a hard difficulty Analytics & Experimentation question, commonly asked during Technical Screen rounds at Uber.

What role is this question designed for?

This question is commonly asked for Data Scientist candidates at Uber during technical interviews.

Estimate causal effect with interference

Quick Overview

This question evaluates a data scientist's proficiency in causal inference for experiments with noncompliance and interference, covering estimands such as intent-to-treat and local average treatment effects, instrumental-variable and cluster-randomization strategies, exposure mapping for spillovers, and conducting sensitivity analyses.

A/B Test With Noncompliance and Interference: Causal Effect of Surge Recommendations on Completed Trips

Context

You ran an A/B test that assigned some drivers to receive surge recommendations. About 30% of assigned (treated) drivers ignored the suggestion (noncompliance). Surge in one zone can also affect neighboring zones (interference/spillovers). The outcome is completed trips per driver (e.g., per shift or time block).

To make treatment well-defined for both treated and control drivers, assume you can generate a "ghost" recommendation for control drivers by running the recommendation algorithm offline to record the counterfactual target zone they would have been encouraged to move to if treated.

Task

Propose an analysis plan to estimate the causal effect of following a surge recommendation on completed trips that:

Defines estimands (e.g., ITT and LATE) in the presence of noncompliance and interference.
Uses either cluster randomization or a 2SLS/IV strategy with assignment as the instrument.
States instrument assumptions (relevance, monotonicity, exclusion), and how you would test/justify them.
Specifies exposure mappings to handle interference between neighboring zones.
Details estimation steps, including computing robust/clustered standard errors.
Discusses sensitivity analyses for spillovers and noncompliance.

Quick Overview

Context

Task

Propose an analysis plan to estimate the causal effect of following a surge recommendation on completed trips that:

Defines estimands (e.g., ITT and LATE) in the presence of noncompliance and interference.

Uses either cluster randomization or a 2SLS/IV strategy with assignment as the instrument.

States instrument assumptions (relevance, monotonicity, exclusion), and how you would test/justify them.

Specifies exposure mappings to handle interference between neighboring zones.

Details estimation steps, including computing robust/clustered standard errors.

Discusses sensitivity analyses for spillovers and noncompliance.

Estimate causal effect with interference

Quick Overview

A/B Test With Noncompliance and Interference: Causal Effect of Surge Recommendations on Completed Trips

Context

Task

Solution

Comments (0)

Estimate causal effect with interference

Quick Overview

A/B Test With Noncompliance and Interference: Causal Effect of Surge Recommendations on Completed Trips

Context

Task

Solution

Comments (0)