PracHub
QuestionsPremiumLearningGuidesCheatsheetNEWCoaches
|Home/Analytics & Experimentation/Netflix

Compute ITT, TOT, and LATE with noncompliance

Last updated: Mar 29, 2026

Quick Overview

This question evaluates understanding of causal inference and experimental analysis, specifically estimation and interpretation of ITT, TOT, and LATE under noncompliance along with classification of compliance types (compliers, always-takers, never-takers, defiers).

  • medium
  • Netflix
  • Analytics & Experimentation
  • Data Scientist

Compute ITT, TOT, and LATE with noncompliance

Company: Netflix

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: medium

Interview Round: Onsite

In the same personalization experiment, not everyone assigned to treatment actually receives personalization (noncompliance). You are given user-level columns: - `Z` (0/1): randomized assignment (instrument) - `D` (0/1): actually received personalization (treatment received) - `Y` (float): `minutes_streamed` Tasks: 1) Define and compute the **Intention-to-Treat (ITT)** effect of assignment on minutes streamed. 2) Define what people often mean by **Treatment-on-the-Treated (TOT)** in this setting, and compute it. 3) Using an IV interpretation, compute the **LATE** for compliers and explain what assumptions are required. 4) Conceptually classify users into compliance types (compliers, always-takers, never-takers, defiers) and state which group LATE pertains to.

Quick Answer: This question evaluates understanding of causal inference and experimental analysis, specifically estimation and interpretation of ITT, TOT, and LATE under noncompliance along with classification of compliance types (compliers, always-takers, never-takers, defiers).

Related Interview Questions

  • Estimate ATE of personalization on streaming - Netflix (medium)
  • Estimate ATE, ITT, and TOT from experiment - Netflix (easy)
  • Plan and analyze a ranking A/B test - Netflix (hard)
  • Design experiment on culture memo emphasis - Netflix (medium)
  • Design and power a frequency-cap experiment - Netflix (hard)
Netflix logo
Netflix
Mar 5, 2026, 12:00 AM
Data Scientist
Onsite
Analytics & Experimentation
13
0

In the same personalization experiment, not everyone assigned to treatment actually receives personalization (noncompliance).

You are given user-level columns:

  • Z (0/1): randomized assignment (instrument)
  • D (0/1): actually received personalization (treatment received)
  • Y (float): minutes_streamed

Tasks:

  1. Define and compute the Intention-to-Treat (ITT) effect of assignment on minutes streamed.
  2. Define what people often mean by Treatment-on-the-Treated (TOT) in this setting, and compute it.
  3. Using an IV interpretation, compute the LATE for compliers and explain what assumptions are required.
  4. Conceptually classify users into compliance types (compliers, always-takers, never-takers, defiers) and state which group LATE pertains to.

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Analytics & Experimentation•More Netflix•More Data Scientist•Netflix Data Scientist•Netflix Analytics & Experimentation•Data Scientist Analytics & Experimentation
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.