Run a clean A/B test for autocomplete

Read the full interview experience this question came from →

Quick Overview

This question evaluates experimental-design and causal-inference competency for online A/B testing of ML-ranked autocomplete, covering metric formulation, variance-reduction strategies, sample-size computation, and operational validity considerations.

Run a clean A/B test for autocomplete

Company: Etsy

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: hard

Interview Round: Technical Screen

Overview: This question evaluates experimental-design and causal-inference competency for online A/B testing of ML-ranked autocomplete, covering metric formulation, variance-reduction strategies, sample-size computation, and operational validity considerations.

Read the full Etsy Data Scientist interview experience this question came from

|Home/Analytics & Experimentation/Etsy
Etsy logo
Etsy
Oct 13, 2025
hardData ScientistTechnical ScreenAnalytics & Experimentation
4
0
Loading...
Loading comments...