How do you design an A/B experiment?
Company: Anthropic
Role: Software Engineer
Category: Analytics & Experimentation
Difficulty: hard
Interview Round: Onsite
Overview: This question evaluates competency in online experiment design, including hypothesis framing, metric selection and guardrails, unit of randomization and interference control, power/sample-size reasoning, and identification and mitigation of common biases.