Design A/B Test for Google Maps UI Change

Q: Design A/B Test for Google Maps UI Change

This question evaluates a data scientist's competency in experimental design and product analytics, including hypothesis formulation, metric selection, guardrail definition, randomization, sample-size calculation, and analysis planning for a mobile mapping application's UI change.

Q: How do I approach Analytics & Experimentation interview questions?

Analytics & Experimentation questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master analytics & experimentation interviews.

Question

A/B Test Design: Moving the Google Maps Search Bar to the Bottom

Context

Google Maps is considering a UI change: moving the search bar from the top to the bottom of the screen on mobile. We want to evaluate whether this increases search usage without harming user experience or system stability.

Task

Design an experiment that covers:

Hypotheses
Primary success metric(s) and secondary metrics
Guardrail metrics (safety/quality)
Experiment unit and exposure rules
Randomization and bucketing
Sample-size calculation and runtime
Analysis plan and validity checks
Result interpretation and rollout decision

Design A/B Test for Google Maps UI Change

A/B Test Design: Moving the Google Maps Search Bar to the Bottom

Context

Task

Solution

Comments (0)