PracHub
QuestionsPremiumLearningGuidesInterview PrepNEWCoaches
|Home/Analytics & Experimentation/Google

Diagnose and reverse an adoption-rate decline

Last updated: Mar 29, 2026

Quick Overview

This question evaluates a data scientist's competency in product analytics and experimentation, covering precise metric definition and validation, instrumentation and event quality checks, rapid triage of adoption regressions, hypothesis generation, experiment design, and causal inference.

  • hard
  • Google
  • Analytics & Experimentation
  • Data Scientist

Diagnose and reverse an adoption-rate decline

Company: Google

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: hard

Interview Round: Onsite

Google Meet’s enterprise adoption rate (weekly active unique users ÷ total enabled users) has fallen from 38% to 31% over the last 4 calendar weeks. You are the on-call analyst. (a) Precisely define and validate “adoption rate” (event definitions, de-duplication, bot filtering, identity across devices, time zones, attribution windows). How would you backfill and reconcile with historical dashboards? (b) Lay out a 24-hour triage plan to distinguish instrumentation issues, seasonality, and true behavioral change; include concrete queries/checks, holdout benchmarks, and sanity ratios. (c) Propose at least three falsifiable hypotheses segmented by customer tier, geography, client platform (web/iOS/Android), and feature usage (recording/meeting size). What evidence would support or refute each? (d) Design experiments to reverse the decline (e.g., onboarding nudge, performance fix, reminder). Specify primary/secondary metrics, guardrails, MDE, power, sample size, duration, and ramp plan; explain how you’d choose variants under limited traffic. (e) Show how you’d separate causal impact from external shocks (holidays, competitor launches) using diff-in-diff, synthetic control, or interrupted time series. What assumptions must hold, and how will you test them? (f) Identify risks like metric gaming, delayed conversions, and Simpson’s paradox. What monitoring and drill-downs prevent false wins and ensure reproducibility?

Quick Answer: This question evaluates a data scientist's competency in product analytics and experimentation, covering precise metric definition and validation, instrumentation and event quality checks, rapid triage of adoption regressions, hypothesis generation, experiment design, and causal inference.

Related Interview Questions

  • Design an A/B test for search ranking - Google (easy)
  • Design an Unbiased Upgrade Experiment - Google (hard)
  • Design a Causal Upgrade Experiment - Google (hard)
  • Design an experiment to measure latency impact - Google (medium)
  • How would you use propensity score matching here - Google (medium)
Google logo
Google
Oct 13, 2025, 9:49 PM
Data Scientist
Onsite
Analytics & Experimentation
2
0

Problem: Investigating a 7pp Drop in Google Meet Enterprise Adoption Rate

Context

Over the last 4 calendar weeks, enterprise adoption rate has fallen from 38% to 31%. Adoption rate is defined as weekly active unique users divided by total enabled users. You are the on-call analyst.

Tasks

(a) Precisely define and validate "adoption rate". Cover event definitions, de-duplication, bot filtering, cross-device identity, time zones, and attribution windows. Describe how you would backfill and reconcile with historical dashboards.

(b) Lay out a 24-hour triage plan to distinguish instrumentation issues, seasonality, and true behavioral change. Include concrete queries/checks, holdout benchmarks, and sanity ratios.

(c) Propose at least three falsifiable hypotheses segmented by customer tier, geography, client platform (web/iOS/Android), and feature usage (e.g., recording, meeting size). For each, state the evidence that would support or refute it.

(d) Design experiments to reverse the decline (e.g., onboarding nudge, performance fix, reminder). For each, specify primary/secondary metrics, guardrails, minimal detectable effect (MDE), power, sample size, duration, and a ramp plan. Explain how you would choose variants under limited traffic.

(e) Show how to separate causal impact from external shocks (holidays, competitor launches) using difference-in-differences, synthetic control, or interrupted time series. State the assumptions and how to test them.

(f) Identify risks such as metric gaming, delayed conversions, and Simpson’s paradox. Describe monitoring and drill-downs that prevent false wins and ensure reproducibility.

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Analytics & Experimentation•More Google•More Data Scientist•Google Data Scientist•Google Analytics & Experimentation•Data Scientist Analytics & Experimentation
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.