Diagnose YouTube Usage Decline: Key Metrics and Segmentation
Quick Overview
Evaluates systematic product analytics for diagnosing a sudden YouTube usage decline. Strong answers validate instrumentation, decompose DAU and watch time, segment by platform and cohort, inspect rollout and incident data, and confirm root causes with experiments or causal analyses.
Diagnose YouTube Usage Decline: Key Metrics and Segmentation
Company: Google
Role: Data Scientist
Category: Analytics & Experimentation
Difficulty: hard
Interview Round: Technical Screen
##### Scenario
YouTube observes a sudden decline in daily active users and total watch-time across the platform.
##### Question
How would you systematically diagnose the drop in YouTube usage? Which engagement and funnel metrics would you inspect, and how would you segment users to localize the issue? What further analyses or experiments would you run to confirm root causes?
##### Hints
Frame with acquisition-activation-engagement-retention funnel, segment by device/geo/feature launch, compare cohorts pre- and post-drop, run hold-out or rollback tests to isolate factors.
Quick Answer: Evaluates systematic product analytics for diagnosing a sudden YouTube usage decline. Strong answers validate instrumentation, decompose DAU and watch time, segment by platform and cohort, inspect rollout and incident data, and confirm root causes with experiments or causal analyses.
Diagnose YouTube Usage Decline: Key Metrics and Segmentation
YouTube observes a sudden decline in daily active users and total watch time across the platform. You need to diagnose the root cause systematically.
Constraints & Assumptions
Treat the first step as triage: verify the drop is real before proposing product changes.
Assume access to event logs, playback logs, experiment and rollout logs, content supply metrics, app versions, device/OS data, geography, and monitoring dashboards.
Distinguish breadth decline, such as fewer active users, from depth decline, such as less watch time per active user.
Use segmentation and causal checks to move from symptoms to root cause.
Clarifying Questions to Ask Guidance
When did the decline start, and was it sudden or gradual?
Is the drop in DAU, watch time per user, session starts, playback success, or all of them?
Is the issue global or concentrated in certain regions, platforms, app versions, or traffic sources?
Were there recent launches, experiments, infrastructure incidents, policy changes, or external events?
Part 1 - Validate and Decompose the Metrics
Which engagement and funnel metrics would you inspect first?
What This Part Should Cover Guidance
Data quality checks, logging parity, late-arriving events, client/server discrepancies, and incident dashboards.
DAU, sessions per DAU, watch time per DAU, plays per session, playback starts, completion, searches, recommendations, subscriptions, and retention.
Funnel decomposition from app open to impression, click, playback start, watch time, and return visit.
Part 2 - Segment to Localize the Issue
How would you segment users and traffic to find where the decline is coming from?
What This Part Should Cover Guidance
Segments by geography, time zone, device, OS, app version, logged-in status, new versus returning users, traffic source, content category, creator supply, and experiment exposure.
Cohort and seasonality comparisons to isolate unusual changes.
Contribution analysis showing which segment explains the aggregate decline.
Part 3 - Confirm Root Causes
What analyses or experiments would you run to confirm the cause?
What This Part Should Cover Guidance
Rollout correlation, rollback or holdout analysis, difference-in-differences, causal impact, or A/B experiment readouts.
Checks for recommendation quality, content supply shocks, playback failures, latency, search issues, notification changes, and external outages.
A decision tree for immediate mitigation versus longer-term follow-up.
What a Strong Answer Covers Guidance
A strong answer validates instrumentation, decomposes the usage drop, localizes impact through segmentation, forms testable hypotheses, and uses rollout or experiment evidence to confirm root cause before recommending fixes.
Follow-up Questions Guidance
What if DAU is stable but watch time falls?
How would you handle a decline caused by one app version?
How would you separate seasonality from a product regression?