PracHub
QuestionsPremiumLearningGuidesInterview PrepNEWCoaches
|Home/Analytics & Experimentation/Other

Find and fix metric drops systematically

Last updated: Mar 29, 2026

Quick Overview

This question evaluates a Data Scientist's ability to decompose key metrics, distinguish instrumentation issues from behavioral changes, and design validation experiments within the Analytics & Experimentation domain, testing both conceptual understanding and practical application.

  • medium
  • Other
  • Analytics & Experimentation
  • Data Scientist

Find and fix metric drops systematically

Company: Other

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: medium

Interview Round: Onsite

A social app’s weekly average likes per user is down year‑over‑year. 1) Decompose the metric arithmetically to enumerate mutually exclusive root causes (e.g., likes/user down with stable user count vs. stable likes with user count up due to low‑engagement new users). 2) Propose a step‑by‑step investigation plan that distinguishes technical issues from behavior changes and pinpoints problematic segments; include diagnostics you’d run first, decision thresholds for escalation, and an action plan for both a 'bad' underperforming segment and a 'good' overperforming segment to expand. 3) Specify how you’d validate root causes and fixes with experiments.

Quick Answer: This question evaluates a Data Scientist's ability to decompose key metrics, distinguish instrumentation issues from behavioral changes, and design validation experiments within the Analytics & Experimentation domain, testing both conceptual understanding and practical application.

Related Interview Questions

  • Design metrics resilient to data quality - Other (Medium)
  • Design and power an A/B on question mix - Other (medium)
  • Design an A/B test with guardrails - Other (hard)
  • Separate demand from supply for jeans - Other (medium)
  • Design an A/B test for a Celebrate reaction - Other (hard)
Other logo
Other
Oct 13, 2025, 9:49 PM
Data Scientist
Onsite
Analytics & Experimentation
1
0

Investigating a YoY Drop in Weekly Average Likes per User

Context

You are a Data Scientist evaluating a social app where the weekly average likes per user (LPU) has declined year over year (YoY). Assume you have access to instrumentation for both numerator and denominator, including events like: like_tap, like_write_success, like_counted, session_start, feed_impression (exposure), and DAU/WAU definitions.

Tasks

  1. Arithmetic decomposition: Decompose LPU into factors to enumerate mutually exclusive root causes of a YoY decline. Provide a factor tree and highlight cases like stable likes with user count up due to low-engagement new users.
  2. Investigation plan: Propose a step-by-step plan to distinguish technical issues from behavioral changes and to pinpoint problematic segments. Include:
    • Diagnostics you would run first
    • Decision thresholds for escalation
    • An action plan for both a "bad" underperforming segment to fix and a "good" overperforming segment to expand
  3. Validation: Specify how you would validate root causes and proposed fixes using experiments.

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Analytics & Experimentation•More Other•More Data Scientist•Other Data Scientist•Other Analytics & Experimentation•Data Scientist Analytics & Experimentation
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.