PracHub
QuestionsPremiumLearningGuidesCheatsheetNEWCoaches
|Home/Analytics & Experimentation/Instacart

How to debug an apparent D14 retention drop

Last updated: Mar 29, 2026

Quick Overview

This question evaluates competency in cohort-based retention analysis, understanding metric maturity and right-censoring, performing data quality and definition checks, and localizing real declines across segments, releases, or funnel changes.

  • easy
  • Instacart
  • Analytics & Experimentation
  • Data Scientist

How to debug an apparent D14 retention drop

Company: Instacart

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: easy

Interview Round: Technical Screen

## Scenario A dashboard shows **D14 retention** (users retained on day 14 after signup/first activity). In the last week, the chart shows a **sharp decline**. Assume retention is computed as a cohort metric: - Users are assigned to a cohort by **first activity date**. - D14 retention for a cohort is measured 14 days later. ## Task Explain how you would determine whether this decline reflects a real product issue or a **false alarm**. ### Requirements Include: - How metric “maturity” / delayed observation can create misleading recent-week dips. - What plots/tables you would inspect (cohort table, maturity curve, right-censoring). - Data quality checks and definition checks. - If it’s real, how you would localize the cause (segments, releases, funnel changes).

Quick Answer: This question evaluates competency in cohort-based retention analysis, understanding metric maturity and right-censoring, performing data quality and definition checks, and localizing real declines across segments, releases, or funnel changes.

Related Interview Questions

  • How would you investigate a metric decline? - Instacart (easy)
  • Should you roll out if NSM decreases? - Instacart (easy)
  • Design a pricing experiment with network effects - Instacart (easy)
  • Investigate marketplace metrics and experiment rollout - Instacart (easy)
  • Recommend and validate a budget allocation strategy - Instacart (Medium)
Instacart logo
Instacart
Feb 6, 2026, 12:33 PM
Data Scientist
Technical Screen
Analytics & Experimentation
3
0

Scenario

A dashboard shows D14 retention (users retained on day 14 after signup/first activity). In the last week, the chart shows a sharp decline.

Assume retention is computed as a cohort metric:

  • Users are assigned to a cohort by first activity date .
  • D14 retention for a cohort is measured 14 days later.

Task

Explain how you would determine whether this decline reflects a real product issue or a false alarm.

Requirements

Include:

  • How metric “maturity” / delayed observation can create misleading recent-week dips.
  • What plots/tables you would inspect (cohort table, maturity curve, right-censoring).
  • Data quality checks and definition checks.
  • If it’s real, how you would localize the cause (segments, releases, funnel changes).

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Analytics & Experimentation•More Instacart•More Data Scientist•Instacart Data Scientist•Instacart Analytics & Experimentation•Data Scientist Analytics & Experimentation
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.