Diagnosing and Fixing a Breakdown in New-User Sign-Ups

Quick Overview

A product manager diagnosis question about a sign-up flow where new users have stopped signing up. It tests confirming the drop is real, locating it by funnel step and user segment, ordering internal and external hypotheses, and planning mitigation, recovery checks and monitoring.

Diagnosing and Fixing a Breakdown in New-User Sign-Ups

Company: Meta

Role: Product Manager

Category: Analytics & Experimentation

Difficulty: medium

Interview Round: Other

Something has gone wrong in your product's sign-up flow: new users are no longer signing up. You are the product manager. Explain how you would work out what is happening and what you would do about it. ```hint Confirm before you diagnose Before generating product theories, check that the drop is real, then find the exact step in the flow and the group of users where people now stop. ``` ### Clarifying Questions - Has sign-up stopped entirely, or has it fallen steeply with some users still completing it? - Did the change happen suddenly on a specific day, or build up over weeks? - Is the problem visible on every platform, sign-up method and country, or concentrated in one of them? - Are visits to the sign-up entry point and activity among existing users normal, or have they moved too? ### What a Strong Answer Covers - A check that the drop is real and not a tracking, pipeline or metric-definition change - Localization of the drop to a step in the funnel and to segments such as platform, app version, sign-up method and country - Internal and external hypotheses, checked in an order that tests the cheapest and most likely causes first - Immediate mitigation alongside root-cause work, including who is told and what is paused - How recovery is confirmed and how a repeat would be caught sooner ### Follow-up Questions - Suppose the drop is limited to one mobile platform and began the day a new app version started rolling out. What do you do in the first hour? - Sign-ups are down, yet the number of new people using the product is flat. What could explain that, and how does it change your response? - What monitoring would catch a break like this within hours instead of days?

Overview: A product manager diagnosis question about a sign-up flow where new users have stopped signing up. It tests confirming the drop is real, locating it by funnel step and user segment, ordering internal and external hypotheses, and planning mitigation, recovery checks and monitoring.

Meta logo
Meta
Feb 4, 2024
mediumProduct ManagerOtherAnalytics & Experimentation
0
0

Something has gone wrong in your product's sign-up flow: new users are no longer signing up. You are the product manager. Explain how you would work out what is happening and what you would do about it.

Clarifying Questions Guidance

  • Has sign-up stopped entirely, or has it fallen steeply with some users still completing it?
  • Did the change happen suddenly on a specific day, or build up over weeks?
  • Is the problem visible on every platform, sign-up method and country, or concentrated in one of them?
  • Are visits to the sign-up entry point and activity among existing users normal, or have they moved too?

What a Strong Answer Covers Guidance

  • A check that the drop is real and not a tracking, pipeline or metric-definition change
  • Localization of the drop to a step in the funnel and to segments such as platform, app version, sign-up method and country
  • Internal and external hypotheses, checked in an order that tests the cheapest and most likely causes first
  • Immediate mitigation alongside root-cause work, including who is told and what is paused
  • How recovery is confirmed and how a repeat would be caught sooner

Follow-up Questions Guidance

  • Suppose the drop is limited to one mobile platform and began the day a new app version started rolling out. What do you do in the first hour?
  • Sign-ups are down, yet the number of new people using the product is flat. What could explain that, and how does it change your response?
  • What monitoring would catch a break like this within hours instead of days?