Defining Success for Facebook's Reactions: Purpose, Key Metric and Guardrails

Quick Overview

A product metrics question about Facebook's reactions feature: decide what the feature is meant to achieve and how to tell whether it is succeeding. It tests tying a feature to user and business value, choosing a primary metric that resists gaming, and adding supporting and guardrail metrics.

Defining Success for Facebook's Reactions: Purpose, Key Metric and Guardrails

Company: Meta

Role: Product Manager

Category: Analytics & Experimentation

Difficulty: medium

Interview Round: Other

Facebook lets people respond to a post with reactions such as Love, Haha or Angry rather than only a Like. How would you set a goal for this feature, and how would you measure progress toward it? ```hint Ask what reactions are for Before choosing any metric, write down what the feature does for the person reacting and for the person who posted; the goal should follow from that. ``` ### Clarifying Questions - Is the scope reactions on Facebook posts only, or also on comments, Messenger and other Meta apps? - Are we setting a goal for the feature as it works today, or for a planned change to it? - Should Like count as a reaction here, or only the more expressive options? - Over what period should the goal be set, such as a quarter or a year? ### What a Strong Answer Covers - The feature's purpose for the person reacting, the person who posted and the company, tied to its mission and business. - One primary metric that reflects that purpose, with the reason it captures value rather than raw volume. - Supporting metrics across adoption, depth of use and the effect on posters. - Guardrails for the ways the goal could be gamed or could hurt other parts of the product. - How the goal becomes a concrete target, and how a change's effect would be measured apart from other feed changes. ### Follow-up Questions - If reactions rise while comments fall, is that a win? How would you decide? - Should every reaction type count the same as a Like in feed ranking? What would you measure to decide? - How would you test a change to reactions when one person's reaction changes what their friends see?

Overview: A product metrics question about Facebook's reactions feature: decide what the feature is meant to achieve and how to tell whether it is succeeding. It tests tying a feature to user and business value, choosing a primary metric that resists gaming, and adding supporting and guardrail metrics.

Meta logo
Meta
Nov 27, 2023
mediumProduct ManagerOtherAnalytics & Experimentation
0
0

Facebook lets people respond to a post with reactions such as Love, Haha or Angry rather than only a Like. How would you set a goal for this feature, and how would you measure progress toward it?

Clarifying Questions Guidance

  • Is the scope reactions on Facebook posts only, or also on comments, Messenger and other Meta apps?
  • Are we setting a goal for the feature as it works today, or for a planned change to it?
  • Should Like count as a reaction here, or only the more expressive options?
  • Over what period should the goal be set, such as a quarter or a year?

What a Strong Answer Covers Guidance

  • The feature's purpose for the person reacting, the person who posted and the company, tied to its mission and business.
  • One primary metric that reflects that purpose, with the reason it captures value rather than raw volume.
  • Supporting metrics across adoption, depth of use and the effect on posters.
  • Guardrails for the ways the goal could be gamed or could hurt other parts of the product.
  • How the goal becomes a concrete target, and how a change's effect would be measured apart from other feed changes.

Follow-up Questions Guidance

  • If reactions rise while comments fall, is that a win? How would you decide?
  • Should every reaction type count the same as a Like in feed ranking? What would you measure to decide?
  • How would you test a change to reactions when one person's reaction changes what their friends see?