Metrics framework for Facebook's content-sharing feature

Quick Overview

A product manager metrics question about the Share feature on Facebook: define what sharing is for, choose one primary measure of success, and support it with funnel, recipient-side and guardrail metrics. It tests metric definition, the trade-off between share volume and real value, and awareness of the harms that resharing can spread.

Metrics framework for Facebook's content-sharing feature

Company: Meta

Role: Product Manager

Category: Analytics & Experimentation

Difficulty: medium

Interview Round: Other

You own the Share feature on Facebook as its product manager. Share lets people pass content they come across on Facebook along to other people. Explain how you would tell whether Share is succeeding: what the feature is for, which single metric you would treat as the main measure of success, what supports it, and what would tell you the feature is causing harm. ```hint Follow one share Trace a single share from the moment someone taps Share until the content reaches the people it was sent to, and note who gets value at each step and where the experience could break down. ``` ### Clarifying Questions - Which destinations count as a share: reposting to one's own profile or a group, posting to a Page, sending in Messenger, and handing a link to an app outside Facebook? - Is this a standing health review of a mature feature, or are we judging a specific change to it? - Should success be judged for the person sharing, the people receiving the content, the creator whose post spreads, or all three? - Is the spread of false or harmful content through reshares part of this team's scorecard, or owned only by an integrity team? ### What a Strong Answer Covers - A stated purpose for Share, the parties it serves, and how it ties to Facebook's mission and business - One primary success metric, precisely defined (unit, time window, what counts), with the reasoning for choosing it over the obvious alternatives - Supporting metrics along the share funnel and on the recipient side, broken down by destination, content type and user segment - Guardrails for the harms sharing can amplify and for effects on the rest of Facebook - How the metrics would be read in practice: baselines, decomposing a change in the primary metric, and spotting metrics that can be gamed ### Follow-up Questions - After a redesign of the share sheet, shares go up but the people receiving them react and reply less. How would you judge the change? - How would you measure success for shares sent to apps outside Facebook, where most of what happens next is invisible to you? - One type of content starts spreading through reshares faster than anything else, and some of it is later found to be false. Which of your metrics would catch this first, and what would you trade off to slow it?

Overview: A product manager metrics question about the Share feature on Facebook: define what sharing is for, choose one primary measure of success, and support it with funnel, recipient-side and guardrail metrics. It tests metric definition, the trade-off between share volume and real value, and awareness of the harms that resharing can spread.

Meta logo
Meta
Mar 28, 2024
mediumProduct ManagerOtherAnalytics & Experimentation
0
0

You own the Share feature on Facebook as its product manager. Share lets people pass content they come across on Facebook along to other people. Explain how you would tell whether Share is succeeding: what the feature is for, which single metric you would treat as the main measure of success, what supports it, and what would tell you the feature is causing harm.

Clarifying Questions Guidance

  • Which destinations count as a share: reposting to one's own profile or a group, posting to a Page, sending in Messenger, and handing a link to an app outside Facebook?
  • Is this a standing health review of a mature feature, or are we judging a specific change to it?
  • Should success be judged for the person sharing, the people receiving the content, the creator whose post spreads, or all three?
  • Is the spread of false or harmful content through reshares part of this team's scorecard, or owned only by an integrity team?

What a Strong Answer Covers Guidance

  • A stated purpose for Share, the parties it serves, and how it ties to Facebook's mission and business
  • One primary success metric, precisely defined (unit, time window, what counts), with the reasoning for choosing it over the obvious alternatives
  • Supporting metrics along the share funnel and on the recipient side, broken down by destination, content type and user segment
  • Guardrails for the harms sharing can amplify and for effects on the rest of Facebook
  • How the metrics would be read in practice: baselines, decomposing a change in the primary metric, and spotting metrics that can be gamed

Follow-up Questions Guidance

  • After a redesign of the share sheet, shares go up but the people receiving them react and reply less. How would you judge the change?
  • How would you measure success for shares sent to apps outside Facebook, where most of what happens next is invisible to you?
  • One type of content starts spreading through reshares faster than anything else, and some of it is later found to be false. Which of your metrics would catch this first, and what would you trade off to slow it?