Picking the primary metric and guardrails for posting on Facebook

Quick Overview

A PM metrics question on measuring the success of Facebook's Posts feature. It tests defining what success means for people who post and the friends who respond, mapping both journeys to metrics, choosing a primary metric and setting guardrails for quality and integrity.

Picking the primary metric and guardrails for posting on Facebook

Company: Meta

Role: Product Manager

Category: Analytics & Experimentation

Difficulty: medium

Interview Round: Other

Facebook Posts is the feature people use to share an update: text, often with photos, a video, a link, a location or tagged friends, published to their profile and shown in friends' feeds, where others can react, comment and share. As the product manager for Posts, how would you measure whether the feature is successful? ```hint Two sides of every post A post only works if one person creates it and others respond to it. Think about what success means for each side, and which number would show that both are happening. ``` ### Clarifying Questions - Does "Posts" mean only updates people publish to their own profile, or also posts in Groups, by Pages and in Marketplace listings? - Are we judging the feature as it works today, or a recent change to the composer? - Should I cover all platforms and countries, or one in particular? - Is success judged for the people who post, the friends who see the posts, Facebook's business, or a balance of the three? ### What a Strong Answer Covers - The purpose of Posts for the people who create them, the friends who respond and Meta, tied to its mission of connecting people. - The creation journey and the response journey, with metrics at each step. - One primary metric with a rationale, including how it avoids rewarding volume over quality. - Guardrails for integrity, engagement bait, regretted posts and shifts to other sharing surfaces, plus useful segments. ### Follow-up Questions - Original posts from individuals decline while reshares of other content rise. Is Posts still succeeding? - A ranking change raises comments per post, but fewer people post. How would you judge it? - How would your metrics change if the question were about the period right after Posts launched rather than today?

Overview: A PM metrics question on measuring the success of Facebook's Posts feature. It tests defining what success means for people who post and the friends who respond, mapping both journeys to metrics, choosing a primary metric and setting guardrails for quality and integrity.

Meta logo
Meta
Sep 10, 2024
mediumProduct ManagerOtherAnalytics & Experimentation
0
0

Facebook Posts is the feature people use to share an update: text, often with photos, a video, a link, a location or tagged friends, published to their profile and shown in friends' feeds, where others can react, comment and share. As the product manager for Posts, how would you measure whether the feature is successful?

Clarifying Questions Guidance

  • Does "Posts" mean only updates people publish to their own profile, or also posts in Groups, by Pages and in Marketplace listings?
  • Are we judging the feature as it works today, or a recent change to the composer?
  • Should I cover all platforms and countries, or one in particular?
  • Is success judged for the people who post, the friends who see the posts, Facebook's business, or a balance of the three?

What a Strong Answer Covers Guidance

  • The purpose of Posts for the people who create them, the friends who respond and Meta, tied to its mission of connecting people.
  • The creation journey and the response journey, with metrics at each step.
  • One primary metric with a rationale, including how it avoids rewarding volume over quality.
  • Guardrails for integrity, engagement bait, regretted posts and shifts to other sharing surfaces, plus useful segments.

Follow-up Questions Guidance

  • Original posts from individuals decline while reshares of other content rise. Is Posts still succeeding?
  • A ranking change raises comments per post, but fewer people post. How would you judge it?
  • How would your metrics change if the question were about the period right after Posts launched rather than today?