Facebook Rooms group video: choosing a north-star metric, funnel metrics and guardrails

Treat Facebook Rooms as Meta's group video-calling feature: a person opens a room from Facebook or Messenger, shares it, and others join the live call. You are the product manager for Rooms, and leadership wants to know whether it is succeeding. Define how you would measure that: the purpose the metrics should reflect, the single north-star metric you would report, the supporting metrics that explain changes in it, and the guardrails that would warn you Rooms is causing harm elsewhere. ```hint Define a successful room first Before naming any metric, describe what has to happen for one room to count as a success for its host and for the people invited, then look for the steps where a room most often fails. ``` ### Clarifying Questions - Is Rooms newly launched, where adoption is the open question, or established, where repeat use and call quality matter more? - Do people who join from a link without signing in to a Facebook account count as users, and can their sessions be measured? - Should Rooms be judged on its own usage, or on what it adds to Meta overall, for example extra time people spend live with friends and Groups instead of in rival video apps? - Which entry points are in scope: Messenger, the Facebook feed, Groups and Events, or all of them? ### What a Strong Answer Covers - A clear purpose for Rooms, and the host and guest actions that show the purpose is being met - A precisely defined north-star metric based on rooms where people actually connected rather than rooms created, with the reason it beats the alternatives - Supporting metrics across the funnel (creation, sharing, joining, call quality, repeat hosting), segmented by entry point and room type - Guardrails specific to Rooms: uninvited or abusive joiners, call reliability, and calls merely shifted from other Meta calling features - How the metrics are read together, including a trade-off when two of them move in opposite directions ### Follow-up Questions - A new feed entry point sharply raises rooms created per day, but the share of rooms that anyone joins falls. Is the launch working? - How would you tell whether Rooms adds new group video time or only moves calls that would have happened in Messenger anyway? - Would you measure a room attached to a large Group or an Event differently from a room among a handful of friends? - Leadership asks you to set goals for Rooms for the next six months rather than only say how you would measure it. Which single primary goal would you choose, what time-bound targets would you commit to, and how would you check progress along the way?