Smart Headset Launch Scorecard: Success Metrics, North Star and Guardrails
Company: Meta
Role: Product Manager
Category: Analytics & Experimentation
Difficulty: medium
Interview Round: Other
Facebook is getting ready to release a new headset that comes with smart capabilities. Lay out how you would decide whether the launch is a success: what the company is trying to achieve with it, which metrics you would track, which single metric matters most, and which signals would tell you something is going wrong.
```hint A sale is not the finish line
Consider what has to happen after someone buys the headset for the company's reasons for building it to pay off, and where along that path the smart capabilities are supposed to make a difference.
```
### Clarifying Questions
- What kind of headset is it (virtual or mixed reality, augmented-reality glasses, or audio headphones), and what do its smart capabilities include, such as a voice assistant, cameras or other sensors?
- What is the launch meant to achieve: profit on the hardware, growth of the app and developer ecosystem, or establishing a new platform even at a loss?
- Who are the target buyers (consumers, businesses, or both), and in which markets?
- Is this the first product of its kind, or a successor to an existing headset whose launch we can benchmark against?
### What a Strong Answer Covers
- A launch goal tied to why the company makes headsets, stated before any metric.
- A funnel from purchase through setup, early use and lasting habit to ecosystem spend, with metrics at each stage.
- One justified north-star metric, and why alternatives such as units sold or revenue fall short.
- Metrics specific to the smart capabilities, including whether their use relates to retention and how that could be tested.
- Guardrails on hardware quality, comfort and safety, privacy of cameras and microphones, and unit economics, judged against a baseline over defined time horizons.
### Follow-up Questions
- Sales beat the forecast, but four weeks later few of the headsets are still used weekly. How do you diagnose why?
- The hardware itself cannot be A/B tested. How would you estimate whether the smart capabilities cause people to keep using the headset?
- How would your metrics change if most buyers turned out to be businesses using the headset for employee training?
Overview: A product metrics question about judging whether a new Facebook headset with smart capabilities is succeeding after launch. It tests tying metrics to the launch goal, building a funnel from purchase to habitual use, choosing a north-star metric, and setting quality, safety and privacy guardrails.