Is a messaging drop worth a sales gain? Weighing two diverging Facebook Shops metrics
Company: Meta
Role: Product Manager
Category: Product / Decision Making
Difficulty: medium
Interview Round: Other
You are the product manager for Facebook Shops. Weekly items sold have gone up, but over the same period the number of messages exchanged on Marketplace has gone down. How would you evaluate this trade-off, and what would you need to see to call it acceptable or not?
```hint What is a message for?
Before weighing one number against the other, list the jobs messages do for buyers and sellers, and ask which of those jobs you would be glad to see disappear.
```
### Clarifying Questions
- Did a specific launch on Shops or Marketplace, such as a new purchase flow or a ranking change, coincide with the shift, or did both metrics drift without a known cause?
- How large and how sudden are the two moves, and do they begin in the same week?
- Is the sales growth on business Shops listings, on individual sellers' Marketplace listings, or both, and are the lost messages on the same listings?
- Is messaging engagement a company goal in its own right here, or are messages valued only as a path to a sale?
### What a Strong Answer Covers
- Validating both metrics first: definitions, logging changes, seasonality, and whether the two moves are connected at all.
- A clear model of what messages do (pre-sale questions, negotiation, logistics, post-sale support, trust) and which of those jobs the drop removed.
- Segmentation by surface, category, buyer and seller type, and platform to locate the change and test competing hypotheses.
- A framework that weighs the short-term sales gain against long-term health: trust, buyer and seller retention, supply from individual sellers, and the value of messaging to the wider company.
- A concrete recommendation with guardrails and a plan to measure it causally, for example with a holdout.
### Follow-up Questions
- Your analysis shows the drop is mostly lost negotiation threads on used goods, while extra sales come mainly from new buyers on Shops listings. What do you recommend?
- How would you put a value on a lost message so it can be compared with an extra item sold?
- Leadership wants message volume restored without giving up the sales gain. What would you try first?
Overview: A Facebook Shops product manager sees weekly items sold rising while Marketplace message volume falls and must judge the trade-off. It tests metric validation, understanding what buyer-seller messages do, segmentation, hypothesis building, and weighing short-term sales against trust, retention and ecosystem health.