Trust and Safety Plan for Launching Private Messaging on YouTube

Google wants YouTube to add messaging, so that people can hold private conversations inside YouTube instead of interacting only through public features such as comments and live chat. You are the product manager responsible for trust and safety on this launch. Walk through how you would approach building the feature so that it protects the people who use it, and explain what you would decide before, during and after launch. ```hint Start with reach, not with classifiers Many harms in private messaging depend on who is able to start a conversation with whom. Settle that for YouTube's mix of viewers, creators and younger users before choosing how to detect bad messages. ``` ### Clarifying Questions - Which conversations is the feature for: friends sharing videos with each other, viewers contacting creators, creators messaging their audience, or group chats around a channel? Each one is abused in different ways. - Will people under 18 be able to use it at launch, and in which countries does it launch first? - Will messages be end-to-end encrypted, or will YouTube be able to scan message content on its servers? - What business goal must the feature hit (more video sharing, closer creator-fan relationships, or retention), so that safety targets can be set against it? ### What a Strong Answer Covers - A threat model specific to private messaging on YouTube: grooming and sextortion of minors, scams that impersonate creators, spam and malicious links, harassment of creators and commenters, and illegal content - Safety built into the product: who can contact whom, defaults for teens, message requests, limits on links and media, and rate limits for new or low-trust accounts - Detection, user reporting, enforcement and appeals, and how the encryption decision changes what is possible - A phased rollout with safety gates, using metrics that weigh harm prevalence against legitimate use - Explicit trade-offs between privacy, safety, friction and growth ### Follow-up Questions - If leadership requires end-to-end encryption, what changes in your plan and what protection do you lose? - In the second week, accounts posing as a popular creator start messaging that creator's subscribers about a giveaway. What do you do in the first 48 hours, and what do you change permanently? - Which single metric would make you pause the rollout, and how would you set its threshold?