Gmail Health Metrics and the KPIs to Defend Against Faster, Cleaner Email Rivals

Gmail has been around for many years and leads the email market. Recently a wave of newer email products, Superhuman and Hey among them, has arrived, and most of them pitch themselves as giving users a faster, cleaner or more user-centric experience than the incumbent. Answer the two parts below. ### Clarifying Questions - Should the answer cover consumer Gmail accounts, paying business customers on Google Workspace, or both? - If a person keeps a Gmail address but reads and sends mail through a different email app, does that count as a loss for Gmail? - What would losing the top spot mean here: fewer active users, less of users' time and attention, or fewer paying business customers? ### Part 1 — Metrics an email service like Gmail tracks Which metrics do you think an email provider such as Gmail measures to understand how its product is doing? ```hint Follow a user and a message Think about a user's life cycle (signing up, coming back, reading, replying, organizing, searching) and about what the service has to get right for every single message, such as delivering it, filtering it and showing it quickly. ``` #### What This Part Should Cover - A goal for Gmail and a small set of top-level metrics tied to it - Life-cycle metrics from sign-up to retention, broken out by consumer and business users - Quality metrics specific to email: spam filtering mistakes in both directions, delivery and load speed, account security - Business metrics such as paid storage and business seats, kept separate from user-value metrics ### Part 2 — Metrics to defend the lead The newcomers say they offer a better experience than Gmail. If Gmail is at risk of losing its leading position, which metrics should it watch closely and work to improve? ```hint Make each claim measurable Take each word the rivals use (faster, cleaner, user-centric) and ask what a user would actually notice and how you would measure it. Then ask which users would leave first and what early signs they would show. ``` #### What This Part Should Cover - Each competitor claim turned into a measurable experience metric with a clear definition - Leading indicators that a valuable segment is drifting away, gathered within privacy limits - A short prioritized list of metrics to improve, with how the team would act on them - Guardrails so that gains on one experience metric do not come at the cost of spam protection, security or revenue ### What a Strong Answer Covers - A structure that separates a north-star metric, supporting metrics and guardrails instead of one long unranked list - Segmentation by consumer versus business customers and by heavy versus light email users - Awareness that more time spent in an inbox is not automatically better for an email product - Respect for user privacy when measuring behavior and competition ### Follow-up Questions - After a launch that helps people get through their inbox faster, time spent in Gmail falls. How do you tell whether that is good or bad? - Conversations between coworkers keep moving from email to chat tools. How would that change which Gmail metrics you trust? - How would you set a target for inbox load time, and how would you check that the improvement actually matters to users?