Evaluate WhatsApp Group Video Calling
Company: Meta
Role: Product Analyst
Category: Analytics & Experimentation
Difficulty: hard
Interview Round: Technical Screen
Meta is considering improvements to WhatsApp group video calling. The product team wants to understand whether users need this feature, how to increase the number of participants in each call, and how to evaluate the change with an A/B test.
Answer the following:
1. How would you determine whether users need or value group video calling?
2. What product levers could increase the number of participants in a group video call?
3. How would you design an A/B test for a change intended to increase group video call participation?
4. What success, guardrail, and diagnostic metrics would you track?
5. What trade-offs may exist among these metrics?
6. How would network effects affect experiment design and interpretation?
Overview: This question evaluates product analytics and experimentation competencies, including user need assessment, identification of product levers to drive engagement, A/B test design, metric selection, and reasoning about network effects, situated in the Analytics & Experimentation domain for a Product Analyst role.