Identify User Interest in Group Video Calls Using Data
Overview
This question evaluates a candidate's competency in product analytics, experimental design, causal inference, user segmentation, modeling for launch decisions, and accounting for network effects and metric definition.
Meta
Jul 12, 2025, 6:59 PM
Data Scientist
Technical Screen
Analytics & Experimentation
143
0
Group Video-Calling Feature Analysis
Context
You are asked to design, launch, and analyze a new group video-calling feature for a large social/messaging app. You currently only have historical one-to-one (1:1) video call data. Address the business context, data and modeling needs, participant limits, post-launch metrics, and an experiment design that accounts for network effects.
Questions
-
Business Goal
- What is the primary business goal of launching group video calls?
-
User Identification and Data Requirements
- How would you identify which users are most interested in group video calls using 1:1 call history?
- What additional data would improve the analysis?
-
Participant Limit Analysis
- Should the product impose a participant limit (cap)?
- How would you determine the optimal cap?
-
Success Metrics and Measurement
- Which success metrics would you track after launch?
- How would you measure cannibalization versus incremental engagement?
-
Experiment Design (Bonus)
- How would you design an experiment that accounts for network effects?
Important Consideration
- Hint: Explicitly consider network effects when designing the experiment.
Solution
Login required
Show