Determine User Need for In-App Video Call Feature
Company: Meta
Role: Data Scientist
Category: Analytics & Experimentation
Difficulty: hard
Interview Round: Technical Screen
##### Scenario
Company is considering launching a new in-app Video Call feature and has full historical user and call data available.
##### Question
Using the available data, how would you determine whether users need an in-app Video Call feature? 2. After launch, what success and guard-rail metrics would you track to evaluate feature quality? 3. Describe step-by-step how you would design and run an A/B test for this feature. 4. What are the engineering pros and cons of enforcing a hard hang-off (automatic call termination) policy, and how might that affect experiment results?
##### Hints
Think funnel, engagement, retention, power-user segmentation, experiment unit, sample size, run duration, and potential user experience trade-offs.
Quick Answer: This question evaluates a data scientist's competencies in product analytics, experimentation design, causal inference, metric definition and interpretation, segmentation, and assessing engineering trade-offs within the Analytics & Experimentation domain.