##### Scenario Considering launching a group video feature on a social media platform. ##### Question How would you assess whether introducing a group video feature is successful? Discuss key metrics, potential A/B experiment design, success criteria, and trade-offs. ##### Hints Think engagement, retention, frequency, call quality metrics, experiment setup, guardrails.

This question evaluates a data scientist's competency in product analytics, experiment design, causal inference under network effects, metric selection (primary, secondary, guardrails), and interpretation of quantitative go/no-go criteria.

How do I approach Analytics & Experimentation interview questions?

Analytics & Experimentation questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master analytics & experimentation interviews.

What difficulty level is this interview question?

This is a medium difficulty Analytics & Experimentation question, commonly asked during Technical Screen rounds at Meta.

What role is this question designed for?

This question is commonly asked for Data Scientist candidates at Meta during technical interviews.

Evaluate Success of Group Video Feature with Key Metrics

Evaluate the Success of a New Group Video Feature

Context

You are assessing the launch of a Group Video feature on a social media platform. The feature allows multiple users to participate in the same video call. You need to determine whether the feature is successful.

Assume:

The platform already supports 1:1 video calls and messaging.
Group calls can be created and joined via invites.
There is risk of interference (network effects) because users call each other.

Task

Discuss the following:

Key metrics (primary, secondary, guardrails) to evaluate success.
An A/B experiment design that accounts for network effects and measurement.
Clear, quantitative success criteria (go/no-go) and how you’d interpret results.
Major trade-offs and risks (product, measurement, and operational) and how you’d mitigate them.

Evaluate the Success of a New Group Video Feature

Context

Assume:

The platform already supports 1:1 video calls and messaging.
Group calls can be created and joined via invites.
There is risk of interference (network effects) because users call each other.

Task

Discuss the following:

Key metrics (primary, secondary, guardrails) to evaluate success.
An A/B experiment design that accounts for network effects and measurement.
Clear, quantitative success criteria (go/no-go) and how you’d interpret results.
Major trade-offs and risks (product, measurement, and operational) and how you’d mitigate them.

Evaluate Success of Group Video Feature with Key Metrics

Quick Overview

Evaluate the Success of a New Group Video Feature

Context

Task

Solution

Submit Your Answer to Earn 20XP

Evaluate Success of Group Video Feature with Key Metrics

Quick Overview

Evaluate the Success of a New Group Video Feature

Context

Task

Solution

Submit Your Answer to Earn 20XP