##### Scenario Product team wants to understand whether friends' content drives more social engagement and how to evaluate the introduction of unconnected content in the Info Stream. ##### Question The hypothesis is that friends' content is more 'social' and drives stronger engagement than unconnected content. Describe how you would validate this hypothesis using the provided data. Unconnected content will be introduced to the Info Stream for the first time. Focusing on metrics and experimentation, explain how you would measure whether this launch is successful. ##### Hints Think of A/B tests, treatment vs control, primary engagement metrics (CTR, reactions), guardrails (retention, time spent), and ways to segment by relationship.

This question evaluates a data scientist's competency in experimental design, metric selection, and causal inference within the analytics and experimentation domain.

How do I approach Analytics & Experimentation interview questions?

Analytics & Experimentation questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master analytics & experimentation interviews.

What difficulty level is this interview question?

This is a medium difficulty Analytics & Experimentation question, commonly asked during Technical Screen rounds at Meta.

What role is this question designed for?

This question is commonly asked for Data Scientist candidates at Meta during technical interviews.

How to Validate Friends' Content Engagement Hypothesis?

Evaluating Friends' vs Unconnected Content in the Info Stream

Context

The Info Stream currently prioritizes content from a user's friends. The product team plans to introduce recommended ("unconnected") content from accounts the user does not follow for the first time. The goal is to understand whether friends' content is inherently more "social" (e.g., comments, replies, reshares) than unconnected content, and to measure whether launching unconnected content improves overall engagement without harming core health metrics.

Assumptions (for clarity):

Impressions, clicks, reactions, comments, shares, hides, and time-on-content are logged per post impression.
Each impression is labeled with relationship_type ∈ {friend, friend-of-friend, group, page, unconnected} and content_type (e.g., photo, video, link).
Ranking is stable aside from the unconnected insertion logic.

Question

Hypothesis: Friends' content is more "social" and drives stronger engagement than unconnected content. Describe how you would validate this hypothesis using the available data.
Unconnected content will be introduced to the Info Stream for the first time. Focusing on metrics and experimentation, explain how you would measure whether this launch is successful.

Hints: Consider A/B tests (treatment vs. control), primary engagement metrics (CTR, reactions), guardrails (retention, time spent), and segmentation by relationship.

Context

Assumptions (for clarity):

Impressions, clicks, reactions, comments, shares, hides, and time-on-content are logged per post impression.

Each impression is labeled with relationship_type ∈ {friend, friend-of-friend, group, page, unconnected} and content_type (e.g., photo, video, link).

Ranking is stable aside from the unconnected insertion logic.

Question

Hypothesis: Friends' content is more "social" and drives stronger engagement than unconnected content. Describe how you would validate this hypothesis using the available data.

Unconnected content will be introduced to the Info Stream for the first time. Focusing on metrics and experimentation, explain how you would measure whether this launch is successful.

Hints: Consider A/B tests (treatment vs. control), primary engagement metrics (CTR, reactions), guardrails (retention, time spent), and segmentation by relationship.

How to Validate Friends' Content Engagement Hypothesis?

Quick Overview

Evaluating Friends' vs Unconnected Content in the Info Stream

Context

Question

Solution

Submit Your Answer

How to Validate Friends' Content Engagement Hypothesis?

Quick Overview

Evaluating Friends' vs Unconnected Content in the Info Stream

Context

Question

Solution

Submit Your Answer