How do I approach Analytics & Experimentation interview questions?

Analytics & Experimentation questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master analytics & experimentation interviews.

What difficulty level is this interview question?

This is a medium difficulty Analytics & Experimentation question, commonly asked during Technical Screen rounds at Meta.

What role is this question designed for?

This question is commonly asked for Data Scientist candidates at Meta during technical interviews.

Assessing whether a new metric A is meaningful for News Feed

Quick Overview

This question evaluates a data scientist's ability to validate a proposed proxy metric for product goals, testing skills in metrics validation, predictive reasoning, experiment design, and instrumentation within the Analytics & Experimentation domain.

Evaluating a Proposed Proxy Metric for News Feed

Context

A partner team proposes a new proxy metric, metric A, intended to capture "meaningful interactions" in News Feed. Before adopting it, you need to evaluate whether it is a good proxy for the underlying product goals (e.g., user value, long-term engagement, satisfaction).

Task

Assess whether metric A is meaningful for News Feed along three dimensions:

Predictive power: Does A reliably predict the outcomes we care about, ahead of time?
Actionability: Can the product/ranking system move A in the right direction, and will doing so improve the true goals without perverse incentives?
Collection cost: What is the engineering, infra, latency, privacy, and experimentation cost to log and use A at scale?

Provide a plan, tests, and decision criteria for each dimension.

Evaluating a Proposed Proxy Metric for News Feed

Context

Task

Assess whether metric A is meaningful for News Feed along three dimensions:

Predictive power: Does A reliably predict the outcomes we care about, ahead of time?
Actionability: Can the product/ranking system move A in the right direction, and will doing so improve the true goals without perverse incentives?
Collection cost: What is the engineering, infra, latency, privacy, and experimentation cost to log and use A at scale?

Provide a plan, tests, and decision criteria for each dimension.

Assessing whether a new metric A is meaningful for News Feed

Quick Overview

Evaluating a Proposed Proxy Metric for News Feed

Context

Task

Solution

Submit Your Answer to Earn 20XP

Assessing whether a new metric A is meaningful for News Feed

Quick Overview

Evaluating a Proposed Proxy Metric for News Feed

Context

Task

Solution

Submit Your Answer to Earn 20XP