Scenario: LinkedIn is rolling out an upgraded job recommendation algorithm. Question 1: Which key offline and online metrics would you track to judge success? Question 2: How would you design an A/B test to compare the new model against the current one while mitigating network effects? Question 3: How would you determine required sample size, exposure, and test duration? Question 4: If performance differs across user segments, how would you diagnose root causes and iterate?

This question evaluates skills in experimentation design, online and offline metrics for recommender systems, causal inference for A/B testing, and diagnostic analysis in a two-sided marketplace.

How do I approach Analytics & Experimentation interview questions?

Analytics & Experimentation questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master analytics & experimentation interviews.

What difficulty level is this interview question?

This is a hard difficulty Analytics & Experimentation question, commonly asked during Onsite rounds at LinkedIn.

What role is this question designed for?

This question is commonly asked for Data Scientist candidates at LinkedIn during technical interviews.

Evaluate 'Job You May Be Interested In' Recommender

LinkedIn Jobs Recommender Upgrade — Metrics, Experiment Design, Powering, and Diagnostics

Context

LinkedIn is upgrading the algorithm that recommends jobs to members across surfaces such as the Jobs tab, homepage modules, and notifications. This is a two‑sided marketplace: member outcomes (finding relevant jobs, applying) must improve without harming employer outcomes (quality and distribution of applications). Assume we can log impressions, positions, clicks, saves, apply starts/completions, response/latency, and eligibility sets per request.

Questions

Which key offline and online metrics would you track to judge success?
How would you design an A/B test to compare the new model against the current one while mitigating network effects?
How would you determine required sample size, exposure, and test duration?
If performance differs across user segments, how would you diagnose root causes and iterate?

LinkedIn Jobs Recommender Upgrade — Metrics, Experiment Design, Powering, and Diagnostics

Context

Questions

Which key offline and online metrics would you track to judge success?
How would you design an A/B test to compare the new model against the current one while mitigating network effects?
How would you determine required sample size, exposure, and test duration?
If performance differs across user segments, how would you diagnose root causes and iterate?

Evaluate 'Job You May Be Interested In' Recommender

Quick Overview

LinkedIn Jobs Recommender Upgrade — Metrics, Experiment Design, Powering, and Diagnostics

Context

Questions

Solution

Comments (0)

Evaluate 'Job You May Be Interested In' Recommender

Quick Overview

LinkedIn Jobs Recommender Upgrade — Metrics, Experiment Design, Powering, and Diagnostics

Context

Questions

Solution

Comments (0)