PracHub
QuestionsPremiumCoachesLearningGuidesInterview Prep
|Home/Analytics & Experimentation/Meta

Design experiment for unconnected content in feed

Last updated: Mar 29, 2026

Quick Overview

This question evaluates a data scientist's competency in causal inference, observational analysis, metric design, and experiment engineering for personalization, specifically measuring and comparing the "socialness" of friend versus unconnected content.

  • hard
  • Meta
  • Analytics & Experimentation
  • Data Scientist

Design experiment for unconnected content in feed

Company: Meta

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: hard

Interview Round: Technical Screen

Part A — Validate that friends' content is more "social" than unconnected content in a personalized feed. Using impression- and interaction-level logs like feed_impressions(user_id, post_id, impression_ts) and interactions(user_id, post_id, type, interaction_ts), plus a friendships graph, design an analysis plan that: (i) defines a 'socialness' outcome at the impression level (e.g., a weighted action score per impression, follow/DM initiation within 7 days, or unique commenters); (ii) justifies and stress-tests action weights (like=1, comment=3, share=5) via sensitivity analysis and backtesting; (iii) controls for confounding from ranking/exposure (e.g., inverse propensity weighting or matched sampling using predicted exposure scores); (iv) specifies primary effect estimates (ATE and quantile effects overall and by cohort), statistical tests, CIs, and how you'll handle repeated measures per user. Part B — We are launching unconnected content into a feed that previously showed only friends. Define success and design an A/B experiment that minimizes network interference: specify unit of randomization (viewer-level vs cluster), exposure definition, ramp plan, sample-size/power target (include MDE assumptions), primary KPIs (e.g., per-impression socialness, viewer retention D+1, sessions/user), and guardrails (cannibalization of friends' impressions/engagement, creator follows, ads RPM/CTR, integrity metrics). Describe how you'll detect and mitigate spillover (e.g., two-sided markets, creator supply responses), novelty/learning effects, and how you would interpret conflicting metric movements. Include decision thresholds and a rollback/ship framework.

Quick Answer: This question evaluates a data scientist's competency in causal inference, observational analysis, metric design, and experiment engineering for personalization, specifically measuring and comparing the "socialness" of friend versus unconnected content.

Related Interview Questions

  • Measure scheduled posts feature success - Meta (medium)
  • Estimate ads ranking revenue impact - Meta (medium)
  • How should you evaluate unconnected content? - Meta (medium)
  • Should WhatsApp launch group calls? - Meta (medium)
  • How would you grow Meta products? - Meta (medium)
Meta logo
Meta
Oct 13, 2025, 9:49 PM
Data Scientist
Technical Screen
Analytics & Experimentation
2
0

Analytics & Experimentation Case: Socialness of Friends vs Unconnected Content

Context

You work on a personalized feed that shows posts from friends and unconnected creators. You have impression- and interaction-level logs:

  • feed_impressions(user_id, post_id, impression_ts, slot, session_id, device, locale, ranker_score, content_type, creator_id)
  • interactions(user_id, post_id, type, interaction_ts)
  • friendships(viewer_id, friend_id, edge_ts) indicating friendship ties at impression time

Assume you can join impressions to interactions and friendship status at the impression timestamp.

Part A — Observational Analysis Plan

Validate that content from friends is more "social" than content from unconnected creators in a personalized feed. Using the logs and the friendship graph, design an analysis that:

  1. Defines a per-impression "socialness" outcome. Examples include:
    • A weighted action score within a post-impression window.
    • Follow or DM initiation within 7 days.
    • Unique commenters on the post attributable to the viewer.
  2. Justifies and stress-tests action weights (e.g., like=1, comment=3, share=5) via sensitivity analysis and backtesting against long-term outcomes (e.g., retention, future sessions).
  3. Controls for confounding from ranking and exposure differences between friend and unconnected impressions (e.g., inverse propensity weighting using predicted exposure scores, matched sampling on slot/score/context).
  4. Specifies primary effect estimates (overall ATE and quantile effects), cohort cuts, statistical tests, confidence intervals, and how you will handle repeated measures per user and creator.

Part B — Experiment Design for Introducing Unconnected Content

You will launch unconnected content into a feed that previously showed only friends. Define success and design an A/B test that minimizes network interference. Specify:

  1. Unit of randomization (viewer-level vs. graph/geo clusters) and the exposure definition.
  2. Ramp plan and sample-size/power targets with explicit MDE assumptions.
  3. Primary KPIs (e.g., per-impression socialness, D+1 retention, sessions/user) and guardrails (e.g., cannibalization of friends' impressions/engagement, creator follows, ads RPM/CTR, integrity metrics).
  4. How you will detect and mitigate spillover/interference (two-sided creator–viewer market, creator supply responses), novelty/learning effects, and how to interpret conflicting metric movements.
  5. Decision thresholds and a rollback/ship framework.

Solution

Show

Submit Your Answer to Earn 20XP

Sign in to leave a comment

Loading comments...

Browse More Questions

More Analytics & Experimentation•More Meta•More Data Scientist•Meta Data Scientist•Meta Analytics & Experimentation•Data Scientist Analytics & Experimentation
PracHub

Master your tech interviews with 8,000+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.