Evaluating the Facebook ‘Memory’ feature

Quick Overview

Evaluates Facebook Memories feature performance beyond click-through rate and surface-level engagement. Strong answers measure incremental engagement, retention, cannibalization, quality guardrails, frequency caps, sensitive-content handling, and launch criteria.

Evaluating the Facebook ‘Memory’ feature

Company: Meta

Role: Data Scientist

Category: Analytics & Experimentation

Difficulty: medium

Interview Round: Technical Screen

Scenario: The Memories feature resurfaces old posts to spark nostalgia and engagement. Recent data shows mixed click‑through rates and questions about whether it inflates time‑spent or simply reshuffles attention. You must propose an evaluation framework, decide acceptable CTR thresholds, and ensure content is not resurfaced too frequently. ​ Question 1: Outline a framework to evaluate the performance of the Facebook Memories feature. (Hint: retention, depth of interaction, share rate) Question 2: Is a 20 % click‑through rate acceptable for Memories? Explain how you would benchmark it. (Hint: industry norms, impression volume, user intent) Question 3: Is total time‑spent a good metric for Memories’ impact? Why or why not? (Hint: attribution challenges, alternative metrics) Question 4: After resurfacing a 2019 post in 2020, how would you prevent it appearing again in 2021? (Hint: deduping strategy, cool‑down windows)

Quick Answer: Evaluates Facebook Memories feature performance beyond click-through rate and surface-level engagement. Strong answers measure incremental engagement, retention, cannibalization, quality guardrails, frequency caps, sensitive-content handling, and launch criteria.

|Home/Analytics & Experimentation/Meta
Meta logo
Meta
Jul 12, 2025, 6:59 PM
mediumData ScientistTechnical ScreenAnalytics & Experimentation
95
0

Evaluating the Facebook Memories Feature

You are asked to assess whether the Memories feature, which resurfaces users' past posts, delivers real user value without simply reshuffling attention from other content.

Design an evaluation plan, set acceptable CTR expectations, choose impact metrics, and avoid over-resurfacing the same content.

Constraints & Assumptions

  • Measure incremental value, not only clicks on Memories.
  • Include cannibalization and safety or emotional-harm guardrails.
  • Evaluate frequency and resurfacing policy.
  • Consider user intent and nostalgia value.

Clarifying Questions to Ask Guidance

  • Where are Memories surfaced: feed, notifications, stories, or dedicated tab?
  • What content types are eligible and what content is excluded?
  • What is the target user action: click, share, comment, save, or reconnect?
  • Are there controls for sensitive memories?

Part 1 - Evaluation Framework

How would you evaluate Memories performance?

What This Part Should Cover Guidance

  • Use user-level experiments or holdouts.
  • Track CTR, share rate, comments, meaningful interactions, retention, notification opt-outs, hides, reports, and user sentiment.
  • Measure cannibalization of feed, profile, and other surfaces.
  • Segment by user tenure, posting history, content type, and prior engagement.

Part 2 - CTR and Time Spent

Is a 20% CTR acceptable, and is total time spent a good metric?

What This Part Should Cover Guidance

  • Benchmark CTR against surface, intent, volume, and comparable modules.
  • Avoid judging CTR without impression quality and user value.
  • Treat time spent as ambiguous and supplement with quality, retention, survey, and action metrics.
  • Include confidence intervals and practical significance.

Part 3 - Frequency and Guardrails

How would you avoid over-resurfacing and protect quality?

What This Part Should Cover Guidance

  • Use frequency caps, recency rules, content-quality filters, sensitive-content exclusions, and user controls.
  • Monitor hides, negative feedback, opt-outs, and emotional-harm reports.
  • Test personalization of timing and content type.

Follow-up Questions Guidance

  • What if Memories increases shares but decreases feed engagement?
  • How would you handle bad or sensitive memories?
  • How would you estimate incremental retention from Memories?
Loading comments...