PracHub
QuestionsPremiumCoachesLearningGuidesInterview Prep
|Home/Machine Learning/Meta

Evaluate Product-Ranking Algorithm with Precision and Recall Metrics

Last updated: Mar 29, 2026

Quick Overview

This question evaluates competency in assessing product‑ranking models with emphasis on ranking metrics, precision and recall interpretations, experiment metric design, and the ability to map model outputs to user‑level funnels and business KPIs.

  • medium
  • Meta
  • Machine Learning
  • Data Scientist

Evaluate Product-Ranking Algorithm with Precision and Recall Metrics

Company: Meta

Role: Data Scientist

Category: Machine Learning

Difficulty: medium

Interview Round: Onsite

##### Scenario Instagram Shopping wants to improve its product-ranking algorithm. ##### Question Which offline and online metrics would you use to evaluate a ranking model for a shopping feed and why? Explain how precision and recall translate to this setting and how you would reconcile offline metrics with on-site business KPIs. ##### Hints Discuss NDCG, MAP, click-through, conversion lift and user-level funnels.

Quick Answer: This question evaluates competency in assessing product‑ranking models with emphasis on ranking metrics, precision and recall interpretations, experiment metric design, and the ability to map model outputs to user‑level funnels and business KPIs.

Related Interview Questions

  • Implement 1NN Embeddings and Forward Pass - Meta (hard)
  • Design and evaluate an ads ranking algorithm - Meta (easy)
  • How would you design a Shop Ads ranking algorithm? - Meta (easy)
  • Derive Linear Regression Solution - Meta (medium)
  • Explain key ML metrics and techniques - Meta (medium)
Meta logo
Meta
Aug 4, 2025, 10:55 AM
Data Scientist
Onsite
Machine Learning
3
0

Scenario

Instagram Shopping wants to improve its product‑ranking algorithm for the shopping feed. The goal is to select and order products for each user to maximize value (e.g., conversions/revenue) while maintaining a good user experience.

Task

  1. Propose offline metrics to evaluate a ranking model for a shopping feed and explain why they fit this use case.
  2. Propose online (experiment) metrics, including how you would structure user‑level funnels.
  3. Explain how precision and recall translate to ranking in this setting (including @K variants).
  4. Explain how you would reconcile offline metrics with on‑site business KPIs.

Hints (for scope)

  • Consider NDCG and MAP for offline ranking evaluation.
  • Consider click‑through, conversion lift, and funnels for online evaluation.

Solution

Show

Submit Your Answer to Earn 20XP

Sign in to leave a comment

Loading comments...

Browse More Questions

More Machine Learning•More Meta•More Data Scientist•Meta Data Scientist•Meta Machine Learning•Data Scientist Machine Learning
PracHub

Master your tech interviews with 8,000+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.