PracHub
QuestionsCoachesLearningGuidesInterview Prep
|Home/Machine Learning/Meta

Design and evaluate an ads ranking algorithm

Last updated: Mar 29, 2026

Quick Overview

This question evaluates a candidate's proficiency in designing and evaluating production-scale ads ranking systems within Machine Learning, covering ranking architecture, predictive modeling, offline and online evaluation, and operational monitoring.

  • easy
  • Meta
  • Machine Learning
  • Analytics Engineer

Design and evaluate an ads ranking algorithm

Company: Meta

Role: Analytics Engineer

Category: Machine Learning

Difficulty: easy

Interview Round: Onsite

## Ads ranking algorithm (sponsored content) You are designing an algorithm to rank ads in a feed/search results page. ### Requirements - Objective: maximize long-term platform value (e.g., revenue) while maintaining good user experience. - Constraints: low latency, advertisers have budgets/bids, user experience guardrails, and potential policy/fairness constraints. ### Questions 1. Describe a **ranking architecture** (candidate generation → scoring → final ranking) and what models you would use. 2. What would you predict (e.g., pCTR, pCVR, expected revenue), and how would you combine predictions with bids/budgets? 3. How would you handle common issues: position bias, calibration, cold start for new ads, and feedback loops? 4. Propose an **offline evaluation** plan (metrics + validation strategy) and an **online testing** plan. 5. List key monitoring metrics after launch and how you’d detect regressions or fraud/gaming.

Quick Answer: This question evaluates a candidate's proficiency in designing and evaluating production-scale ads ranking systems within Machine Learning, covering ranking architecture, predictive modeling, offline and online evaluation, and operational monitoring.

Related Interview Questions

  • Self-Attention: Implementation, Complexity, and Efficient Variants - Meta (hard)
  • Machine Learning Fundamentals: Optimizers, Scaling Laws, and Clustering - Meta (hard)
  • Implement 1NN Embeddings and Forward Pass - Meta (hard)
  • How would you design a Shop Ads ranking algorithm? - Meta (easy)
  • Derive Linear Regression Solution - Meta (medium)
|Home/Machine Learning/Meta

Design and evaluate an ads ranking algorithm

Meta logo
Meta
Feb 15, 2026, 9:40 PM
easyAnalytics EngineerOnsiteMachine Learning
8
0
Loading...

Ads ranking algorithm (sponsored content)

You are designing an algorithm to rank ads in a feed/search results page.

Requirements

  • Objective: maximize long-term platform value (e.g., revenue) while maintaining good user experience.
  • Constraints: low latency, advertisers have budgets/bids, user experience guardrails, and potential policy/fairness constraints.

Questions

  1. Describe a ranking architecture (candidate generation → scoring → final ranking) and what models you would use.
  2. What would you predict (e.g., pCTR, pCVR, expected revenue), and how would you combine predictions with bids/budgets?
  3. How would you handle common issues: position bias, calibration, cold start for new ads, and feedback loops?
  4. Propose an offline evaluation plan (metrics + validation strategy) and an online testing plan.
  5. List key monitoring metrics after launch and how you’d detect regressions or fraud/gaming.
Loading comments...

Browse More Questions

More Machine Learning•More Meta•More Analytics Engineer•Meta Analytics Engineer•Meta Machine Learning•Analytics Engineer Machine Learning

Write your answer

Your first approved answer each day earns 20 XP.

Sign in to write your answer.
PracHub

Master your tech interviews with 8,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • AI Coding Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.