PracHub
QuestionsPremiumLearningGuidesInterview PrepNEWCoaches
|Home/Machine Learning/Meta

Design and evaluate an ads ranking algorithm

Last updated: Mar 29, 2026

Quick Overview

This question evaluates a candidate's proficiency in designing and evaluating production-scale ads ranking systems within Machine Learning, covering ranking architecture, predictive modeling, offline and online evaluation, and operational monitoring.

  • easy
  • Meta
  • Machine Learning
  • Analytics Engineer

Design and evaluate an ads ranking algorithm

Company: Meta

Role: Analytics Engineer

Category: Machine Learning

Difficulty: easy

Interview Round: Onsite

## Ads ranking algorithm (sponsored content) You are designing an algorithm to rank ads in a feed/search results page. ### Requirements - Objective: maximize long-term platform value (e.g., revenue) while maintaining good user experience. - Constraints: low latency, advertisers have budgets/bids, user experience guardrails, and potential policy/fairness constraints. ### Questions 1. Describe a **ranking architecture** (candidate generation → scoring → final ranking) and what models you would use. 2. What would you predict (e.g., pCTR, pCVR, expected revenue), and how would you combine predictions with bids/budgets? 3. How would you handle common issues: position bias, calibration, cold start for new ads, and feedback loops? 4. Propose an **offline evaluation** plan (metrics + validation strategy) and an **online testing** plan. 5. List key monitoring metrics after launch and how you’d detect regressions or fraud/gaming.

Quick Answer: This question evaluates a candidate's proficiency in designing and evaluating production-scale ads ranking systems within Machine Learning, covering ranking architecture, predictive modeling, offline and online evaluation, and operational monitoring.

Related Interview Questions

  • How would you design a Shop Ads ranking algorithm? - Meta (easy)
  • Derive Linear Regression Solution - Meta (medium)
  • Explain key ML metrics and techniques - Meta (medium)
  • Design an ad recommendation ranking approach - Meta (easy)
  • Build harmful-content text classifier - Meta (medium)
Meta logo
Meta
Feb 15, 2026, 9:40 PM
Analytics Engineer
Onsite
Machine Learning
5
0
Loading...

Ads ranking algorithm (sponsored content)

You are designing an algorithm to rank ads in a feed/search results page.

Requirements

  • Objective: maximize long-term platform value (e.g., revenue) while maintaining good user experience.
  • Constraints: low latency, advertisers have budgets/bids, user experience guardrails, and potential policy/fairness constraints.

Questions

  1. Describe a ranking architecture (candidate generation → scoring → final ranking) and what models you would use.
  2. What would you predict (e.g., pCTR, pCVR, expected revenue), and how would you combine predictions with bids/budgets?
  3. How would you handle common issues: position bias, calibration, cold start for new ads, and feedback loops?
  4. Propose an offline evaluation plan (metrics + validation strategy) and an online testing plan.
  5. List key monitoring metrics after launch and how you’d detect regressions or fraud/gaming.

Solution

Show

Comments (0)

Sign in to leave a comment

Loading comments...

Browse More Questions

More Machine Learning•More Meta•More Analytics Engineer•Meta Analytics Engineer•Meta Machine Learning•Analytics Engineer Machine Learning
PracHub

Master your tech interviews with 7,500+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.