Design a search-to-ads ranking pipeline
Quick Overview
This question evaluates knowledge of designing a low-latency search-plus-ads ranking pipeline and related competencies in retrieval, filtering, multi-stage ranking, ad auction mechanics, pacing/budget constraints, result mixing, experimentation, and monitoring.
Snapchat
Feb 11, 2026, 12:00 AM
Machine Learning Engineer
Onsite
System Design
2
0
Loading...
Prompt
Design a high-level search + ads ranking system for an app where a user issues a query and the product shows a mix of organic search results and sponsored ads.
Requirements
- Return results within a strict latency budget (assume ~200 ms end-to-end).
- Ensure good user experience while meeting monetization goals.
- Support experimentation (A/B tests) and continuous model iteration.
Discuss
- The main components of the request flow (retrieval, filtering, ranking, mixing).
- How ads ranking differs from organic ranking (auction/bids, pacing/budgets, policies).
- How you would mix ads and organic results and what constraints you would enforce.
- Key metrics to monitor and how you would debug regressions.
Solution
Show