Find A Low-Quality Annotator From Label Data
Company: Meta
Role: Machine Learning Engineer
Category: Data Manipulation (SQL/Python)
Difficulty: hard
Interview Round: Onsite
Quick Answer: Practice a pandas-style data analysis prompt for identifying a low-quality annotator from label data. The question emphasizes cleaning, agreement or ground-truth comparisons, sparse annotator handling, class imbalance, and AI product rollout metrics.