Choose ML metrics under asymmetric costs
Company: Meta
Role: Data Scientist
Category: Machine Learning
Difficulty: hard
Interview Round: Technical Screen
Quick Answer: This question evaluates a data scientist's competency in cost-sensitive binary classification, covering skills such as defining business cost matrices, threshold selection and probability calibration, handling extreme class imbalance, fairness assessment across segments, monitoring for drift and feedback loops, and designing experiments to measure long-term product impact. It is a machine learning domain question commonly asked to probe practical judgment about trade-offs between precision and recall, operational metrics, and product-level consequences, testing both conceptual understanding of decision theory and practical application to production ML.