Choose ML metrics under asymmetric costs

Quick Overview

This question evaluates a data scientist's competency in cost-sensitive binary classification, covering skills such as defining business cost matrices, threshold selection and probability calibration, handling extreme class imbalance, fairness assessment across segments, monitoring for drift and feedback loops, and designing experiments to measure long-term product impact. It is a machine learning domain question commonly asked to probe practical judgment about trade-offs between precision and recall, operational metrics, and product-level consequences, testing both conceptual understanding of decision theory and practical application to production ML.

Choose ML metrics under asymmetric costs

Company: Meta

Role: Data Scientist

Category: Machine Learning

Difficulty: hard

Interview Round: Technical Screen

Quick Answer: This question evaluates a data scientist's competency in cost-sensitive binary classification, covering skills such as defining business cost matrices, threshold selection and probability calibration, handling extreme class imbalance, fairness assessment across segments, monitoring for drift and feedback loops, and designing experiments to measure long-term product impact. It is a machine learning domain question commonly asked to probe practical judgment about trade-offs between precision and recall, operational metrics, and product-level consequences, testing both conceptual understanding of decision theory and practical application to production ML.

|Home/Machine Learning/Meta
Meta logo
Meta
Oct 13, 2025, 9:49 PM
hardData ScientistTechnical ScreenMachine Learning
4
0
Loading...
Loading comments...