This question evaluates competency in designing and operationalizing latency-sensitive machine learning systems, covering real-time feature engineering, training with delayed labels, class imbalance strategies, metric selection, deployment architecture, and post-deployment monitoring.
You need to build and operate a real-time system that flags potentially fraudulent subscription-payment transactions with sub-second latency. Historical labels come from chargebacks/refunds with a delay of weeks. Data includes transaction attributes, user/account metadata, device/network signals, and historical behavior.
Outline the end-to-end approach, covering:
Login required