Design a Revenue Ranking Platform
Company: Creditkarma
Role: Machine Learning Engineer
Category: ML System Design
Difficulty: medium
Interview Round: Onsite
Overview: This question evaluates a machine learning engineer's competency in designing production-scale recommendation and ranking systems that balance revenue optimization with user experience, regulatory compliance, and long-term trust, emphasizing funnel modeling, delayed and sparse conversion labels, negative sampling correction, system architecture, data infrastructure, large-scale serving, and operational lifecycle. It is commonly asked to assess both conceptual understanding of trade-offs in multi-stage funnel modeling and label censoring and practical application skills in scalable ML system design, including handling class imbalance, calibration, monitoring, and deployment in the ML system design domain.