Design a Revenue Ranking Platform

Company: Creditkarma

Role: Machine Learning Engineer

Category: ML System Design

Difficulty: medium

Interview Round: Onsite

Quick Answer: This question evaluates a machine learning engineer's competency in designing production-scale recommendation and ranking systems that balance revenue optimization with user experience, regulatory compliance, and long-term trust, emphasizing funnel modeling, delayed and sparse conversion labels, negative sampling correction, system architecture, data infrastructure, large-scale serving, and operational lifecycle. It is commonly asked to assess both conceptual understanding of trade-offs in multi-stage funnel modeling and label censoring and practical application skills in scalable ML system design, including handling class imbalance, calibration, monitoring, and deployment in the ML system design domain.