Design and diagnose a regression pipeline

Quick Overview

This question evaluates a data scientist's ability to design and diagnose an end-to-end regression pipeline for zero-inflated, heavy-tailed targets, focusing on feature engineering for high-cardinality variables, handling multicollinearity, choosing appropriate loss/distribution and regularization, time-aware validation, uncertainty quantification, interpretability, and data leakage mitigation. It is commonly asked in the Machine Learning domain to test practical application alongside conceptual understanding of regression modeling, distributional assumptions, cross-validation strategies, and performance versus interpretability trade-offs.

Design and diagnose a regression pipeline

Company: Voleon Group

Role: Data Scientist

Category: Machine Learning

Difficulty: hard

Interview Round: Technical Screen

You must predict 90-day customer value CLV_90 (many zeros, heavy right tail) at the user level from features collected up to a cutoff date: continuous spends by marketing channel (Spend_SEM, Spend_Social, Spend_Display), recency/frequency/monetary (RFM), device, region, tenure, and dozens of sparse categorical campaign IDs (high cardinality), with known issues: strong multicollinearity among spend channels, heteroskedastic errors, and nonlinear effects. Design a regression pipeline that: (1) chooses an appropriate loss/distribution (e.g., log-link GLM, Tweedie, zero-inflated, quantile regression, or gradient-boosted regression) and justifies it; (2) performs feature processing (log1p transforms, standardization, rare-category bucketing, target encoding for high-cardinality features with K-fold out-of-fold encoding to avoid leakage); (3) handles multicollinearity and feature selection (ridge/lasso/elastic net): write the elastic net objective with α and λ, and explain when each penalty dominates; (4) sets up time-based nested cross-validation that prevents leakage from future signals and campaign overlap; (5) diagnoses model assumptions: detect and address heteroskedasticity (e.g., via White-robust SE, variance-stabilizing transforms, or modeling the mean-variance relationship in a Tweedie GLM), nonlinearity (splines/interactions), and influential outliers (Huber/Tukey loss); (6) provides calibrated 95% prediction intervals for CLV_90 (e.g., conformal prediction or bootstrap) and compares them to OLS analytic intervals; (7) interprets effects: compute and interpret standardized coefficients for a regularized linear model versus SHAP values for a tree model; (8) quantifies and mitigates data leakage risks (e.g., target leakage via post-cutoff features, look-ahead in target encoding); and (9) contrasts performance and interpretability trade-offs between a regularized linear model and a gradient-boosting model, specifying metrics that are robust to heavy tails (e.g., MAE, Quantile loss, MAPE with epsilon).

Quick Answer: This question evaluates a data scientist's ability to design and diagnose an end-to-end regression pipeline for zero-inflated, heavy-tailed targets, focusing on feature engineering for high-cardinality variables, handling multicollinearity, choosing appropriate loss/distribution and regularization, time-aware validation, uncertainty quantification, interpretability, and data leakage mitigation. It is commonly asked in the Machine Learning domain to test practical application alongside conceptual understanding of regression modeling, distributional assumptions, cross-validation strategies, and performance versus interpretability trade-offs.

|Home/Machine Learning/Voleon Group
Voleon Group logo
Voleon Group
Oct 13, 2025, 9:49 PM
hardData ScientistTechnical ScreenMachine Learning
54
0

CLV_90 Prediction Pipeline under Zero-Inflation, Heavy Tails, and Multicollinearity

Context

You need to predict 90-day customer value (CLV_90) at the user level. Targets have many zeros and a heavy right tail. Features are available up to a fixed cutoff date per user and include:

  • Continuous channel spends: Spend_SEM, Spend_Social, Spend_Display
  • RFM features (recency, frequency, monetary)
  • Device, region, tenure
  • Dozens of sparse, high-cardinality campaign IDs

Known issues:

  • Strong multicollinearity among spend channels
  • Heteroskedastic errors
  • Nonlinear effects

Task

Design an end-to-end regression pipeline that:

  1. Chooses and justifies an appropriate loss/distribution (e.g., log-link GLM, Tweedie, zero-inflated/hurdle, quantile regression, or gradient-boosted regression).
  2. Performs feature processing: log1p transforms, standardization, rare-category bucketing, and target encoding for high-cardinality features using K-fold out-of-fold encoding to avoid leakage.
  3. Handles multicollinearity and feature selection with ridge/lasso/elastic net. Write the elastic net objective with α and λ, and explain when each penalty dominates.
  4. Sets up time-based nested cross-validation that prevents leakage from future signals and campaign overlap.
  5. Diagnoses model assumptions and mitigations: heteroskedasticity (e.g., robust SE, variance-stabilizing transforms, Tweedie mean–variance), nonlinearity (splines/interactions), and influential outliers (Huber/Tukey loss).
  6. Provides calibrated 95% prediction intervals for CLV_90 (e.g., conformal prediction or bootstrap) and compares them to OLS analytic intervals.
  7. Interprets effects: standardized coefficients for a regularized linear model versus SHAP values for a tree model.
  8. Quantifies and mitigates data leakage risks (e.g., target leakage via post-cutoff features, look-ahead in target encoding).
  9. Compares performance and interpretability trade-offs between a regularized linear model and a gradient-boosting model, and specifies metrics robust to heavy tails (e.g., MAE, Quantile loss, MAPE with epsilon).
Loading comments...