Train GradientBoostingClassifier with 5-Fold Cross-Validation

Quick Overview

This interview question evaluates core ML concepts, assumptions, math intuition, training/evaluation trade-offs, and practical failure modes in a realistic interview setting. A strong answer for Train GradientBoostingClassifier with 5-Fold Cross-Validation states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

Train GradientBoostingClassifier with 5-Fold Cross-Validation

Company: Boston Consulting Group

Role: Data Scientist

Category: Machine Learning

Difficulty: easy

Interview Round: Take-home Project

##### Scenario BCG CodeSignal notebook – final model training task ##### Question Train a GradientBoostingClassifier on the prepared data using 5-fold cross-validation, report mean ROC-AUC, and save the trained model to disk (model.pkl). Provide the full Python code. ##### Hints Pipeline ➜ cross_val_score ➜ joblib.dump.

Quick Answer: This interview question evaluates core ML concepts, assumptions, math intuition, training/evaluation trade-offs, and practical failure modes in a realistic interview setting. A strong answer for Train GradientBoostingClassifier with 5-Fold Cross-Validation states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

|Home/Machine Learning/Boston Consulting Group
Boston Consulting Group logo
Boston Consulting Group
Aug 4, 2025, 10:55 AM
easyData ScientistTake-home ProjectMachine Learning
6
0

Train GradientBoostingClassifier with 5-Fold Cross-Validation

Final Model Training: GradientBoostingClassifier with 5-Fold CV

Context

Assume the notebook already contains a prepared feature matrix X and a binary target y (0/1), with any necessary preprocessing completed. Your goal is to evaluate and train a final model.

Task

  1. Build a scikit-learn Pipeline that uses a GradientBoostingClassifier.
  2. Evaluate the model using 5-fold Stratified cross-validation and report the mean ROC-AUC.
  3. Fit the model on the full dataset (X, y).
  4. Save the trained pipeline to disk as model.pkl.

Deliverable

Provide the full Python code that performs all steps above.

Clarifying Questions to Ask Guidance

  • Clarify the task, data shape, labels, constraints, and evaluation metric.
  • State assumptions behind the math or modeling technique you choose.
  • Connect theory to practical training, debugging, and deployment implications.

What a Strong Answer Covers Guidance

  • Correct definitions and formulas where the prompt requires them.
  • A practical explanation of how the method behaves on real data.
  • Trade-offs, failure modes, diagnostics, and mitigation strategies.
  • Evaluation choices that match the product or modeling objective.

Follow-up Questions Guidance

  • How would noisy labels, class imbalance, or distribution shift affect the answer?
  • What would you monitor after deployment?
  • Which baseline would you compare against first?
Loading comments...

Browse More Questions

More Machine Learning•More Boston Consulting Group•More Data Scientist•Boston Consulting Group Data Scientist•Boston Consulting Group Machine Learning•Data Scientist Machine Learning