How do I approach Machine Learning interview questions?

Machine Learning questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master machine learning interviews.

What difficulty level is this interview question?

This is a hard difficulty Machine Learning question, commonly asked during Take-home Project rounds at DRW.

What role is this question designed for?

This question is commonly asked for Machine Learning Engineer candidates at DRW during technical interviews.

Build an imbalanced classification pipeline with sklearn

Quick Overview

Build an imbalanced classification pipeline with sklearn evaluates core ML concepts, assumptions, math intuition, training/evaluation trade-offs, and practical failure modes in a realistic interview setting. A strong answer states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

Build an imbalanced classification pipeline with sklearn

Take-home: End-to-end Imbalanced Binary Classification Pipeline (scikit-learn + imbalanced-learn)

Context

You are given a tabular, imbalanced binary classification problem (y ∈ {0, 1}, with minority class 1). Build a clean, reproducible pipeline that prevents data leakage, compares imbalance strategies, and delivers evaluation artifacts and threshold tuning.

Requirements

Data preprocessing
- Use a Pipeline (and a ColumnTransformer if there are mixed numeric/categorical features) to perform:
  - Numeric scaling
  - Categorical encoding
  - Class imbalance handling via resampling
  - Modeling
- Ensure the resampling step happens inside each cross-validation fold to avoid leakage.
Imbalance strategies to compare
- Class-weight adjustments (e.g., class_weight="balanced") without explicit resampling.
- Explicit resampling (e.g., SMOTE or RandomUnderSampler) with class_weight=None.
Modeling and tuning
- Try at least two classifiers (e.g., LogisticRegression and RandomForest). You may optionally include an XGBoost-compatible estimator.
- Hyperparameter tuning with StratifiedKFold cross-validation.
- Primary metric: ROC-AUC. Also report PR-AUC (Average Precision).
- Use GridSearchCV (or equivalent) with scoring={'roc_auc', 'average_precision'} and refit='roc_auc'.
Evaluation artifacts and thresholding
- On a held-out test set, produce:
  - Confusion matrix at a selected threshold
  - ROC curve and PR curve
  - Calibration curve
- Demonstrate threshold tuning to:
  - Maximize F1, and
  - Maximize recall subject to precision ≥ 0.90.
Reproducibility and documentation
- Fixed random seeds; clean, well-documented code.
- Clear notes on how leakage is prevented and how to adapt to a real dataset.

Constraints & Assumptions

Preserve the scope, facts, inputs, and requested outputs from the prompt above.
If the prompt leaves a detail unspecified, state a reasonable assumption before relying on it.
Keep the answer interview-ready: concise enough to present, but concrete enough to implement or evaluate.

Clarifying Questions to Ask

Clarify the task, data shape, labels, constraints, and evaluation metric.
State assumptions behind the math or modeling technique you choose.
Connect theory to practical training, debugging, and deployment implications.

What a Strong Answer Covers

Correct definitions and formulas where the prompt requires them.
A practical explanation of how the method behaves on real data.
Trade-offs, failure modes, diagnostics, and mitigation strategies.
Evaluation choices that match the product or modeling objective.

Follow-up Questions

How would noisy labels, class imbalance, or distribution shift affect the answer?
What would you monitor after deployment?
Which baseline would you compare against first?

Quick Overview

Requirements

Data preprocessing

Use a Pipeline (and a ColumnTransformer if there are mixed numeric/categorical features) to perform:
- Numeric scaling
- Categorical encoding
- Class imbalance handling via resampling
- Modeling
Ensure the resampling step happens inside each cross-validation fold to avoid leakage.

Imbalance strategies to compare

Class-weight adjustments (e.g., class_weight="balanced") without explicit resampling.
Explicit resampling (e.g., SMOTE or RandomUnderSampler) with class_weight=None.

Modeling and tuning

Try at least two classifiers (e.g., LogisticRegression and RandomForest). You may optionally include an XGBoost-compatible estimator.
Hyperparameter tuning with StratifiedKFold cross-validation.
Primary metric: ROC-AUC. Also report PR-AUC (Average Precision).
Use GridSearchCV (or equivalent) with scoring={'roc_auc', 'average_precision'} and refit='roc_auc'.

Evaluation artifacts and thresholding

On a held-out test set, produce:
- Confusion matrix at a selected threshold
- ROC curve and PR curve
- Calibration curve
Demonstrate threshold tuning to:
- Maximize F1, and
- Maximize recall subject to precision ≥ 0.90.

Reproducibility and documentation

Fixed random seeds; clean, well-documented code.
Clear notes on how leakage is prevented and how to adapt to a real dataset.

Constraints & Assumptions

Preserve the scope, facts, inputs, and requested outputs from the prompt above.

If the prompt leaves a detail unspecified, state a reasonable assumption before relying on it.

Keep the answer interview-ready: concise enough to present, but concrete enough to implement or evaluate.

Clarifying Questions to Ask

Clarify the task, data shape, labels, constraints, and evaluation metric.

State assumptions behind the math or modeling technique you choose.

Connect theory to practical training, debugging, and deployment implications.

What a Strong Answer Covers

Correct definitions and formulas where the prompt requires them.

A practical explanation of how the method behaves on real data.

Trade-offs, failure modes, diagnostics, and mitigation strategies.

Evaluation choices that match the product or modeling objective.

Follow-up Questions

How would noisy labels, class imbalance, or distribution shift affect the answer?

What would you monitor after deployment?

Which baseline would you compare against first?

Build an imbalanced classification pipeline with sklearn

Quick Overview

Build an imbalanced classification pipeline with sklearn

Build an imbalanced classification pipeline with sklearn

Take-home: End-to-end Imbalanced Binary Classification Pipeline (scikit-learn + imbalanced-learn)

Context

Requirements

Constraints & Assumptions

Clarifying Questions to Ask

What a Strong Answer Covers

Follow-up Questions

Write your answer

Build an imbalanced classification pipeline with sklearn

Quick Overview

Build an imbalanced classification pipeline with sklearn

Build an imbalanced classification pipeline with sklearn

Take-home: End-to-end Imbalanced Binary Classification Pipeline (scikit-learn + imbalanced-learn)

Context

Requirements

Constraints & Assumptions

Clarifying Questions to Ask

What a Strong Answer Covers

Follow-up Questions

Write your answer