##### Scenario Company screens ML engineers with a 90-minute CodeSignal test containing conceptual MCQs and Python modeling tasks. ##### Question State and interpret the bias and variance terms in the bias–variance decomposition. Which regularization technique(s) can shrink linear-model coefficients exactly to zero and why? Name two practical approaches for detecting data leakage in a supervised learning pipeline. Given dataframe df(user_id, event_time, event_type, purchase), build a binary classifier predicting whether a user will purchase within the next 7 days and report AUC on a held-out set. Implement logistic regression with gradient descent using only numpy; provide convergence diagnostics. ##### Hints Discuss bias-variance trade-off, L1 geometry, validation splits, temporal leakage checks, and write clean, vectorized Python.

This interview question evaluates core ML concepts, assumptions, math intuition, training/evaluation trade-offs, and practical failure modes in a realistic interview setting. A strong answer for Detect Data Leakage in Supervised Learning Pipelines states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

How do I approach Machine Learning interview questions?

Machine Learning questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master machine learning interviews.

What difficulty level is this interview question?

This is a hard difficulty Machine Learning question, commonly asked during Take-home Project rounds at Boston Consulting Group.

What role is this question designed for?

This question is commonly asked for Data Scientist candidates at Boston Consulting Group during technical interviews.

Detect Data Leakage in Supervised Learning Pipelines | Boston Consulting Group Interview Question

Detect Data Leakage in Supervised Learning Pipelines

ML Take‑home: Bias–Variance, Regularization, Leakage, and From‑scratch Logistic Regression

Context

You are given user event logs in a Pandas dataframe df with columns:

user_id: unique user identifier
event_time: timestamp of the event
event_type: categorical event name (e.g., view, click, add_to_cart, purchase)
purchase: indicator (0/1) if the event is a purchase

Your goal is to build a leakage‑free binary classifier that predicts whether a user will purchase within the next 7 days, then evaluate AUC on a held‑out set.

Tasks

Bias–variance decomposition
- State the bias and variance terms and interpret them in the bias–variance decomposition.
Regularization and sparsity
- Which regularization technique(s) can shrink linear‑model coefficients exactly to zero, and why?
Detecting data leakage
- Name two practical approaches for detecting data leakage in a supervised learning pipeline.
Modeling: Logistic regression from scratch
- Using df(user_id, event_time, event_type, purchase), build a binary classifier to predict whether a user will purchase within the next 7 days.
- Use a temporally correct split and report AUC on a held‑out set.
- Implement logistic regression with gradient descent using only numpy for the model (pandas allowed for data prep). Provide basic convergence diagnostics.

Implementation requirements

Ensure no temporal leakage: features must use data up to an anchor time; labels look forward 7 days after the anchor.
Clean, vectorized Python; no sklearn for the model or metrics (implement AUC yourself).

Constraints & Assumptions

Preserve the scope, facts, inputs, and requested outputs from the prompt above.
If the prompt leaves a detail unspecified, state a reasonable assumption before relying on it.
Keep the answer interview-ready: concise enough to present, but concrete enough to implement or evaluate.

Clarifying Questions to Ask

Clarify the task, data shape, labels, constraints, and evaluation metric.
State assumptions behind the math or modeling technique you choose.
Connect theory to practical training, debugging, and deployment implications.

What a Strong Answer Covers

Correct definitions and formulas where the prompt requires them.
A practical explanation of how the method behaves on real data.
Trade-offs, failure modes, diagnostics, and mitigation strategies.
Evaluation choices that match the product or modeling objective.

Follow-up Questions

How would noisy labels, class imbalance, or distribution shift affect the answer?
What would you monitor after deployment?
Which baseline would you compare against first?

Detect Data Leakage in Supervised Learning Pipelines

ML Take‑home: Bias–Variance, Regularization, Leakage, and From‑scratch Logistic Regression

Context

You are given user event logs in a Pandas dataframe df with columns:

user_id: unique user identifier
event_time: timestamp of the event
event_type: categorical event name (e.g., view, click, add_to_cart, purchase)
purchase: indicator (0/1) if the event is a purchase

Your goal is to build a leakage‑free binary classifier that predicts whether a user will purchase within the next 7 days, then evaluate AUC on a held‑out set.

Tasks

Bias–variance decomposition
- State the bias and variance terms and interpret them in the bias–variance decomposition.
Regularization and sparsity
- Which regularization technique(s) can shrink linear‑model coefficients exactly to zero, and why?
Detecting data leakage
- Name two practical approaches for detecting data leakage in a supervised learning pipeline.
Modeling: Logistic regression from scratch
- Using df(user_id, event_time, event_type, purchase), build a binary classifier to predict whether a user will purchase within the next 7 days.
- Use a temporally correct split and report AUC on a held‑out set.
- Implement logistic regression with gradient descent using only numpy for the model (pandas allowed for data prep). Provide basic convergence diagnostics.

Implementation requirements

Ensure no temporal leakage: features must use data up to an anchor time; labels look forward 7 days after the anchor.
Clean, vectorized Python; no sklearn for the model or metrics (implement AUC yourself).

Constraints & Assumptions

Preserve the scope, facts, inputs, and requested outputs from the prompt above.
If the prompt leaves a detail unspecified, state a reasonable assumption before relying on it.
Keep the answer interview-ready: concise enough to present, but concrete enough to implement or evaluate.

Clarifying Questions to Ask

Clarify the task, data shape, labels, constraints, and evaluation metric.
State assumptions behind the math or modeling technique you choose.
Connect theory to practical training, debugging, and deployment implications.

What a Strong Answer Covers

Correct definitions and formulas where the prompt requires them.
A practical explanation of how the method behaves on real data.
Trade-offs, failure modes, diagnostics, and mitigation strategies.
Evaluation choices that match the product or modeling objective.

Follow-up Questions

How would noisy labels, class imbalance, or distribution shift affect the answer?
What would you monitor after deployment?
Which baseline would you compare against first?

Detect Data Leakage in Supervised Learning Pipelines

Quick Overview

Detect Data Leakage in Supervised Learning Pipelines

Detect Data Leakage in Supervised Learning Pipelines

ML Take‑home: Bias–Variance, Regularization, Leakage, and From‑scratch Logistic Regression

Context

Tasks

Implementation requirements

Constraints & Assumptions

Clarifying Questions to Ask

What a Strong Answer Covers

Follow-up Questions

Write your answer

Detect Data Leakage in Supervised Learning Pipelines

Quick Overview

Detect Data Leakage in Supervised Learning Pipelines

Detect Data Leakage in Supervised Learning Pipelines

ML Take‑home: Bias–Variance, Regularization, Leakage, and From‑scratch Logistic Regression

Context

Tasks

Implementation requirements

Constraints & Assumptions

Clarifying Questions to Ask

What a Strong Answer Covers

Follow-up Questions

Write your answer