Explain core ML fundamentals

Quick Overview

Explain core ML fundamentals evaluates core ML concepts, assumptions, math intuition, training/evaluation trade-offs, and practical failure modes in a realistic interview setting. A strong answer states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

Explain core ML fundamentals

Company: Amazon

Role: Machine Learning Engineer

Category: Machine Learning

Difficulty: medium

Interview Round: Onsite

Answer the following ML fundamentals: What is the bias–variance trade-off and how do regularization techniques help? Derive the gradient for logistic regression with L2 regularization. Compare ROC-AUC vs PR-AUC and when each is preferable. How do you detect and prevent data leakage in cross-validation? What methods handle class imbalance (e.g., weighting, resampling, thresholds) and how do they affect calibration? When would you prefer tree-based models over linear models and why? How do you assess calibration and improve it?

Quick Answer: Explain core ML fundamentals evaluates core ML concepts, assumptions, math intuition, training/evaluation trade-offs, and practical failure modes in a realistic interview setting. A strong answer states assumptions, handles edge cases, explains trade-offs, and shows how to validate the result clearly.

|Home/Machine Learning/Amazon
Amazon logo
Amazon
Jul 17, 2025, 12:00 AM
mediumMachine Learning EngineerOnsiteMachine Learning
8
0

Explain core ML fundamentals

ML Fundamentals — Onsite Interview Task

Context: Answer the following fundamentals as if in an onsite ML Engineer interview. Assume binary classification unless noted. For logistic regression with L2 regularization, use y ∈ {0,1}, feature matrix X ∈ R^{N×d}, parameters (w, b), sigmoid σ(z) = 1/(1+e^{-z}), and do not regularize the bias.

  1. Explain the bias–variance trade-off and how regularization techniques help.
  2. Derive the gradient for logistic regression with L2 regularization.
  3. Compare ROC-AUC versus PR-AUC and state when each is preferable.
  4. How do you detect and prevent data leakage in cross-validation?
  5. What methods handle class imbalance (e.g., weighting, resampling, thresholding) and how do they affect calibration?
  6. When would you prefer tree-based models over linear models, and why?
  7. How do you assess calibration and improve it?

Clarifying Questions to Ask Guidance

  • Clarify the task, data shape, labels, constraints, and evaluation metric.
  • State assumptions behind the math or modeling technique you choose.
  • Connect theory to practical training, debugging, and deployment implications.

What a Strong Answer Covers Guidance

  • Correct definitions and formulas where the prompt requires them.
  • A practical explanation of how the method behaves on real data.
  • Trade-offs, failure modes, diagnostics, and mitigation strategies.
  • Evaluation choices that match the product or modeling objective.

Follow-up Questions Guidance

  • How would noisy labels, class imbalance, or distribution shift affect the answer?
  • What would you monitor after deployment?
  • Which baseline would you compare against first?
Loading comments...

Browse More Questions

More Machine Learning•More Amazon•More Machine Learning Engineer•Amazon Machine Learning Engineer•Amazon Machine Learning•Machine Learning Engineer Machine Learning