PracHub
QuestionsPremiumCoachesLearningGuidesInterview Prep
|Home/Machine Learning/Amazon

Explain core ML fundamentals

Last updated: Mar 29, 2026

Quick Overview

This question evaluates a candidate's mastery of core Machine Learning fundamentals including the bias–variance trade-off and regularization, gradient derivation for logistic regression with L2 regularization, evaluation metrics (ROC-AUC vs PR-AUC), cross-validation and data leakage, class imbalance mitigation techniques, model selection between tree-based and linear approaches, and calibration. It is commonly asked because it probes both conceptual understanding and practical application in the Machine Learning domain, testing theoretical reasoning about trade-offs and metrics as well as the ability to apply validation, evaluation, and model-selection principles in realistic settings.

  • medium
  • Amazon
  • Machine Learning
  • Machine Learning Engineer

Explain core ML fundamentals

Company: Amazon

Role: Machine Learning Engineer

Category: Machine Learning

Difficulty: medium

Interview Round: Onsite

Answer the following ML fundamentals: What is the bias–variance trade-off and how do regularization techniques help? Derive the gradient for logistic regression with L2 regularization. Compare ROC-AUC vs PR-AUC and when each is preferable. How do you detect and prevent data leakage in cross-validation? What methods handle class imbalance (e.g., weighting, resampling, thresholds) and how do they affect calibration? When would you prefer tree-based models over linear models and why? How do you assess calibration and improve it?

Quick Answer: This question evaluates a candidate's mastery of core Machine Learning fundamentals including the bias–variance trade-off and regularization, gradient derivation for logistic regression with L2 regularization, evaluation metrics (ROC-AUC vs PR-AUC), cross-validation and data leakage, class imbalance mitigation techniques, model selection between tree-based and linear approaches, and calibration. It is commonly asked because it probes both conceptual understanding and practical application in the Machine Learning domain, testing theoretical reasoning about trade-offs and metrics as well as the ability to apply validation, evaluation, and model-selection principles in realistic settings.

Related Interview Questions

  • Predicting the Next Elevator Call Location - Amazon (medium)
  • Explain Transformer and MoE Fundamentals - Amazon (medium)
  • Explain Core ML Interview Concepts - Amazon (hard)
  • Evaluate NLP Classification Models - Amazon (easy)
  • Explain overfitting, regularization, and LLM techniques - Amazon (medium)
Amazon logo
Amazon
Jul 17, 2025, 12:00 AM
Machine Learning Engineer
Onsite
Machine Learning
5
0

ML Fundamentals — Onsite Interview Task

Context: Answer the following fundamentals as if in an onsite ML Engineer interview. Assume binary classification unless noted. For logistic regression with L2 regularization, use y ∈ {0,1}, feature matrix X ∈ R^{N×d}, parameters (w, b), sigmoid σ(z) = 1/(1+e^{-z}), and do not regularize the bias.

  1. Explain the bias–variance trade-off and how regularization techniques help.
  2. Derive the gradient for logistic regression with L2 regularization.
  3. Compare ROC-AUC versus PR-AUC and state when each is preferable.
  4. How do you detect and prevent data leakage in cross-validation?
  5. What methods handle class imbalance (e.g., weighting, resampling, thresholding) and how do they affect calibration?
  6. When would you prefer tree-based models over linear models, and why?
  7. How do you assess calibration and improve it?

Solution

Show

Submit Your Answer to Earn 20XP

Sign in to leave a comment

Loading comments...

Browse More Questions

More Machine Learning•More Amazon•More Machine Learning Engineer•Amazon Machine Learning Engineer•Amazon Machine Learning•Machine Learning Engineer Machine Learning
PracHub

Master your tech interviews with 8,000+ real questions from top companies.

Product

  • Questions
  • Learning Tracks
  • Interview Guides
  • Resources
  • Premium
  • For Universities
  • Student Access

Browse

  • By Company
  • By Role
  • By Category
  • Topic Hubs
  • SQL Questions
  • Compare Platforms
  • Discord Community

Support

  • support@prachub.com
  • (916) 541-4762

Legal

  • Privacy Policy
  • Terms of Service
  • About Us

© 2026 PracHub. All rights reserved.