Implement Gradient Descent Regression
Company: Databricks
Role: Machine Learning Engineer
Category: Machine Learning
Difficulty: medium
Interview Round: Onsite
Implement linear regression from scratch to predict a continuous target `y` from input features `X` using gradient descent. Use mean squared error as the training objective.
Be prepared to:
- write the training loop,
- derive or explain the gradient updates,
- choose and tune the learning rate,
- explain early stopping,
- and debug common reasons why the model does not converge.
Quick Answer: This question evaluates understanding of linear regression and gradient-based optimization, including loss formulation, gradient derivation, parameter updates, hyperparameter tuning, and debugging of convergence issues.