Explain vanishing gradients and activations

Q: Explain vanishing gradients and activations

This is a Machine Learning interview question from Amazon for Machine Learning Engineer roles. View the full question and solution on PracHub.

Q: How do I approach Machine Learning interview questions?

Machine Learning questions require understanding of core concepts and practice. PracHub provides solutions with explanations to help you master machine learning interviews.

Question

Explain the vanishing gradient problem in deep neural networks.

In your answer:

Describe how backpropagation works at a high level and why gradients can vanish in deep networks.
Show how the choice of activation function (e.g., sigmoid, tanh, ReLU) affects gradient magnitude.
Discuss common techniques (including activation choices) to mitigate vanishing gradients.

Explain vanishing gradients and activations

Solution

Comments (0)