Step 3 - Compute the Gradients

Learn about gradients and how they can be computed and visualized.

Introduction to gradients

A gradient is a partial derivative; why partial? Because one computes it with respect to (w.r.t.) a single parameter. Since we have two parameters, b and w, we must compute two partial derivatives.

A derivative tells you how much a given quantity changes when you slightly vary some other quantity. In our case, how much does our MSE loss change when we vary each one of our two parameters separately?

Get hands-on with 1200+ tech skills courses.