Optimization and Gradient Descent

Learn about the fundamental algorithm behind machine learning training: gradient descent.

In our 2D example, the loss function can be thought of as a parabolic-shaped function that reaches its minimum on a certain pair of w1w_1 and w2w_2. Visually, we have:

Get hands-on with 1200+ tech skills courses.