Introduction to Model Optimization

Why is optimization hard?

The optimal value of one weight depends on the value of the other weights. Many weights are optimized at once. From the slope, we will understand which weights to increase or decrease. However, the updates may not improve the model meaningfully. This calls for changing the hyperparameters.

Get hands-on with 1200+ tech skills courses.