Optimisation Function

Learn about different types of optimisation functions: what they are, their benefits and drawbacks?

We'll cover the following

We can also refine the technique that uses the back propagated gradients to update the network weights.

Stochastic gradient descent

Previously we used a fairly simple method, stochastic gradient descent. The method is popular because it is simple and fairly lightweight in terms of computer resources.

Get hands-on with 1200+ tech skills courses.