Forward and Backward Propagation in RNNs

In this lesson, we will discuss how the forward and backward weight updates take place in an RNN.

We'll cover the following

Forward propagation

This is the process of calculating and storing the intermediate variables (including outputs) for the neural network in order from the input layer to the output layer. We will not discuss this in too much detail, as it is assumed you already have some background knowledge on this.

A simple architecture of an RNN is shown below:

Get hands-on with 1200+ tech skills courses.