Feedforward Neural Networks

In this lesson, we will extend our single layer perceptron to include more layers, so that it can learn more complex representations.

Multi-Layer Perceptrons

We covered perceptrons in the last lesson. You saw how they cannot be used for the XOR problem. In this chapter, we will look into multi-layer perceptrons and how they can solve non-linear problems. Multi-layer perceptrons are also referred to as Feedforward Networks.

Adding more perceptron layers can improve the Neural Network’s performance for complex classification tasks. These complex tasks can be problems that are not linearly separable and result in the non-linear decision boundary.

Multilayer Perceptron for XOR problem [Credits: PADS RWTH Aachen]

The above diagram displays the multi-layer perceptron for solving the XOR problem. Here, we break down the is the symbols.

  • x1x_1 and x2x_2 are the input features, ...

Get hands-on with 1400+ tech skills courses.