Decoder: Feedforward and Add and Norm Component

Learn about the feedforward component and add and norm component of the decoder, as well as the linear and softmax layers of the transformer.

Feedforward network

The next sublayer in the decoder is the feedforward network, as shown in the following figure:

Get hands-on with 1200+ tech skills courses.