Exercise: A Primer on Transformers

Complete this hands-on exercise to test your knowledge of the components of the encoders.

We'll cover the following


Say we have a transformer with 2 encoders. Assuming that we are expanding the components of encoder 2, rearrange the cards to generate the encoder representation of the input sentence:

Get hands-on with 1200+ tech skills courses.