Other Gated Architectures and Attention

Get an understanding of GRU, NTM, and attention.

Gated recurrent unit (GRU)

A popular and slightly simplified variant of LSTM\text{LSTM} is the gated recurrent unit (GRU)\text{(GRU)} shown in figure A below. This model is defined by the following equations:

Get hands-on with 1200+ tech skills courses.