Connect LSTM Cells Across Time and Space
Explore the process of connecting LSTM cells across time and space within recurrent neural networks. Understand how context and hidden states link cells through time, and how layers connect in space. Practice implementing these connections in PyTorch to model sequential data like sine waves, gaining hands-on experience with custom LSTM architectures.
We'll cover the following...
We'll cover the following...
Let’s see how LSTM cells are connected in time and space. Let’s start from the time perspective by considering a single sequence of timesteps and one cell as it is easier to understand.
Focus on the left cell. The upper left arrow is the context memory vector , and the lower arrow is the previous ...