Predictions
Explore how to calculate word prediction probabilities using the softmax function in LSTM-based language models. Learn to identify vocabulary word probabilities at each time step and generate next-word predictions effectively in natural language processing.
We'll cover the following...
We'll cover the following...
Chapter Goals:
Calculate softmax probabilities to make predictions for each time step
A. Calculating probabilities
When using a feed-forward neural network for multiclass predictions, we first need to convert the model's logits into probabilities with the softmax function. For an RNN language model, the idea is the exact same. After converting the RNN's ...