Predictions
Explore how to calculate word prediction probabilities using the softmax function in LSTM-based language models. Learn to identify vocabulary word probabilities at each time step and generate next-word predictions effectively in natural language processing.
We'll cover the following...
We'll cover the following...
Chapter Goals:
Calculate softmax probabilities to make predictions for each time step
A. Calculating probabilities
When using a feed-forward neural network for multiclass predictions, we first need to convert the model's logits into probabilities with the softmax function. For an RNN language model, the ...