GloVe: Global Vectors Representation

Learn about the GloVe algorithm for word embeddings.

One of the main limitations of the skip-gram and CBOW algorithms is that they can only capture local contextual information because they only look at a fixed-length window around a word. There’s an important part of the puzzle missing here because these algorithms don’t look at global statistics (by global statistics, we mean a way for us to see all the occurrences of words in the context of another word in a text corpus).

Get hands-on with 1200+ tech skills courses.