Semantic Similarity Methods for Semantic Parsing
Explore semantic similarity methods using spaCy, including synonym dictionaries and word vector-based techniques. Understand how to compare verbs and direct objects to determine if utterances share the same intent, a crucial skill for building NLP applications like chatbots and semantic parsers.
We'll cover the following...
Natural language allows us to express the same concept in different ways and with different words. Every language has synonyms and semantically related words.
As an NLP developer, while developing a semantic parser for a chatbot application, text classification, or any other semantic application, you should keep in mind that users use a fairly wide set of phrases and expressions for each intent. In fact, if you're building a chatbot by using a platform such as RASA or on a platform such as Dialogflow, we're asked to provide as many utterance examples as we can provide for each intent. Then, these utterances are used to train the intent classifier behind the scenes.
There are usually two ways to recognize semantic similarity, either with a synonyms dictionary or with word vector-based semantic similarity methods. We will discuss both approaches. Let's start with how to use a synonyms ...