Method 1: NER First

This lesson will use NER to help us find ideas for good questions. Transformer models are continuously trained and updated. Also, the datasets used for training might change. Finally, these are not rule-based algorithms that produce the same result each time. The outputs might change from one run to another.

NER can detect people, locations, organizations, and other entities in a sequence. We will first run a NER task that will give us some of the main parts of the paragraph we can focus on to ask questions.

Using NER to find questions

We will continue to run QA_1.ipynb cell by cell. The program now initializes the pipeline with the NER task to perform with the default model and tokenizer:

Get hands-on with 1200+ tech skills courses.