Transformers and spaCy

Let's look at the new transformer-based pipelines.

spaCy v3.0 was released with great new features and components. The most exciting new feature is undoubtedly transformer-based pipelines. The new transformer-based pipelines bring spaCy's accuracy to the state of the art. Integrating transformers into the spaCy NLP pipeline introduced one more pipeline component called Transformer. This component allows us to use all HuggingFace models with spaCy pipelines. If we recall from earlier, the spaCy NLP pipeline looks like this without transformers:

Get hands-on with 1200+ tech skills courses.