Transformers for Natural Language Processing
INTERACTIVE COURSE

Transformers for Natural Language Processing

Intermediate

137 Lessons

15h

Certificate of Completion

Transformers for Natural Language Processing
2 Assessments
97 Playgrounds
16 Quizzes
256 Illustrations

Takeaway Skills

Ability to work with Python, PyTorch, and TensorFlow

Ability to explore and implement transformers, as well as key AI language understanding neural network models

Ability to learn the new skills required to become an Industry 4.0 AI Specialist

Proficiency in Python deep learning and the necessary tools needed to effectively enhance language understanding

Ability to create a transformer-based recommendation system

Course Overview

The demand for language understanding is on the rise in many fields, such as media, social media, and research papers. Vast amounts of data need to be processed for research, documents need to be translated and summarized for every area of the economy, and social media posts need to be scanned for ethical and legal reasons, among hundreds of other AI tasks whose use is ever-expanding. This course will cover everything from developing code to prompt design, a new programming skill that controls the behavio...Show More

Course Content

1

Course Introduction

2

Basics of Transformers

3

Architecture of the Transformer Model

4

Fine-Tuning BERT Models

5

Pretraining a RoBERTa Model from Scratch

6

Downstream NLP Tasks with Transformers

10 Lessons

7

Machine Translation with the Transformer

10 Lessons

8

The Rise of Transformers with GPT-3 Engines

10 Lessons

9

Applying Transformers for AI Text Summarization

9 Lessons

10

Matching Tokenizers and Datasets

6 Lessons

Transformers for NLP—Exam 1

Assessment

11

Semantic Role Labeling with BERT-Based Transformers

7 Lessons

12

Your Data Speaks: Story, Questions, and Answers

9 Lessons

13

Detecting Customer Emotions to Make Predictions

7 Lessons

14

Analyzing Fake News with Transformers

7 Lessons

15

Interpreting Black Box Transformer Models

8 Lessons

16

From NLP to Task-Agnostic Transfomer Models

7 Lessons

17

The Emergence of Transformer-Driven Copilots

8 Lessons

Transformers for NLP—Exam 2

Assessment

18

Conclusion

1 Lesson

19

Appendix

4 Lessons

COURSE AUTHOR

How You'll Learn

Hands-on Coding Environments

You don’t get better at swimming by watching others. Coding is no different. Practice as you learn with live code environments inside your browser.

2x Faster Learning — With No Setup

Videos are holding you back. Educative‘s interactive, text-based lessons accelerate learning — no setup, downloads, or alt-tabbing required.

AI-Powered Learning

Learn faster and smarter with adaptive AI tools embedded in every Educative course.

Progress You Can Show

Built-in assessments let you test your skills. Completion certificates let you show them off.

Recommended Courses

BEFORE STARTING THIS COURSE

AFTER FINISHING THIS COURSE

FOR TEAMS

Interested in this course for your business or team?

Unlock this course (and 1,000+ more) for your entire org with DevPath