Back To Course Home

Natural Language Processing with TensorFlow

0% completed

Introduction to Natural Language Processing

Introduction: Natural Language Processing What Is Natural Language Processing?Tasks of Natural Language Processing The Traditional Approach to Natural Language Processing The Deep Learning Approach to Natural Language Processing Summary: Introduction to Natural Language Processing

Understanding TensorFlow 2

Introduction: Understanding TensorFlow 2 What Is TensorFlow 2?TensorFlow 2 Architecture: Building and Executing Graphs Café Le TensorFlow 2: Understanding TensorFlow 2 with an Analogy Flashback: TensorFlow 1 Defining Inputs in TensorFlow Building a Data Pipeline Using the tf.data API Defining Variables and Output in TensorFlow Defining Operations in TensorFlow Neural Network-Related Operations Keras: TensorFlow's Model-Building API Implementing Our First Neural Network Summary: Understanding TensorFlow 2 Quiz: Understanding TensorFlow 2

Word2vec: Learning Word Embeddings

Introduction of Word2vec: Learning Word Embeddings Classical Approaches to Learning Word Representations An Intuitive Understanding of Word2vec The Skip-Gram Algorithm Data Generators in the Skip-Gram Algorithm with TensorFlow Implementing the Skip-Gram Architecture with TensorFlow Training and Evaluating the Skip-Gram Model The Continuous Bag-of-Words Algorithm Summary of Word2vec: Learning Word Embeddings Quiz of Word2vec: Learning Word Embeddings

Advanced Word Vector Algorithms

Introduction: Advanced Word Vector Algorithms GloVe: Global Vectors Representation Implementing GloVe Generating Data for GloVe Training and Evaluating GloVe ELMo: Taking Ambiguities Out of Word Vectors Preparing Inputs for ELMo Generating Embeddings with ELMo Dataset in Document Classification with ELMo Generating Document Embeddings Classifying Documents with Document Embeddings Summary: Advanced Word Vector Algorithms Quiz: Advanced Word Vector Algorithms

Sentence Classification with Convolutional Neural Networks

Introduction: Sentence Classification with CNNs Introducing CNNs Understanding CNNs: Convolution Operations Understanding CNNs: Pooling Operations Understanding CNNs: Fully Connected Layers Exercise: Image Classification on Fashion-MNIST with CNN CNNs for Sentence Classification: Transformation of Data CNNs for Sentence Classification: Downloading and Preparing Data CNNs for Sentence Classification: Building a Tokenizer The Sentence Classification CNN Model Sentence Classification with CNNs Summary: Sentence Classification with CNNs Quiz: Sentence Classification with CNNs

Recurrent Neural Networks

Introduction: Recurrent Neural Networks Understanding RNNs Backpropagation through Time Applications of RNNs Named Entity Recognition with RNNs: Preparing Data Named Entity Recognition with RNNs: Defining the Model Named Entity Recognition with RNNs: Training and Evaluation NER with Character and Token Embeddings Summary: Recurrent Neural Networks Quiz: Recurrent Neural Networks

Understanding Long Short-Term Memory Networks

Introduction: Understanding Long Short-Term Memory Networks

Understanding Long Short-Term Memory Networks

How LSTMs Solve the Vanishing Gradient Problem

Improving LSTMs

Other Variants of LSTMs

Summary: Understanding Long Short-Term Memory Networks

Quiz: Understanding Long Short-Term Memory Networks

Applications of LSTM: Generating Text

Introduction: Applications of LSTMs—Generating Text Understanding the Data Implementing the Language Model Generating New Text with the Model Comparing LSTMs to LSTMs with Peephole Connections and GRUs Improving Sequential Models: Beam Search Improving LSTMs: Generating Text with Words Instead of N-grams Summary: Applications of LSTMs—Generating Text Quiz: Applications of LSTMs—Generating Text

Sequence-to-Sequence Learning: Neural Machine Translation

Introduction: Sequence-to-Sequence Learning—NMT Machine Translation Understanding Neural Machine Translation Preparing Data for the NMT System Defining the NMT Model Attention: Analyzing, Computing, and Implementing Training the NMT The BLEU Score: Evaluating Machine Translation Systems Visualizing Attention Patterns Inference with NMT Other Applications of Seq2Seq Models: Chatbots Summary: Sequence-to-Sequence Learning—NMT Quiz: Sequence-to-Sequence Learning—NMT

Transformers

Introduction: Transformers Transformer Architecture: Encoder, Decoder, and Computing Output Transformer Architecture: Embedding Layers Transformer Architecture: Residuals and Normalization Understanding BERT Use Case: Using BERT to Answer Questions Use Case: Implementing BERT Training and Evaluating Model and Answering Questions with BERT Summary: Transformers Quiz: Transformers

Image Captioning with Transformers

Introduction: Image Captioning with Transformers Getting to Know the Data Processing and Tokenizing Data Defining a tf.data.Dataset The Machine Learning Pipeline for Image Caption Generation Implementing and Training the Model with TensorFlow Evaluating the Results Quantitatively Evaluating the Model and Generating Captions from It Summary: Image Captioning with Transformers Quiz: Image Captioning with Transformers

Final Remarks

Appendix: Mathematical Foundations and Advanced TensorFlow

Introduction to the Technical Tools Basic Data Structures Special Types of Matrices Probability Visualizing Word Embeddings with TensorBoard Summary: Appendix

Quiz: Understanding Long Short-Term Memory Networks

Test how well you understand long short-term memory networks.

1

What is the primary purpose of peephole connections in LSTM networks?

A)

To reduce the number of parameters in LSTM gates

B)

To introduce more parameters and information to the LSTM gates

C)

To skip connections between LSTM gates

D)

To remove connections between LSTM gates

Question 1 of 70 attempted

Get hands-on with 1200+ tech skills courses.