Search⌘ K

AI Features

Performing Natural Language Processing with R

1.Before We Begin

Introduction to the Course Key Skills for Success

2.Important Concepts in Natural Language Processing

Understanding Tokens and N-Grams Creating a List of Frequent Terms Removing Unnecessary Terms Reducing and Aggregating Terms Mid-Chapter Quiz Determining the Sentiment of a Document Understanding Parts of Speech Searching for Matching Documents with tf-idf Comparing R Packages for NLP End of Chapter Quiz

3.Text Mining Package

Installation and Documentation Using the File Folder as Corpus

4.Understanding Corpora and Sources

Corpus Classes and Source Types Using a Suitable Corpus Class Using a Suitable Source Type Quiz: Understanding Corpora and Sources

5.Converting Text to Structured Data

Document-Term Matrix Stopword Removal Removing Other Unnecessary Terms Quiz on Converting Text to Structured Data

6.Document Insights and Advanced Search Techniques

Alternative Approaches Understanding Tokenization and Its Importance Preserve Phrases with N-grams Analyzing Textual Comparisons with Document-Term Matrices Refining Textual Meaning through Stemming Implement tf-idf with tm Visualization with tm Quiz: Tokens, N-Grams, tf-idf, and Stemming

7.Working with Metadata in the tm Package

Understanding Metadata in Text Analysis Assigning Metadata Using Metadata Quiz: Working with Metadata in the tm Package

8.Implementing NLP with the quanteda Package

Understanding quanteda Installing quanteda quanteda Basics Implementing Sentiment Analysis with quanteda Text Statistics with quanteda Calculate tf-idf with quanteda Quiz: Implementing NLP with the quanteda Package

9.Implementing NLP with the tidytext Package

Understanding tidytext tidytext Basics Stemming with tidytext Lemmatization with tidytext Calculate tf-idf with tidytext Recognizing Parts of Speech with tidytext Quiz on tidytext

Assessment

Assess What You Have Learned About NLP

10.Concluding Remarks

11.Appendix

A Note About the Sample Files

Performing Natural Language Processing with R

Quiz: Implementing NLP with the quanteda Package

Quiz yourself on what you’ve learned so far in this chapter.

We'll cover the following...

Using quanteda for Natural Language Processing

1.

Which quanteda function calculates tf-idf from a document-feature matrix?

A.

dfm_tfidf()

B.

makeTermFrequencyInverseDocumentFrequency()

C.

bind_tf_idf( )

D.

weighting = weightTfIdf

1 / 4