0% completed

All LessonsFree Lessons (3)

Introduction

Course Overview Introduction to the Course

Introduction to Web Scraping

What Is Web Scraping?Why Use Web Scraping?Get to Know the Website Architecture Legal and Ethical Considerations Quiz: Introduction to Web Scraping

Puppeteer Fundamentals

Introduction to Puppeteer Structure of a Puppeteer Project Navigate to a Web Page Selectors Evaluate JavaScript Request Interception Debug Issues Challenge: Puppeteer Fundamentals Quiz: Puppeteer Fundamentals

Advanced Concepts

Handle URL parameters Use of Pagination Handle Infinite Scrolling Login and Authentication Captchas and Other Security Measures Challenge: Advanced Concepts Quiz: Advanced Concepts

Storing Scraped Data

Store Scraped Data in JSON Format

Store Scraped Data in CSV Format

Take Screenshots with Puppeteer

Export to PDF with Puppeteer

Exporting Data to a Database

Quiz: Storing Scraped Data

Scraping a Book Store

Understand the Website Extract Book Categories Navigate Through Categories Extract Details of a Book Extract All Books Under a Category Extract Books Under All Categories Bonus Lesson: Download Images Challenge: Scraping Quotes

Best Practices for Web Scraping

Dealing with Dynamic Content Handling Errors

Conclusion

Recap of the Key Concepts Resources for Further Learning and Practice Future Directions of Web Scraping Congratulations!

Project

Headless Web Scraping Using Puppeteer

Web Scraping with Puppeteer/

...

/

Quiz: Storing Scraped Data

Quiz: Storing Scraped Data

Test what you’ve learned in this chapter.

We'll cover the following...

Technical Quiz

1.

Which format is commonly used for structured data interchange and is lightweight and human-readable?

A.

JSON

B.

CSV

C.

Database

D.

Screenshots

1 / 5