Back To Course Home

Mastering Big Data with PySpark

0% completed

Introduction to the Course

About This Course What We Will Learn

Introduction to Big Data

Overview of Big Data

Big Data Processing Concepts

Big Data Storage Concepts

Introduction to Data Ingestion

Quiz: Introduction to Big Data

Exploring PySpark Core and RDDs

Introduction to Apache Spark Overview of PySpark Resilient Distributed Datasets (RDDs)RDD Operations Quiz: PySpark RDDs

PySpark DataFrames and SQL

PySpark DataFrames Advanced PySpark DataFrame Operations Introduction to PySpark SQL Data Exploration and Analysis with PySpark SQL Quiz: PySpark Data Structures Solution: PySpark Data Structures

Customer Churn Analysis Using PySpark

Introduction to Customer Churn Analysis Quiz: Customer Churn Analysis Using PySpark Solution: Customer Churn Analysis Using PySpark

Machine Learning with PySpark

Overview of Machine Learning Concepts Introduction to PySpark MLlib The ML Pipeline in PySpark Feature Extraction Techniques in PySpark MLlib Feature Transformation Techniques in PySpark MLlib Quiz: Machine Learning with PySpark

Modeling with PySpark MLlib

Regression with PySpark MLlib Classification with PySpark MLlib Unsupervised Learning with PySpark MLlib Model Selection and Hyperparameter Tuning Using PySpark MLlib Model Evaluation Metrics in Depth

Predicting Diabetes in Patients Using PySpark MLlib

Introduction to the Diabetes Prediction Analysis Quiz: Predicting Diabetes Using PySpark MLlib Solution: Predicting Diabetes Using PySpark MLlib

Performance Optimization in PySpark

Introduction to Performance Optimization Partition Optimization Broadcast Variables and PySpark Accumulators Optimizing DataFrame Operations in PySpark Quiz: Performance Optimization in PySpark

PySpark Optimization: Analyzing NYC Restaurants Data

Introduction to PySpark Optimization Using NYC Restaurant Data Quiz: Optimizing PySpark DataFrame Operations Solution: Optimizing PySpark DataFrame Operations

Integrating PySpark with Other Big Data Tools

Integrating PySpark with Other Tools and Best Practices PySpark Integration with Apache Hive PySpark Integration with Apache Kafka Quiz: PySpark Integration Tools

Wrap Up

Final Conclusion

Quiz: Introduction to Big Data

Test your understanding of the introduction to big data.

Get hands-on with 1200+ tech skills courses.