HomeCoursesEffective Data Manipulation with pandas

Beginner

24h

Effective Data Manipulation with pandas

Delve into effective data manipulation with pandas. Discover filtering, merging, grouping, and reshaping techniques through hands-on examples, best practices, and performance tips for real-world analysis.

Join 2.7 million developers at

Overview

Content

Reviews

The course is a comprehensive guide to using pandas for data analysis. It covers a wide range of topics related to data manipulation, including filtering, merging, grouping, pivoting, and reshaping data. In this course, you’ll learn about the best practices and efficient techniques for working with data. You’ll be provided with numerous examples of real-world data analysis problems and gain hands-on experience with the pandas library to solve them effectively. This course will also cover performance considerations and provide insights on common pitfalls to avoid when using pandas. The course is suitable for both beginners and experienced users of pandas. It includes detailed explanations of pandas concepts and functions, as well as tips and tricks for optimizing your code. By the time you’re done with this course, you’ll be able to effectively handle data using pandas.

The course is a comprehensive guide to using pandas for data analysis. It covers a wide range of topics related to data manipula...Show More

WHAT YOU'LL LEARN

An understanding of efficient data manipulation techniques for working with data in pandas

Working knowledge of different techniques for handling missing data in pandas

The ability to reshape and pivot data

Hands-on experience of the best practices for working with pandas

An understanding of efficient data manipulation techniques for working with data in pandas

Content

89 Lessons17 Quizzes4 Challenges

Introduction

10 Lessons

Get familiar with pandas data structures for efficient data manipulation in Python.

Similarities in pandas and NumPy

Categorical Data in pandas

Exercise: Series in pandas

Solution: Series in pandas

Summary

Quiz: pandas Series

Series Deep Dive

27 Lessons

Unpack the core of pandas Series manipulation, covering attributes, operations, and data cleaning.

Data Loading and Series Attributes

Operators and Dunder Methods

Aggregate Methods

Exercise: Aggregate Methods

Solution: Aggregate Methods

Conversion Methods

Manipulation Methods

Quiz: Methods in Series

Conditional Methods

Handling Missing Data

Other Manipulation Methods

Data Cleaning

Quiz: Duplicate values and NaN

Indexing Operations

Indexing Operations (.iloc)

Exercise: Data Manipulation and Indexing

Solution: Data Manipulation and Indexing

Quiz: Indexing, Manipulation Methods, and Data Cleaning

String Manipulation

Optimizing Manipulations Using Cython

Date and Time Manipulation

Dates in the Index

Quiz: String Manipulation, Date-Time Manipulation, and DT Indexing

Plotting with a Series: Histogram, Box Plot, and Kernel Density

Plotting with a Series: Line, Bar, and Pie Plots

Categorical Manipulation

Quiz: Plotting and Categorical Data

DataFrames

29 Lessons

Examine building, manipulating, and visualizing DataFrames in pandas for effective data analysis.

Introduction to DataFrames

Math Methods on DataFrames

Quiz: DataFrames and Math Methods on DataFrames

Exercise: DataFrames in pandas

Solution: DataFrames in pandas

Looping and Aggregation

The apply() Method

Exercise: Looping, Aggregation and apply() Method

Solution: Looping, Aggregation, and apply() Method

Columns Types, .assign, and Memory Usage

Creating and Updating Columns

Dealing with Missing and Duplicated Data

Quiz: Missing and Duplicated Data

Sorting Columns and Indexes

Filtering and Indexing Operations

Indexing by Position

Indexing by Name

Filtering with Function and .loc

Line and Bar Plots

Scatter, Area, and Stacked Bar Plots

Exercise: Sorting, Columns, Filtering, and Indexing Operations.

Solution: Sorting, Columns, Filtering, and Indexing Operations

Exercise: Plotting

Solution: Plotting

Quiz: Sorting Columns, Filtering, and Indexing Operations.

Reshaping DataFrames with Dummies

Reshaping by Pivoting and Grouping

Aggregations

Manipulating Data

21 Lessons

Grasp the fundamentals of manipulating and reshaping data, handling time series, joins, and exporting formats.

Grouping

More Aggregations

Cross-tabulation Deep Dive

Exercise: Reshaping/Aggregations

Solution: Reshaping/Aggregations

Quiz: Reshaping, Pivot Tables, Aggregations

Melting and Transposing Data

Stacking and Flattening Data

Quiz: Melting, Transposing, Stacking, and Unstacking Data

Working with Time Series

Adding Rows and Columns in a DataFrame

Joins in DataFrames

Joining Real-World Datasets

Quiz: Joining in pandas

Exporting Data to CSV and Excel

Exporting Data to Feather, SQL, and JSON

Styling DataFrames

Checking if DataFrames are Equal

Debugging Chains

Debugging apply (and friends)

Debugging Memory Usage and Timing Information

Wrapping Up

1 Lessons

Explore continuous improvement in data analysis, from understanding data to engaging in real-world projects.

Conclusion

Appendix

1 Lessons

Follow the process of installing and setting up pandas for Python projects.

Installation

Certificate of Completion

Showcase your accomplishment by sharing your certificate of completion.

Developed by MAANG Engineers

Every Educative lesson is designed by our in-house team of ex-MAANG software engineers and PhD computer science educators, and developed in consultation with developers and data scientists working at Meta, Google, and more. Our mission is to get you hands-on with the necessary skills to stay ahead in a constantly changing industry. No video, no fluff. Just interactive, project-based learning with personalized feedback that adapts to your goals and experience.

Trusted by 2.7 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Software Developer

Carlos Matias La Borde

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Personalized Interview Prep

Skip the LeetCode grind with a custom roadmap that adapts to your goals. Hands-on practice for Coding Interviews, System Design, and more.

Mock Interviews

Test your skills in a simulated interview setting. Receive personalized feedback based on your performance. Available for Coding Interviews, System Design, and more.

AI Prompt

Build prompt engineering skills. Practice implementing AI-informed solutions.

Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Course

Introduction to Data Science with Python

Delve into foundational Python programming, explore libraries like pandas and Matplotlib, and gain insights into data management, analysis, and visualization with practical projects.

4 h 10 m

beginner

Course

Machine Learning with NumPy, pandas, scikit-learn, and More

Delve into practical machine learning with NumPy, pandas, scikit-learn, and more. Gain insights into data analysis, feature engineering, and deep learning using industry-standard frameworks. Basic Python required.

15 h

intermediate

Course

Data Analytics Interview Prep Using Pandas

The ultimate guide to data analytics interviews using Pandas. Strengthen your skills with advanced concepts and practice with real-world interview questions. Developed by FAANG engineers.

2 h 30 m

beginner

Course

Learn to Code: Python for Absolute Beginners

Want to learn how to code? Get hands-on with Python for beginners. Master the basics, solve real-world problems, and confidently build in-demand Python skills for diverse industries.

8 h

beginner

Course

Python 101: Interactively learn how to program with Python 3

This is a 101-level course in Python that will help you learn to program in Python for free.

10 h

beginner

Course

Python 201 - Interactively Learn Advanced Concepts in Python 3

Delve into intermediate and advanced Python: explore key modules, understand Unicode, generators, iterators, master web tasks and effective code testing for enhanced programming skills.

11 h

intermediate

Course

Introduction to Data Science with Python

beginner

4 hour 10 min

Course

Machine Learning with NumPy, pandas, scikit-learn, and More

intermediate

15 hour

Course

Data Analytics Interview Prep Using Pandas