HomeCoursesAdvanced pandas—Going Beyond the Basics

Intermediate

16h

Updated 1 month ago

Advanced pandas—Going Beyond the Basics
Save

Explore advanced pandas techniques for reshaping, manipulating, and handling data. Use unique features and extended libraries to optimize workflows and improve data analysis efficiency.

Join 2.7 million developers at

Overview

Content

Reviews

Pandas is an easy-to-use and performant Python library for data manipulation and analysis. It is an important toolkit in a world where the volume of data created and captured is growing exponentially. In this course, you’ll discover an in-depth exploration of the pandas library. The course covers advanced techniques to reshape data, manipulate data, and handle various data types. You will also learn how to use less conventional pandas features to streamline workflows, while also leveraging extended pandas libraries for enhanced data analysis. Whether you are an aspiring data scientist, a researcher, or a seasoned professional looking to sharpen your skills, this course is your pathway to becoming proficient in using pandas to analyze and manipulate data effectively and efficiently.

Pandas is an easy-to-use and performant Python library for data manipulation and analysis. It is an important toolkit in a world...Show More

WHAT YOU'LL LEARN

Understanding of pandas’ extensive capabilities in reading data from different sources

Working knowledge of how to effectively handle different types of data in pandas

Hands-on experience using data reshaping and manipulation techniques in pandas

Ability to leverage extended pandas libraries for advanced capabilities in handling and analyzing data

Familiarity with less conventional yet useful features of pandas

Knowledge of efficiency boosting techniques

Understanding of pandas’ extensive capabilities in reading data from different sources

TAKEAWAY SKILLS

Python

Data Manipulation

Data Plotting

Data Extraction

Data Statistics

Data Science

Analysis Tools

Python 3

Data Collection

Data Cleaning

Data Visualisation

Data Analysis

Data types

Python Programming

Polars

Time Series Analysis

Data Storytelling

Content

94 Lessons10 Quizzes

Before We Begin

1 Lessons

Get familiar with advanced pandas for data manipulation, transformation, and visualization skills.

Course Introduction

Reading Data into pandas

8 Lessons

Get started with reading diverse data formats into pandas for efficient analysis.

Importance of Data Ingestion

Read Data from the Web

Read Data from HTML Files

Read Data from XML Files

Read Data from Statistical Software Files

Read Data from SQL Databases

Read Data from Binary Files (Feather, HDF5, ORC, Parquet)

Quiz

Combining Data

7 Lessons

Examine methods for combining and merging pandas DataFrames to enhance data manipulation.

Importance of Combining Data

Concatenate

Merging—Types of Joins

Merge 2—Implementation

Merging—Scenarios

Combine and Update

Quiz

Reshaping and Manipulating Data

13 Lessons

Enhance your skills in reshaping and manipulating data for effective analysis in pandas.

Importance of Reshaping and Manipulating Data

GroupBy—The groupby() method

GroupBy—Aggregate

GroupBy—Transform and Filter

GroupBy—Further Useful Features

Pivot—Long and Wide Formats

Pivot—The pivot() method

Unpivot

Stack and Unstack

Further Reshaping Capabilities

Advanced Indexing 1

Advanced Indexing 2

Quiz

Encoding Data Types

2 Lessons

Take a closer look at inspecting, converting, and encoding data types in pandas.

Inspect Data Types

Convert and Encode Data Types

Handling Numerical Data

10 Lessons

Focus on advanced arithmetic, comparison, filtering, and statistical methods using pandas.

Arithmetic Operations 1

Arithmetic Operations 2

Comparison Operations

Filtering

Ordered Numerical Data

Discretize and Clip Data

Statistical Methods

Cumulative Operations

Apply Custom Functions

Quiz

Handling Categorical Data

6 Lessons

Master handling and transforming categorical data for efficient and meaningful analysis using pandas.

Encode Categorical Data

Modify Categorical Data

Comparison and Other Common Operations

Factorize and Cross-Tabulate

Other Features and Properties

Quiz

Handling Text Data

7 Lessons

Learn how to use pandas methods for transforming and managing complex text data efficiently.

Text Data Types

String Methods—Basic Transformations and Checks

String Methods—Slice, Split, and Partition

String Methods—Concatenate and Match

String Methods—Find, Extract, and Replace

String Methods—Leading and Trailing Characters

Quiz

Handling Time Series Data

17 Lessons

Unpack the core of advanced pandas techniques for time series analysis, manipulation, and resampling.

Time Series Data Types

Time Series Indexes—Creating Indexes

Time Series Indexes—Slice and Index

Time Series Indexes—Attributes

Time Series Indexes—Methods

Arithmetic Operations with Timedelta and DateOffset

Closer Look at Time Deltas

Business Dates and Holidays

Business Hours

Time Zones

Timeseries Merging

Resampling—Upsample and Downsample

Resampling—Aggregation and Other Parameters

Shifting and Frequency Conversion

Window Operations—Rolling

Window Operations—Weighted, Expanding, and Exponential Moving

Quiz

10.

Handling Sparse Data Structures

2 Lessons

Break apart the techniques for handling and optimizing sparse data structures using pandas.

Sparse Arrays

Accessors and Operations

11.

Handling Missing Data

4 Lessons

Grasp the fundamentals of representing, detecting, and managing missing data in pandas.

Missing Data Representation

Missing Data Detection and Calculations

Managing Missing Data

Quiz

Data Analysis and Visualization with sidetable and Bokeh

Project

12.

Leveraging Further Features of pandas

6 Lessons

Solve problems in advanced pandas features like function chaining, assertions, styling, settings, and efficiency.

Function Chaining with pipe()

Assertion Functions

DataFrame Table Styles

Option Settings

Efficiency Boosts

Quiz

13.

Utilizing Extended Libraries

5 Lessons

Follow the process of leveraging advanced libraries to enhance data analysis with pandas.

14.

Wrap Up

1 Lessons

Build on essential pandas skills for advanced data handling and real-world applications.

Conclusion

15.

Appendix

5 Lessons

Learn how to use setups, prerequisites, and updates for advanced pandas functionalities.

What's New in pandas 2.0

Setup Requirements

Overview of Statistical Software and Binary File Formats

Prerequisite Setup for Reading Data into pandas

Prerequisite Setup for Utilizing Extended Libraries

Time Series Analysis and Visualization Using Python and Plotly

Project

Certificate of Completion

Showcase your accomplishment by sharing your certificate of completion.

Course Author:

Kenneth Leung

Developed by MAANG Engineers

Every Educative resource is designed by our team of ex-MAANG software engineers and PhD computer science educators — subject matter experts who’ve shipped production code at scale and taught the theory behind it. The goal is to get you hands-on with the skills you need to stay ahead in today's constantly evolving tech landscape. No videos, no fluff — just interactive, project-based learning with personalized feedback that adapts to your goals and experience.

Trusted by 2.7 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Software Developer

Carlos Matias La Borde

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI Mock Interviews

Test your skills in a simulated interview setting. Receive personalized feedback based on your performance. Available for Coding Interviews, System Design, and more.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Course

Data Analysis & Processing with Pandas

Gain insights into Pandas' powerful tools for data analysis. Learn about Series, DataFrames, and optimize performance for data operations, filtering, and file uploads in data science and machine learning.

4 h

intermediate

Course

Pandas Brain Teasers

Explore puzzles designed to enhance your critical thinking and problem-solving skills using pandas. Gain insights into common pitfalls and sharpen your data manipulation techniques.

1 h 20 m

intermediate

Course

Machine Learning with NumPy, pandas, scikit-learn, and More

Delve into practical machine learning with NumPy, pandas, scikit-learn, and more. Gain insights into data analysis, feature engineering, and deep learning using industry-standard frameworks. Basic Python required.

15 h

intermediate

Course

Mastering Data Analysis with Python Pandas

Gain insights into using Python Pandas for efficient data analysis and manipulation. Delve into detailed functions, parameters, and methods to elevate your data handling skills.

2 h 25 m

beginner

Course

Effective Data Manipulation with pandas

Delve into effective data manipulation with pandas. Discover filtering, merging, grouping, and reshaping techniques through hands-on examples, best practices, and performance tips for real-world analysis.

24 h

beginner

Course

A Practical Guide to Machine Learning with Python

Explore practical coding of basic machine learning models using Python. Gain insights into algorithms like linear regression, logistic regression, SVM, KNN, and decision trees.

72 h 30 m

beginner

Course

Data Analysis & Processing with Pandas

Machine Learning with NumPy, pandas, scikit-learn, and More