Back To Module Home

Data Analysis & Processing with Pandas

0% completed

Introduction

Introduction Fundamental Data Structures in pandas Creating a Series Object Create a Series From a Numpy ndarray and a Scalar Value Manipulating Series Objects Creating a DataFrame From Arrays and Lists Creating a DataFrame From a Series Creating a DataFrame From a File Quiz

Basic Operations on DataFrames

Indexing and Slicing Description Challenge - Overall Description of the Data Challenge Solution Review Concatenation Grouping Data __ Part 1 Grouping Data __ Part 2 Deletion in a DataFrame Select Data From DataFrame Merging in a DataFrame Challenge - Group by a Single Column and Analyze Challenge Solution Review Sorting a DataFrame Apply Function to a DataFrame Iteration Data in DataFrame Challenge - Find the Most Popular Item Challenge Solution Review Quiz

Other topics

Deal with Missing Value Export Data to File Export Data to File String Type Challenge - Drop Duplicated Rows on SN Challenge Solution Review Deal With datetime Type Conversion Rename Columns Drop Duplicate Row Quiz

Improve performance

Speed up File Loading

Reduce Memory Usage

Speed up Column Operations

Optimized Data Filtering

...

/

Speed up File Loading

Speed up File Loading

In this lesson, we show how to speed up file loading.

You may notice one thing, if you load a large CSV file into the DataFrame, the object may be very slow. It’s a time-consuming operation. If your file is a static file, it won’t change frequency. If loading this file frequently and doing data analysis is part of your job, then reducing file load time would be a very useful operation.

Export DataFrame object to `hdf` file format

There is a method to export your static file ...