HomeCoursesData Science Projects with Python

5.0

Beginner

24h

Updated 3 months ago

Data Science Projects with Python

Learn data science with Python by exploring datasets, building, deploying, and monitoring models alongside mastering logistic regression, decision trees, gradient boosting, and SHAP values.

Join 2.7 million developers at

Overview

Content

Reviews

As businesses gather vast amounts of data, machine learning is becoming an increasingly valuable tool for utilizing data to deliver cutting-edge predictive models that support informed decision-making. In this course, you will work on a data science project with a realistic dataset to create actionable insights for a business. You’ll begin by exploring the dataset and cleaning it using pandas. Next, you will learn to build and evaluate logistic regression classification models using scikit-learn. You will explore the bias-variance trade-off by examining how the logistic regression model can be extended to address the overfitting problem. Then, you will train and visualize decision tree models. You'll learn about gradient boosting and understand how SHAP values can be used to explain model predictions. Finally, you’ll learn to deliver a model to the client and monitor it after deployment. By the end of the course, you will have a deep understanding of how data science can deliver real value to businesses.

As businesses gather vast amounts of data, machine learning is becoming an increasingly valuable tool for utilizing data to deli...Show More

WHAT YOU'LL LEARN

Hands-on experience in data exploration, data processing, data modeling and data visualization using pandas, scikit-learn, and Matplotlib

The ability to evaluate model performance and interpret model predictions

Working knowledge of how predictive models can support business decision-making

An understanding of the mathematical foundations of machine learning models

Hands-on experience in data exploration, data processing, data modeling and data visualization using pandas, scikit-learn, and Matplotlib

Content

98 Lessons7 Projects7 Quizzes

Introduction

2 Lessons

Get familiar with machine learning's role in data science and essential Python libraries.

Overview

Course Structure

Data Exploration and Cleaning

16 Lessons

Discover the logic behind data exploration and cleaning for effective data science projects.

Introduction: Python for Data Science

Exercise: Getting Familiar with Python

Different Types of Data Science Problems

Introduction to Jupyter and pandas

Exercise: Loading the Case Study Data in a Jupyter Notebook

Getting Familiar with Data and Performing Data Cleaning

Exercise: Verifying Basic Data Integrity

Boolean Masks

Exercise: Continuing Verification of Data Integrity

Exercise: Exploring and Cleaning the Data

Exercise: Exploring the Credit Limit and Demographic Feature

Deep Dive: Categorical Features

Exercise: Implementing OHE for a Categorical Feature

Exploring the Financial History Features in the Dataset

Summary: Data Exploration and Cleaning

Quiz: Data Exploration and Cleaning

(Challenge) Exploring Remaining Financial Features in Dataset

Project

Introduction to scikit-learn and Model Evaluation

14 Lessons

Examine scikit-learn tools for model training, evaluation metrics, and generating synthetic data.

Introduction: scikit-learn and Model Evaluation

The Response Variable and Concluding the Initial Exploration

scikit-learn

Generating Synthetic Data

Exercise: Linear Regression in scikit-learn

Model Performance Metrics for Binary Classification

Splitting the Data: Training and Test Sets

Classification Accuracy

Exercise: Calculating True and False Rates and Confusion Matrix

Exercise: Obtaining Probabilities from Logistic Regression Model

The Receiver Operating Characteristic (ROC) Curve

Precision

Summary: Introduction to scikit-learn and Model Evaluation

Quiz: Introduction to scikit-learn and Model Evaluation

Fake News Detection Using Scikit-learn

Project

Premium

(Challenge) Logistic Regression and Precision-Recall Curve

Project

Details of Logistic Regression and Feature Extraction

16 Lessons

Break down complex ideas in logistic regression, feature extraction, and their practical applications.

Introduction: Logistic Regression and Feature Extraction

Examining Relationships Between Features and Response Variable

Pearson Correlation

Mathematics of Linear Correlation

Exercise: F-test and Univariate Feature Selection

Finer Points of the F-test

Exercise: Visualizing the Feature and Response Variable Relationship

Univariate Feature Selection

Exercise: Plotting the Sigmoid Function

Scope of Functions

Why Is Logistic Regression Considered a Linear Model?

Exercise: Finding Appropriate Features for Logistic Regression

Logistic Regression Predictions Using Sigmoid

Exercise: Linear Decision Boundary of Logistic Regression

Summary: Details of Logistic Regression and Feature Extractor

Quiz: Details of Logistic Regression and Feature Extraction

(Challenge) Logistic Regression Model and Coefficients

Project

The Bias-Variance Trade-Off

14 Lessons

Map out the steps for regularization, cross-validation, and gradient descent in logistic regression.

Introduction: The Bias-Variance Trade-Off

Estimating the Coefficients and Intercepts of Logistic Regression

Gradient Descent to Find Optimal Parameter Values

Exercise: Using Gradient Descent to Minimize a Cost Function

Assumptions of Logistic Regression

The Motivation for Regularization

Exercise: Generating and Modeling Synthetic Classification Data

Lasso (L1) and Ridge (L2) Regularization

Cross-Validation

Exercise: The Synthetic Data Classification Problem

Options for Logistic Regression in scikit-learn

Scaling Data, Pipelines, and Interaction Features in Scikit-Learn

Summary: The Bias-Variance Trade-Off

Quiz: The Bias-Variance Trade-Off

(Challenge) Cross-Validation and Feature Engineering

Project

Decision Trees and Random Forests

13 Lessons

Tackle decision trees and random forests to enhance predictive modeling and handle non-linear data.

Introduction: Decision Trees and Random Forests

Decision Trees

Exercise: A Decision Tree in scikit-learn

Training Decision Trees: Node Impurity

Training Decision Trees: Greedy Algorithm and Stopping Criteria

Using Decision Trees: Advantages and Predicted Probabilities

A More Convenient Approach to Cross-Validation

Exercise: Find Optimal Hyperparameters for a Decision Tree

Random Forests: Predictions and Ensembles of Decision Trees

Exercise: Fitting a Random Forest

Checkerboard Graph

Summary: Decision Trees and Random Forests

Quiz: Decision Trees and Random Forests

(Challenge) Cross-Validation Grid Search with Random Forest

Project

Gradient Boosting, XGBoost, and SHAP Values

12 Lessons

Master advanced techniques in gradient boosting, XGBoost, and SHAP values for model performance and interpretation.

Introduction: XGBoost

Gradient Boosting and XGBoost

XGBoost Hyperparameters: Early Stopping

XGBoost Hyperparameters: Tuning the Learning Rate

Other Important Hyperparameters in XGBoost

Exercise: Randomized Grid Search to Tune XGBoost Hyperparameters

Another Way of Growing Trees: XGBoost's grow_policy

Explaining Model Predictions with SHAP Values

Exercise: SHAP Visualization and Analysis

Missing Data

Summary: Gradient Boosting, XGBoosting, and SHAP Values

Quiz: Gradient Boosting, XGBoosting, and SHAP Values

(Challenge) XGBoost and SHAP Explanation for Case Study Data

Project

Predict Frog Toxicity with Python and XGBoost

Project

Premium

Test Set Analysis, Financial Insights, and Delivery to the Client

10 Lessons

Learn how to use test set analysis for model evaluation, financial insights, and client delivery.

Introduction: Test Set Analysis

Review of Modeling Results

Model Performance on the Test Set

Distribution of Predicted Probability and Decile Chart

Exercise: Equal-Interval Chart

Calibration of Predicted Probabilities

Financial Analysis

Exercise: Characterizing Costs and Savings

Summary: Analysis, Financial Insights, and Delivery to the Client

Quiz: Test Set Analysis and Financial Insights

(Challenge) Deriving Financial Insights

Project

Appendix

1 Lessons

Create a Jupyter Notebook locally with recommended hardware, software, and Anaconda.

How to Create Jupyter Notebook Locally

Certificate of Completion

Showcase your accomplishment by sharing your certificate of completion.

Course Author:

Packt

Developed by MAANG Engineers

Every Educative lesson is designed by our in-house team of ex-MAANG software engineers and PhD computer science educators, and developed in consultation with developers and data scientists working at Meta, Google, and more. Our mission is to get you hands-on with the necessary skills to stay ahead in a constantly changing industry. No video, no fluff. Just interactive, project-based learning with personalized feedback that adapts to your goals and experience.

Trusted by 2.7 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Software Developer

Carlos Matias La Borde

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Personalized Interview Prep

Skip the LeetCode grind with a custom roadmap that adapts to your goals. Hands-on practice for Coding Interviews, System Design, and more.

Mock Interviews

Test your skills in a simulated interview setting. Receive personalized feedback based on your performance. Available for Coding Interviews, System Design, and more.

AI Prompt

Build prompt engineering skills. Practice implementing AI-informed solutions.

Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Course

An Introductory Guide to Data Science and Machine Learning

Gain insights into data science fundamentals, explore machine learning and big data, and delve into real-time projects. Discover systematic approaches to data acquisition, wrangling, and solving diverse problems.

6 h

beginner

Course

Data Science in Production: Building Scalable Model Pipelines

Gain insights into building scalable data and model pipelines, explore different cloud environments, delve into streaming workflows, and discover essential tools for creating real-time data products.

8 h

advanced

Course

Data Science Interview Handbook

The ultimate guide to data science interviews. Developed by FAANG engineers, it covers Python, algorithms, ML concepts, and interview questions. Get interview-ready in just a few hours.

9 h

intermediate

Course

Python 3: From Beginner to Advanced

Gain insights into Python by exploring basic to advanced concepts, including loops, classes, and GUIs with Tkinter. Delve into testing and become a productive Python programmer.

4 h

beginner

Course

Data Science for Non-Programmers

Discover how to conduct data analysis in Python without prior programming experience. Discover Python basics, data preprocessing, EDA, and predictive analytics for solving business problems.

13 h

beginner

Course

Fundamentals of Machine Learning for Software Engineers

Explore machine learning's essentials for software engineers, delve into supervised learning, neural networks, and deep learning, and gain skills to tackle real-world data challenges effectively.

15 h

beginner

Course

An Introductory Guide to Data Science and Machine Learning

beginner

6 hour

Course

Data Science in Production: Building Scalable Model Pipelines

advanced

8 hour

Course

Data Science Interview Handbook