HomeCoursesDeep Learning with PyTorch Step-by-Step: Part I - Fundamentals

Beginner

Deep Learning with PyTorch Step-by-Step: Part I - Fundamentals
Save

Delve into PyTorch basics: autograd, model classes, datasets, and data loaders. Gain insights into model development while avoiding common pitfalls. Start creating and training your own PyTorch models.

Join 2.7 million developers at

Overview

Content

Reviews

This course is designed to provide you with an easy-to-follow, structured, incremental, and from-first-principles approach to learning PyTorch. In this course, you’ll be introduced to the fundamentals of PyTorch: autograd, model classes, datasets, data loaders, and more. You will develop, step-by-step, not only the models themselves but also your understanding of them. You'll be shown both the reasoning behind the code and how to avoid some common pitfalls and errors along the way. By the time you finish this course, you’ll have a thorough understanding of the concepts and tools necessary to start developing and training your own models using PyTorch.

This course is designed to provide you with an easy-to-follow, structured, incremental, and from-first-principles approach to le...Show More

TAKEAWAY SKILLS

Python

Machine Learning

Deep Learning

Neural Networks

PyTorch

Content

92 Lessons20 Quizzes

Introduction

2 Lessons

Get familiar with PyTorch's pythonic nature and foundational concepts designed for beginners.

Why PyTorch?

Course Overview

Visualizing Gradient Descent

15 Lessons

Unpack the core of visualizing gradient descent, exploring parameter updates, learning rates, and feature scaling using a linear regression model in Numpy.

Spoilers

Gradient Descent

Data Generation

Basic Steps for Using Gradient Descent (Step 0 and 1)

Step 2a - Compute the Loss

Step 2b - Computing the Loss Surface

Step 3 - Compute the Gradients

Step 4 - Update the Parameters

Learning Rate

Scaling the Dataset

Step 5 - Rinse and Repeat!

Recap

Quiz

Challenge 1 - Visualizing Gradient Descent

Solution Review - Visualizing Gradient Descent

A Simple Regression Problem

21 Lessons

Master the steps to implement linear regression with PyTorch, covering tensors, autograd, optimizers, and model creation.

Spoilers

Reviewing the Steps of Gradient Descent

Linear Regression in Numpy

PyTorch Tensors

Loading Data, Devices, and CUDA

Dynamic Computation Graphs

Putting It All Together

Recap

Quiz

Challenge 2 - A Simple Regression Problem

Solution Review: A Simple Regression Problem

Rethinking the Training Loop

17 Lessons

Grasp the fundamentals of creating an effective training loop in PyTorch.

Spoilers

Introducing Higher-Order Functions

Rethinking the Training Loop

Building a Dataset

DataLoader

Quiz

Mini-Batch Inner Loop and Training Split

Evaluation

TensorBoard

SummaryWriter

Saving and Loading Models

Deploying / Making Predictions

Putting It All Together

Recap

Quiz

Challenge 3 - Rethinking the Training Loop

Solution Review - Rethinking the Training Loop

Going Classy

15 Lessons

Deepen your knowledge of creating and integrating a PyTorch class, enhancing code management.

Spoilers

Going Classy

Functions

Different Method Types

Training Methods

Saving and Loading Methods

Finalising the Methods needed for going Classy

Classy Pipeline

Model Training and Predictions

Checkpointing

Putting It All Together

Recap

Quiz

Challenge 4 - Going Classy

Solution Review - Going Classy

A Simple Classification Problem

19 Lessons

See how it works to build and evaluate a binary classification model using PyTorch.

Spoilers

Classification Problems

Model for Classification Problems

Sigmoid and Logistic Regression

Quiz

Loss

Binary Cross-Entropy Loss in PyTorch

Imbalanced Dataset

Model Configuration, Training, and Predictions for Classification

Decision Boundary

Classification Threshold and Confusion Matrix

Metrics

Trade-offs and Curves

Best + Worst Curves and Models

Putting it All Together

Recap

Quiz

Challenge 5 - A Simple Classification Problem

Solution Review: A Simple Classification Problem

Conclusion

1 Lessons

Build on your deep learning skills by exploring further and staying engaged.

What's Next?

Appendix

2 Lessons

Get familiar with setting up Jupyter notebooks and running TensorBoard for deep learning tasks.

Setup Guide

Running TensorBoard

Certificate of Completion

Showcase your accomplishment by sharing your certificate of completion.

Course Author:

Daniel Voigt Godoy

Developed by MAANG Engineers

Every Educative resource is designed by our in-house team of ex-MAANG software engineers and PhD computer science educators — subject matter experts who’ve shipped production code at scale and taught the theory behind it. The goal is to get you hands-on with the skills you need to stay ahead in today's constantly evolving tech landscape. No videos, no fluff — just interactive, project-based learning with personalized feedback that adapts to your goals and experience.

Trusted by 2.7 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Software Developer

Carlos Matias La Borde

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI Mock Interviews

Test your skills in a simulated interview setting. Receive personalized feedback based on your performance. Available for Coding Interviews, System Design, and more.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Free Resources

FOR TEAMS

Interested in this course for your business or team?

Unlock this course (and 1,000+ more) for your entire org with DevPath

Deep Learning with PyTorch Step-by-Step: Part I - Fundamentals Save

Deep Learning with PyTorch Step-by-Step: Part I - Fundamentals
Save