4.3
Beginner
14h
Building a Machine Learning Pipeline from Scratch
Learn about ML pipeline development, delve into best practices, discover advanced Python concepts, and explore testing methodologies to elevate your software engineering skills and career prospects.
Machine learning (ML) has matured into a mainstream development activity, and data scientists are expected to be able to write production-grade training pipelines. This course will provide you with a foundation in ML pipeline development guided by best practices in software engineering.
You’ll start by learning about code organization, style, and conceptual ideas, such as topological sorting of directed acyclic graphs. You’ll dive into the hands-on development of an ML pipeline. You’ll learn some advanced Python concepts and useful libraries. Finally, you’ll learn about testing methodologies and how to package your code into a distributable library.
By the end of this course, you’ll understand what makes a great ML pipeline work, better appreciate software engineering processes, improve your Python knowledge, and learn how to build ML training pipelines. This knowledge will make you more attractive to potential employers and improve your chances of thriving as a new data scientist.
Machine learning (ML) has matured into a mainstream development activity, and data scientists are expected to be able to write p...Show More
WHAT YOU'LL LEARN
An understanding of what constitutes as a machine learning training pipeline
Hands-on experience building a machine learning pipeline in Python
Familiarity with advanced Python concepts, such as abstract base classes and mixins
An understanding of software engineering best practices, including code style, documentation, and logging
A working knowledge of unit testing in Python
An understanding of what constitutes as a machine learning training pipeline
Show more
TAKEAWAY SKILLS
Content
2.
Getting Started
3 Lessons
Look at how traditional engineering practices enhance ML pipeline stability and collaboration.
3.
Structuring the ML Pipeline
6 Lessons
Break apart the ML pipeline structure, directory organization, code style, and dependency management.
4.
Directed Acyclic Graphs (DAGs)
3 Lessons
Break down the steps to construct and sort DAGs for machine learning tasks.
5.
The ML Library
8 Lessons
Unveil object-oriented implementation, configuration management, dataset and model handling, and report generation in ML pipelines.
6.
The Pipeline Core
7 Lessons
Follow the process of structuring machine learning pipelines, including argument parsing, logging, and tracking experiments.
7.
Extending the Pipeline
2 Lessons
Build on extending machine learning pipelines to support new datasets and models effectively.
8.
Testing
4 Lessons
Step through unit testing, Pytest for code coverage, and comprehensive system testing.
9.
Deployment
2 Lessons
Get started with packaging and deploying machine learning models for consistent predictions.
10.
Other Considerations
4 Lessons
Explore considerations for data quality monitoring, reproducibility, and leveraging off-the-shelf ML solutions.
Certificate of Completion
Showcase your accomplishment by sharing your certificate of completion.
Course Author:
Developed by MAANG Engineers
Trusted by 2.8 million developers working at companies
"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"
Anthony Walker
@_webarchitect_
"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"
Evan Dunbar
ML Engineer
"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."
Software Developer
Carlos Matias La Borde
"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"
Souvik Kundu
Front-end Developer
"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."
Vinay Krishnaiah
Software Developer
Hands-on Learning Powered by AI
See how Educative uses AI to make your learning more immersive than ever before.
AI Prompt
Code Feedback
Explain with AI
AI Code Mentor
Free Resources
