AI-powered learning
Save this course
Optimization for Machine Learning with NumPy and SciPy
Learn optimization for machine learning, including gradients, convex optimization, and gradient descent. Explore constrained optimization and advanced methods using NumPy and SciPy.
62 Lessons
2 Projects
9h
Join 2.9 million developers at
Join 2.9 million developers at
LEARNING OBJECTIVES
- An understanding of how real-world problems can be framed as optimization problems
- Working knowledge about the taxonomy of optimization problems and techniques
- Familiarity with the fundamental concepts of optimization
- Hands-on experience implementing popular optimization algorithms
- The ability to solve popular machine learning problems using optimization
Learning Roadmap
1.
Introduction to Optimization
Introduction to Optimization
Get familiar with optimization techniques, algorithms, and their applications in machine learning.
2.
Vector Calculus
Vector Calculus
Discover the logic behind differentiation, gradients, Hessian, Taylor series, and integrals in vector calculus.
Differentiation of the Univariate FunctionsPartial Derivatives and GradientsGradients of the Vector-Valued FunctionsGradients of MatricesHigher-Order Gradients: HessianLinearization and the Taylor SeriesIntegrals and the Trapezoidal RuleQuiz Yourself on Vector CalculusChallenge: The Taylor SeriesSolution: The Taylor Series
3.
Convex Optimization
Convex Optimization
14 Lessons
14 Lessons
Examine convex optimization techniques, including gradient methods, ridge regression, and Fisher analysis.
4.
Gradient Descent for Non-Convex Optimization
Gradient Descent for Non-Convex Optimization
10 Lessons
10 Lessons
Grasp the fundamentals of advanced gradient descent techniques for optimizing non-convex problems.
5.
Constrained Optimization
Constrained Optimization
10 Lessons
10 Lessons
Explore constrained optimization using linear programming, simplex method, and Lagrange duality.
6.
Miscellaneous Methods
Miscellaneous Methods
9 Lessons
9 Lessons
Tackle diverse optimization techniques, including Newton's, Quasi-Newton, barrier methods, and SciPy utilities.
Certificate of Completion
Showcase your accomplishment by sharing your certificate of completion.
Complete more lessons to unlock your certificate
Developed by MAANG Engineers
ABOUT THIS COURSE
In this course, you will learn about optimization, one of the fundamental pillars of mathematics and machine learning. Machine learning depends heavily on optimization because it allows the model to learn from data and generate precise predictions.
You will begin by introducing optimization. Then, you will learn about optimization basics, including gradients and integrals. Next, you will cover convex optimization. You will then learn how to compute gradient descent for non-convex optimization. Next, you’ll learn how to perform constrained optimization. You will finish the course by studying the miscellaneous methods of optimization, like Newton’s methods, quasi-Newton methods, and conjugate gradient descent.
After completing this course, you’ll have the practical skills to formulate, analyze, and implement optimization algorithms for machine learning using the NumPy and SciPy libraries. This will help you become a highly proficient data scientist or machine learning engineer.
ABOUT THE AUTHOR
Puneet Mangla
Data and Applied Scientist at Microsoft Advertising working on Ad quality checks. As a part-time technical writer, I love teaching machine learning concepts through blogs and courses.
Trusted by 2.9 million developers working at companies
A
Anthony Walker
@_webarchitect_
E
Evan Dunbar
ML Engineer
S
Software Developer
Carlos Matias La Borde
S
Souvik Kundu
Front-end Developer
V
Vinay Krishnaiah
Software Developer
Built for 10x Developers
No Passive Learning
Learn by building with project-based lessons and in-browser code editor


Personalized Roadmaps
The platform adapts to your strengths & skills gaps as you go


Future-proof Your Career
Get hands-on with in-demand skills


AI Code Mentor
Write better code with AI feedback, smart debugging, and "Ask AI"




MAANG+ Interview Prep
AI Mock Interviews simulate every technical loop at top companies


Free Resources