HomeCoursesLearn to Use HPC Systems and Supercomputers

4.6

Beginner

Learn to Use HPC Systems and Supercomputers

Gain insights into using HPC systems and supercomputers to solve large computational problems. Explore HPC components, software stacks, job schedulers, and parallel programming, including Open MP, MPI, and GPU coding.

Join 2.7 million developers at

Overview

Content

Reviews

Learn to use High Performance Computing (HPC) Systems and solve large computational problems. This course assumes basic familiarity with the Bash command line environment found on GNU/Linux and other Unix-like environments. This course is of the first of its kind, should be your second step from my previous Educative course "Learn to Analyze Text Data in Bash Shell and Linux" You'll learn: - Intro to HPC Systems and Supercomputers - HPC system's basic components - HPC software stack - HPC job schedulers and batch systems (PBS and Slurm with demos) - Introduction to parallel programming (Open MP, MPI and GPU coding) Video demos are included, I think it is a must have course for students, researchers, big data analysts, and developers. It will help you to utilize High Performance Computing systems at your institution. Non-interactive course. More details at: www.scientificprogramming.io/learn-hpc

Learn to use High Performance Computing (HPC) Systems and solve large computational problems. This course assumes basic famili...Show More

Content

53 Lessons

Supercomputers and HPC clusters

4 Lessons

Solve problems in supercomputing history, examples, cluster computing, and its benefits.

A Little bit of Supercomputing history

Supercomputing examples

HPC cluster computers

Benefits of using cluster computing

Components of a HPC system

5 Lessons

Discover the logic behind HPC components, including nodes for management, computation, storage, and user access.

Components of a HPC cluster

Compute node(s)

Master node(s)

Storage node(s)

HPC software stack

5 Lessons

Go hands-on with accessing HPC systems, data transfer, software lists, modules, and job schedulers.

PBS - Portable Batch System

12 Lessons

Grasp the fundamentals of PBS for efficient job management and scripting in HPC systems.

A simple PBS job script

PBS interactive jobs

PBS arrays

PBS Matlab example

SLURM -Workload Manager

8 Lessons

Solve problems in managing HPC with SLURM, from job execution to dependencies.

Introduction to Slurm

Slurm commands

A simple Slurm job

Slurm distrbuted MPI and GPU jobs

Slurm multi-threaded OpenMP jobs

Slurm interactive jobs

Slurm array jobs

Slurm job dependencies

Parallel programming - OpenMP

8 Lessons

See how it works to utilize OpenMP for efficient parallel programming with threads and shared memory.

OpenMP

OpenMP basics

Open MP - clauses

OpenMP - worksharing constructs

OpenMP- Hello world!

Open MP - reduction and parallel `for-loop`

OpenMP - section parallelization

OpenMP vector addition

Parallel programming - MPI

5 Lessons

Build on MPI principles, program structures, and practical examples for effective parallel programming.

MPI - Message Passing Interface

MPI program stucture

MPI - hello world!

MPI send/ receive

MPI `ping-pong` send and receive example

Parallel programming - GPU and CUDA

4 Lessons

Try out parallel programming with GPUs using CUDA for high-performance applications.

GPUs - graphics processing units

GPU Programming - CUDA

CUDA - hello world!

CUDA - vector additon demo

Conclusions and references

2 Lessons

Discover the logic behind using HPC systems, key commands, and essential references.

Conclusion

References

Certificate of Completion

Showcase your accomplishment by sharing your certificate of completion.

Course Author:

Scientific Programmer

Developed by MAANG Engineers

Every Educative lesson is designed by a team of ex-MAANG software engineers and PhD computer science educators, and developed in consultation with developers and data scientists working at Meta, Google, and more. Our mission is to get you hands-on with the necessary skills to stay ahead in a constantly changing industry. No video, no fluff. Just interactive, project-based learning with personalized feedback that adapts to your goals and experience.

Trusted by 2.7 million developers working at companies

"These are high-quality courses. Trust me. I own around 10 and the price is worth it for the content quality. EducativeInc came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks"

Anthony Walker

@_webarchitect_

"Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!"

Evan Dunbar

ML Engineer

"You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it."

Software Developer

Carlos Matias La Borde

"I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site"

Souvik Kundu

Front-end Developer

"Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content."

Vinay Krishnaiah

Software Developer

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Personalized Interview Prep

Skip the LeetCode grind with a custom roadmap that adapts to your goals. Hands-on practice for Coding Interviews, System Design, and more.

Mock Interviews

Test your skills in a simulated interview setting. Receive personalized feedback based on your performance. Available for Coding Interviews, System Design, and more.

AI Prompt

Build prompt engineering skills. Practice implementing AI-informed solutions.

Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!

Free Resources

FOR TEAMS

Interested in this course for your business or team?

Unlock this course (and 1,000+ more) for your entire org with DevPath