0% completed

All LessonsFree Lessons (5)

Supercomputers and HPC clusters

A Little bit of Supercomputing history Supercomputing examples HPC cluster computers Benefits of using cluster computing

Components of a HPC system

Components of a HPC cluster Login node(s)Compute node(s)Master node(s)Storage node(s)

HPC software stack

Access to HPC Data Transfer HPC software list HPC software modules Job Schedulers

PBS - Portable Batch System

Introduction to PBS PBS basic commands PBS `qsub`PBS `qstat`PBS `qdel` command PBS `qalter`PBS job states PBS variables A simple PBS job script PBS interactive jobs PBS arrays PBS Matlab example

SLURM -Workload Manager

Introduction to Slurm Slurm commands A simple Slurm job Slurm distrbuted MPI and GPU jobs Slurm multi-threaded OpenMP jobs Slurm interactive jobs Slurm array jobs Slurm job dependencies

Parallel programming - OpenMP

OpenMP OpenMP basics Open MP - clauses OpenMP - worksharing constructs OpenMP- Hello world!Open MP - reduction and parallel `for-loop`OpenMP - section parallelization OpenMP vector addition

Parallel programming - MPI

MPI - Message Passing Interface

MPI program stucture

MPI - hello world!

MPI send/ receive

MPI `ping-pong` send and receive example

Parallel programming - GPU and CUDA

GPUs - graphics processing units GPU Programming - CUDA CUDA - hello world!CUDA - vector additon demo

Conclusions and references

Conclusion References

Learn to Use HPC Systems and Supercomputers/

...

/

MPI program stucture

MPI program stucture

We'll cover the following...

MPI uses objects called communicators and groups to define which collection of processes may communicate with each other. Most MPI routines require you to specify a communicator as an argument.

MPI program schema

It is very important to learn the MPI program structure before we proceed to ...