Kinds of Parallel Programming
Understand the main types of parallel programming in C, including shared and distributed memory models. Learn to differentiate embarrassingly parallel problems, which can be easily split across processing units, from inherently serial problems that require sequential computation. Discover how mixed parallel and serial tasks appear in real-world applications like neural networks, and how parallelism can improve performance in various scenarios.
We'll cover the following...
There are many kinds of parallel programming, some are general and can be run on any hardware while others are specific to particular hardware architectures.
Two main paradigms we can talk about here are shared memory and distributed memory models. In shared memory models, multiple processing units have access to the same shared memory ...