HomeCoursesConcurrent Data Processing in Elixir

Updated 27 Aug

AI-powered learning

Save

Concurrent Data Processing in Elixir

Name: Concurrent Data Processing in Elixir
Price: 59 USD
Author: The Pragmatic Programmers

Gain insights into data processing and concurrency in Elixir. Explore GenServer, GenStage, Flow, and Broadway to enhance performance, set up pipelines, and handle increased workloads efficiently.

78 lessons

1 project

11h 10min

Created by The Pragmatic Programmers

What's included

78 lessons across 7 modules
7 quizzes with instant feedback
1 project in preconfigured environments
AI Tutor on every lesson

Join 3.1 million developers at

What You'll Learn

Understand how concurrency works in Elixir
Learn about Elixir supervisors and GenServers
Learn to use data processing pipelines
Learn to use the Flow module in Elixir
Learn to set up data ingestion pipelines

Learning Roadmap

78 Lessons7 Quizzes

Getting Started

Get familiar with concurrent data processing in Elixir and its prerequisites.

What Does This Course Cover?

Course Prerequisites and Intended Audience

Easy Concurrency with the Task Module

Unpack the core of concurrent programming in Elixir with the Task module and supervision.

Introduction to Concurrency

An Introduction to the Task Module

Create the Playground

Start Tasks and Retrieve Results

Synchronous vs. Asynchronous Programs

Retrieve a Task’s Results

Use the await and yield Functions to Retrieve Results

Stop a Task and Async Task

Manage a Series of Tasks

Parameters of the async_stream Function

Link Processes

Meet the Supervisor

Use Task.Supervisor

Understand the “Let It Crash” Philosophy

Wrapping Up

Quiz: Easy Concurrency with the Task Module

Long-Running Processes Using GenServer

19 Lessons

Work your way through GenServer callbacks, process management, and optimizing concurrency in Elixir.

Create a GenServer and Supervisor From Scratch

Project

Premium

Data Processing Pipelines with GenStage

13 Lessons

Find out about GenStage's role in managing data pipelines, back-pressure, and concurrency.

Process Collections with Flow

12 Lessons

Take a closer look at concurrent data processing with Elixir's Flow library for large datasets.

Data Ingestion Pipelines with Broadway

15 Lessons

See how Broadway simplifies data-ingestion pipelines with concurrent processing, batching, and fault tolerance.

Concluding the Course

Learn how to improve your ability to create efficient, scalable Elixir applications.

Course Summary

Certificate of Completion

Showcase your accomplishment by sharing your certificate of completion.

About this course

WHY I WROTE THIS COURSE

Most engineers don’t think that concurrency is distinct from programming. Data processing includes transforming information in some way, like reporting, data aggregation, or analytics. On the other hand, concurrency involves significantly improving performance. This course is designed to help you navigate the world of concurrency tools available in the Elixir ecosystem. You’ll explore popular modules and libraries like GenServer, GenStage, Flow, and Broadway. You’ll be able to ingest data, set up pipelines, and run concurrent processes with Elixir. By the end of the course, you’ll have a wide range of new techniques to simplify your product, improve code performance, and make your application more resilient to increased workloads.

ABOUT THE AUTHOR

The Pragmatic Programmers

We create timely, practical books and learning resources on classic and cutting-edge topics to help you practice your craft and accelerate your career.

Learn more about The

Trusted by 3.1 million developers working at companies

These are high-quality courses. Trust me the price is worth it for the content quality. Educative came at the right time in my career. I'm understanding topics better than with any book or online video tutorial I've done. Truly made for developers. Thanks

Anthony Walker

@_webarchitect_

Just finished my first full #ML course: Machine learning for Software Engineers from Educative, Inc. ... Highly recommend!

Evan Dunbar

ML Engineer

You guys are the gold standard of crash-courses... Narrow enough that it doesn't need years of study or a full blown book to get the gist, but broad enough that an afternoon of Googling doesn't cut it.

Software Developer

Carlos Matias La Borde

I spend my days and nights on Educative. It is indispensable. It is such a unique and reader-friendly site

Souvik Kundu

Front-end Developer

Your courses are simply awesome, the depth they go into and the breadth of coverage is so good that I don't have to refer to 10 different websites looking for interview topics and content.

Vinay Krishnaiah

Software Developer

FOR TEAMS

Interested in this course for your business or team?

Unlock this course (and 1,000+ more) for your entire org with DevPath