GenStage producers

The Broadway library is an excellent choice when working with popular message brokers. However, it’s not limited to just that. Broadway could be useful in a wide range of use cases where we need a data-processing pipeline with built-in dynamic batching. We only have to bring our own GenStage producer and Broadway will happily do the work for us. We’ll see how this works by revisiting the scraper project one last time. We already used GenStage and Flow to implement it, so it will be great to implement another version using Broadway, for comparison.

Replace :flow with :broadway

Let’s start by replacing :flow with :broadway in the dependencies’ list:

Get hands-on with 1200+ tech skills courses.