Visualizing Live Streaming Data with Elixir, Kafka, and Chart.js

In this project, we’ll use the popular message streaming service Kafka with two Elixir applications. The two primary processes in Kafka are the producer, which sends messages, and the consumer, which receives those messages. We’ll use the Kaffe wrapper library to interface Kafka and your Elixir code.

We’ll first start the Kafka and Zookeeper servers. Then, we’ll develop the producer application. This application will send the CPU utilization percentage and the memory used by all the processes to the Kafka server.

After configuring and implementing the producer, we’ll modify an already-given basic consumer application to receive those messages. Then, we’ll plot the data in a real-time chart using the Chart.js library.