CLOUD LABS
Monitor Industrial Processes Using AWS IoT Core
Learn to build an IoT data pipeline using AWS services, including IoT Core, Kinesis Data Streams, and Amazon S3, for efficient data management and storage.
intermediate
Certificate of Completion
Learning Objectives
In this Cloud Lab, we will learn to create a data pipeline to efficiently gather, process, and securely store industrial data. We will start with creating IAM roles and an S3 bucket required for the pipeline. Next, we will connect our device with IoT Core by creating the required IoT Core infrastructure and then using the security credentials related to our infrastructure to establish a connection between our device and IoT Core. This will conclude the first part of the pipeline—-sending the device data to IoT Core.
The next step is to create a Kinesis Data Stream which will act as a data conduit, allowing data from IoT Core to flow through it efficiently. It will also set the stage for effective and secure transfer of data to Amazon S3 for long-term storage. Once the data stream is created, we will integrate it with IoT Core and test if the integration is working.
Next, we will set up an ETL (Extract, Transform, Load) job. This job is tasked with extracting data from the Kinesis Data Stream and efficiently transferring it to an Amazon S3 bucket for long-term storage. For that, we will first create a catalog table with our kinesis data stream as its source and then write an ETL job to transfer the data from the stream to an Amazon S3 bucket using this catalog table.
After completing this Cloud Lab, you will have gained hands-on experience in setting up an end-to-end data pipeline for IoT data using AWS IoT Core, Kinesis Data Streams, and Amazon S3.
Here is a high-level architecture diagram of the infrastructure that you will create in this Cloud Lab:
Trusted by 1.4 million developers working at companies including
Your method is simple, straight to the point and I can practice with it everywhere, even from my phone, that's something I have never had in other learning platforms.
I highly recommend Educative. The courses are well organized and easy to understand.
I prefer Educative courses because they have a nice mix of text & images. I find that with full video courses, it can often be too easy to go into passive learning mode.
I prefer Educative courses because they have a nice mix of text & images. I find that with full video courses, it can often be too easy to go into passive learning mode.
Your method is simple, straight to the point and I can practice with it everywhere, even from my phone, that's something I have never had in other learning platforms.
I highly recommend Educative. The courses are well organized and easy to understand.
I prefer Educative courses because they have a nice mix of text & images. I find that with full video courses, it can often be too easy to go into passive learning mode.
Get access to Educative Cloud Labs
