Building ETL Pipelines on AWS
Building ETL Pipelines on AWS

CLOUD LABS

Building ETL Pipelines on AWS

In this Cloud Lab, you’ll learn how to create an ETL data pipeline with AWS Glue.

8 Tasks

intermediate

1hr 30m

Certificate of Completion

Desktop OnlyDevice is not compatible.
No Setup Required
Amazon Web Services

Learning Objectives

A thorough understanding of AWS Glue ETL
The ability to set up a visual ETL pipeline
Hands-on experience performing ETL operations on a dataset

Technologies
AWS logoAWS
Glue ETL
S3
DynamoDB logoDynamoDB
Skills Covered
Using AWS Cloud Services
Cloud Lab Overview

AWS Glue is a serverless data integration service that makes it easier to discover, prepare, move, and integrate data from multiple sources. It provides ETL (extract, transform, load) service, which is a process used in data engineering to extract data from various sources, transform it into a desired format, and load it into a target data store for analysis, reporting, and business intelligence. AWS Glue simplifies the ETL process, making it easier for businesses to prepare and transform their data for analytics.

In this Cloud Lab, you’ll create a DynamoDB table as source data. You’ll set up a database in AWS Glue with the DynamoDB table as its source. After that, you’ll use the AWS Glue crawler to fetch metadata from the DynamoDB table and into Data Catalog tables in the Glue database. You’ll then set up an ETL pipeline in AWS Glue and extract data from the Glue database, perform transformations on the data, and load the resulting data in the S3 bucket.

After the completion of this Cloud Lab, the provisioned infrastructure will be similar to the one given below:

The architecture diagram
The architecture diagram

Cloud Lab Tasks
1.Introduction
Getting Started
2.Set Up the Data Stores
Create a DynamoDB Table
Configure and Run a Glue Crawler
Create an S3 bucket
3.Build ETL Pipeline
Create a Visual ETL Pipeline with AWS Glue
Configure and Run the ETL Job
4.Conclusion
Clean Up
Wrap Up
Labs Rules Apply
Stay within resource usage requirements.
Do not engage in cryptocurrency mining.
Do not engage in or encourage activity that is illegal.

Trusted by 1.4 million developers working at companies including

Don’t take our word for it. See what our developers have to say.

Your method is simple, straight to the point and I can practice with it everywhere, even from my phone, that's something I have never had in other learning platforms.

Felipe Matheus
TestimonialsImg

I highly recommend Educative. The courses are well organized and easy to understand.

Adina Ong
TestimonialsImg

I prefer Educative courses because they have a nice mix of text & images. I find that with full video courses, it can often be too easy to go into passive learning mode.

Clifford Fajardo
TestimonialsImg

I prefer Educative courses because they have a nice mix of text & images. I find that with full video courses, it can often be too easy to go into passive learning mode.

Clifford Fajardo
TestimonialsImg
Don’t take our word for it. See what our developers have to say.

Your method is simple, straight to the point and I can practice with it everywhere, even from my phone, that's something I have never had in other learning platforms.

Felipe Matheus
TestimonialsImg

I highly recommend Educative. The courses are well organized and easy to understand.

Adina Ong
TestimonialsImg

I prefer Educative courses because they have a nice mix of text & images. I find that with full video courses, it can often be too easy to go into passive learning mode.

Clifford Fajardo
TestimonialsImg

Get access to Educative Cloud Labs

Course Footer Image
Course Footer Image