Deliver DynamoDB Records to Amazon S3 Using Kinesis Data Streams

CLOUD LABS

Deliver DynamoDB Records to Amazon S3 Using Kinesis Data Streams

In this lab, you’ll build a real-time data delivery pipeline that streams data from DynamoDB through Kinesis to S3. This challenge-based exercise is designed for hands-on practice; step-by-step instructions will not be provided.

1 Task

intermediate

1hr

Certificate of Completion

Desktop OnlyDevice is not compatible.

No Setup Required

Amazon Web Services

Technologies

Kinesis

DynamoDB

Desktop Only

No Setup Required

Amazon Web Services

Labs Rules Apply

Stay within resource usage requirements.

Do not engage in cryptocurrency mining.

Do not engage in or encourage activity that is illegal.

Cloud Lab Overview

Amazon DynamoDB, Amazon Kinesis Data Streams, and Kinesis Data Firehose form a powerful trio for building event-driven data pipelines. Together, they enable continuous capture and delivery of database changes for analytics, monitoring, and downstream processing.

In this Challenge Cloud Lab, you’ll be tested on your ability to design and implement a continuous data delivery pipeline using these services. You’ll configure DynamoDB streams to capture item-level updates, process them through Kinesis Data Streams, and deliver the data to Amazon S3 using Kinesis Data Firehose, all without step-by-step instructions.

A high-level architecture diagram for this Challenge Cloud Lab is given below:

Cloud Lab Tasks

Implementing a DynamoDB-to-S3 Streaming Pipeline

Labs Rules Apply

Stay within resource usage requirements.

Do not engage in cryptocurrency mining.

Do not engage in or encourage activity that is illegal.

Before you start...

Try these optional labs before starting this lab.

Cloud Lab

Processing Amazon S3 Events Using AWS Lambda

beginner

1hr 30m

Cloud Lab

Working with NoSQL Databases: A Beginner's Guide to AWS DynamoDB

beginner

1hr

Cloud Lab

Building a Logs Processing Pipeline with Amazon Kinesis

beginner

2hr

Cloud Lab

Building a Real-Time Data Pipeline with Kinesis and S3 Tables

intermediate

1hr 30m

Relevant Courses

Use the following content to review prerequisites or explore specific concepts in detail.

Hear what others have to say

Join 1.4 million developers working at companies like

"Your method is simple, straight to the point and I can practice with it everywhere, even from my phone, that's something I have never had in other learning platforms."

Felipe Matheus

Software Engineer

"I highly recommend Educative. The courses are well organized and easy to understand."

Adina Ong

Senior Engineering Manager

"I prefer Educative courses because they have a nice mix of text & images. I find that with full video courses, it can often be too easy to go into passive learning mode."

Clifford Fajardo

Senior Software Engineer

"I love the content on Educative and I feel as if I am definitely improving in my craft."

Thomas Chang

Software Engineer

Learn in-demand tech skills in half the time

PRODUCTS

Mock Interview

New

Courses

Skill Paths

Projects

Assessments

Newsletter

Fenzo

Deliver DynamoDB Records to Amazon S3 Using Kinesis Data Streams

AWS services you’ll be tested on: