0% completed

All LessonsFree Lessons (3)

Getting Started

Data Team Structure

Data Team Roles

Data Team Structure: Embedded or Centralized?

Quiz: Data Team Structure

Data Engineering Life Cycle

Set Up the Google Cloud Introduction to Data Engineering Life Cycle Ingestion, Transformation, and Visualization Storage and Infrastructure Quiz: Data Engineering Life Cycle

Cloud Data Architecture

Evolution of Cloud Data Architecture Cloud Service Models Cloud Data Architectures: Lambda, Kappa, and Data Warehouse Cloud Data Architectures: Data Lake and Data Mesh Patterns of Good Cloud Data Architecture Quiz: Cloud Data Architecture

Data Ingestion

Batch Ingestion Stream Ingestion Push vs. Pull Ingestion Methods—SFTP, API, and Object Storage Ingestion Methods—CDC Ingestion Methods—Streaming Platform Ingest with pandas Ingest with PySpark Quiz: Data Ingestion

Data Modeling

Introduction to Data Modeling Kimball’s Dimensional Modeling Steps of Dimensional Modeling DDL vs. DML Query Life Cycle Challenge: BigQuery SQL Solution: BigQuery SQL Quiz: Data Modeling

Data Orchestration

What Is Data Orchestration?Airflow Basics Airflow DAG Design Challenge: Build an FXRate Reporting Pipeline with Airflow Solution: Build an FXRate Reporting Pipeline with Airflow Orchestration Tool: Dagster Orchestration Tool: dbt Quiz: Data Orchestration

Project

Mastering Airflow: Building an ETL Pipeline

Data Quality

Data Quality Measurement Data Schema: Avro and Protobuf Manage Data Quality in dbt Quiz: Data Quality

Mini Project

Build an End-to-End Data Pipeline for Formula 1 Analysis

Epilogue

The Way Forward

Appendix

Additional Resources

Data Engineering Foundations in Python/

...

/

Quiz: Data Team Structure

Quiz: Data Team Structure

Test your knowledge of data team structures.

We'll cover the following...

Technical Quiz

1.

What’s the main role of an analytics engineer?

A.

Building data infrastructure

B.

Bridging the gap between data engineers and data analysts/scientists

C.

Presenting data insights to stakeholders

D.

Making predictions based on the data

1 / 5

...