0% completed
All LessonsFree Lessons (3)
Getting Started
Introduction
Data Team Structure
Data Team RolesData Team Structure: Embedded or Centralized?Quiz: Data Team Structure
Data Engineering Life Cycle
Set Up the Google CloudIntroduction to Data Engineering Life CycleIngestion, Transformation, and VisualizationStorage and InfrastructureQuiz: Data Engineering Life Cycle
Cloud Data Architecture
Evolution of Cloud Data ArchitectureCloud Service ModelsCloud Data Architectures: Lambda, Kappa, and Data WarehouseCloud Data Architectures: Data Lake and Data MeshPatterns of Good Cloud Data ArchitectureQuiz: Cloud Data Architecture
Data Ingestion
Batch IngestionStream IngestionPush vs. PullIngestion Methods—SFTP, API, and Object StorageIngestion Methods—CDCIngestion Methods—Streaming PlatformIngest with pandasIngest with PySparkQuiz: Data Ingestion
Data Modeling
Introduction to Data ModelingKimball’s Dimensional ModelingSteps of Dimensional ModelingDDL vs. DMLQuery Life CycleChallenge: BigQuery SQLSolution: BigQuery SQLQuiz: Data Modeling
Data Orchestration
What Is Data Orchestration?Airflow BasicsAirflow DAG DesignChallenge: Build an FXRate Reporting Pipeline with AirflowSolution: Build an FXRate Reporting Pipeline with AirflowOrchestration Tool: DagsterOrchestration Tool: dbtQuiz: Data Orchestration

Project

Premium
Mastering Airflow: Building an ETL Pipeline
Data Quality
Data Quality MeasurementData Schema: Avro and ProtobufManage Data Quality in dbtQuiz: Data Quality

Mini Project

Build an End-to-End Data Pipeline for Formula 1 Analysis
Epilogue
The Way Forward
Appendix
Additional Resources
Mock interview
Premium
Data Engineering Fundamentals