Cloud Data Engineering
Cloud data platforms on AWS, GCP and Azure: Redshift, BigQuery, Snowflake, data lakes, lake houses and cost governance
100% Free · All lessons unlocked
Course Content
Foundations
Core concepts and groundwork
Cloud Computing Models — IaaS, PaaS, SaaS for DE
Reading
Networking Basics — VPCs, Subnets, Security Groups
Reading
IAM — Roles, Policies and Least Privilege
Reading
Infrastructure as Code with Terraform
Reading
Cost Optimisation Strategies for Cloud DE Workloads
Reading
Practice — Provision a Terraform VPC and S3 Bucket
Exercise
Core Skills
Essential techniques and patterns
S3 — Storage Classes, Lifecycle and Event Triggers
Reading
AWS Glue — Crawlers, ETL Jobs and Data Catalog
Reading
Amazon Redshift — Architecture and COPY Command
Reading
Amazon EMR — Spark on Managed Hadoop
Reading
Kinesis Data Streams and Kinesis Firehose
Reading
Practice — Build an AWS Glue ETL Job to Redshift
Exercise
Applied Practice
Hands-on, real-world scenarios
BigQuery — Architecture, Slots and Partitioning
Reading
Cloud Storage, Dataflow and Apache Beam
Reading
Pub/Sub for Event Streaming
Reading
Dataproc — Spark on GCP
Reading
BigQuery ML for In-Database Modelling
Reading
Practice — Dataflow Pipeline into BigQuery
Exercise
Advanced Topics
Deeper, more complex material
Azure Data Lake Storage Gen2 and Delta Lake
Reading
Azure Data Factory — Pipelines and Data Flows
Reading
Azure Synapse Analytics Overview
Reading
Azure Databricks — Unified Analytics Platform
Reading
Azure Event Hubs for Streaming Ingestion
Reading
Practice — ADF Pipeline to Synapse Analytics
Exercise
Production & Scale
Building for the real world
Apache Iceberg — Table Format, Schema Evolution, Time-Travel and Partitioning on S3
Reading
Medallion Architecture — Bronze, Silver, Gold
Reading
Serverless Data Processing — Lambda and Cloud Functions
Reading
Multi-Cloud and Hybrid Data Strategies
Reading
FinOps — Tagging, Budgets and Cost Alerts
Reading
Practice — Implement Medallion Lakehouse on S3
Exercise
Mastery & Capstone
Projects and final review
Project Brief — Cloud-Native Lakehouse Pipeline
Reading
Ingest Raw Data to Bronze Layer on S3
Exercise
Transform to Silver with Glue/Spark
Exercise
Build Gold Layer and Query in Athena/BigQuery
Exercise
Capstone — Submit Cloud DE Portfolio Project
Project
100% Free · All lessons unlocked
Topic Overview
What you'll learn
- Core concepts and fundamentals of Cloud Data Engineering
- Industry best practices and design patterns
- Hands-on exercises with real-world scenarios
- Performance optimization and advanced techniques
- Building production-ready applications