Melbourne Workshop: Building Modern Data Pipelines with Mage & Iceberg

Join Cloud Shuttle for an intensive hands-on workshop where you'll learn to build modern data pipelines using Mage AI and Apache Iceberg. Perfect for data engineers and analytics professionals looking to enhance their data pipeline capabilities.

What You'll Learn

Introduction to Mage AI and its key features

Understanding Apache Iceberg and its advantages over traditional data lakes

Hands-on experience building a real-world pipeline:

Fetching weather data

Transforming data using Mage blocks

Loading data into Apache Iceberg

Best practices for production-grade data pipelines

Hands-on Workshop Agenda

1. Mage AI & Iceberg Foundations (30 mins)

Mage concepts and key features

Apache Iceberg fundamentals

Setting up your development environment

2. Building Your First Pipeline (75 mins)

Creating Iceberg table structures

Implementing data loader blocks

Adding transformation logic

Configuring Iceberg data export

Testing and verification

3. Q&A and Best Practices (15 mins)

Common issues and solutions

Production deployment considerations

Cloud Shuttle's real-world insights

Prerequisites

Basic understanding of Python

Familiarity with data engineering concepts

Laptop with Python installed (detailed setup instructions will be shared with registered participants)

About Cloud Shuttle

Cloud Shuttle is a specialised data engineering consultancy helping organisations build robust, scalable data infrastructure. Our team brings real-world experience implementing these technologies at scale.

Registration

Register Now!

Limited seats available! Register now to secure your spot!