Skip to content

HonahX/iceberg-summit-workshop

Repository files navigation

Iceberg Summit Workshop: Getting Started with Iceberg 🚀

Welcome! Let's dive into Apache Iceberg together in this interactive, hands-on workshop. Whether you're brand-new or already familiar with Iceberg, you'll walk away with practical skills and resources to confidently integrate Iceberg into your data workflows.

We'll explore Iceberg fundamentals, core concepts, and real-world table operations using Python-based tools like PyIceberg and DuckDB. Together, we'll follow data through the entire lifecycle—from ingestion and transformation to multi-engine querying.

This first session is a warm-up focused on clear, easy-to-follow examples of basic table operations with PyIceberg to introduce you to the essentials of Iceberg.

Alternative Way to Run the Workshop

If you're having trouble installing Docker Desktop on your laptop, don't worry! We've prepared a Google Colab version of the workshop that doesn't require any local setup. Simply click the link below and follow the instructions provided to run the workshop:

Before You Arrive

Please make sure your laptop is ready:

  1. Working Laptop: Ensure you have network connectivity.
  2. Git Installed: Install Git here.
  3. Docker Desktop Installed: We'll use Docker for quick setup. Follow instructions for your system:

Optional: Prepare the Workshop Environment in Advance

Want to save time on workshop day? You can build and prepare the environment ahead of time by running:

docker compose up -d --build

Once you see the following message in your terminal

it means all the containers are setup successfully. You can then shutdown them via

docker compose down

How to Run the Workshop

Step 1: Clone the Workshop Repo

In your terminal, navigate to your desired folder and run:

git clone https://github.com/HonahX/iceberg-summit-workshop.git

Step 2: Launch the Workshop Environment

Inside the repo directory, start the environment by running:

docker compose up -d

Proceed to the next step once you see

in your terminal.

Step 3: Access the Workshop Notebook

Stopping the Workshop

When you're finished, run the following code in the terminal that ran step 1:

docker compose down

Once you see

every component of the workshop has been shut down.

Next Part: Iceberg in Production Workshop

Ready to go deeper?

Check out the second part of the workshop focused on production use cases:

https://github.com/dlt-hub/workshop-iceberg-summit

We can't wait to get started—see you there! 🎉

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages