In this repository we will store all materials for workshops, courses, etc.
- Workshop August 2024 Part1: dlt fundamentals:
- Location: workshops/workshop_august_2024/part1
- Content:
- How dlt works under the hood;
- Create your first pipeline;
- Understand dlt’s sources and resources;
- Explore destinations;
- Deduplicate your data with incremental loading;
- Understand dlt state, schema management, and metadata.
- Workshop August 2024: Go-to-production
- Location: workshops/workshop_august_2024/part2
- Content:
- Custom incremental loading
- Schema Configuration & Data Contracts
- Tracing, Logging & Retries
- Performance Optimization
- Custom sources with RestAPI helpers
- Custom destinations: Reverse ETL
- Deployment with AWS Lambda, Dagster & Airflow
- Bonus: dbt Runner