ELT for AEMET weather data.

Built a complete end-to-end data platform to ingest, process, and analyze complex, multi-source public datasets for business intelligence.

The Data Engineering Zoomcamp covers essential skills in containerization, workflow orchestration, data warehousing, analytics engineering, batch, and streaming processing. It includes tools like Docker, Terraform, BigQuery, dbt, Spark, Kafka, Kestra, Postgres, Google Data Studio, and Metabase.

libraries used in Kestra Flows

Multi-source research OS orchestrated with Kestra — scheduled ingest, RAG, optional LiteLLM BYOK (single or multi-model), and briefing delivery.

Cloud-native batch pipeline analyzing global tech ecosystem health by correlating layoffs trends with YC startup activity. Built with Terraform, Kestra, GCS, BigQuery, dbt, and Looker Studio.

Multi-Agent System for Autonomous, Verifiable Knowledge Synthesis

Data Engineering Pipeline extracting and transforming data from rewe shop API.

Data Engineering ZoomCamp

Open Source software code for use with PCIe card-based hardware AI accelerators catering to both inference and training use cases

End-to-end data pipeline analyzing the October 10, 2025 Ethereum crash - PySpark, dbt, BigQuery, Kestra, Looker Studio

Real-time phishing infrastructure detector from Certificate Transparency logs (DE Zoomcamp 2026 capstone)

GitHub Issue Auto-Triage & Notification System

This repository contains my work completed during the Data Engineering Zoomcamp 2025

This repositories contains the trip cost prediction deployment on GCP with Bigquery.

A multi-layer orchestration foundation for R&D agents, connecting research, insight extraction, experiment gating, roadmap design, state management, and external sync into a single execution loop. - 探索・洞察・評価・計画・状態管理をつなぐ、R&Dエージェント向けオーケストレーション基盤。

Automated Salesforce analytics pipeline with Kestra orchestration, Snowflake data warehouse, and Gemini AI insights

A self-hosted, lightweight ETL pipeline for orchestrated exports from REST API data to S3 with zero infrastructure overhead. Intelligent API batching, S3 optimization, retry logic, automatic S3 gap backfilling, customizable logging.

GCP Batch Data Pipeline

The World Disaster Pipeline is an ETL system that processes global disaster data from the EM-DAT database. It automates ingestion, transformation, storage, and visualization, all in the cloud.