Terraform modules for provisioning and managing AWS Glue resources

Terraform module which creates Glue resources on AWS

Proof of Value Terraform Scripts to utilize Amazon Web Services (AWS) Security, Identity & Compliance Services to Support your AWS Account Security Posture.

Companion repository for the "Streamlining AWS Glue CI/CD — A Comprehensive Blueprint" blog post

Create terraform module for AWS Glue

These Terraform modules aggregate Security Hub findings to centralized account using Amazon Kinesis Firehose and AWS Glue

AWS ETL example via AWS DMS & AWS Glue

FinOps PoC: detect idle AWS resources and optionally clean them up; CUR + Athena + Grafana for $/day.

These Terraform modules aggregate the AWS Trusted Advisor results from different accounts to a centralised account, using AWS Lambda, AWS IAM, Amazon S3 and Amazon SQS

A data engineering portfolio project using AWS cloud services to analyze correlations between Malaysian retail performance and fuel prices. Features Terraform IaC, ETL/ELT with AWS S3, Glue, SQL analytics via Athena coupled with data transformation via dbt, and workflow orchestration with Kestra.

Terraform module for AWS Glue related infrastructure

Project that incorporates TerraForm to create AWS infrastructure using S3, Lambda, and DynamoDB tables for ocean and river data 🐢

Glue ETL crawler and jobs with Athena queries

End-to-end batch and streaming data pipeline on AWS to process user ratings and activity data. Leverages Amazon RDS, Glue, S3, Kinesis, and PostgreSQL with pgvector for real-time recommendation generation and model training.

OpenTofu/TF modules for provisioning and managing AWS Glue resources.

Data lake project for a US based Insurance Company

Genomics data pipeline is a serverless, event-driven AWS pipeline for processing genomics VCF files, transforming them into Parquet, and enabling analytics with Athena, built using Terraform.

Connect to a private RDS cluster from an AWS Glue job

A Terraform module that creates a Glue job