glue-job
Here are 25 public repositories matching this topic...
Data Streaming and Batch processing using AWS Services
-
Updated
Aug 18, 2024 - Python
IMDB Movie Data ETL Pipeline using S3, Glue, Redshift, EventBridge, SNS
-
Updated
Aug 6, 2024 - Python
The Sensitive Data Protection on AWS solution allows enterprise customers to create data catalogs, discover, protect, and visualize sensitive data across multiple AWS accounts. The solution eliminates the need for manual tagging to track sensitive data such as Personal Identifiable Information (PII) and classified information.
-
Updated
Aug 2, 2024 - TypeScript
Pipeline ETL na AWS
-
Updated
Jul 28, 2024 - Python
Data Engineering project using data streaming produced by python applications, ETL process and availability for ad-hoc SQL queries in the AWS cloud
-
Updated
Jul 5, 2024 - Jupyter Notebook
This project creates a serverless data pipeline to extract data from the Colombo Stock Market ASI Index API using AWS Lambda, Kinesis Firehose, and S3. An AWS Glue workflow processes and transforms the data, storing it in an Apache Iceberg table via Athena and Glue ETL jobs.
-
Updated
Jul 2, 2024 - Python
This project outlines the final project requirements for DAV6100 - Information Architectures, focusing on group assignments, scoring criteria, topic selection, core requirements, and project components such as design, development, visualization, and executive presentation.
-
Updated
May 14, 2024 - HTML
This project aims to analyze the popularity of YouTube content across different regions by leveraging datasets sourced from Kaggle. It employs a systematic approach to data preprocessing, cleaning, and analysis using various AWS (Amazon Web Services) services including S3, Lambda, Glue, and others, to build an automated ETL pipeline.
-
Updated
Apr 26, 2024 - Python
Terraform module to create and manage a AWS Glue job
-
Updated
Apr 18, 2024 - HCL
Glue Data Quality Example - Deploy to your AWS Account w/ Terraform to test
-
Updated
Jul 13, 2024 - HCL
Glue scripts for converting AWS Service Logs for use in Athena
-
Updated
Feb 1, 2024 - Python
-
Updated
Oct 28, 2023 - Python
This Project aims to automate the process of infrastructure creation.
-
Updated
Sep 25, 2023 - HCL
O projeto foi elaborado com o objetivo de estabelecer uma arquitetura na AWS, originada a partir de uma migração de um banco de dados existente em um ambiente local (on-premise).
-
Updated
Aug 17, 2023 - Python
ETL using application streaming and creating a Data Lake
-
Updated
Apr 7, 2023 - Jupyter Notebook
This is a data pipeline built with the purpose of serving a business team.
-
Updated
Feb 28, 2023 - Python
Improve this page
Add a description, image, and links to the glue-job topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the glue-job topic, visit your repo's landing page and select "manage topics."