Batch ETL using Cloud Environment which is GCP by utilizing Cloud Composer + Google Cloud Storage + Dataflow + Cloud Build
-
Updated
Jun 6, 2021 - Python
Batch ETL using Cloud Environment which is GCP by utilizing Cloud Composer + Google Cloud Storage + Dataflow + Cloud Build
A tool for performing scheduled database backups and transferring encrypted data to secure clouds, for home labs, hobby projects, etc., in environments such as k8s, docker, vms.
Django simple application using GAE(Google App Engine) and Cloud Storage
Flask BoilerPlate Template for Google App Engine
A CSV file upload and image compression system designed to handle asynchronous uploads, with status checks and webhook notifications.
Apache Airflow powered ETL Pipeline for moving about 133k images from Kaggle to GCS and BigQuery
Run your `pypiserver` on AppEngine with Google Cloud Storage backend ⚡
A receipt organizer (first hackathon project)
Airflow powered ETL pipeline for moving Near-Earth-Object data from NASA to Google Cloud
This is an exercises provided by ChatGPT about sales data.
GoogleVision_OCR Project to Read out PDF
Web-scraping data engineering showcase for MMDA traffic data.
This repository contains the files for the Discord Bot we made for the RUHacks2022 Hackathon held on May 6th, 2022
AWS Config Custom Resource Samples
Implementation of a standard file system with POSIX interface that uses Google Cloud storage object
Add a description, image, and links to the googlecloudstorage topic page so that developers can more easily learn about it.
To associate your repository with the googlecloudstorage topic, visit your repo's landing page and select "manage topics."