Automated pipeline for generating and processing Dock balance reports using Apache Airflow, SFTP, AWS S3, and Lambda.
-
Updated
Apr 2, 2025 - Python
Automated pipeline for generating and processing Dock balance reports using Apache Airflow, SFTP, AWS S3, and Lambda.
This script automates cleaning up a specific folder in an S3 bucket, deleting all objects within it. It uses secure AWS credentials and is built on the Mage.ai platform. Additionally, the roadmap includes approach handling and logging for greater robustness and monitoring.
Add a description, image, and links to the s3-aws topic page so that developers can more easily learn about it.
To associate your repository with the s3-aws topic, visit your repo's landing page and select "manage topics."