ingestion
Here are 36 public repositories matching this topic...
IBIS is a workflow creation-engine that abstracts the Hadoop internals of ingesting RDBMS data.
-
Updated
Apr 13, 2022 - Python
Official NetBox Labs plugin for NetBox for Diode
-
Updated
Jun 11, 2025 - Python
Python script for ingesting various files into a semantic graph. For text, images, cpp, python, rust, javascript, and PDFs.
-
Updated
Sep 17, 2024 - Python
Python Open-source ETL tool for seamless data movement across PostgreSQL, MySQL, Redshift, BigQuery, S3, GCS, and CSV files, with yaml/json-based configuration.
-
Updated
May 25, 2025 - Python
This project aims to predict smartphone prices using a combination of batch and stream processing techniques in a Big Data environment. The architecture follows the Lambda Architecture pattern, providing both real-time and batch processing capabilities to users.
-
Updated
Apr 15, 2024 - Python
Periodically ingest incremental updates (inserts / deletes) into BigQuery using Cloud Composer / Airflow orchestration workflow
-
Updated
Dec 12, 2019 - Python
Read-only mirror of https://gitlab.com/sorcero/community/ingestum
-
Updated
Jan 23, 2023 - Python
Tagbase is a data lifecycle management system for electronic timeseries sensor data. It supports different types of data and works with equipment from various manufacturers.
-
Updated
Jun 10, 2025 - Python
Extract Transform and Load unstructured data into the Clarifai's AI platform
-
Updated
May 19, 2025 - Python
A fully interactive tool designed to streamline your GitHub repository prompt generation process and facilitate RAG (Retrieval-Augmented Generation) workflows
-
Updated
Jan 5, 2025 - Python
LogFlow é uma aplicação ETL (Extração, Transformação e Carregamento) especializada em processamento de logs
-
Updated
Apr 17, 2025 - Python
A MongoDb to Elasticsearch ETL pipeline
-
Updated
Oct 3, 2017 - Python
Automate data ingestion into FiftyOne with Twilio
-
Updated
Oct 24, 2023 - Python
Simple python interface for the Fivetran API. Powered by HTTPx.
-
Updated
Jun 5, 2024 - Python
The aim of this project is automate data ingestion from flat files like CSV and compressed files GZIP into a database like Postgres. The entire setup is automated using Docker and is pretty fast too as multiprocessing is being used.
-
Updated
Oct 24, 2022 - Python
Data ingestor that reads and parses executive orders from wikisource
-
Updated
Apr 2, 2017 - Python
Improve this page
Add a description, image, and links to the ingestion topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the ingestion topic, visit your repo's landing page and select "manage topics."