Data Engineering Project with Hadoop HDFS and Kafka

Mediator implementation for python 3.6+ (version >=1.2<1.3 for python 3.5), that supports pipline behaviors, async executing

🔥 AgnFlow: AI-Oriented Python Workflow Framework | Flexible Loops (Auto-Exit), No-Code Visual DAG for Rapid Agent Development

My small cheatsheets for tf2onnx, git commands, linux commands and evaluations

Including pre-trained language models for fine-tuning on other NLP tasks

The scan to model pipeline (SMP) is an open source tool that automatically generates mesh model files (PLY) by filtering and clustering data in LAS, a point cloud format. Using this, you can automate the extraction of buildings, ground, and trees from PCD. It is structured as a pipeline, so you can easily adjust parameters for each data processing

batch machine learning

Sparkify - Data Pipelines with Airflow - Udacity Data Engineering Expert Track.

This repository outlines a comprehensive guide for training a distributed deep learning model.

hGMNet : host Genetics and Microbe interaction Networks

Deploying Flask Application on Azure Web Apps

针对 RAGFlow: v0.15.0 开发的本地客户端类工具，其原来的初衷为解决大批量的文档无法用批量接口上传的问题。

The simplest application for planning your tasks.

Platform to build resource-intensive pipelines with simple Python.

deltalake tutorial w/ spark, hive, hadoop

💻🔧 Scrapy and Selenium Projects 🪛 ⚙💻

NCP: NLP Cancer Pipline