Data Engineering Project with Hadoop HDFS and Kafka

Mediator implementation for python 3.6+ (version >=1.2<1.3 for python 3.5), that supports pipline behaviors, async executing

The scan to model pipeline (SMP) is an open source tool that automatically generates mesh model files (PLY) by filtering and clustering data in LAS, a point cloud format. Using this, you can automate the extraction of buildings, ground, and trees from PCD. It is structured as a pipeline, so you can easily adjust parameters for each data processing

Including pre-trained language models for fine-tuning on other NLP tasks

My small cheatsheets for tf2onnx, git commands, linux commands and evaluations

batch machine learning

hGMNet : host Genetics and Microbe interaction Networks

Sparkify - Data Pipelines with Airflow - Udacity Data Engineering Expert Track.

Deploying Flask Application on Azure Web Apps

This repository outlines a comprehensive guide for training a distributed deep learning model.

The simplest application for planning your tasks.

deltalake tutorial w/ spark, hive, hadoop

NCP: NLP Cancer Pipline

💻🔧 Scrapy and Selenium Projects 🪛 ⚙💻