A lightweight framework for collecting and processing data from HTTP POST requests
-
Updated
Oct 5, 2026 - Python
A lightweight framework for collecting and processing data from HTTP POST requests
Video quality assessment and filtering pipeline for ML training data. Automatically handles format conversion, scene segmentation, face detection, text detection, and audio-video sync checking. Supports 127 concurrent processes with checkpoint recovery
This repository containing code for preprocessing text data from PDF and DOCX files for use with GPT-3. It includes steps such as tokenization, removal of stop words and punctuation, and formatting for GPT-3 input.
A from-scratch OpenCV pipeline that quality-checks, normalizes, and skull-strips brain MRI scans structured after the intake pipelines real medical-imaging teams run before any scan reaches a model or a radiologist.
To associate your repository with the data-preprocessing-pipelines topic, visit your repo's landing page and select "manage topics."