High performance data processing employs high performance computing (HPC) to process data, which is then translated into information and knowledge. The advent of high-performance computing and data analytics enabled real-time interrogation of extremely large data sets.
♿ Suite of open and standards-based tools for performing reliable accessibility conformance testing at scale
This is a custom library for data processing, visualization and machine learning tools.
This project is designed to extract text from documents and prepare it for processing by Large Language Models (LLM). Implemented a feature to store and utilize text style information, enabling the program to identify and segment content based on potential headers and titles.
Easy data compression algorithm.
Optimization study that analyzes 10s of Gb of raw satellite data to map maritime shipping paths and optimizes network to reduce CO2 output.
EverAnalyzer is my thesis in the Department of Digital Systems of the University of Piraeus. EverAnalyzer is a platform for collecting, preprocessing, processing and analyzing Big Data from the Twitter platform.
This repository is created as part of the Data Science Coursework Birzeit university by Dr. Hussein Soboh
Automate geocoding of addresses from Excel files using Selenium WebDriver, with caching and logging for efficient data processing.
Multi-class network intrusion detection using CatBoost with GPU/CPU support, handling highly imbalanced datasets. Includes stratified downsampling, K-Fold cross-validation, and explainable AI with SHAP feature importance analysis. Designed for high-performance training on large datasets with detailed evaluation metrics and visualizations.
A lightweight browser-based tool that lets you upload a CSV, detect phone number country codes, and download a filtered file — fast, secure, and fully client-side.
A city autocomplete menu using the GeoNames datasets and the Algolia search engine
Efficient Python-based geocoding tool with local Nominatim server support, caching, and progress tracking for large datasets.
‘R for Geoscience’ is a project focused on the field of Earth Science, aiming to utilize the R programming language for processing, analyzing, and visualizing Earth science data.
ste proyecto implementa un pipeline automatizado para la clonación, transformación y normalización de páginas HTML
Json repository of quotes from different authors
A comprehensive repository housing a collection of insightful blog posts, in-depth documentation, and resources exploring various facets of data engineering. From ETL processes and database management to orchestration tools, data quality, monitoring, and deployment strategies
Add a description, image, and links to the data-processing topic page so that developers can more easily learn about it.
To associate your repository with the data-processing topic, visit your repo's landing page and select "manage topics."