PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"

Document level Attitude and Relation Extraction toolkit (AREkit) for sampling and processing large text collections with ML and for ML

Batch-scheduler framework for controlling execution in a packet-processing pipeline based on strict service-level objectives

Online Multiple Hypothesis Testing

FastDynamicBatcher is a library for batching inputs across requests to accelerate machine learning workloads

NASA Harmony service that groups together files into batches for concatenation

Batching with python asyncio

TurboBatch accelerates transformer inference by up to 10.2x with dynamic batching. It's lightweight, HuggingFace-compatible, and ideal for real-time NLP tasks.

SHIRT: SHIRT Handles Intense Renaming Transformations - A command-line tool for renaming and encoding files and directories.

simulation of Bucket brigade in production lines.

Migrates public entity financial data from EDGAR zip into AWS S3 bucket

Deep Learning Brand Recognition, using client-server architecture for low resource consumption & easy deployment.

Batch-aware online task creation for meta-learning.

High-performance async HTTP logging handler for Datadog with batching, retry logic, and comprehensive error handling

🚀 X-Model server for boosting ML inference without letting you do any heavy-lifting in the backend.

Seq2Label Sentiment Analysis

Deep Learning Stream Classification, using client-server architecture for low resource consumption & easy deployment.

A simple Python library for batching lists of objects

A distributed visit counter service, designed to efficiently track page visits with support for caching, sharding, and batching.