Performant implementations of various streaming algorithms, including Count–min sketch, Top k, HyperLogLog, Reservoir sampling.
-
Updated
Aug 14, 2024 - Rust
#
streaming-algorithms
Here are 6 public repositories matching this topic...
A deterministic genomics engine with O(√t) memory. Run whole-genome workloads in <100 MB RAM. Built in Rust.
-
Updated
Nov 13, 2025 - Rust
Fast and Memory Efficient Genome Sketching via HyperLogLog, HyperMinHash and UltraLogLog
hyperloglog cardinality-estimation streaming-algorithms metagenome average-nucleotide-identity hyperloglogplus ultraloglog genome-sketching hyperminhash
-
Updated
Nov 12, 2025 - Rust
Process any data size with a fixed, small memory footprint. EM-√ is an external-memory ETL/log processing engine with hard peak-RAM guarantees. Unlike traditional systems that "try" to stay within memory limits, EM-√ enforces a strict memory cap, enabling you to process arbitrarily large datasets using small memory footprints.
rust streaming cloud big-data efficiency cloud-computing memory-allocation streaming-algorithms streaming-data efficient-algorithm edge-computing big-data-analytics edge-ai
-
Updated
Nov 18, 2025 - Rust
Approximate UniFrac via Weighted MinHash 🦀
big-data metagenomics minhash locality-sensitive-hashing beta-diversity microbiome rejection-sampling streaming-algorithms lsh-algorithm unifrac weighted-jaccard ruzicka-similarity weighted-minhash bray-curtis
-
Updated
Nov 1, 2025 - Rust
Sublinear-space zero-knowledge proof system with production REST API. TinyZKP is a high-performance ZKP prover/verifier that uses only O(√T) memory for proofs over traces of length T, rather than the typical O(T) that most systems require.
rust security privacy streaming-algorithms cryptography-algorithms efficient-algorithm zero-knowledge edge-computing edge-devices zero-knowledge-proofs arithmetic-circuits blockchain-rollup
-
Updated
Oct 12, 2025 - Rust
Improve this page
Add a description, image, and links to the streaming-algorithms topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the streaming-algorithms topic, visit your repo's landing page and select "manage topics."