Skip to content

docs: update readmes with new benchmark sections and results#153

Merged
kacy merged 1 commit intomainfrom
docs/benchmark-refresh
Feb 15, 2026
Merged

docs: update readmes with new benchmark sections and results#153
kacy merged 1 commit intomainfrom
docs/benchmark-refresh

Conversation

@kacy
Copy link
Owner

@kacy kacy commented Feb 15, 2026

summary

updates both bench/README.md and README.md to reflect the expanded benchmark suite:

bench/README.md:

  • added qdrant column to vector similarity and SIFT1M tables
  • corrected SIFT1M note — 1M × 128 × 4B = 512MB, fits in 32GB (c2-standard-8)
  • added new sections with results-pending tables:
    • gRPC vs RESP3 (sequential and pipelined RESP3 vs gRPC unary)
    • pub/sub throughput (1/10/100 subscribers, 64B/1KB, SUBSCRIBE vs PSUBSCRIBE)
    • protobuf storage overhead (PROTO.SET/GET/GETFIELD/SETFIELD vs raw)
    • memory by data type (string/hash/sorted set/vector)
  • updated scripts table with bench-all, bench-grpc, bench-pubsub, bench-proto
  • updated running benchmarks and cloud VM sections with new commands
  • corrected command count from ~101 to ~106
  • all existing caveat paragraphs preserved exactly as-is

README.md:

  • added vector query performance to benchmark highlights
  • added bench-vector, bench-grpc, bench-all to benchmark commands
  • updated command count (101 → 106) and LOC (~22k → ~31k)

what was tested

  • verified all markdown tables render correctly
  • cross-referenced script names against actual files in bench/
  • confirmed command count by checking Command enum in ember-protocol
  • verified LOC estimate by counting .rs files excluding test modules

bench/README.md:
- added qdrant column to vector similarity and SIFT1M tables
- corrected SIFT1M note — fits in 32GB (c2-standard-8), not 16+
- added new sections: gRPC vs RESP3, pub/sub throughput, protobuf
  storage overhead, memory by data type (all results pending)
- added new scripts to scripts table (bench-all, bench-grpc, bench-pubsub, bench-proto)
- updated running benchmarks section with new commands
- updated command count from ~101 to ~106
- kept existing caveat paragraphs exactly as-is

README.md:
- added vector query performance to highlights
- added bench-vector, bench-grpc, bench-all to benchmark commands
- updated command count from 101 to 106 and LOC from ~22k to ~31k
@kacy kacy merged commit 7840242 into main Feb 15, 2026
7 checks passed
@kacy kacy deleted the docs/benchmark-refresh branch February 15, 2026 13:16
kacy added a commit that referenced this pull request Feb 19, 2026
bench/README.md:
- added qdrant column to vector similarity and SIFT1M tables
- corrected SIFT1M note — fits in 32GB (c2-standard-8), not 16+
- added new sections: gRPC vs RESP3, pub/sub throughput, protobuf
  storage overhead, memory by data type (all results pending)
- added new scripts to scripts table (bench-all, bench-grpc, bench-pubsub, bench-proto)
- updated running benchmarks section with new commands
- updated command count from ~101 to ~106
- kept existing caveat paragraphs exactly as-is

README.md:
- added vector query performance to highlights
- added bench-vector, bench-grpc, bench-all to benchmark commands
- updated command count from 101 to 106 and LOC from ~22k to ~31k
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant