Version 0.1.208

What's Changed

• Move temporary dir deletion to inner function, delete temp dir in skipped benchmarks by @mpozniak95 in #248
• added filtering by platform by @slice4e in #238
• Added compare tool to replace redisbench-admin by @fcostaoliveira in #250
• Enabled triggering build/benchmarks on forks by @fcostaoliveira in #251
• github updates from cli/builder/runner. unified update messaging from github<->cli by @fcostaoliveira in #253
• Fixed coordinator filtering based upon test regexp by @fcostaoliveira in #254
• Fixed git_timestamp_ms usage on cli triggering (for historical/past data filling) by @fcostaoliveira in #255

New Contributors

• @mpozniak95 made their first contribution in #248
• @fcostaoliveira made their first contribution in #250

Full Changelog: v0.1.72...v0.1.208

Version 0.1.72

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

• Include a DECR benchmark covering embstring object @filipecosta90 (#237)
• fix logging level @slice4e (#232)
• Aligned lhash* test-files' names with name inside file @markovamaria (#228)
• Bumping min python version to 3.8.1 and locking deps @filipecosta90 (#231)

Version 0.1.71

What's Changed

• Enabled arch selection on self-contained-coordinator by @filipecosta90 in #230

Full Changelog: v0.1.70...v0.1.71

Version 0.1.70

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

• Fix for TypeError in self-coordinator @markovamaria (#224)

Version 0.1.69

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

• Enabled defaults metrics parsing and merging @filipecosta90 (#226)
• Fixed memory requirements on specific tests that could fail on Sapphire Rappids @slice4e (#225)

Version 0.1.68

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

• Added --maxmemory to client runner. @filipecosta90 (#221)
• Move getting commits by tags to separate function @markovamaria (#220)
• updated description for mutli-exec - for issue 212 @slice4e (#219)
• changed log level from error to info - fixing issue #84 @slice4e (#218)
• Added conversion for str for git timestamps @markovamaria (#216)
• Fixed memory requirements of 4 hash/list tests @slice4e (#215)
• Updated geo benchmarks to fully saturate one primary. Include zset benchmarks with long score @filipecosta90 (#214)
• Update timestamp conversion in client @markovamaria (#211)
• Fix mem reqs @slice4e (#213)
• Client runner: enabled oss cluster benchmarks for string (just set and get commands) benchmarks @filipecosta90 (#200)
• fixed memory requirements for load-list @slice4e (#207)
• fixed the load-stream bechmarks such that the memory footprint does not keep growing. @slice4e (#205)
• added recommendation to use taskset for the redis server when using t… @slice4e (#197)
• fix hincrby data population to correspond to the description. @slice4e (#196)
• added support for hexists @slice4e (#195)
• Memtier without docker @slice4e (#192)
• Fix memory reqs for load stream @slice4e (#202)
• Enabled --cluster-mode in client runner @filipecosta90 (#199)
• Added SADD test variations discussed in redis/pull/11595 @filipecosta90 (#198)
• modified Readme file to remove codenames and details which could chan… @slice4e (#193)
• Bumping version from 0.1.65 to 0.1.66 @filipecosta90 (#191)

Version 0.1.65

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

• Running tox using self hosted runner. maxmemory check fix on client-runner @filipecosta90 (#189)

Version 0.1.63

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

• Fixes tests after memtier password args @filipecosta90 (#187)
• Updated benchmark config to include resource memory usage. Checking valid memory settings upon CLI runner @filipecosta90 (#186)
• Updated dbconfig requests memory limit based uppon client runner checks @filipecosta90 (#188)

Version 0.1.62

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

• Updated the benchmark SPEC to include command priority. Included --dry-run and --tests-priority-upper-limit in redis-benchmarks-spec-client-runner @filipecosta90 (#184)

Version 0.1.61

Redis performance and observability spec change

Project status:

The following is a high level status report for currently available specs and tools.

• Benchmark platforms specification: Experimental components are released and available for beta testing.
• Benchmark topologies specification: Experimental components are released and available for beta testing.
• Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
• Test-suites specification: Experimental components are released and available for beta testing.
• Spec tool implementation: API: Experimental components are released and available for beta testing.
• Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
• Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
• Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
• *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.

Release changes:

• Added support for ZREVRANK, ZRANK, ZINCRBY and ZREM @slice4e (#182)
• Fixed stats checker @filipecosta90 (#181)
• Added HINCRBY, HMSET, MGET, ZSCORE, EVALSHA, GETBIT, EXISTS, EXPIRE, EXPIREAT, PEXPIRE, SCAN, TOUCH, TTL, and ZRANGEBYSCORE benchmarks @filipecosta90 (#177)
• Added execution and updated installation section to Readme @markovamaria (#175)
• Fix value bug @slice4e (#179)
• Added support for BITFIELD command. @slice4e (#178)
• Added command ZREVRANGEBYSCORE @slice4e (#174)
• Added support for MULTI EXEC @filipecosta90 (#176)
• Added FPADD command testcase. @slice4e (#172)
• Validated SPEC fields uppon PR and commit @filipecosta90 (#173)
• Avoid RDB usage on unit tests @filipecosta90 (#145)
• Fixed runner tests according to test cases @filipecosta90 (#170)
• Enable RESP 3 support in benchmark-tools @ofekshenawa (#169)
• Introduced --tests-regex flag to ease the process of running a subsetof tests @filipecosta90 (#168)
• Fix issue 130 @slice4e (#167)
• Fix bug 87 @slice4e (#142)
• Included ZCARD and HMGET tests @filipecosta90 (#144)
• Formatted all yml test-suite files @filipecosta90 (#143)
• Extended runner functional coverage @filipecosta90 (#138)
• Added GEOSEARCH BYBOX variation @filipecosta90 (#140)
• Enforcing keyspace length check and checking for datasets within scc @filipecosta90 (#136)