Skip to content

[BUG]: ERROR The total numbers of keys in setup does not match the expected spec: 1!=0. Aborting... #206

Closed
@zhoujie2022

Description

@zhoujie2022

Describe the bug
Run redis-benchmarks-spec-client-runner according to Readme.md failed
Is the step wrong?

To Reproduce
Steps to reproduce the behavior:

  1. Install redis-benchmarks-specification
    sudo apt install python3-pip -y
    sudo pip3 install --upgrade pip
    sudo apt install docker.io -y
    sudo apt install supervisor -y
    python3 -m pip install redis-benchmarks-specification --ignore-installed PyYAML
  2. Make redis
    git clone https://github.com/redis/redis.git
    cd redis
    make
  3. Run redis-server
    ./src/redis-server --port 6379 &
    18569:M 03 Feb 2023 01:24:08.003 * Ready to accept connections tcp
  4. Run redis-benchmarks-spec-client-runner
    redis-benchmarks-spec-client-runner --db_server_host localhost --db_server_port 6379 --client_aggregated_results_folder ./test

Expected behavior
redis-benchmarks-spec-client-runner output:
2023-02-03 01:24:59 INFO redis-benchmarks-spec-client-runner (solely client) 0.1.67
2023-02-03 01:24:59 INFO Using test-suites folder dir /usr/local/lib/python3.9/dist-packages/redis_benchmarks_specification/test-suites
2023-02-03 01:24:59 INFO Acception all test files. If you need further filter specify a regular expression via --tests-regexp
2023-02-03 01:24:59 INFO There are a total of 88 test-suites in folder /usr/local/lib/python3.9/dist-packages/redis_benchmarks_specification/test-suites
2023-02-03 01:24:59 INFO Running the benchmark specs.
2023-02-03 01:24:59 INFO Loading default specifications from file: /usr/local/lib/python3.9/dist-packages/redis_benchmarks_specification/test-suites/defaults.yml
2023-02-03 01:24:59 INFO Found RedisTimeSeries default metrics specification. Will include the following metrics on all benchmarks $."BEST RUN RESULTS".Totals."Ops/sec" $."BEST RUN RESULTS".Totals."Latency" $."BEST RUN RESULTS".Totals."Misses/sec" $."BEST RUN RESULTS".Totals."Percentile Latencies"."p50.00" $."WORST RUN RESULTS".Totals."Ops/sec" $."WORST RUN RESULTS".Totals."Latency" $."WORST RUN RESULTS".Totals."Misses/sec" $."WORST RUN RESULTS".Totals."Percentile Latencies"."p50.00" $."AGGREGATED AVERAGE RESULTS (3 runs)".Totals."Ops/sec" $."AGGREGATED AVERAGE RESULTS (3 runs)".Totals."Latency" $."AGGREGATED AVERAGE RESULTS (3 runs)".Totals."Misses/sec" $."AGGREGATED AVERAGE RESULTS (5 runs)".Totals."Percentile Latencies"."p50.00" $."ALL STATS".Totals."Ops/sec" $."ALL STATS".Totals."Latency" $."ALL STATS".Totals."Misses/sec" $."ALL STATS".Totals."Percentile Latencies"."p50.00"
2023-02-03 01:24:59 INFO Found RedisTimeSeries default time metric specification. Will use the following JSON path to retrieve the test time $."ALL STATS".Runtime."Start time"
2023-02-03 01:24:59 INFO Benchmark required memory: 1073741824 Bytes
2023-02-03 01:24:59 INFO Using total system memory as max 4122423296
2023-02-03 01:24:59 INFO Resetting commmandstats for shard 0
2023-02-03 01:24:59 INFO Test memtier_benchmark-1key-pfadd-4KB-values-pipeline-10 priority (61) is within the priority limit [0,100000]
2023-02-03 01:24:59 INFO Benchmark used memory at start of benchmark: 1g
2023-02-03 01:24:59 INFO Checking if there is a keyspace check being enforced
2023-02-03 01:24:59 INFO Ensuring keyspace length requirement = 1 is met.
2023-02-03 01:24:59 ERROR The total numbers of keys in setup does not match the expected spec: 1!=0. Aborting...
2023-02-03 01:24:59 CRITICAL Some unexpected exception was caught during local work. Failing test....
2023-02-03 01:24:59 CRITICAL <class 'Exception'>

Environment (please complete the following information):

  • OS: [Debian GNU/Linux 11]
  • PyPi version package [0.1.67]
  • Platfrom [x86_64]

Metadata

Metadata

Assignees

Labels

bugSomething isn't workingtriageOn triage by Performance Group

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions