Skip to content

Benchmark is broken #5

@konard

Description

@konard
Run cargo bench --bench bench -- --output-format bencher | tee out.txt
 Downloading crates ...
  Downloaded bitflags v1.3.2
  Downloaded cast v0.3.0
  Downloaded atty v0.2.14
  Downloaded regex-syntax v0.8.8
  Downloaded lazy_static v1.5.0
  Downloaded itertools v0.10.5
  Downloaded aho-corasick v1.1.4
  Downloaded walkdir v2.5.0
  Downloaded same-file v1.0.6
  Downloaded num-traits v0.2.19
  Downloaded indexmap v1.9.3
  Downloaded half v2.2.1
  Downloaded crossbeam-utils v0.8.21
  Downloaded clap_lex v0.2.4
  Downloaded regex v1.12.2
  Downloaded ciborium-ll v0.2.2
  Downloaded crossbeam-epoch v0.9.18
  Downloaded clap v3.2.25
  Downloaded ciborium-io v0.2.2
  Downloaded rayon-core v1.12.1
  Downloaded tinytemplate v1.2.1
  Downloaded plotters-svg v0.3.7
  Downloaded hashbrown v0.12.3
  Downloaded criterion v0.4.0
  Downloaded oorandom v11.1.5
  Downloaded rayon v1.10.0
  Downloaded textwrap v0.16.1
  Downloaded os_str_bytes v6.6.1
  Downloaded plotters-backend v0.3.7
  Downloaded ciborium v0.2.2
  Downloaded either v1.15.0
  Downloaded crossbeam-deque v0.8.6
  Downloaded anes v0.1.6
  Downloaded memchr v2.7.6
  Downloaded autocfg v1.5.0
  Downloaded regex-automata v0.4.13
test Create/Doublets_United_NonVolatile ... bench:       99055 ns/iter (+/- 916)
test Create/Doublets_Split_Volatile ... bench:       84602 ns/iter (+/- 2141)
test Create/Doublets_Split_NonVolatile ... bench:       83718 ns/iter (+/- 998)


Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 1824.2s, or reduce sample count to 10.
test Delete/Neo4j_NonTransaction ... bench:  1988067696 ns/iter (+/- 102395488)

Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 1450.3s, or reduce sample count to 10.
thread 'main' panicked at 'called `Result::unwrap()` on an `Err` value: NotExists(4000)', benches/benchmarks/delete.rs:23:9
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
test Delete/Neo4j_Transaction ... 
error: bench failed

CI run: https://github.com/linksplatform/Comparisons.Neo4jVSDoublets/actions/runs/20442351221/job/58738054640

Actually benchmark was failed, but we get false success status, that must be fixed.

5134f36#diff-b335630551682c19a781afebcf4d07bf978fb1f8ac04c6bf87428ed5106870f5

Please download all logs and data related about the issue to this repository, make sure we compile that data to ./docs/case-studies/issue-{id} folder, and use it to do deep case study analysis (also make sure to search online for additional facts and data), in which we will reconstruct timeline/sequence of events, find root causes of the problem, and propose possible solutions.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions