Skip to content

Releases: bencherdev/bencher

v0.4.27

16 Nov 21:06
Compare
Choose a tag to compare
  • Limit GitHub Action Check to 65,535 characters
  • Fix CLI HTML table output bug for Benchmarks with different Measures

v0.4.26

12 Nov 01:50
Compare
Choose a tag to compare
  • Fix GitHub Action summary bug (Thank you @dklassic)

v0.4.25

10 Nov 15:37
Compare
Choose a tag to compare
  • Add GitHub Action summary when using --github-actions option
  • Add ability to track build times with the new --build-time flag

v0.4.24

03 Nov 15:45
Compare
Choose a tag to compare

v0.4.23

19 Oct 23:54
Compare
Choose a tag to compare
  • Fix Console Alert Perf Plot button bug
  • Fix benchmark.js adapter (js_benchmark) float parsing bug (Thank you @arv)
  • Fix Catch2 adapter (cpp_catch2) long name parse bug
  • BREAKING CHANGE The Catch2 adapter (cpp_catch2) now includes the test case name in the benchmark name (ex: Test Case: Benchmark Name)
  • Fix Benchmark results table x-overflow bug when there were several Measures

v0.4.22

14 Oct 01:38
Compare
Choose a tag to compare
  • Remove bloom filter in Perf Query when there is no branch head specified

v0.4.21

06 Oct 12:59
Compare
Choose a tag to compare
  • BREAKING CHANGE Update the Branch JSON to include the concept of a Head which now contains the Start Point
  • Changing a branch's start point will now update the branch head instead of creating a new branch and archiving the old one
  • Deprecate --branch-start-point, --branch-start-point-hash, and --branch-reset in favor of --start-point, --start-point-hash, and --start-point-reset for bencher run
  • Introduce a max_versions for Branch Start Points, default to 255
  • Add the --start-point-max-versions option to bencher run
  • Thresholds are no longer cloned based off of a branch start point
  • Add the --start-point-clone-thresholds flag to bencher run
  • Add Thresholds to Report JSON
  • Add --threshold-measure, --threshold-test, --threshold-min-sample-size, --threshold-max-sample-size, --threshold-window, --threshold-lower-boundary, --threshold-upper-boundary, and --thresholds-reset to bencher run
  • Fix public plots pages to not require authentication
  • Add --measure option to bencher mock to mock multiple measures
  • Add a bencher archive and bencher unarchive subcommand to archive and unarchive dimensions
  • Fix broken default version tag for bencher up (Thank you @mwasplund)
  • Add --api-port and --console-port options to bencher up to set the API and Console UI ports

v0.4.20

14 Sep 16:23
Compare
Choose a tag to compare
  • Add public pages for Reports, Branches, Testbeds, Benchmarks, Measures, and Plots
  • Add links between all dimension pages
  • BREAKING CHANGE Change the Report results format to mirror Bencher Metric Format, from measures owning benchmarks to benchmarks owning measures
  • Remove user email from Report results
  • Add a table view for Reports in the Console UI
  • Update PR comments to be more concise
  • Remove deprecated statistic field from Threshold in favor of model
  • Remove deprecated server endpoint /v0/server/endpoint in favor of /v0/server/config/console
  • Track global bus events for iai-callgrind adapter (Thank you @OmarTawfik)

v0.4.19

25 Aug 19:28
Compare
Choose a tag to compare
  • Add the --format option to bencher run
  • BREAKING CHANGE Remove the Report JSON from the default bencher run output (now use --format json)
  • BREAKING CHANGE Remove the --html flag from bencher run (now use --format html)
  • Standardize all bencher CLI default values
  • Allow --branch-reset to be used with --branch-start-point
  • Update archived branches renaming scheme

v0.4.18

30 Jul 17:57
Compare
Choose a tag to compare
  • Add the concept of archived to Branches, Testbeds, Benchmarks, and Measures
  • Remove Alert stats endpoint
  • Fix + Add API token UI permissions bug
  • Filter for archived resources in the Console UI
  • Archive and unarchive resources in the Console UI
  • Make Start Points for Branches fallible
  • Parse results for multiple tools for iai-callgrind adapter (Thank you @OmarTawfik)