Writing intermediate results

[wenkokke]

Is there currently any way to force hyperfine to write intermediate results, so that I can abort a benchmark without losing all the progress I've made so far? I'm asking, because I've been benchmarking several algorithms with exponential complexity recently, and so sometimes letting the benchmark finish isn't an option.

[sharkdp]

Are you talking about the --export … options?

There is no option like this, so far.

[wenkokke]

Yeah, I'm requesting that the --export options (at least the JSON and CSV options) write results to the file as soon as they become available, instead of at the end of the entire benchmark suite.

[sharkdp]

Sounds like a good idea to me 👍

[BaronVonDrew]

@sharkdp Hey, I'd love to pick this up and add an 'incremental export' option if you don't mind? I'm fairly new to Rust but think I can give it a go

[sharkdp]

Sounds great!

[negge]

Hi, I also ran into this issue recently on a long running benchmark. Do you know when this will be landing?

On a related note, please confirm that the target file is writable before invoking the test.

[sharkdp]

On a related note, please confirm that the target file is writable before invoking the test.

you mean.. before running the first (potentially long-running) benchmark? That sounds like a good idea!

[sharkdp]

Released in https://github.com/sharkdp/hyperfine/releases/tag/v1.12.0