Based on tests it looks like all metrics currently are written to the metrics store at the end of the challenge. For long-running benchmarks this is impractical as it gives a potentially vary large amount of data to index at the end and makes it hard to see how the benchmark is doing during the execution.

It would be very useful to be able to stream metrics through bulk requests to the metrics store as the benchmark progresses.