Include timestamps in reportlog

[hterik]

Hi
Can each BaseReport entry written to json log get timestamps included for when each test was started and finished. Right now it only contains a runtime.

When analyzing test results, we some times need to correlate test runs with other external data not known to pytest, for example environmental factors, such as cpu and network load, which we store in other monitoring-systems.

[nicoddemus]

Hi @hterik,

As workaround, I guess you can take the mtime of the file, and just add the duration of each report.

[hterik]

Is there any no time in between each test that is not accounted for in the report?

Even if small, it will eventually and intermittently accumulate a lot of drift, so the last tests in the report would be very misaligned with the real timestamps of when the test was actually executed.
Accuracy of these timestamps is paramount, an approximation that has a risk of being offset would lead to a lot of confusion.

[RonnyPfannschmidt]

As a workaround you could add a report section with iso timestamps using the surrounding hooks

[nicoddemus]

Accuracy of these timestamps is paramount, an approximation that has a risk of being offset would lead to a lot of confusion.

True.

@RonnyPfannschmidt's suggestion is probably the best solution atm.

[nicoddemus]

I'm open to update pytest-reportlog to add these timestamps to each line being output too, but I won't have time to do it anytime soon, so PRs are welcome. 👍

[RonnyPfannschmidt]

@nicoddemus can this be considered resolved by upstream changes ?

[nicoddemus]

Indeed, thanks!

Closing as fixed by pytest-dev/pytest#10711.