[Perf] Windows/x64: 3 Regressions on 10/25/2022 10:16:52 PM

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.18362
Baseline	f4b715f1cfadcbf85486f369724528c051be5733
Compare	a8ea8e67dc20689aa2e4c738a2f84ea3483ec872
Diff	Diff

Regressions in System.Text.Json.Tests.Perf_Strings

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
WriteStringsUtf16 - Duration of single invocation	14.14 ms	15.54 ms	1.10	0.03	False
WriteStringsUtf16 - Duration of single invocation	7.31 ms	7.73 ms	1.06	0.04	False
WriteStringsUtf16 - Duration of single invocation	13.23 ms	14.87 ms	1.12	0.07	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Tests.Perf_Strings*'

Related Issues

Regressions

• [Perf] Windows/arm64: 11 Regressions on 10/25/2022 10:16:52 PM
• [Perf] Windows/arm64: 1 Regression on 10/25/2022 10:16:52 PM

Improvements

• [Perf] Linux/arm64: 3 Improvements on 10/25/2022 10:16:52 PM
• [Perf] Windows/arm64: 4 Improvements on 10/25/2022 10:16:52 PM

Payloads

Baseline
Compare

Histogram

Edge Detector Info

Collection Data

System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: True, SkipValidation: True, Escaped: OneEscaped)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 15.535415104166667 > 14.916351333333333.
IsChangePoint: Marked as a change because one of 10/25/2022 7:09:53 PM, 11/1/2022 2:33:16 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 2:33:16 AM.
IsRegressionStdDev: Marked as regression because -7.323190903384949 (T) = (0 -15122278.619531948) / Math.Sqrt((43353365022.608925 / (22)) + (421970695632.47644 / (28))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (22) + (28) - 2, .025) and -0.06748252075812576 = (14166300.923402578 - 15122278.619531948) / 14166300.923402578 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: True, Escaped: NoneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 7.733511553030303 > 7.70626969815341.
IsChangePoint: Marked as a change because one of 10/25/2022 2:56:59 AM, 11/1/2022 2:33:16 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 2:33:16 AM.
IsRegressionStdDev: Marked as regression because -9.535329533230067 (T) = (0 -7815919.095926029) / Math.Sqrt((24030970943.013245 / (18)) + (16908910719.693138 / (32))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (18) + (32) - 2, .025) and -0.05559188884237484 = (7404300.069506438 - 7815919.095926029) / 7404300.069506438 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Json.Tests.Perf_Strings.WriteStringsUtf16(Formatted: False, SkipValidation: True, Escaped: OneEscaped)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 14.869127083333334 > 14.136050020833336.
IsChangePoint: Marked as a change because one of 10/25/2022 8:17:52 AM, 11/1/2022 2:33:16 AM falls between 10/23/2022 1:14:54 PM and 11/1/2022 2:33:16 AM.
IsRegressionStdDev: Marked as regression because -12.27398841614298 (T) = (0 -14802205.46632342) / Math.Sqrt((44757204418.52601 / (19)) + (346630075509.9611 / (31))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (19) + (31) - 2, .025) and -0.10677891552329886 = (13374130.333269633 - 14802205.46632342) / 13374130.333269633 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[AndyAyersMS]

Duping to dotnet/runtime#77730