Open
Description
Run Information
Architecture | x64 |
---|---|
OS | Windows 10.0.18362 |
Baseline | 0d889f56d2c79f6ac73c218147e3a5a07883fb8e |
Compare | 0e18cfda13a8136103c83442e1a649cdecc237b0 |
Diff | Diff |
Regressions in System.Text.Perf_Utf8Encoding
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
GetBytes - Duration of single invocation | 150.91 μs | 167.34 μs | 1.11 | 0.00 | True | |||||
GetBytes - Duration of single invocation | 131.78 μs | 139.42 μs | 1.06 | 0.06 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Perf_Utf8Encoding*'
Payloads
Histogram
System.Text.Perf_Utf8Encoding.GetBytes(Input: Chinese)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 167.34102430555555 > 158.46117698317312.
IsChangePoint: Marked as a change because one of 4/22/2022 6:17:37 AM, 4/26/2022 6:18:08 AM falls between 4/17/2022 3:25:40 PM and 4/26/2022 6:18:08 AM.
IsRegressionStdDev: Marked as regression because -38.43626538585459 (T) = (0 -167616.7196611192) / Math.Sqrt((1800002.7033671488 / (37)) + (3314983.301481756 / (20))) is less than -2.0040447832881556 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (37) + (20) - 2, .025) and -0.11879085380500277 = (149819.52979956483 - 167616.7196611192) / 149819.52979956483 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.
```#### System.Text.Perf_Utf8Encoding.GetBytes(Input: EnglishMostlyAscii)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 139.41750158027813 > 138.82715793583517.
IsChangePoint: Marked as a change because one of 4/22/2022 6:17:37 AM, 4/26/2022 6:18:08 AM falls between 4/17/2022 3:25:40 PM and 4/26/2022 6:18:08 AM.
IsRegressionStdDev: Marked as regression because -21.189330942510974 (T) = (0 -144455.18469587973) / Math.Sqrt((5276224.016555518 / (35)) + (3927623.323439888 / (20))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (35) + (20) - 2, .025) and -0.09459874985914388 = (131970.9023187434 - 144455.18469587973) / 131970.9023187434 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Architecture | x64 |
---|---|
OS | Windows 10.0.18362 |
Baseline | 0d889f56d2c79f6ac73c218147e3a5a07883fb8e |
Compare | 4c667f113f1eeec9bdd5f62bd438cb3038f56d2d |
Diff | Diff |
Regressions in System.Collections.ContainsFalse<Int32>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
Span - Duration of single invocation | 22.09 μs | 25.80 μs | 1.17 | 0.26 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsFalse<Int32>*'
Payloads
Histogram
System.Collections.ContainsFalse<Int32>.Span(Size: 512)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.80083470394737 > 23.197887634165802.
IsChangePoint: Marked as a change because one of 2/15/2022 2:06:03 PM, 2/19/2022 11:51:48 PM, 3/11/2022 11:18:20 AM, 4/22/2022 6:17:37 AM, 4/26/2022 6:18:08 AM falls between 4/17/2022 3:25:40 PM and 4/26/2022 6:18:08 AM.
IsRegressionStdDev: Marked as regression because -9.748059548395899 (T) = (0 -28003.985504461212) / Math.Sqrt((1865907.1966771088 / (35)) + (4711650.941949565 / (19))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (35) + (19) - 2, .025) and -0.23620126770599273 = (22653.25739102982 - 28003.985504461212) / 22653.25739102982 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository