Closed
Description
Run Information
| Architecture | arm64 |
|---|---|
| OS | Windows 10.0.19041 |
| Baseline | c66fa996b5cc32d94b2e6a8dfeb7c3d3a3098694 |
| Compare | da0e0f73e24036a88411dde8158df80e5f4bff01 |
| Diff | Diff |
Improvements in System.Tests.Perf_Char
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| Char_ToLower - Duration of single invocation | 27.96 ns | 24.80 ns | 0.89 | 0.18 | False | |||||
| Char_ToUpper - Duration of single invocation | 25.27 ns | 21.82 ns | 0.86 | 0.37 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Char*'Payloads
Histogram
System.Tests.Perf_Char.Char_ToLower(c: 'İ', cultureName: en-US)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 24.79683194919235 < 26.99815700226668.
IsChangePoint: Marked as a change because one of 11/17/2021 1:03:18 AM, 11/24/2021 10:47:45 PM falls between 11/16/2021 7:52:31 AM and 11/24/2021 10:47:45 PM.
IsImprovementStdDev: Marked as improvement because 11.357180174536603 (T) = (0 -25.485707984281067) / Math.Sqrt((3.159412685636631 / (299)) + (3.291190768870089 / (39))) is greater than 1.9670493839589689 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (39) - 2, .975) and 0.12074034288393035 = (28.985417195044512 - 25.485707984281067) / 28.985417195044512 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Tests.Perf_Char.Char_ToUpper(c: 'İ', cultureName: en-US)
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 21.81759316624065 < 23.766185325354957.
IsChangePoint: Marked as a change because one of 11/17/2021 1:03:18 AM, 11/24/2021 10:47:45 PM falls between 11/16/2021 7:52:31 AM and 11/24/2021 10:47:45 PM.
IsImprovementStdDev: Marked as improvement because 8.30018149530974 (T) = (0 -22.85009775501109) / Math.Sqrt((2.7263596904962295 / (62)) + (5.166435760620022 / (37))) is greater than 1.984723186013634 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (62) + (37) - 2, .975) and 0.13468475237045596 = (26.40667411975803 - 22.85009775501109) / 26.40667411975803 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
| Architecture | arm64 |
|---|---|
| OS | Windows 10.0.19041 |
| Baseline | c66fa996b5cc32d94b2e6a8dfeb7c3d3a3098694 |
| Compare | da0e0f73e24036a88411dde8158df80e5f4bff01 |
| Diff | Diff |
Improvements in System.Threading.Tests.Perf_Timer
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| LongScheduleAndDispose - Duration of single invocation | 253.87 ns | 214.79 ns | 0.85 | 0.21 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Threading.Tests.Perf_Timer*'Payloads
Histogram
System.Threading.Tests.Perf_Timer.LongScheduleAndDispose
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 214.79001460251465 < 234.62735647339045.
IsChangePoint: Marked as a change because one of 10/5/2021 5:02:12 PM, 11/14/2021 9:27:23 PM, 11/17/2021 1:03:18 AM, 11/24/2021 10:47:45 PM falls between 11/16/2021 7:52:31 AM and 11/24/2021 10:47:45 PM.
IsImprovementStdDev: Marked as improvement because 29.707648476833278 (T) = (0 -215.923816890784) / Math.Sqrt((105.21360211292107 / (299)) + (7.874053936124922 / (39))) is greater than 1.9670493839589689 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (39) - 2, .975) and 0.09287619325981146 = (238.03125360221887 - 215.923816890784) / 238.03125360221887 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository