Open
Description
Run Information
Architecture | x64 |
---|---|
OS | Windows 10.0.18362 |
Baseline | bdd67af67dbf43c0f5e9151b98dc100b9555898a |
Compare | fbc20578253e0deb7267eea5a02b680c3cfe0e2a |
Diff | Diff |
Improvements in System.Numerics.Tests.Perf_VectorOf<Byte>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
MultiplyOperatorBenchmark - Duration of single invocation | 65.56 ns | 57.06 ns | 0.87 | 0.07 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Byte>*'
Related Issues
Regressions
- [Perf] Windows/x64: 31 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Windows/x86: 30 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Linux/x64: 15 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM
Improvements
Payloads
Histogram
Edge Detector Info
System.Numerics.Tests.Perf_VectorOf<Byte>.MultiplyOperatorBenchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 57.0646205350053 < 62.22800691785699.
IsChangePoint: Marked as a change because one of 8/29/2022 8:26:03 AM, 9/6/2022 1:06:44 PM, 9/13/2022 12:23:36 PM, 9/23/2022 1:16:35 AM, 9/29/2022 7:42:19 AM, 10/11/2022 8:42:28 PM, 10/17/2022 3:19:47 PM, 11/2/2022 9:35:40 AM, 11/8/2022 2:29:58 AM falls between 10/30/2022 12:44:54 AM and 11/8/2022 2:29:58 AM.
IsImprovementStdDev: Marked as improvement because 22.23483013916855 (T) = (0 -51.997623891147924) / Math.Sqrt((13.434420614929758 / (299)) + (3.3120039857433965 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.16984805693129068 = (62.63627318504539 - 51.997623891147924) / 62.63627318504539 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Architecture | x64 |
---|---|
OS | Windows 10.0.18362 |
Baseline | bdd67af67dbf43c0f5e9151b98dc100b9555898a |
Compare | fbc20578253e0deb7267eea5a02b680c3cfe0e2a |
Diff | Diff |
Improvements in System.IO.Tests.Perf_FileStream
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
CopyToFileAsync - Duration of single invocation | 59.70 ms | 52.74 ms | 0.88 | 0.25 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.Perf_FileStream*'
Related Issues
Regressions
- [Perf] Windows/x64: 31 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Windows/x86: 30 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Linux/x64: 15 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM
Improvements
Payloads
Histogram
Edge Detector Info
System.IO.Tests.Perf_FileStream.CopyToFileAsync(fileSize: 104857600, options: None)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 52.7442625 < 54.288206339285715.
IsChangePoint: Marked as a change because one of 11/2/2022 9:35:40 AM, 11/8/2022 2:29:58 AM falls between 10/30/2022 12:44:54 AM and 11/8/2022 2:29:58 AM.
IsImprovementStdDev: Marked as improvement because 11.00848345269169 (T) = (0 -54072802.16600528) / Math.Sqrt((4948160299630.963 / (299)) + (1173055410061.11 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.05499744657846666 = (57219741.86231141 - 54072802.16600528) / 57219741.86231141 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x64 |
---|---|
OS | Windows 10.0.18362 |
Baseline | bdd67af67dbf43c0f5e9151b98dc100b9555898a |
Compare | fbc20578253e0deb7267eea5a02b680c3cfe0e2a |
Diff | Diff |
Improvements in System.Collections.IterateForEach<String>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
Dictionary - Duration of single invocation | 3.08 μs | 2.91 μs | 0.95 | 0.44 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach<String>*'
Related Issues
Regressions
- [Perf] Windows/x64: 31 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Windows/x86: 30 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Linux/x64: 15 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM
Improvements
Payloads
Histogram
Edge Detector Info
System.Collections.IterateForEach<String>.Dictionary(Size: 512)
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.9111980041037118 < 2.915573783570904.
IsChangePoint: Marked as a change because one of 8/29/2022 10:15:14 PM, 9/6/2022 11:34:40 PM, 9/13/2022 8:43:59 AM, 9/23/2022 1:16:35 AM, 10/19/2022 7:27:15 PM, 11/2/2022 9:35:40 AM, 11/8/2022 2:29:58 AM falls between 10/30/2022 12:44:54 AM and 11/8/2022 2:29:58 AM.
IsImprovementStdDev: Marked as improvement because 6.579993572607765 (T) = (0 -2774.6133609603276) / Math.Sqrt((67126.55637480615 / (299)) + (19262.459091102886 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.07862054596201445 = (3011.368821825214 - 2774.6133609603276) / 3011.368821825214 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x64 |
---|---|
OS | Windows 10.0.18362 |
Baseline | bdd67af67dbf43c0f5e9151b98dc100b9555898a |
Compare | fbc20578253e0deb7267eea5a02b680c3cfe0e2a |
Diff | Diff |
Improvements in System.Numerics.Tests.Perf_VectorOf<SByte>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
MultiplyOperatorBenchmark - Duration of single invocation | 65.91 ns | 59.27 ns | 0.90 | 0.05 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<SByte>*'
Related Issues
Regressions
- [Perf] Windows/x64: 31 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Windows/x86: 30 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Linux/x64: 15 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM
Improvements
Payloads
Histogram
Edge Detector Info
System.Numerics.Tests.Perf_VectorOf<SByte>.MultiplyOperatorBenchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 59.272855077916155 < 62.38066462402477.
IsChangePoint: Marked as a change because one of 8/29/2022 8:26:03 AM, 9/6/2022 1:06:44 PM, 9/13/2022 12:23:36 PM, 9/23/2022 1:16:35 AM, 9/29/2022 7:42:19 AM, 11/2/2022 9:35:40 AM, 11/8/2022 2:29:58 AM falls between 10/30/2022 12:44:54 AM and 11/8/2022 2:29:58 AM.
IsImprovementStdDev: Marked as improvement because 16.39113351937879 (T) = (0 -52.75689997492603) / Math.Sqrt((15.140591857328621 / (299)) + (5.648636596513892 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.15793998279981575 = (62.65218499548358 - 52.75689997492603) / 62.65218499548358 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x64 |
---|---|
OS | Windows 10.0.18362 |
Baseline | bdd67af67dbf43c0f5e9151b98dc100b9555898a |
Compare | fbc20578253e0deb7267eea5a02b680c3cfe0e2a |
Diff | Diff |
Improvements in System.Globalization.Tests.StringEquality
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
Compare_Same_Upper - Duration of single invocation | 1.77 μs | 1.56 μs | 0.88 | 0.05 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.StringEquality*'
Related Issues
Regressions
- [Perf] Windows/x64: 31 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Windows/x86: 30 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Linux/x64: 15 Regressions on 11/2/2022 4:25:40 PM
- [Perf] Alpine/x64: 18 Regressions on 11/2/2022 4:25:40 PM
Improvements
Payloads
Histogram
Edge Detector Info
System.Globalization.Tests.StringEquality.Compare_Same_Upper(Count: 1024, Options: (en-US, OrdinalIgnoreCase))
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.5588008109814868 < 1.6867380321028294.
IsChangePoint: Marked as a change because one of 9/29/2022 7:42:19 AM, 10/2/2022 11:57:04 PM, 10/17/2022 3:19:47 PM, 10/19/2022 7:27:15 PM, 10/31/2022 10:23:25 PM, 11/2/2022 9:35:40 AM, 11/8/2022 2:29:58 AM falls between 10/30/2022 12:44:54 AM and 11/8/2022 2:29:58 AM.
IsImprovementStdDev: Marked as improvement because 7.454846221850489 (T) = (0 -1657.423205001415) / Math.Sqrt((45718.288694118804 / (299)) + (1381.704391777979 / (18))) is greater than 1.9675235316906419 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (18) - 2, .975) and 0.06381388568952363 = (1770.3992610722999 - 1657.423205001415) / 1770.3992610722999 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository