Description
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | d3a3eda6f4660e85f7a603b624b43993529be377 |
Compare | fbc20578253e0deb7267eea5a02b680c3cfe0e2a |
Diff | Diff |
Regressions in System.Numerics.Tests.Perf_VectorOf<UInt32>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
OnesComplementOperatorBenchmark - Duration of single invocation | 0.35 ns | 10.23 ns | 29.17 | 0.10 | False | |||||
OnesComplementBenchmark - Duration of single invocation | 0.35 ns | 9.92 ns | 28.28 | 0.25 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt32>*'
Related Issues
Regressions
Improvements
Payloads
Histogram
Edge Detector Info
System.Numerics.Tests.Perf_VectorOf<UInt32>.OnesComplementOperatorBenchmark
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.232853187028917 > 0.3682951914384786.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -239.87499158472266 (T) = (0 -10.099243376366788) / Math.Sqrt((1.0495633287414307E-05 / (31)) + (0.03136813506749971 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.71893677956053 = (0.35165798281064814 - 10.099243376366788) / 0.35165798281064814 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<UInt32>.OnesComplementBenchmark
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.920666468642251 > 0.3683458647212298.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -223.08780257821465 (T) = (0 -10.088546084752902) / Math.Sqrt((1.518183988373323E-05 / (31)) + (0.0361831398766661 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.666233276382382 = (0.35193134680393057 - 10.088546084752902) / 0.35193134680393057 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | d3a3eda6f4660e85f7a603b624b43993529be377 |
Compare | fbc20578253e0deb7267eea5a02b680c3cfe0e2a |
Diff | Diff |
Regressions in System.Numerics.Tests.Perf_VectorOf<Byte>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
OnesComplementBenchmark - Duration of single invocation | 0.35 ns | 9.92 ns | 28.16 | 0.25 | False | |||||
OnesComplementOperatorBenchmark - Duration of single invocation | 0.35 ns | 9.92 ns | 28.16 | 0.12 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Byte>*'
Related Issues
Regressions
Improvements
Payloads
Histogram
Edge Detector Info
System.Numerics.Tests.Perf_VectorOf<Byte>.OnesComplementBenchmark
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.919990507952027 > 0.3684033442029486.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -251.53719064957235 (T) = (0 -10.028436084932789) / Math.Sqrt((4.5620299729594605E-07 / (31)) + (0.028122187288692486 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.55617941123143 = (0.3511826964145107 - 10.028436084932789) / 0.3511826964145107 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<Byte>.OnesComplementOperatorBenchmark
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.919659263496312 > 0.36840275668755323.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -238.03575362909368 (T) = (0 -9.997381041296865) / Math.Sqrt((3.8728034663135453E-07 / (31)) + (0.0312018458304494 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.469552543925435 = (0.3511604555734408 - 9.997381041296865) / 0.3511604555734408 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | d3a3eda6f4660e85f7a603b624b43993529be377 |
Compare | fbc20578253e0deb7267eea5a02b680c3cfe0e2a |
Diff | Diff |
Regressions in System.Numerics.Tests.Perf_VectorOf<Double>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
OnesComplementBenchmark - Duration of single invocation | 0.35 ns | 10.21 ns | 29.12 | 0.25 | False | |||||
EqualsBenchmark - Duration of single invocation | 0.81 ns | 12.48 ns | 15.47 | 0.08 | False | |||||
OnesComplementOperatorBenchmark - Duration of single invocation | 0.35 ns | 10.31 ns | 29.40 | 0.11 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Double>*'
Related Issues
Regressions
Improvements
Payloads
Histogram
Edge Detector Info
System.Numerics.Tests.Perf_VectorOf<Double>.OnesComplementBenchmark
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.212588828844682 > 0.36831785229104136.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -246.75154480180652 (T) = (0 -10.072989986396268) / Math.Sqrt((3.113583446549675E-07 / (31)) + (0.029494342140933702 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.695547288150706 = (0.35102972197208177 - 10.072989986396268) / 0.35102972197208177 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<Double>.EqualsBenchmark
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 12.476559503640553 > 0.8469036278313005.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -343.4939786745 (T) = (0 -12.291401516624575) / Math.Sqrt((0.0005088788718934147 / (31)) + (0.020938782636762483 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -14.291285611838616 = (0.8038174048039812 - 12.291401516624575) / 0.8038174048039812 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<Double>.OnesComplementOperatorBenchmark
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.314355237097585 > 0.3683554492318309.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -226.2317580247239 (T) = (0 -10.122614428772772) / Math.Sqrt((7.485072758264043E-06 / (31)) + (0.035438785396535825 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.79869046157266 = (0.35149565020256096 - 10.122614428772772) / 0.35149565020256096 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | d3a3eda6f4660e85f7a603b624b43993529be377 |
Compare | fbc20578253e0deb7267eea5a02b680c3cfe0e2a |
Diff | Diff |
Regressions in System.Numerics.Tests.Perf_VectorOf<Int32>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
OnesComplementOperatorBenchmark - Duration of single invocation | 0.45 ns | 10.24 ns | 22.83 | 0.09 | False | |||||
OnesComplementBenchmark - Duration of single invocation | 0.35 ns | 9.92 ns | 28.28 | 0.25 | False | |||||
SquareRootBenchmark - Duration of single invocation | 18.51 ns | 20.50 ns | 1.11 | 0.04 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<Int32>*'
Related Issues
Regressions
Improvements
Payloads
Histogram
Edge Detector Info
System.Numerics.Tests.Perf_VectorOf<Int32>.OnesComplementOperatorBenchmark
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.237169950584947 > 0.3691557928810883.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -225.62876354228246 (T) = (0 -10.057134875937658) / Math.Sqrt((0.0003108741744081932 / (31)) + (0.034944957751987735 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.371709416617506 = (0.3544775793469506 - 10.057134875937658) / 0.3544775793469506 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<Int32>.OnesComplementBenchmark
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.91955282620574 > 0.3683046115678106.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -243.46825270061078 (T) = (0 -10.077341660173582) / Math.Sqrt((1.8210017835673E-06 / (31)) + (0.030319953517507128 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.688914764313235 = (0.3512625605730129 - 10.077341660173582) / 0.3512625605730129 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<Int32>.SquareRootBenchmark
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 20.50154013343025 > 19.386174653741755.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -32.11382280287923 (T) = (0 -20.263139769141354) / Math.Sqrt((0.04573048603154225 / (31)) + (0.04739048984668227 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.11092605790998478 = (18.239863602860254 - 20.263139769141354) / 18.239863602860254 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | d3a3eda6f4660e85f7a603b624b43993529be377 |
Compare | fbc20578253e0deb7267eea5a02b680c3cfe0e2a |
Diff | Diff |
Regressions in System.Linq.Tests.Perf_Enumerable
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
WhereSingleOrDefault_LastElementMatches - Duration of single invocation | 325.36 ns | 388.18 ns | 1.19 | 0.04 | False | |||||
Select - Duration of single invocation | 798.47 ns | 891.91 ns | 1.12 | 0.03 | False | |||||
FirstWithPredicate_LastElementMatches - Duration of single invocation | 985.50 ns | 1.05 μs | 1.06 | 0.02 | False | |||||
Select - Duration of single invocation | 1.12 μs | 1.21 μs | 1.08 | 0.01 | False | |||||
WhereSingleOrDefault_LastElementMatches - Duration of single invocation | 753.84 ns | 811.56 ns | 1.08 | 0.02 | False | |||||
WhereFirst_LastElementMatches - Duration of single invocation | 719.54 ns | 762.78 ns | 1.06 | 0.01 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Linq.Tests.Perf_Enumerable*'
Related Issues
Regressions
Improvements
Payloads
Histogram
Edge Detector Info
System.Linq.Tests.Perf_Enumerable.WhereSingleOrDefault_LastElementMatches(input: Array)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 388.1762834942391 > 341.33331817713974.
IsChangePoint: Marked as a change because one of 9/9/2022 3:12:19 AM, 9/15/2022 1:09:14 PM, 9/23/2022 1:16:35 AM, 10/2/2022 11:57:04 PM, 10/19/2022 7:27:15 PM, 10/26/2022 7:11:30 AM, 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -224.5179500119383 (T) = (0 -386.6338686272019) / Math.Sqrt((0.9308831490833372 / (31)) + (0.8677928344754632 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.19015502092229022 = (324.8600911901263 - 386.6338686272019) / 324.8600911901263 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Linq.Tests.Perf_Enumerable.Select(input: List)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 891.9098076813004 > 837.31191760236.
IsChangePoint: Marked as a change because one of 8/27/2022 12:34:40 AM, 9/26/2022 8:26:31 AM, 10/19/2022 7:27:15 PM, 10/25/2022 12:27:43 PM, 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -30.868250013890737 (T) = (0 -866.540415535576) / Math.Sqrt((11.093248047381715 / (31)) + (83.7078089020045 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.08430191637837313 = (799.1689421981912 - 866.540415535576) / 799.1689421981912 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Linq.Tests.Perf_Enumerable.FirstWithPredicate_LastElementMatches(input: List)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 1.0468959900591077 > 1034.7795407060016.
IsChangePoint: Marked as a change because one of 8/24/2022 2:39:26 AM, 8/27/2022 12:34:40 AM, 9/26/2022 8:26:31 AM, 10/19/2022 7:27:15 PM, 10/25/2022 2:34:53 PM, 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -72.54341340199926 (T) = (0 -1046.1378427173622) / Math.Sqrt((2.4376557657731506 / (31)) + (11.465599916147882 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.060749349805875895 = (986.2252971531987 - 1046.1378427173622) / 986.2252971531987 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Linq.Tests.Perf_Enumerable.Select(input: IList)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 1.2128833255645326 > 1.1733245613714787.
IsChangePoint: Marked as a change because one of 8/27/2022 12:34:40 AM, 9/26/2022 8:26:31 AM, 10/25/2022 12:27:43 PM, 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -61.70660160744853 (T) = (0 -1212.4633446828693) / Math.Sqrt((9.207804049105606 / (31)) + (38.798075478781314 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.08440589274675023 = (1118.0899631702991 - 1212.4633446828693) / 1118.0899631702991 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Linq.Tests.Perf_Enumerable.WhereSingleOrDefault_LastElementMatches(input: IEnumerable)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 811.5556800806227 > 790.6306510161276.
IsChangePoint: Marked as a change because one of 10/2/2022 11:57:04 PM, 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -78.42687722132564 (T) = (0 -812.2675529889704) / Math.Sqrt((4.146859849610885 / (31)) + (8.852412342676736 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.08081242551990057 = (751.5342475807005 - 812.2675529889704) / 751.5342475807005 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Linq.Tests.Perf_Enumerable.WhereFirst_LastElementMatches(input: IEnumerable)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 762.7764646811012 > 751.1322871210074.
IsChangePoint: Marked as a change because one of 10/3/2022 1:11:02 PM, 10/6/2022 2:13:23 PM, 10/19/2022 7:27:15 PM, 10/25/2022 12:27:43 PM, 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -61.028639171858835 (T) = (0 -763.033356164663) / Math.Sqrt((7.142750166448125 / (31)) + (6.85269152188829 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -0.06552011958756862 = (716.1135131451208 - 763.033356164663) / 716.1135131451208 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | d3a3eda6f4660e85f7a603b624b43993529be377 |
Compare | fbc20578253e0deb7267eea5a02b680c3cfe0e2a |
Diff | Diff |
Regressions in System.Numerics.Tests.Perf_VectorOf<SByte>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
OnesComplementOperatorBenchmark - Duration of single invocation | 0.35 ns | 10.27 ns | 29.29 | 0.08 | False | |||||
OnesComplementBenchmark - Duration of single invocation | 0.35 ns | 10.37 ns | 29.55 | 0.13 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<SByte>*'
Related Issues
Regressions
Improvements
Payloads
Histogram
Edge Detector Info
System.Numerics.Tests.Perf_VectorOf<SByte>.OnesComplementOperatorBenchmark
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.27405148731388 > 0.3683583403013838.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -244.45613805937222 (T) = (0 -10.06952659278593) / Math.Sqrt((7.060681308198053E-06 / (31)) + (0.030021518045891236 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.635791828319867 = (0.3516412835082666 - 10.06952659278593) / 0.3516412835082666 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<SByte>.OnesComplementBenchmark
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 10.368093945301476 > 0.3683620730802239.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -221.97446660066907 (T) = (0 -10.100202914997531) / Math.Sqrt((1.4208390662419122E-06 / (31)) + (0.03664830970184221 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.755727995241386 = (0.35124142628797134 - 10.100202914997531) / 0.35124142628797134 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | d3a3eda6f4660e85f7a603b624b43993529be377 |
Compare | fbc20578253e0deb7267eea5a02b680c3cfe0e2a |
Diff | Diff |
Regressions in System.Numerics.Tests.Perf_VectorOf<UInt16>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
OnesComplementOperatorBenchmark - Duration of single invocation | 0.35 ns | 9.92 ns | 28.25 | 0.30 | False | |||||
OnesComplementBenchmark - Duration of single invocation | 0.35 ns | 9.92 ns | 28.44 | 0.06 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorOf<UInt16>*'
Related Issues
Regressions
Improvements
Payloads
Histogram
Edge Detector Info
System.Numerics.Tests.Perf_VectorOf<UInt16>.OnesComplementOperatorBenchmark
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.920443412682918 > 0.3683201030079756.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -249.64798071414197 (T) = (0 -10.00412786154018) / Math.Sqrt((2.0492913549376778E-07 / (31)) + (0.02840768000393018 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.505475044049934 = (0.35095460945943374 - 10.00412786154018) / 0.35095460945943374 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_VectorOf<UInt16>.OnesComplementBenchmark
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 9.918218042171077 > 0.3683095608222839.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -223.14525618400833 (T) = (0 -10.079122704829096) / Math.Sqrt((3.6573315413853704E-07 / (31)) + (0.0361114200629665 / (19))) is less than -2.010634757623041 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (19) - 2, .025) and -27.725439801920857 = (0.350877924736077 - 10.079122704829096) / 0.350877924736077 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Architecture | x86 |
---|---|
OS | Windows 10.0.18362 |
Baseline | d3a3eda6f4660e85f7a603b624b43993529be377 |
Compare | fbc20578253e0deb7267eea5a02b680c3cfe0e2a |
Diff | Diff |
Regressions in System.Numerics.Tests.Perf_VectorConvert
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
Convert_float_uint - Duration of single invocation | 21.42 μs | 24.09 μs | 1.12 | 0.01 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_VectorConvert*'
Related Issues
Regressions
Improvements
Payloads
Histogram
Edge Detector Info
System.Numerics.Tests.Perf_VectorConvert.Convert_float_uint
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 24.090204999678683 > 21.995298670247877.
IsChangePoint: Marked as a change because one of 11/2/2022 4:14:20 AM, 11/8/2022 2:29:58 AM falls between 10/29/2022 4:38:27 PM and 11/8/2022 2:29:58 AM.
IsRegressionStdDev: Marked as regression because -29.18149240574193 (T) = (0 -24220.03409285443) / Math.Sqrt((248324.77542410404 / (21)) + (22653.184411918824 / (19))) is less than -2.0243941639098457 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (19) - 2, .025) and -0.1593734292628975 = (20890.62374687417 - 24220.03409285443) / 20890.62374687417 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository