Closed
Description
Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.19042 |
| Baseline | c2469455eab98fdcea71997d3cc5004a992fc88f |
| Compare | 58614a0f6da787c9d6d914b99564f066d13f69ed |
| Diff | Diff |
Improvements in System.Numerics.Tests.Perf_Matrix4x4
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix4x4*'Payloads
Histogram
System.Numerics.Tests.Perf_Matrix4x4.IsIdentityBenchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.1658364640071641 < 11.294568996285266.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 2345.7481452225084 (T) = (0 -1.166038150533465) / Math.Sqrt((0.006227133291906094 / (299)) + (4.7317381426145394E-07 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.9018469859873882 = (11.879799741897275 - 1.166038150533465) / 11.879799741897275 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromScalarBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.4350060087829282 < 8.162137069642295.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 345.5129607931682 (T) = (0 -0.43502477822555646) / Math.Sqrt((0.16909458472751004 / (299)) + (2.983437297246574E-07 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.9497186224873153 = (8.651807085353052 - 0.43502477822555646) / 8.651807085353052 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationYWithCenterBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.7127986556672703 < 8.83078329131682.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 538.4652657425199 (T) = (0 -0.7139539526735585) / Math.Sqrt((0.07133485366741352 / (299)) + (4.617441552355619E-07 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.9209497693076059 = (9.031649198491857 - 0.7139539526735585) / 9.031649198491857 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix4x4.CreateFromMatrix3x2
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 8.513833638544696 < 10.793662739358114.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 55.81317947669123 (T) = (0 -8.421215057668634) / Math.Sqrt((0.5662630945105225 / (299)) + (0.016738263595740845 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.26921170814360884 = (11.523467400218703 - 8.421215057668634) / 11.523467400218703 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromVectorBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.6454673562520397 < 8.170661828978849.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 344.98346176835577 (T) = (0 -0.6440956001157201) / Math.Sqrt((0.16189214201619734 / (299)) + (5.651260060755977E-07 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.9257253309319793 = (8.671807066900003 - 0.6440956001157201) / 8.671807066900003 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix4x4.CreateScaleFromVectorWithCenterBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.1486125823126743 < 8.343325021047548.
IsChangePoint: Marked as a change because one of 12/5/2022 3:14:07 PM, 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 117.04132068380274 (T) = (0 -1.1446241271331756) / Math.Sqrt((1.6048940085660086 / (299)) + (0.00027718499519107346 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.882425140946697 = (9.735279602710438 - 1.1446241271331756) / 9.735279602710438 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationZBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.4346723023084031 < 8.635898716666185.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 462.3873561782398 (T) = (0 -0.4238482322506757) / Math.Sqrt((0.08887583408580359 / (299)) + (0.0008328675717490423 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.9537139389803377 = (9.157146296605903 - 0.4238482322506757) / 9.157146296605903 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationZWithCenterBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.7133736565104227 < 8.425237637761938.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 444.91892063311263 (T) = (0 -0.7147560414503461) / Math.Sqrt((0.10488577989784051 / (299)) + (1.4185111662050495E-05 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.9211070747663367 = (9.059824304060198 - 0.7147560414503461) / 9.059824304060198 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationYBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.362518371065141 < 8.626404580565486.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 507.4464135943554 (T) = (0 -0.4209026636496226) / Math.Sqrt((0.07151147999919952 / (299)) + (0.0008148173269610918 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.9541076558244234 = (9.171522422984474 - 0.4209026636496226) / 9.171522422984474 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix4x4.CreateRotationXWithCenterBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.8526366962879074 < 8.508147375480927.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 598.7882870538366 (T) = (0 -0.8528498534183354) / Math.Sqrt((0.055862192212969605 / (299)) + (2.5109347004534844E-07 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.9056355315268465 = (9.037828191243085 - 0.8528498534183354) / 9.037828191243085 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.19042 |
| Baseline | c2469455eab98fdcea71997d3cc5004a992fc88f |
| Compare | 58614a0f6da787c9d6d914b99564f066d13f69ed |
| Diff | Diff |
Improvements in System.Numerics.Tests.Perf_Vector3
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| TransformByMatrix4x4Benchmark - Duration of single invocation | 4.39 ns | 3.34 ns | 0.76 | 0.01 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Vector3*'Payloads
Histogram
System.Numerics.Tests.Perf_Vector3.TransformByMatrix4x4Benchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.3413457667435793 < 4.071227092897889.
IsChangePoint: Marked as a change because one of 12/28/2022 5:13:50 PM, 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 159.54764224956574 (T) = (0 -3.347055529838485) / Math.Sqrt((0.0174943246938254 / (299)) + (1.9857703814237962E-05 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.26954682434532634 = (4.582163020701038 - 3.347055529838485) / 4.582163020701038 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
| Architecture | x64 |
|---|---|
| OS | Windows 10.0.19042 |
| Baseline | c2469455eab98fdcea71997d3cc5004a992fc88f |
| Compare | 58614a0f6da787c9d6d914b99564f066d13f69ed |
| Diff | Diff |
Improvements in System.Numerics.Tests.Perf_Matrix3x2
| Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
|---|---|---|---|---|---|---|---|---|---|---|
| SubtractBenchmark - Duration of single invocation | 10.75 ns | 1.01 ns | 0.09 | 0.01 | False | |||||
| MultiplyByMatrixBenchmark - Duration of single invocation | 12.26 ns | 3.68 ns | 0.30 | 0.02 | False | |||||
| AddOperatorBenchmark - Duration of single invocation | 10.93 ns | 1.01 ns | 0.09 | 0.02 | False | |||||
| MultiplyByScalarBenchmark - Duration of single invocation | 9.44 ns | 0.36 ns | 0.04 | 0.01 | False | |||||
| IsIdentityBenchmark - Duration of single invocation | 6.50 ns | 1.32 ns | 0.20 | 0.02 | False | |||||
| EqualityOperatorBenchmark - Duration of single invocation | 5.54 ns | 2.16 ns | 0.39 | 0.06 | False | |||||
| NegateBenchmark - Duration of single invocation | 11.72 ns | 0.36 ns | 0.03 | 0.05 | False |
Repro
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tests.Perf_Matrix3x2*'Payloads
Histogram
System.Numerics.Tests.Perf_Matrix3x2.SubtractBenchmark
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.009010998379199 < 10.293830498140323.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 905.2652666879914 (T) = (0 -1.009715638890564) / Math.Sqrt((0.03457227061609153 / (299)) + (7.125122796672232E-07 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.9060392800222752 = (10.74614625271003 - 1.009715638890564) / 10.74614625271003 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByMatrixBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 3.6838467687205365 < 11.672466840379636.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 619.5021292983748 (T) = (0 -3.6844856364488074) / Math.Sqrt((0.059855133781417505 / (299)) + (1.6072207446036653E-06 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.7041077517837707 = (12.45211950857291 - 3.6844856364488074) / 12.45211950857291 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.AddOperatorBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.0090326321512566 < 10.335136558279531.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 931.5040229610735 (T) = (0 -1.0097612437075854) / Math.Sqrt((0.03274913393995773 / (299)) + (4.4552221852042597E-07 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.9061554076604422 = (10.75992999206568 - 1.0097612437075854) / 10.75992999206568 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.MultiplyByScalarBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.36492602881084113 < 8.861599481794551.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 1086.1906341155282 (T) = (0 -0.36554785459478817) / Math.Sqrt((0.020500791958063282 / (299)) + (2.719201337251281E-07 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.9609494203019461 = (9.360881641739267 - 0.36554785459478817) / 9.360881641739267 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.IsIdentityBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 1.3223440669442588 < 6.175784894504034.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 739.5096852599614 (T) = (0 -1.3229890332972423) / Math.Sqrt((0.015132365916942486 / (299)) + (8.611565975249005E-07 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.7991547075446341 = (6.587105015624161 - 1.3229890332972423) / 6.587105015624161 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.EqualityOperatorBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 2.1584391397302363 < 5.263022247684243.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 416.89288230787236 (T) = (0 -2.158380746380822) / Math.Sqrt((0.018746827549254868 / (299)) + (4.0951061666356066E-07 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.6047070716873006 = (5.460205816465856 - 2.158380746380822) / 5.460205816465856 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Numerics.Tests.Perf_Matrix3x2.NegateBenchmark
```log
Description of detection logic
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 0.3649291747989327 < 11.142872076083274.
IsChangePoint: Marked as a change because one of 1/6/2023 6:58:01 PM, 1/10/2023 7:48:18 AM falls between 1/1/2023 3:57:25 AM and 1/10/2023 7:48:18 AM.
IsImprovementStdDev: Marked as improvement because 864.0089038558908 (T) = (0 -0.3659253188059389) / Math.Sqrt((0.053986372709857205 / (299)) + (5.039417830964417E-07 / (14))) is greater than 1.9676211333067681 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (14) - 2, .975) and 0.9694473623952841 = (11.976881457509805 - 0.3659253188059389) / 11.976881457509805 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository