[Perf] Linux/x64: 48 Regressions on 4/17/2023 7:48:00 AM

[performanceautofiler]

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	7dbf6a5f2fd636db350f9cc31b2dfd3af0eff1a8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
NegateBenchmark - Duration of single invocation	24.87 ns	46.08 ns	1.85	0.57	False
DivideBenchmark - Duration of single invocation	24.14 ns	45.69 ns	1.89	0.53	False
XorBenchmark - Duration of single invocation	4.37 ns	49.20 ns	11.27	0.59	True
ConditionalSelectBenchmark - Duration of single invocation	5.98 ns	51.82 ns	8.67	0.62	False
SumBenchmark - Duration of single invocation	2.21 ns	39.46 ns	17.87	0.65	False
AddBenchmark - Duration of single invocation	2.48 ns	36.81 ns	14.86	0.60	False
GreaterThanOrEqualAllBenchmark - Duration of single invocation	2.68 ns	45.75 ns	17.06	0.65	False
BitwiseAndBenchmark - Duration of single invocation	3.35 ns	47.59 ns	14.20	0.64	True
InequalityOperatorBenchmark - Duration of single invocation	2.46 ns	27.22 ns	11.06	0.73	False
MinBenchmark - Duration of single invocation	3.36 ns	52.44 ns	15.62	0.59	False
GreaterThanBenchmark - Duration of single invocation	6.19 ns	64.93 ns	10.48	0.60	False
GreaterThanOrEqualAnyBenchmark - Duration of single invocation	4.83 ns	31.44 ns	6.51	0.74	False
MultiplyOperatorBenchmark - Duration of single invocation	5.45 ns	29.88 ns	5.48	0.56	False
LessThanOrEqualBenchmark - Duration of single invocation	3.32 ns	57.03 ns	17.19	0.54	False
GreaterThanAnyBenchmark - Duration of single invocation	2.56 ns	25.83 ns	10.07	0.73	False
DotBenchmark - Duration of single invocation	2.27 ns	69.48 ns	30.57	0.62	False
LessThanAllBenchmark - Duration of single invocation	2.47 ns	27.45 ns	11.12	0.68	False
MultiplyBenchmark - Duration of single invocation	3.38 ns	40.93 ns	12.12	0.61	False
MaxBenchmark - Duration of single invocation	3.34 ns	56.53 ns	16.92	0.54	False
AbsBenchmark - Duration of single invocation	6.12 ns	36.35 ns	5.94	0.64	True
BitwiseOrBenchmark - Duration of single invocation	3.43 ns	50.66 ns	14.76	0.60	True
GreaterThanOrEqualBenchmark - Duration of single invocation	3.12 ns	72.84 ns	23.35	0.61	False
OnesComplementOperatorBenchmark - Duration of single invocation	5.71 ns	42.85 ns	7.51	0.59	True
EqualityOperatorBenchmark - Duration of single invocation	2.27 ns	21.70 ns	9.55	0.73	False
BitwiseOrOperatorBenchmark - Duration of single invocation	3.27 ns	48.69 ns	14.89	0.59	True
ZeroBenchmark - Duration of single invocation	1.97 ns	17.45 ns	8.85	0.70	True
SubtractBenchmark - Duration of single invocation	3.49 ns	42.95 ns	12.31	0.56	False
AddOperatorBenchmark - Duration of single invocation	2.86 ns	34.90 ns	12.19	0.56	False
EqualsStaticBenchmark - Duration of single invocation	4.52 ns	55.32 ns	12.23	0.56	False
LessThanBenchmark - Duration of single invocation	3.20 ns	58.28 ns	18.24	0.52	False
EqualsAllBenchmark - Duration of single invocation	4.71 ns	34.74 ns	7.37	0.69	False
LessThanOrEqualAllBenchmark - Duration of single invocation	2.50 ns	26.72 ns	10.68	0.73	False
CountBenchmark - Duration of single invocation	0.15 ns	19.71 ns	131.29	0.91	True
GreaterThanAllBenchmark - Duration of single invocation	2.51 ns	55.27 ns	21.99	0.64	False
LessThanOrEqualAnyBenchmark - Duration of single invocation	2.65 ns	47.53 ns	17.93	0.59	False
EqualsAnyBenchmark - Duration of single invocation	2.50 ns	52.20 ns	20.90	0.66	False
LessThanAnyBenchmark - Duration of single invocation	2.99 ns	45.88 ns	15.32	0.68	False
OnesComplementBenchmark - Duration of single invocation	3.20 ns	42.16 ns	13.17	0.58	True
BitwiseAndOperatorBenchmark - Duration of single invocation	3.64 ns	51.27 ns	14.10	0.59	True
ExclusiveOrOperatorBenchmark - Duration of single invocation	3.36 ns	47.95 ns	14.28	0.59	True
AllBitsSetBenchmark - Duration of single invocation	7.65 ns	29.95 ns	3.91	0.60	True
AndNotBenchmark - Duration of single invocation	3.57 ns	48.69 ns	13.66	0.64	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>*'

Payloads

Baseline
Compare

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.NegateBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 46.07641762919533 > 25.484157331743344.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -9.030581460443429 (T) = (0 -41.541091400486025) / Math.Sqrt((5.674733947815886 / (27)) + (26.81478290225014 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -0.7761773544438627 = (23.38791860877706 - 41.541091400486025) / 23.38791860877706 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.DivideBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.690820992055784 > 25.161955606181614.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.48012289292443 (T) = (0 -42.26821520947525) / Math.Sqrt((3.16261321849385 / (27)) + (6.920735687622066 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.6945150661704442 = (24.944136557605365 - 42.26821520947525) / 24.944136557605365 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.XorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.19925733925429 > 3.4935736545708247.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -183.21598296194063 (T) = (0 -48.63898551012957) / Math.Sqrt((1.0383526369272695 / (27)) + (0.17708976313627087 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -12.744024213893336 = (3.5389187877712107 - 48.63898551012957) / 3.5389187877712107 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.ConditionalSelectBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.81541373339662 > 3.5413724155390462.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -97.92885381848782 (T) = (0 -52.61809409328581) / Math.Sqrt((1.1895390217094994 / (27)) + (1.439557728623394 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -13.28961755792818 = (3.6822604859772605 - 52.61809409328581) / 3.6822604859772605 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.SumBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 39.460563495405275 > 2.4899168045807873.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -20.481480073021498 (T) = (0 -33.4975122543372) / Math.Sqrt((0.2877819493154861 / (27)) + (18.480499982187727 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.588216081735073 = (2.2962034608383126 - 33.4975122543372) / 2.2962034608383126 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.AddBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 36.81449256740229 > 3.371483183732509.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.05097715137802 (T) = (0 -39.83593961601279) / Math.Sqrt((0.46675215943898585 / (27)) + (9.054646962843163 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.947171916326305 = (3.3343405364055516 - 39.83593961601279) / 3.3343405364055516 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.75171229419696 > 2.587061478488969.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -35.68349811588385 (T) = (0 -49.29497881213942) / Math.Sqrt((0.2643803267893332 / (27)) + (13.736355372650944 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -19.508813358535342 = (2.4035997573513375 - 49.29497881213942) / 2.4035997573513375 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.BitwiseAndBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.59487468831248 > 3.4096104601436656.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -95.93076420385309 (T) = (0 -48.79860060005555) / Math.Sqrt((0.6431027875743937 / (26)) + (1.6010040422758802 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -13.74821707760529 = (3.308779654061013 - 48.79860060005555) / 3.308779654061013 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.InequalityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.21583728495809 > 2.5712743200662884.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -13.384247118957015 (T) = (0 -19.79411267537967) / Math.Sqrt((0.1186960175158197 / (27)) + (13.16065806489361 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -6.600101933131134 = (2.6044535783252023 - 19.79411267537967) / 2.6044535783252023 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.MinBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.436391817356224 > 3.478979285778447.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -15.477904001098828 (T) = (0 -60.75803011625992) / Math.Sqrt((0.6480629173213489 / (27)) + (110.14567633427536 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -17.54416769249175 = (3.2763956368265537 - 60.75803011625992) / 3.2763956368265537 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 64.92772379298943 > 3.561621267661207.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -74.63730159356464 (T) = (0 -67.77796333914992) / Math.Sqrt((2.508411654375434 / (27)) + (5.131934490074339 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -16.761026677790742 = (3.8161061614699787 - 67.77796333914992) / 3.8161061614699787 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 31.43513573248222 > 2.4664665144736766.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -17.994336029247844 (T) = (0 -29.544029640892315) / Math.Sqrt((0.8529581477029106 / (26)) + (17.738488069747426 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.577615848502235 = (2.551823279290645 - 29.544029640892315) / 2.551823279290645 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.MultiplyOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.884296697255145 > 3.4625481308331096.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.54666670424187 (T) = (0 -34.463160518047026) / Math.Sqrt((0.5178987877308987 / (27)) + (12.105765059844218 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -9.36012330825866 = (3.3265203021835106 - 34.463160518047026) / 3.3265203021835106 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.02944446377365 > 3.398466544982993.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -35.4493593081427 (T) = (0 -55.68354325569878) / Math.Sqrt((0.040779671170422374 / (26)) + (17.484845010775633 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -16.095840599083814 = (3.2571398249164143 - 55.68354325569878) / 3.2571398249164143 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 25.82745594170482 > 2.6302998236258257.
IsChangePoint: Marked as a change because one of 1/27/2023 3:43:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.32787435437466 (T) = (0 -30.07429179405522) / Math.Sqrt((0.6612068064625831 / (26)) + (11.089552327282835 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.75405739951117 = (2.3580175980082925 - 30.07429179405522) / 2.3580175980082925 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.DotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 69.47640218872655 > 3.0593683016388407.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -55.02649377587872 (T) = (0 -68.48449591726218) / Math.Sqrt((0.1234720241559733 / (27)) + (11.376764191293201 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -23.821556229247513 = (2.759073415250497 - 68.48449591726218) / 2.759073415250497 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 27.450108596247137 > 2.574982566528561.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -14.566251087184542 (T) = (0 -31.348714338218546) / Math.Sqrt((0.27858050270580453 / (25)) + (30.992506946452615 / (8))) is less than -2.0395134463927462 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (8) - 2, .025) and -10.886748361491179 = (2.637282575929443 - 31.348714338218546) / 2.637282575929443 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.MultiplyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 40.93397799419031 > 3.4772081039631804.
IsChangePoint: Marked as a change because one of 1/27/2023 11:36:27 AM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -36.96846694077308 (T) = (0 -40.22893790105784) / Math.Sqrt((0.5577578996695352 / (27)) + (7.784895910588007 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -10.916813184497258 = (3.3758134224502405 - 40.22893790105784) / 3.3758134224502405 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.MaxBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 56.52928604904053 > 3.583271123323237.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -52.305482209797326 (T) = (0 -57.572309069708105) / Math.Sqrt((0.3540167145271324 / (26)) + (8.430111900447649 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -15.293840333385802 = (3.533378742624808 - 57.572309069708105) / 3.533378742624808 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.AbsBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 36.352114063198684 > 6.307892094735755.
IsChangePoint: Marked as a change because one of 1/27/2023 11:43:56 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -33.226207263342154 (T) = (0 -34.170516336590936) / Math.Sqrt((1.0337915335569565 / (27)) + (5.4283952788387255 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -4.658193756120474 = (6.039120929648027 - 34.170516336590936) / 6.039120929648027 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.BitwiseOrBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 50.658771767921 > 3.5376804755758036.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -59.745556424282746 (T) = (0 -49.50229783252979) / Math.Sqrt((1.7607184426059714 / (27)) + (4.239166412752725 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.505515457937628 = (3.412653481778989 - 49.50229783252979) / 3.412653481778989 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanOrEqualBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 72.84373938909593 > 3.3645373853476483.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -45.78560313150566 (T) = (0 -70.2052091130218) / Math.Sqrt((0.8728977645918756 / (27)) + (16.760669950136823 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -19.50440625014592 = (3.4239084154178903 - 70.2052091130218) / 3.4239084154178903 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.OnesComplementOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.84854479016685 > 6.366530391946874.
IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -19.367277559491615 (T) = (0 -45.2652009966623) / Math.Sqrt((0.6868475905699798 / (26)) + (32.68491743986234 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.554331092113859 = (5.991953548860956 - 45.2652009966623) / 5.991953548860956 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.EqualityOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 21.695874942351143 > 2.3337031818019414.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.10500182276335 (T) = (0 -20.285609671185416) / Math.Sqrt((0.39401263297654465 / (26)) + (4.724559933553837 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -7.806883840999334 = (2.3033810865936855 - 20.285609671185416) / 2.3033810865936855 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.BitwiseOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.693976756074434 > 3.436040333293787.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -53.33264821585741 (T) = (0 -49.52987869746883) / Math.Sqrt((0.4846080729332176 / (27)) + (5.87384941670715 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.121849292215197 = (3.2753850233758817 - 49.52987869746883) / 3.2753850233758817 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.ZeroBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 17.451079601695085 > 2.095192880729371.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -28.174043105551718 (T) = (0 -17.33417005924551) / Math.Sqrt((0.367478300854904 / (26)) + (2.2049618926823427 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -6.99391899513587 = (2.168419528618314 - 17.33417005924551) / 2.168419528618314 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.SubtractBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.951057295503944 > 3.5545642714175067.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.861855052658605 (T) = (0 -42.093512381041734) / Math.Sqrt((1.136641520938368 / (27)) + (10.744400333498861 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.316552478252714 = (3.4176375617581365 - 42.093512381041734) / 3.4176375617581365 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.AddOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.895928121839646 > 3.8987636327960615.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -31.16608604991872 (T) = (0 -32.383041685099336) / Math.Sqrt((5.8381991352517435 / (26)) + (4.905002794808764 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -7.392715052171186 = (3.858470290460043 - 32.383041685099336) / 3.858470290460043 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.EqualsStaticBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.32419401630461 > 4.983908389168366.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -63.766263047203594 (T) = (0 -54.42404476572457) / Math.Sqrt((1.7445447640039815 / (27)) + (4.5231884697707105 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -13.28194896544649 = (3.81068752572896 - 54.42404476572457) / 3.81068752572896 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 58.28241000452166 > 2.9647996343399856.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -38.66807364357062 (T) = (0 -56.6119321886343) / Math.Sqrt((1.6775335957320059 / (26)) + (14.812218667471226 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -17.338516189052452 = (3.0870508608777154 - 56.6119321886343) / 3.0870508608777154 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.EqualsAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 34.744817523141826 > 2.426544441110321.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -21.992717671507243 (T) = (0 -28.22580540623765) / Math.Sqrt((0.8313511107614799 / (26)) + (10.80769626971586 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -10.946250709042992 = (2.3627333875448864 - 28.22580540623765) / 2.3627333875448864 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanOrEqualAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 26.715860759910367 > 2.5489586365059433.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -23.140526223596623 (T) = (0 -29.797106126288803) / Math.Sqrt((0.2449112430931249 / (27)) + (11.114558917377849 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.249037063682993 = (2.4326080467691495 - 29.797106126288803) / 2.4326080467691495 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.CountBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 19.710919683270635 > 0.09841566222427127.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -24.47035783241191 (T) = (0 -15.532011630543472) / Math.Sqrt((0.26835795100275284 / (27)) + (3.02529266523675 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -53.01815186829311 = (0.2875331919613536 - 15.532011630543472) / 0.2875331919613536 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.GreaterThanAllBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 55.27099269128034 > 2.6307716320859367.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.979536435757154 (T) = (0 -50.251251186006975) / Math.Sqrt((0.8003980594805293 / (26)) + (14.478329456653357 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -16.977200021746206 = (2.7952768576430316 - 50.251251186006975) / 2.7952768576430316 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanOrEqualAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.52680864809397 > 2.582974262877409.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -45.052185004659 (T) = (0 -48.589081947459455) / Math.Sqrt((0.9654790217882617 / (26)) + (8.089277157463481 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -18.73673302729069 = (2.461860424431621 - 48.589081947459455) / 2.461860424431621 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.EqualsAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 52.2027555089667 > 2.62885022984992.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -55.099022127643934 (T) = (0 -52.9791163236748) / Math.Sqrt((0.12375069740503039 / (27)) + (6.687605470980382 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -20.50145531141791 = (2.4639781613080545 - 52.9791163236748) / 2.4639781613080545 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.LessThanAnyBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.883014068075916 > 2.6158693513796307.
IsChangePoint: Marked as a change because one of 1/26/2023 4:17:33 PM, 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -32.47678010366293 (T) = (0 -50.65894379019355) / Math.Sqrt((1.457047169458074 / (26)) + (16.927593026610452 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -17.120084377155237 = (2.795734431240366 - 50.65894379019355) / 2.795734431240366 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.OnesComplementBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 42.160790284390494 > 3.369566166994424.
IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -107.27507606021591 (T) = (0 -42.45834161486144) / Math.Sqrt((0.29083784912377664 / (26)) + (0.9731048778202602 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -11.629328014325614 = (3.361884461841547 - 42.45834161486144) / 3.361884461841547 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.BitwiseAndOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 51.27472174310439 > 3.7522237501567672.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -50.345048186378285 (T) = (0 -49.948011459197645) / Math.Sqrt((0.43084440875158136 / (26)) + (6.739622684303077 / (8))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (26) + (8) - 2, .025) and -14.19820782928454 = (3.2864408764667457 - 49.948011459197645) / 3.2864408764667457 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.ExclusiveOrOperatorBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.95234691582623 > 3.4079949774909926.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -79.74704633267775 (T) = (0 -49.14145719299116) / Math.Sqrt((1.6087873662740317 / (27)) + (2.1777865267559298 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -14.33302987686211 = (3.2049410708542827 - 49.14145719299116) / 3.2049410708542827 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.AllBitsSetBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 29.948445526116327 > 2.237738985447814.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -56.91204549404501 (T) = (0 -30.314440354245104) / Math.Sqrt((2.60297242424569 / (27)) + (1.1457975615250506 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -11.349131775017819 = (2.454783130225474 - 30.314440354245104) / 2.454783130225474 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<UInt32>.AndNotBenchmark

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 48.69099090244746 > 3.4562512701492545.
IsChangePoint: Marked as a change because one of 3/1/2023 3:09:21 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -119.86013275690009 (T) = (0 -48.74405420634607) / Math.Sqrt((0.5410343567817573 / (27)) + (0.872521281941756 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -14.462505680782822 = (3.1524033175894877 - 48.74405420634607) / 3.1524033175894877 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	887c043eb94be364188e2b23a87efa214ea57f1e
Compare	7dbf6a5f2fd636db350f9cc31b2dfd3af0eff1a8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Exceptions.Handling

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ThrowAndCatchDeep - Duration of single invocation	11.96 μs	13.00 μs	1.09	0.07	False
ThrowAndCatchFinally - Duration of single invocation	4.17 μs	4.84 μs	1.16	0.15	False
TryAndCatchDeep_CaugtAtTheTop - Duration of single invocation	41.36 μs	47.33 μs	1.14	0.05	False
TryAndCatchDeep_CaugtAtTheTop - Duration of single invocation	36.53 μs	43.22 μs	1.18	0.03	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Exceptions.Handling*'

Payloads

Baseline
Compare

Histogram

Exceptions.Handling.ThrowAndCatchDeep(kind: Software)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 12.998704506977976 > 12.596890937026.
IsChangePoint: Marked as a change because one of 3/10/2023 8:06:53 PM, 4/17/2023 1:30:24 AM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -10.1904841022253 (T) = (0 -13011.054535736135) / Math.Sqrt((62639.238072931315 / (27)) + (47504.62183228913 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -0.08077755769392181 = (12038.605393970338 - 13011.054535736135) / 12038.605393970338 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Exceptions.Handling.ThrowAndCatchFinally(kind: Software)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 4.8433007708373 > 4.426648703001254.
IsChangePoint: Marked as a change because one of 3/10/2023 4:14:40 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -16.665575480052837 (T) = (0 -4794.003427287117) / Math.Sqrt((7738.68916411251 / (27)) + (7037.639108448551 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.1347157871317988 = (4224.849501217248 - 4794.003427287117) / 4224.849501217248 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Exceptions.Handling.TryAndCatchDeep_CaugtAtTheTop(kind: Hardware)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 47.32798651660839 > 43.4153437407578.
IsChangePoint: Marked as a change because one of 3/10/2023 8:06:53 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -22.605184360362756 (T) = (0 -48025.316802999485) / Math.Sqrt((414200.6431481323 / (27)) + (699386.535065767 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.17770276336804094 = (40778.809642642584 - 48025.316802999485) / 40778.809642642584 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Exceptions.Handling.TryAndCatchDeep_CaugtAtTheTop(kind: Software)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.22259839409721 > 38.190485717414.
IsChangePoint: Marked as a change because one of 3/10/2023 8:06:53 PM, 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -34.405207168086854 (T) = (0 -43161.753831184236) / Math.Sqrt((311858.489949502 / (27)) + (224209.7452715034 / (8))) is less than -2.034515297446192 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (8) - 2, .025) and -0.18846482069016854 = (36317.233021772765 - 43161.753831184236) / 36317.233021772765 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	887c043eb94be364188e2b23a87efa214ea57f1e
Compare	7dbf6a5f2fd636db350f9cc31b2dfd3af0eff1a8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryGetValueFalse<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
FrozenDictionary - Duration of single invocation	41.19 μs	45.83 μs	1.11	0.46	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueFalse<String, String>*'

Payloads

Baseline
Compare

Histogram

System.Collections.TryGetValueFalse<String, String>.FrozenDictionary(Size: 512)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 45.8314082541423 > 42.90196096641845.
IsChangePoint: Marked as a change because one of 4/17/2023 1:30:24 AM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -5.967537951910633 (T) = (0 -45675.972696877216) / Math.Sqrt((2922468.5845005694 / (27)) + (2335095.307657433 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -0.09510134382675953 = (41709.35681374067 - 45675.972696877216) / 41709.35681374067 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	7526a4c6a0a095670f1135d983a349b4e867f2e2
Compare	7dbf6a5f2fd636db350f9cc31b2dfd3af0eff1a8
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Perf_Dictionary

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Clone - Duration of single invocation	28.28 μs	43.70 μs	1.55	0.09	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_Dictionary*'

Payloads

Baseline
Compare

Histogram

System.Collections.Tests.Perf_Dictionary.Clone(Items: 3000)

Description of detection logic

IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 43.69959969409073 > 29.880491862042163.
IsChangePoint: Marked as a change because one of 4/12/2023 8:39:35 PM, 4/19/2023 1:39:34 AM falls between 4/10/2023 1:33:42 PM and 4/19/2023 1:39:34 AM.
IsRegressionStdDev: Marked as regression because -137.03912072225432 (T) = (0 -43577.07739564635) / Math.Sqrt((205623.13902208704 / (27)) + (30882.728322206243 / (7))) is less than -2.03693334345674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (27) + (7) - 2, .025) and -0.5264489299068227 = (28548.008742294693 - 43577.07739564635) / 28548.008742294693 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[radekdoulik]

this is probably dotnet/runtime#84304

[kotlarmilos]

Mitigated by dotnet/runtime#85048.

Actual fix will be submitted after the Preview 4 snap