[Perf] Windows/x64: 2 Improvements on 7/27/2023 9:58:25 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	Windows 10.0.19042
Queue	OwlWindows
Baseline	a0a8ce681afda6b662e450ac9532b0d4c125520c
Compare	e5efd8010e19593298dc2c3ee15106d5aec5a924
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Improvements in Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Factory_3Explicit - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	14.97 ns	11.38 ns	0.76	0.20	True
CreateInstance_3 - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	647.53 ns	257.93 ns	0.40	0.20	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark*'

Payloads

Baseline
Compare

Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark.Factory_3Explicit

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 11.379924054922688 < 13.293494775967318.
IsChangePoint: Marked as a change because one of 7/27/2023 4:03:50 PM, 7/31/2023 7:57:50 PM falls between 7/23/2023 4:13:29 AM and 7/31/2023 7:57:50 PM.
IsImprovementStdDev: Marked as improvement because 14.209789586825176 (T) = (0 -11.488436648641036) / Math.Sqrt((0.4675761193186499 / (30)) + (0.003236268019314698 / (12))) is greater than 2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (12) - 2, .975) and 0.13475814415354873 = (13.277717173543454 - 11.488436648641036) / 13.277717173543454 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

JIT Disasms

Microsoft.Extensions.DependencyInjection.ActivatorUtilitiesBenchmark.CreateInstance_3

ETL Files

Histogram

Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 257.9304854637164 < 625.8469698843891.
IsChangePoint: Marked as a change because one of 7/27/2023 4:03:50 PM, 7/31/2023 7:57:50 PM falls between 7/23/2023 4:13:29 AM and 7/31/2023 7:57:50 PM.
IsImprovementStdDev: Marked as improvement because 49.034867734258576 (T) = (0 -255.7238136583682) / Math.Sqrt((1811.1031764620916 / (30)) + (30.46289382059432 / (12))) is greater than 2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (12) - 2, .975) and 0.6033099184161884 = (644.643830360905 - 255.7238136583682) / 644.643830360905 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[AndyAyersMS]

Maybe dotnet/runtime#89520 ?