[Perf -17%] System.Net.Primitives.Tests.CredentialCacheTests (2)

[performanceautofiler]

Run Information

Architecture	x64
OS	Windows 10.0.18362
Changes	diff

Regressions in System.Net.Primitives.Tests.CredentialCacheTests

Benchmark	Baseline	Test	Test/Base	Modality	Baseline Outlier
GetCredential_HostPort	28.07 ns	34.32 ns	1.22		False
ForEach	36.55 ns	40.90 ns	1.12		False

Historical Data in Reporting System

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f netcoreapp5.0 --filter 'System.Net.Primitives.Tests.CredentialCacheTests*';

Histogram

System.Net.Primitives.Tests.CredentialCacheTests.GetCredential_HostPort(host: "notfound", hostPortCount: 0)

[27.212 ; 28.888) | @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
[28.888 ; 30.612) | 
[30.612 ; 32.289) | @@@@@@@@@@@@@@@
[32.289 ; 34.066) | 
[34.066 ; 35.742) | @@@@@@@@

System.Net.Primitives.Tests.CredentialCacheTests.ForEach(uriCount: 0, hostPortCount: 0)

[35.616 ; 37.535) | @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
[37.535 ; 39.237) | 
[39.237 ; 41.156) | @@@@@@@@@@@@@@
[41.156 ; 42.714) | 
[42.714 ; 44.633) | @@@@@@@@
[44.633 ; 45.870) | 
[45.870 ; 47.789) | @

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[adamsitnik]

I confirm that it is a regression. @DrewScoggins could you please transfer it to runtime repo?

System.Net.Primitives.Tests.CredentialCacheTests.ForEach(uriCount: 0, hostPortCount: 0)

Conclusion	Base	Diff	Base/Diff	Modality	Operating System	Bit	Processor Name	Base Runtime	Diff Runtime
Slower	70.39	96.66	0.73		Windows 10.0.18363.1016	Arm	Microsoft SQ1 3.0 GHz	.NET Core 3.1.6	5.0.100-rc.1.20413.9
Slower	31.66	33.95	0.93		Windows 10.0.18363.959	X64	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 3.1.6	5.0.100-rc.1.20404.3
Slower	31.77	34.17	0.93		Windows 10.0.18363.959	X64	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 3.1.6	5.0.100-rc.1.20418.3
Slower	38.13	43.92	0.87		Windows 10.0.19041.450	X64	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 3.1.6	5.0.100-rc.1.20413.9
Slower	30.74	33.83	0.91		Windows 10.0.19041.450	X64	Intel Core i7-6700 CPU 3.40GHz (Skylake)	.NET Core 3.1.6	5.0.100-rc.1.20419.9
Slower	28.59	31.65	0.90		Windows 10.0.19042	X64	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 3.1.6	5.0.100-rc.1.20418.3
Slower	35.44	39.05	0.91		Windows 10.0.19041.450	X64	Intel Core i7-8650U CPU 1.90GHz (Kaby Lake R)	.NET Core 3.1.6	5.0.100-rc.1.20419.14
Slower	32.07	38.87	0.83		Windows 10.0.18363.959	X86	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 3.1.6	5.0.100-rc.1.20420.14
Slower	38.14	48.71	0.78		Windows 10.0.19041.450	X86	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 3.1.6	5.0.100-rc.1.20419.5
Same	92.36	135.01	0.68	several?	ubuntu 18.04	Arm64	Unknown processor	.NET Core 3.1.6	6.0.100-alpha.1.20421.6
Slower	34.41	40.05	0.86		ubuntu 18.04	X64	Intel Xeon CPU E5-1650 v4 3.60GHz	.NET Core 3.1.6	5.0.100-rc.1.20403.23
Slower	40.63	48.17	0.84		macOS Mojave 10.14.5	X64	Intel Core i7-5557U CPU 3.10GHz (Broadwell)	.NET Core 3.1.6	5.0.100-rc.1.20404.2
Slower	33.82	45.82	0.74		alpine 3.11	X64	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 3.1.6	6.0.100-alpha.1.20421.6
Slower	35.55	38.51	0.92		ubuntu 18.04	X64	Intel Core i7-7700 CPU 3.60GHz (Kaby Lake)	.NET Core 3.1.6	5.0.100-rc.1.20418.3