System.ConsoleTests.Perf_Console.ResetColor

[performanceautofiler]

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	14e6a418d15ed3fe4d784b55bddbf582733b2b1d
Compare	3ff8d262e504d03977edeb67da2b83d01c9ed2db
Diff	Diff

Regressions in System.Collections.Tests.Perf_SortedSet

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Max - Duration of single invocation	23.28 ns	49.89 ns	2.14	0.34	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Tests.Perf_SortedSet*'

Payloads

Baseline
Compare

Histogram

System.Collections.Tests.Perf_SortedSet.Max

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 49.88604061621433 > 24.504237969801885.
IsChangePoint: Marked as a change because one of 2/11/2022 1:40:07 AM, 3/29/2022 11:07:04 AM, 4/5/2022 2:02:34 AM falls between 3/26/2022 9:07:40 PM and 4/5/2022 2:02:34 AM.
IsRegressionStdDev: Marked as regression because -28.938720371777247 (T) = (0 -47.24642186619891) / Math.Sqrt((0.03666550548851836 / (25)) + (20.694448326502282 / (30))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (30) - 2, .025) and -1.037730752761862 = (23.18580205071888 - 47.24642186619891) / 23.18580205071888 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	14e6a418d15ed3fe4d784b55bddbf582733b2b1d
Compare	3ff8d262e504d03977edeb67da2b83d01c9ed2db
Diff	Diff

Regressions in System.ConsoleTests.Perf_Console

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
ResetColor - Duration of single invocation	8.44 μs	36.84 μs	4.37	0.04	True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.ConsoleTests.Perf_Console*'

Payloads

Baseline
Compare

Histogram

System.ConsoleTests.Perf_Console.ResetColor

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 36.8443647897115 > 8.76702272397032.
IsChangePoint: Marked as a change because one of 3/29/2022 11:07:04 AM, 4/5/2022 2:02:34 AM falls between 3/26/2022 9:07:40 PM and 4/5/2022 2:02:34 AM.
IsRegressionStdDev: Marked as regression because -28.777436313861667 (T) = (0 -41167.64013857459) / Math.Sqrt((3615.8741168672163 / (25)) + (39032151.906201124 / (30))) is less than -2.005745995316835 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (30) - 2, .025) and -3.935595121217563 = (8340.967832146438 - 41167.64013857459) / 8340.967832146438 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[AndyAyersMS]

ResetColor is still slow, could be #66558

cc @SingleAccretion

[SingleAccretion]

Hmm, #66558 was a zero-diff change.

Will see what is up regardless.

@AndyAyersMS could you please move this issue and #84228 to the runtime repository, so that I can assign myself to them?

[AndyAyersMS]

Regression in ResetColor persists and seems to be across x64 too.

[AndyAyersMS]

@SingleAccretion still want me to transfer this one?

[SingleAccretion]

Yes.

[AndyAyersMS]

Looking across arch/os this only seems be windows x86/x64.