[Perf] Linux/arm64: 5 Improvements on 9/9/2022 7:27:51 AM

[performanceautofiler]

Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	e8b149109c8b04161b83d0e4c997b63759c6d936
Compare	071fe7ce868a63113143b949c3c4185f9e5578cf
Diff	Diff

Improvements in System.Text.Tests.Perf_Encoding

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetChars - Duration of single invocation	36.48 ns	33.27 ns	0.91	0.04	False
GetString - Duration of single invocation	29.90 ns	26.63 ns	0.89	0.20	False
GetChars - Duration of single invocation	28.04 ns	25.42 ns	0.91	0.21	False
GetString - Duration of single invocation	31.58 ns	28.58 ns	0.90	0.17	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Tests.Perf_Encoding*'

Payloads

Baseline
Compare

Histogram

System.Text.Tests.Perf_Encoding.GetChars(size: 16, encName: "utf-8")

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 33.26523017491804 < 34.68210609505352.
IsChangePoint: Marked as a change because one of 6/22/2022 5:33:38 PM, 9/9/2022 3:12:19 AM, 9/15/2022 1:10:12 AM falls between 9/6/2022 1:06:44 PM and 9/15/2022 1:10:12 AM.
IsImprovementStdDev: Marked as improvement because 28.715070895088445 (T) = (0 -33.619342978784296) / Math.Sqrt((0.5899854418010603 / (299)) + (0.37320531596399015 / (27))) is greater than 1.9673127716992511 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (27) - 2, .975) and 0.09694050912617533 = (37.228270472251296 - 33.619342978784296) / 37.228270472251296 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetString(size: 16, encName: "utf-8")

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 26.633800260551535 < 28.634187448985788.
IsChangePoint: Marked as a change because one of 6/22/2022 5:33:38 PM, 9/9/2022 3:12:19 AM, 9/15/2022 1:10:12 AM falls between 9/6/2022 1:06:44 PM and 9/15/2022 1:10:12 AM.
IsImprovementStdDev: Marked as improvement because 22.454981990250545 (T) = (0 -27.229881054262865) / Math.Sqrt((0.7723332309550234 / (299)) + (0.4819356378835249 / (27))) is greater than 1.9673127716992511 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (27) - 2, .975) and 0.10544695792008328 = (30.439649493506757 - 27.229881054262865) / 30.439649493506757 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetChars(size: 16, encName: "ascii")

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 25.418588352042374 < 26.499854750883934.
IsChangePoint: Marked as a change because one of 6/22/2022 5:33:38 PM, 9/9/2022 3:12:19 AM, 9/15/2022 1:10:12 AM falls between 9/6/2022 1:06:44 PM and 9/15/2022 1:10:12 AM.
IsImprovementStdDev: Marked as improvement because 14.302306246670584 (T) = (0 -25.558242866743342) / Math.Sqrt((0.6421931833102671 / (299)) + (0.9063713795564017 / (26))) is greater than 1.967335607330539 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (26) - 2, .975) and 0.09718981427788585 = (28.30965276084091 - 25.558242866743342) / 28.30965276084091 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Text.Tests.Perf_Encoding.GetString(size: 16, encName: "ascii")

```log

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 28.57691604557593 < 29.993998972750276.
IsChangePoint: Marked as a change because one of 6/22/2022 5:33:38 PM, 9/9/2022 3:12:19 AM, 9/15/2022 1:10:12 AM falls between 9/6/2022 1:06:44 PM and 9/15/2022 1:10:12 AM.
IsImprovementStdDev: Marked as improvement because 20.788469220751704 (T) = (0 -27.8257332455826) / Math.Sqrt((0.632943993245624 / (299)) + (0.5187281068489489 / (27))) is greater than 1.9673127716992511 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (27) - 2, .975) and 0.09837552299213795 = (30.861776665519656 - 27.8257332455826) / 30.861776665519656 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	arm64
OS	ubuntu 20.04
Baseline	e8b149109c8b04161b83d0e4c997b63759c6d936
Compare	071fe7ce868a63113143b949c3c4185f9e5578cf
Diff	Diff

Improvements in System.Text.Perf_Utf8Encoding

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetString - Duration of single invocation	52.51 μs	48.42 μs	0.92	0.03	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Perf_Utf8Encoding*'

Payloads

Baseline
Compare

Histogram

System.Text.Perf_Utf8Encoding.GetString(Input: EnglishAllAscii)

Description of detection logic

IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed:Marked as improvement because 48.41807794065596 < 49.874910351815885.
IsChangePoint: Marked as a change because one of 8/9/2022 6:41:10 AM, 8/25/2022 6:55:57 AM, 9/9/2022 3:12:19 AM, 9/15/2022 1:10:12 AM falls between 9/6/2022 1:06:44 PM and 9/15/2022 1:10:12 AM.
IsImprovementStdDev: Marked as improvement because 14.134030981739244 (T) = (0 -49000.0375329297) / Math.Sqrt((4572819.170471966 / (299)) + (1133660.9077464691 / (27))) is greater than 1.9673127716992511 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (27) - 2, .975) and 0.06457778885472318 = (52382.803133289824 - 49000.0375329297) / 52382.803133289824 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository