Skip to content

[Perf] Linux/arm64: 7 Improvements on 4/4/2023 10:11:10 PM #15404

Closed
@performanceautofiler

Description

@performanceautofiler

Run Information

Name Value
Architecture arm64
OS ubuntu 20.04
Queue AmpereUbuntu
Baseline b1812ef9914225879dfd5bb1d6e1a57802abdd46
Compare e13f0dc1e0327b5d0cd0602b55ee257ef554f0a1
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in MicroBenchmarks.Serializers.Xml_ToStream<SimpleStructWithProperties>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_BinaryXml_ - Duration of single invocation 756.56 ns 662.26 ns 0.88 0.13 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;SimpleStructWithProperties&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_ToStream<SimpleStructWithProperties>.DataContractSerializer_BinaryXml_


Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 662.2640287421183 < 690.1972288398578.
IsChangePoint: Marked as a change because one of 4/4/2023 3:37:20 PM, 4/5/2023 11:58:06 PM falls between 3/28/2023 10:24:48 AM and 4/5/2023 11:58:06 PM.
IsImprovementStdDev: Marked as improvement because 8.20181254693008 (T) = (0 -654.0684257873504) / Math.Sqrt((291.06531057258206 / (86)) + (247.20390140467347 / (3))) is greater than 1.987608281588541 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (86) + (3) - 2, .975) and 0.1040577274304756 = (730.0341169431708 - 654.0684257873504) / 730.0341169431708 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 20.04
Queue AmpereUbuntu
Baseline b1812ef9914225879dfd5bb1d6e1a57802abdd46
Compare e13f0dc1e0327b5d0cd0602b55ee257ef554f0a1
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in MicroBenchmarks.Serializers.Xml_ToStream<IndexViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_BinaryXml_ - Duration of single invocation 53.51 μs 41.60 μs 0.78 0.01 False
DataContractSerializer_ - Duration of single invocation 81.99 μs 72.33 μs 0.88 0.00 False

graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;IndexViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_ToStream<IndexViewModel>.DataContractSerializer_BinaryXml_


Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 41.599338342713445 < 50.49369534559238.
IsChangePoint: Marked as a change because one of 4/4/2023 3:37:20 PM, 4/5/2023 11:58:06 PM falls between 3/28/2023 10:24:48 AM and 4/5/2023 11:58:06 PM.
IsImprovementStdDev: Marked as improvement because 228.06920363829482 (T) = (0 -41552.40328897428) / Math.Sqrt((90112.56084362185 / (86)) + (4329.618264105631 / (3))) is greater than 1.987608281588541 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (86) + (3) - 2, .975) and 0.21503531779765175 = (52935.379426743304 - 41552.40328897428) / 52935.379426743304 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

MicroBenchmarks.Serializers.Xml_ToStream<IndexViewModel>.DataContractSerializer_


Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 72.32784028139153 < 76.76475367769712.
IsChangePoint: Marked as a change because one of 4/4/2023 3:37:20 PM, 4/5/2023 11:58:06 PM falls between 3/28/2023 10:24:48 AM and 4/5/2023 11:58:06 PM.
IsImprovementStdDev: Marked as improvement because 113.34509549467592 (T) = (0 -72269.19686603226) / Math.Sqrt((222430.2383308484 / (299)) + (13683.596501515833 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.10252275255962114 = (80524.82341156313 - 72269.19686603226) / 80524.82341156313 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 20.04
Queue AmpereUbuntu
Baseline b1812ef9914225879dfd5bb1d6e1a57802abdd46
Compare e13f0dc1e0327b5d0cd0602b55ee257ef554f0a1
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in MicroBenchmarks.Serializers.Xml_ToStream<Location>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_BinaryXml_ - Duration of single invocation 1.66 μs 1.51 μs 0.91 0.01 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;Location&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_ToStream<Location>.DataContractSerializer_BinaryXml_


Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.5136300267821792 < 1.6202667981941805.
IsChangePoint: Marked as a change because one of 4/4/2023 3:37:20 PM, 4/5/2023 11:58:06 PM falls between 3/28/2023 10:24:48 AM and 4/5/2023 11:58:06 PM.
IsImprovementStdDev: Marked as improvement because 21.156677604221127 (T) = (0 -1503.2951506495956) / Math.Sqrt((756.5109955533361 / (86)) + (229.05007078186873 / (3))) is greater than 1.987608281588541 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (86) + (3) - 2, .975) and 0.11493731762557202 = (1698.5182864298224 - 1503.2951506495956) / 1698.5182864298224 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 20.04
Queue AmpereUbuntu
Baseline b1812ef9914225879dfd5bb1d6e1a57802abdd46
Compare e13f0dc1e0327b5d0cd0602b55ee257ef554f0a1
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in MicroBenchmarks.Serializers.Xml_ToStream<ClassImplementingIXmlSerialiable>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_BinaryXml_ - Duration of single invocation 537.21 ns 451.50 ns 0.84 0.01 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;ClassImplementingIXmlSerialiable&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_ToStream<ClassImplementingIXmlSerialiable>.DataContractSerializer_BinaryXml_


Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 451.50039411801873 < 510.7218478590783.
IsChangePoint: Marked as a change because one of 4/4/2023 3:37:20 PM, 4/5/2023 11:58:06 PM falls between 3/28/2023 10:24:48 AM and 4/5/2023 11:58:06 PM.
IsImprovementStdDev: Marked as improvement because 91.65941319257998 (T) = (0 -451.76133815602634) / Math.Sqrt((50.3456366071258 / (86)) + (0.4719870249752097 / (3))) is greater than 1.987608281588541 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (86) + (3) - 2, .975) and 0.14883386054110279 = (530.7557681314952 - 451.76133815602634) / 530.7557681314952 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 20.04
Queue AmpereUbuntu
Baseline b1812ef9914225879dfd5bb1d6e1a57802abdd46
Compare e13f0dc1e0327b5d0cd0602b55ee257ef554f0a1
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in System.Tests.Perf_String

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Trim - Duration of single invocation 4.36 ns 2.14 ns 0.49 0.68 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_String*'

Payloads

Baseline
Compare

Histogram

System.Tests.Perf_String.Trim(s: "Test")


Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 2.141320119432795 < 3.5261738528066227.
IsChangePoint: Marked as a change because one of 4/4/2023 3:37:20 PM, 4/5/2023 11:58:06 PM falls between 3/28/2023 10:24:48 AM and 4/5/2023 11:58:06 PM.
IsImprovementStdDev: Marked as improvement because 15.252475202863131 (T) = (0 -2.159340414111512) / Math.Sqrt((0.26699960403525036 / (299)) + (0.028074797591557815 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.4169663791235243 = (3.7036293222085046 - 2.159340414111512) / 3.7036293222085046 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository


Run Information

Name Value
Architecture arm64
OS ubuntu 20.04
Queue AmpereUbuntu
Baseline b1812ef9914225879dfd5bb1d6e1a57802abdd46
Compare e13f0dc1e0327b5d0cd0602b55ee257ef554f0a1
Diff Diff
Configs CompilationMode:tiered, RunKind:micro

Improvements in MicroBenchmarks.Serializers.Xml_ToStream<LoginViewModel>

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
DataContractSerializer_BinaryXml_ - Duration of single invocation 894.36 ns 784.33 ns 0.88 0.01 False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream&lt;LoginViewModel&gt;*'

Payloads

Baseline
Compare

Histogram

MicroBenchmarks.Serializers.Xml_ToStream<LoginViewModel>.DataContractSerializer_BinaryXml_


Description of detection logic

IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 784.3279561197305 < 841.0860574073891.
IsChangePoint: Marked as a change because one of 4/4/2023 3:37:20 PM, 4/5/2023 11:58:06 PM falls between 3/28/2023 10:24:48 AM and 4/5/2023 11:58:06 PM.
IsImprovementStdDev: Marked as improvement because 86.71890276894288 (T) = (0 -783.9225782460086) / Math.Sqrt((122.43705445851622 / (86)) + (0.23732992090066096 / (3))) is greater than 1.987608281588541 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (86) + (3) - 2, .975) and 0.11941575331469115 = (890.2300730416724 - 783.9225782460086) / 890.2300730416724 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions