Description
Run Information
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 20.04 |
Queue | AmpereUbuntu |
Baseline | b1812ef9914225879dfd5bb1d6e1a57802abdd46 |
Compare | e13f0dc1e0327b5d0cd0602b55ee257ef554f0a1 |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Improvements in MicroBenchmarks.Serializers.Xml_ToStream<SimpleStructWithProperties>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
DataContractSerializer_BinaryXml_ - Duration of single invocation | 756.56 ns | 662.26 ns | 0.88 | 0.13 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream<SimpleStructWithProperties>*'
Payloads
Histogram
MicroBenchmarks.Serializers.Xml_ToStream<SimpleStructWithProperties>.DataContractSerializer_BinaryXml_
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 662.2640287421183 < 690.1972288398578.
IsChangePoint: Marked as a change because one of 4/4/2023 3:37:20 PM, 4/5/2023 11:58:06 PM falls between 3/28/2023 10:24:48 AM and 4/5/2023 11:58:06 PM.
IsImprovementStdDev: Marked as improvement because 8.20181254693008 (T) = (0 -654.0684257873504) / Math.Sqrt((291.06531057258206 / (86)) + (247.20390140467347 / (3))) is greater than 1.987608281588541 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (86) + (3) - 2, .975) and 0.1040577274304756 = (730.0341169431708 - 654.0684257873504) / 730.0341169431708 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 20.04 |
Queue | AmpereUbuntu |
Baseline | b1812ef9914225879dfd5bb1d6e1a57802abdd46 |
Compare | e13f0dc1e0327b5d0cd0602b55ee257ef554f0a1 |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Improvements in MicroBenchmarks.Serializers.Xml_ToStream<IndexViewModel>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
DataContractSerializer_BinaryXml_ - Duration of single invocation | 53.51 μs | 41.60 μs | 0.78 | 0.01 | False | |||||
DataContractSerializer_ - Duration of single invocation | 81.99 μs | 72.33 μs | 0.88 | 0.00 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream<IndexViewModel>*'
Payloads
Histogram
MicroBenchmarks.Serializers.Xml_ToStream<IndexViewModel>.DataContractSerializer_BinaryXml_
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 41.599338342713445 < 50.49369534559238.
IsChangePoint: Marked as a change because one of 4/4/2023 3:37:20 PM, 4/5/2023 11:58:06 PM falls between 3/28/2023 10:24:48 AM and 4/5/2023 11:58:06 PM.
IsImprovementStdDev: Marked as improvement because 228.06920363829482 (T) = (0 -41552.40328897428) / Math.Sqrt((90112.56084362185 / (86)) + (4329.618264105631 / (3))) is greater than 1.987608281588541 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (86) + (3) - 2, .975) and 0.21503531779765175 = (52935.379426743304 - 41552.40328897428) / 52935.379426743304 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
MicroBenchmarks.Serializers.Xml_ToStream<IndexViewModel>.DataContractSerializer_
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 72.32784028139153 < 76.76475367769712.
IsChangePoint: Marked as a change because one of 4/4/2023 3:37:20 PM, 4/5/2023 11:58:06 PM falls between 3/28/2023 10:24:48 AM and 4/5/2023 11:58:06 PM.
IsImprovementStdDev: Marked as improvement because 113.34509549467592 (T) = (0 -72269.19686603226) / Math.Sqrt((222430.2383308484 / (299)) + (13683.596501515833 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.10252275255962114 = (80524.82341156313 - 72269.19686603226) / 80524.82341156313 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 20.04 |
Queue | AmpereUbuntu |
Baseline | b1812ef9914225879dfd5bb1d6e1a57802abdd46 |
Compare | e13f0dc1e0327b5d0cd0602b55ee257ef554f0a1 |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Improvements in MicroBenchmarks.Serializers.Xml_ToStream<Location>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
DataContractSerializer_BinaryXml_ - Duration of single invocation | 1.66 μs | 1.51 μs | 0.91 | 0.01 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream<Location>*'
Payloads
Histogram
MicroBenchmarks.Serializers.Xml_ToStream<Location>.DataContractSerializer_BinaryXml_
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.5136300267821792 < 1.6202667981941805.
IsChangePoint: Marked as a change because one of 4/4/2023 3:37:20 PM, 4/5/2023 11:58:06 PM falls between 3/28/2023 10:24:48 AM and 4/5/2023 11:58:06 PM.
IsImprovementStdDev: Marked as improvement because 21.156677604221127 (T) = (0 -1503.2951506495956) / Math.Sqrt((756.5109955533361 / (86)) + (229.05007078186873 / (3))) is greater than 1.987608281588541 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (86) + (3) - 2, .975) and 0.11493731762557202 = (1698.5182864298224 - 1503.2951506495956) / 1698.5182864298224 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 20.04 |
Queue | AmpereUbuntu |
Baseline | b1812ef9914225879dfd5bb1d6e1a57802abdd46 |
Compare | e13f0dc1e0327b5d0cd0602b55ee257ef554f0a1 |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Improvements in MicroBenchmarks.Serializers.Xml_ToStream<ClassImplementingIXmlSerialiable>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
DataContractSerializer_BinaryXml_ - Duration of single invocation | 537.21 ns | 451.50 ns | 0.84 | 0.01 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream<ClassImplementingIXmlSerialiable>*'
Payloads
Histogram
MicroBenchmarks.Serializers.Xml_ToStream<ClassImplementingIXmlSerialiable>.DataContractSerializer_BinaryXml_
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 451.50039411801873 < 510.7218478590783.
IsChangePoint: Marked as a change because one of 4/4/2023 3:37:20 PM, 4/5/2023 11:58:06 PM falls between 3/28/2023 10:24:48 AM and 4/5/2023 11:58:06 PM.
IsImprovementStdDev: Marked as improvement because 91.65941319257998 (T) = (0 -451.76133815602634) / Math.Sqrt((50.3456366071258 / (86)) + (0.4719870249752097 / (3))) is greater than 1.987608281588541 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (86) + (3) - 2, .975) and 0.14883386054110279 = (530.7557681314952 - 451.76133815602634) / 530.7557681314952 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 20.04 |
Queue | AmpereUbuntu |
Baseline | b1812ef9914225879dfd5bb1d6e1a57802abdd46 |
Compare | e13f0dc1e0327b5d0cd0602b55ee257ef554f0a1 |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Improvements in System.Tests.Perf_String
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
Trim - Duration of single invocation | 4.36 ns | 2.14 ns | 0.49 | 0.68 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_String*'
Payloads
Histogram
System.Tests.Perf_String.Trim(s: "Test")
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 2.141320119432795 < 3.5261738528066227.
IsChangePoint: Marked as a change because one of 4/4/2023 3:37:20 PM, 4/5/2023 11:58:06 PM falls between 3/28/2023 10:24:48 AM and 4/5/2023 11:58:06 PM.
IsImprovementStdDev: Marked as improvement because 15.252475202863131 (T) = (0 -2.159340414111512) / Math.Sqrt((0.26699960403525036 / (299)) + (0.028074797591557815 / (3))) is greater than 1.9679030112610798 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (299) + (3) - 2, .975) and 0.4169663791235243 = (3.7036293222085046 - 2.159340414111512) / 3.7036293222085046 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Name | Value |
---|---|
Architecture | arm64 |
OS | ubuntu 20.04 |
Queue | AmpereUbuntu |
Baseline | b1812ef9914225879dfd5bb1d6e1a57802abdd46 |
Compare | e13f0dc1e0327b5d0cd0602b55ee257ef554f0a1 |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Improvements in MicroBenchmarks.Serializers.Xml_ToStream<LoginViewModel>
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL |
---|---|---|---|---|---|---|---|---|---|---|
DataContractSerializer_BinaryXml_ - Duration of single invocation | 894.36 ns | 784.33 ns | 0.88 | 0.01 | False |
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Payloads
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'MicroBenchmarks.Serializers.Xml_ToStream<LoginViewModel>*'
Payloads
Histogram
MicroBenchmarks.Serializers.Xml_ToStream<LoginViewModel>.DataContractSerializer_BinaryXml_
Description of detection logic
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 784.3279561197305 < 841.0860574073891.
IsChangePoint: Marked as a change because one of 4/4/2023 3:37:20 PM, 4/5/2023 11:58:06 PM falls between 3/28/2023 10:24:48 AM and 4/5/2023 11:58:06 PM.
IsImprovementStdDev: Marked as improvement because 86.71890276894288 (T) = (0 -783.9225782460086) / Math.Sqrt((122.43705445851622 / (86)) + (0.23732992090066096 / (3))) is greater than 1.987608281588541 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (86) + (3) - 2, .975) and 0.11941575331469115 = (890.2300730416724 - 783.9225782460086) / 890.2300730416724 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository