[Perf] Linux/x64: 48 Regressions on 12/13/2023 2:44:37 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in SciMark2.kernel

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
benchmarkLU - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	848.15 ms	998.08 ms	1.18	0.00	True
benchSparseMult - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	788.62 ms	833.22 ms	1.06	0.02	False
benchMonteCarlo - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	750.71 ms	806.28 ms	1.07	0.19	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SciMark2.kernel*'

Payloads

Baseline
Compare

SciMark2.kernel.benchmarkLU

ETL Files

Histogram

JIT Disasms

SciMark2.kernel.benchSparseMult

ETL Files

Histogram

JIT Disasms

SciMark2.kernel.benchMonteCarlo

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in IfStatements.IfStatements

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
OrOr - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	11.69 μs	15.34 μs	1.31	0.03	True
AndAndAnd - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	15.35 μs	19.74 μs	1.29	0.03	True
AndAnd - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	11.69 μs	15.35 μs	1.31	0.02	True
AndOr - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	11.69 μs	15.28 μs	1.31	0.02	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'IfStatements.IfStatements*'

Payloads

Baseline
Compare

IfStatements.IfStatements.OrOr

ETL Files

Histogram

JIT Disasms

IfStatements.IfStatements.AndAndAnd

ETL Files

Histogram

JIT Disasms

IfStatements.IfStatements.AndAnd

ETL Files

Histogram

JIT Disasms

IfStatements.IfStatements.AndOr

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Span.IndexerBench

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Indexer6 - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	907.80 ns	1.02 μs	1.13	0.02	False
Ref - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	412.32 ns	683.25 ns	1.66	0.00	True
Fixed2 - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	414.80 ns	681.84 ns	1.64	0.00	True
Fixed1 - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	414.76 ns	680.81 ns	1.64	0.00	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Span.IndexerBench*'

Payloads

Baseline
Compare

Span.IndexerBench.Indexer6(length: 1024)

ETL Files

Histogram

JIT Disasms

Span.IndexerBench.Ref(length: 1024)

ETL Files

Histogram

JIT Disasms

Span.IndexerBench.Fixed2(length: 1024)

ETL Files

Histogram

JIT Disasms

Span.IndexerBench.Fixed1(length: 1024)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Struct.SpanWrapper

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
WrapperSum - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	6.61 μs	10.98 μs	1.66	0.00	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Struct.SpanWrapper*'

Payloads

Baseline
Compare

Struct.SpanWrapper.WrapperSum

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ConvertULongToDoubleBenchmark - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	4.32 ns	6.85 ns	1.58	0.81	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128*'

Payloads

Baseline
Compare

System.Runtime.Intrinsics.Tests.Perf_Vector128.ConvertULongToDoubleBenchmark

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.MathBenchmarks.Single

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ScaleB - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	21.08 μs	22.94 μs	1.09	0.11	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.MathBenchmarks.Single*'

Payloads

Baseline
Compare

System.MathBenchmarks.Single.ScaleB

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in ByteMark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
BenchLUDecomp - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	1.79 secs	1.94 secs	1.09	0.00	True
BenchIDEAEncryption - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	790.51 ms	851.64 ms	1.08	0.06	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'ByteMark*'

Payloads

Baseline
Compare

ByteMark.BenchLUDecomp

ETL Files

Histogram

JIT Disasms

ByteMark.BenchIDEAEncryption

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Perf_Convert

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ToHexString - Duration of single invocation 📈 - ADX Test Multi Config Graph	257.58 ns	278.58 ns	1.08	0.10	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Perf_Convert*'

Payloads

Baseline
Compare

System.Perf_Convert.ToHexString

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f9529fd9c3fe8a970fb7a68b7fddd15fb686b5dd
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.Perf_RandomAccess

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Write - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	1.05 ms	1.16 ms	1.11	0.05	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_RandomAccess*'

Payloads

Baseline
Compare

System.IO.Tests.Perf_RandomAccess.Write(fileSize: 1048576, bufferSize: 4096, options: None)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Document.Tests.Perf_EnumerateArray

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
EnumerateUsingIndexer - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	253.28 μs	282.97 μs	1.12	0.04	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Document.Tests.Perf_EnumerateArray*'

Payloads

Baseline
Compare

System.Text.Json.Document.Tests.Perf_EnumerateArray.EnumerateUsingIndexer(TestCase: Json400KB)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.StringReaderReadLineTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ReadLine - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	6.23 μs	6.76 μs	1.09	0.01	True
ReadLine - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	8.14 μs	8.78 μs	1.08	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.StringReaderReadLineTests*'

Payloads

Baseline
Compare

System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [1025, 2048])

ETL Files

Histogram

JIT Disasms

System.IO.Tests.StringReaderReadLineTests.ReadLine(LineLengthRange: [ 129, 1024])

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Perf_PriorityQueue<String, String>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Enumerate - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	258.48 ns	362.69 ns	1.40	0.32	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_PriorityQueue<String, String>*'

Payloads

Baseline
Compare

System.Collections.Tests.Perf_PriorityQueue<String, String>.Enumerate(Size: 10)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Char>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IndexOfAnyTwoValues - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	40.64 ns	54.11 ns	1.33	0.49	False
EndsWith - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	42.32 ns	47.94 ns	1.13	0.36	False
SequenceEqual - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	77.58 ns	82.57 ns	1.06	0.15	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span<Char>*'

Payloads

Baseline
Compare

System.Memory.Span<Char>.IndexOfAnyTwoValues(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.EndsWith(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Char>.SequenceEqual(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Perf_BitArray

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
BitArrayCopyToByteArray - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	215.68 ns	292.39 ns	1.36	0.07	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_BitArray*'

Payloads

Baseline
Compare

System.Collections.Tests.Perf_BitArray.BitArrayCopyToByteArray(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.CtorFromCollection<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
FrozenDictionaryOptimized - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	52.26 μs	57.28 μs	1.10	0.15	False
FrozenSet - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	96.75 μs	103.98 μs	1.07	0.18	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.CtorFromCollection<Int32>*'

Payloads

Baseline
Compare

System.Collections.CtorFromCollection<Int32>.FrozenDictionaryOptimized(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Collections.CtorFromCollection<Int32>.FrozenSet(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.IO.Tests.Perf_FileStream

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Write - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	1.30 ms	1.44 ms	1.11	0.01	False
Write_NoBuffering - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	962.45 μs	1.11 ms	1.15	0.18	False
Write - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	1.05 ms	1.20 ms	1.15	0.02	False
Write - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	1.05 ms	1.14 ms	1.09	0.03	False
Append - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	1.11 ms	1.23 ms	1.11	0.03	False
Write - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	1.26 ms	1.45 ms	1.15	0.03	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.IO.Tests.Perf_FileStream*'

Payloads

Baseline
Compare

System.IO.Tests.Perf_FileStream.Write(fileSize: 1048576, userBufferSize: 512, options: None)

ETL Files

Histogram

JIT Disasms

System.IO.Tests.Perf_FileStream.Write_NoBuffering(fileSize: 1048576, userBufferSize: 16384, options: None)

ETL Files

Histogram

JIT Disasms

System.IO.Tests.Perf_FileStream.Write(fileSize: 1048576, userBufferSize: 4096, options: Asynchronous)

ETL Files

Histogram

JIT Disasms

System.IO.Tests.Perf_FileStream.Write(fileSize: 1048576, userBufferSize: 4096, options: None)

ETL Files

Histogram

JIT Disasms

System.IO.Tests.Perf_FileStream.Append(fileSize: 1048576, userBufferSize: 4096, options: DeleteOnClose)

ETL Files

Histogram

JIT Disasms

System.IO.Tests.Perf_FileStream.Write(fileSize: 1048576, userBufferSize: 512, options: Asynchronous)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Benchstone.BenchI.Puzzle

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Test - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	703.32 ms	784.90 ms	1.12	0.00	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.BenchI.Puzzle*'

Payloads

Baseline
Compare

Benchstone.BenchI.Puzzle.Test

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.Span<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
SequenceCompareTo - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	67.53 ns	73.91 ns	1.09	0.21	False
SequenceCompareTo - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	806.86 ns	916.44 ns	1.14	0.05	False
SequenceEqual - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	147.63 ns	160.61 ns	1.09	0.03	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.Span<Int32>*'

Payloads

Baseline
Compare

System.Memory.Span<Int32>.SequenceCompareTo(Size: 33)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.SequenceCompareTo(Size: 512)

ETL Files

Histogram

JIT Disasms

System.Memory.Span<Int32>.SequenceEqual(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Text.Json.Tests.Utf8JsonReaderCommentsTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Utf8JsonReaderCommentParsing - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	298.17 ns	329.39 ns	1.10	0.09	False
Utf8JsonReaderCommentParsing - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	291.74 ns	322.07 ns	1.10	0.11	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.Json.Tests.Utf8JsonReaderCommentsTests*'

Payloads

Baseline
Compare

System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Allow, SegmentSize: 0, TestCase: LongSingleLine)

ETL Files

Histogram

JIT Disasms

System.Text.Json.Tests.Utf8JsonReaderCommentsTests.Utf8JsonReaderCommentParsing(CommentHandling: Skip, SegmentSize: 0, TestCase: LongSingleLine)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Benchstone.BenchF.SqMtx

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Test - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	910.35 ms	965.02 ms	1.06	0.02	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.BenchF.SqMtx*'

Payloads

Baseline
Compare

Benchstone.BenchF.SqMtx.Test

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_Random

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
NextBytes_unseeded - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	423.97 ns	477.78 ns	1.13	0.05	False
NextBytes_span_unseeded - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	418.08 ns	477.14 ns	1.14	0.04	False
ctor_seeded - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	420.70 ns	501.18 ns	1.19	0.00	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Random*'

Payloads

Baseline
Compare

System.Tests.Perf_Random.NextBytes_unseeded

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.NextBytes_span_unseeded

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_Random.ctor_seeded

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Benchstone.BenchI.BubbleSort2

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Test - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	24.94 ms	26.89 ms	1.08	0.03	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.BenchI.BubbleSort2*'

Payloads

Baseline
Compare

Benchstone.BenchI.BubbleSort2.Test

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Span.Sorting

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
BubbleSortSpan - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	321.93 μs	445.01 μs	1.38	0.03	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Span.Sorting*'

Payloads

Baseline
Compare

Span.Sorting.BubbleSortSpan(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	ab1a8224cdf115b65e0db5dc88d11f205068f444
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in Benchstone.BenchI.EightQueens

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Test - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	2.95 μs	3.42 μs	1.16	0.04	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.BenchI.EightQueens*'

Payloads

Baseline
Compare

Benchstone.BenchI.EightQueens.Test

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	f9529fd9c3fe8a970fb7a68b7fddd15fb686b5dd
Compare	acc3f0cea4057f8bde7ffebdabd1dc62c4ebef0b
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.TryGetValueFalse<Int32, Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
ConcurrentDictionary - Duration of single invocation 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	6.31 μs	7.46 μs	1.18	0.56	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueFalse<Int32, Int32>*'

Payloads

Baseline
Compare

System.Collections.TryGetValueFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[radekdoulik]

Chrome bump dotnet/runtime#95832