[Perf] Linux/x64: 2 Improvements on 10/11/2024 1:01:52 AM

### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 22.04
Queue | TigerUbuntu
Baseline | [11c86d8acba2f248b3afb5e8594f5f41ceebf098](https://github.com/dotnet/runtime/commit/11c86d8acba2f248b3afb5e8594f5f41ceebf098)
Compare | [f938d80c30b6ab962bb681ad1ecddf146b014437](https://github.com/dotnet/runtime/commit/f938d80c30b6ab962bb681ad1ecddf146b014437)
Diff | [Diff](https://github.com/dotnet/runtime/compare/11c86d8acba2f248b3afb5e8594f5f41ceebf098...f938d80c30b6ab962bb681ad1ecddf146b014437)
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono


### Improvements in System.Tests.Perf_String

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio
-- | -- | -- | -- | -- | -- | -- | -- | --
|<ul><li>[Remove_Int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Tests.Perf_String.Remove_Int(s%3a%20%22dzsdzsDDZSDZSDZSddsz%22%2c%20i%3a%207).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Runtime/Perf.String.cs#L82-#L88>)</li><li>[ADX - Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpWU247TMBCG75F4B6s3SSDbZsueqBRE9wAstLC0FRcgVLnxtDGK7Wjs7DYV4tmZJIWtugiCZEWZ0f957Dl4DNwWCAq0s48ffWd3KSCw80JmYgK5YXHMPGGcBtfDQjupwNuTnSPXSVoLEZa2lwIXtqe41PvKISapdJA4CsikZr63PjnyQuZxVPQT3MtnYN17rqDa9aU3La0D1a2ctnsDuJxPHUq96k5AmVuYX2vn2wHriI2ldXn5edosIeymEzI5YKfBzlkmhb4weilXBXInjbZfvAujcpnV1tgI8L6y+AfznCS5ILLXY3+BR6NP418EFvBP/dhoM/ww+1+EbgmYI9B3iy55ZnfL8QeQXO+kFltAyQTNXNFmO5S0oHJX+g/ooXFBC9m1saPsVtUVbqN/a6/0Smpoo71ZmVmZt5OmpZUJz27QKFN52oJvygVK8TozC57JTe1rg036k7YRrtY5IE2Ornt6r80vDI0V4Mzk27+9oZkROHVc5ewFE9xBNYJ+P+ofHURnB4fHs+hscBQN+v3u4fOz08OT46dRNIiiOgisHWjBphQcbGwdJtz5r8jQIis/FlBAdZ7qvLUR0Kgsl74zC2Oyh7eo25ZaImSdA2pfGqxOpwWy07Y12tht6KqraqQasAaor2ULpTjKDTCOq7nia79OVHWXkD0J2KLcy1z4+z0Jt8motsnRfKO36IF2ArbIXIxUDeHvVKjxD28B+Yo2ekZHu98MKaeArCpOknJ07E66lPm2SX2jC9k6MVmhdLwfsmz8Nm5ikNBJl0HsXVLB6YEst2aFMF/bwAt+AkN72TW4BQAA>)</li></ul> | 18.41 ns | 15.65 ns | 0.85 | 0.12 | False | | |
|<ul><li>[Remove_Int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Tests.Perf_String.Remove_Int(s%3a%20%22dzsdzsDDZSDZSDZSddsz%22%2c%20i%3a%200).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Runtime/Perf.String.cs#L82-#L88>)</li><li>[ADX - Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpWUbW/TMBDH3yPxHay+SQJZG9oxSqUgugdgsMJoK16AUOXG18YotqOzszUV4rNzSQqrOgRBsqLc6f/z2ffgCXBbICjQzj588J3dpoDATguZiSnkhsUx84RxGlwPC+2kAu9AdopcJ2ktRFjZXgpc2J7iUh8qx5ik0kHiKCCTmvne5uTYC5nHUdFPcCefg3XvuYJq15ferLQOVLdy2u414Goxcyj1ujsFZW5gcamdb0esI7aW1vn551mzhLDbTsjkiEXB3lmmhT4zeiXXBXInjbZfvDOjcpnV1sQI8L6y+AfznCS5ILLXY3+Br64+TX4RWMA/9ROjzfjD/H8RuiVgjkDfHbrimd0vxx9Acr2TWuwAJRM0C0Wb7VHSgspd6d+jx8YFLWSXxl5lN6qucBv9W3uh11JDG+312szLvJ00La1MeHaNRpnK0xZ8Uy5RiteZWfJMbmtfG2zan7aNcLHJAWlydN3TB21+ZmisAOcm3/0dDM2cwJnjKmcvmOAOqhH0+1H/+CgaHj15Oo+Go+No1O93B4Ph8Nnzk8dRNIqiOghsHGjBZhQcbGwdJtz5r8jQIis/FlBAdZ7qvLUR0KisVr4zS2Oy+7eo25ZaImSdI2pfGqxOpwWy17Y12tht6KqraqQasAaor2ULpTjKLTCO64XiG79OVHWXkD0K2LI8yFz4+z0Jd8motsnRfKO36J52CrbIXIxUDeHvVajxj28A+Zo2GtDR7jZDyikgq4qTpBwdu5UuZb5tUt/oQrZJTFYoHR+GLBu/jZsYJHTSZRB751RweiDLnVkhzNc28IKfKIQpn7gFAAA=>)</li></ul> | 4.18 ns | 2.60 ns | 0.62 | 0.15 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/10_15_2024/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Improvement/System.Tests.Perf_String_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/10_15_2024/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Improvement/System.Tests.Perf_String_2.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/10_15_2024/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Improvement/System.Tests.Perf_String.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create aot directory 
mkdir -p $RunDir/artifacts/bin/aot/sgen
mkdir -p $RunDir/artifacts/bin/aot/pack
cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen
cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Tests.Perf_String*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Tests.Perf_String* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create aot directory
mkdir $RunDir\artifacts\bin\aot\sgen
mkdir $RunDir\artifacts\bin\aot\pack
xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y
xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Tests.Perf_String*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Tests.Perf_String* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200
```

</details>

<details>

### System.Tests.Perf_String.Remove_Int(s: "dzsdzsDDZSDZSDZSddsz", i: 7)

#### ETL Files

#### Histogram

#### JIT Disasms

### System.Tests.Perf_String.Remove_Int(s: "dzsdzsDDZSDZSDZSddsz", i: 0)

#### ETL Files

#### Histogram

#### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Perf] Linux/x64: 2 Improvements on 10/11/2024 1:01:52 AM #43138

performanceautofiler
openedon Oct 15, 2024

Run Information

Improvements in System.Tests.Perf_String

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

System.Tests.Perf_String.Remove_Int(s: "dzsdzsDDZSDZSDZSddsz", i: 7)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Remove_Int(s: "dzsdzsDDZSDZSDZSddsz", i: 0)

ETL Files

Histogram

JIT Disasms

Docs

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	11c86d8acba2f248b3afb5e8594f5f41ceebf098
Compare	f938d80c30b6ab962bb681ad1ecddf146b014437
Diff	Diff
Configs	CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Remove_Int - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	18.41 ns	15.65 ns	0.85	0.12	False
Remove_Int - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	4.18 ns	2.60 ns	0.62	0.15	False

[Perf] Linux/x64: 2 Improvements on 10/11/2024 1:01:52 AM #43138

Description

performanceautofileropenedon Oct 15, 2024

Run Information

Improvements in System.Tests.Perf_String

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

System.Tests.Perf_String.Remove_Int(s: "dzsdzsDDZSDZSDZSddsz", i: 7)

ETL Files

Histogram

JIT Disasms

System.Tests.Perf_String.Remove_Int(s: "dzsdzsDDZSDZSDZSddsz", i: 0)

ETL Files

Histogram

JIT Disasms

Docs

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions

performanceautofiler
openedon Oct 15, 2024