[Perf] Linux/x64: 6 Improvements on 8/20/2023 5:37:20 PM

### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 22.04
Queue | TigerUbuntu
Baseline | [a429b0ca4fbb2ed7014815792f1cf1b5939eb567](https://github.com/dotnet/runtime/commit/a429b0ca4fbb2ed7014815792f1cf1b5939eb567)
Compare | [d74b52492d85a3a250654d670942e35f9f0be2e8](https://github.com/dotnet/runtime/commit/d74b52492d85a3a250654d670942e35f9f0be2e8)
Diff | [Diff](https://github.com/dotnet/runtime/compare/a429b0ca4fbb2ed7014815792f1cf1b5939eb567...d74b52492d85a3a250654d670942e35f9f0be2e8)
Configs | CompilationMode:tiered, LLVM:false, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono


### Improvements in System.Reflection.Invoke

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio
-- | -- | -- | -- | -- | -- | -- | -- | --
|<ul><li>[Property_Set_int - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=false_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Reflection.Invoke.Property_Set_int.html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/runtime/System.Reflection/Invoke.cs#L214-#L221>)</li><li>[ADX - Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACoRV32+bMBB+z1/hN2AjlPxcm4pJbfewaerWJZkmraoiN1wSt2Aj2zTJtD9+ZwwUmnQVL3Dfd+fzfXdHApos7iXlyw2JSLznNGVL99aRsFInG6CxOkkp486dd95JCm7OkvhCFnRndzp2SvtSpNm1iMGYNQMJcYUoTaWes9RAMdWg8dXth/1BNxx1+2fz8HQSjiajs2AwGI764fB9GE7CsDoPeHzcd9jtfZiH40lvMBkOfld0msYmg1+Mx2Krgl4YXKTxeBj0w8/94Ps2CW5ArqrMGNeQHKX3zj73gjlbg2w5JIznu8j5eZ9znQd9TLbkH1KpTMfDZ2poqMbUIqlcrugSolYCNSuY5c/ULeNlyIo7A/mEhx5GlZAJc6tYaA76RGIGWLYazflXjGAIKLUUi1RwUYEalDbIbK80pMEUVgksNRM8+MKfxCMEN1JkIPV+MQNt6lc5Zmt7pG0g/KqAGFY0T4qgpWm2EVJ/oykoKyo+9wm405z/yCGHidKS8bVPii/DKy0eue28JaxPHCxUdzcedrETHL/ztrQNl6IfjNMrqiEVO6Bb6IDxsRDQZB9th9KnFf4/apfZ2CPK9mi6HIre8iiT6tydd66Boj+kwLXq/CXbDQJkjvqakpIosmLXyKWZ62nROZFtoRqqlCkQOzNCtq3FYBxYi5wOrOWtDtk4ui9tVde30zTrh2lsTLyfoTlYXcf4HkeLCE47xKVdeYwTt1x/XvO+V4Kv2DqX1PS+mlYjYypj318nX+EiZEnxbvdh9LwcWzpcCWwbkHORlW81yhSkmd67B7Fv1mK+z8Br38Xsx5lG6cnHxrZFjsrTlEr2BwiV60VKd27BNw3gk3ceud+/CODXDeLXOmCcTIoHrCd5SX4tP0RA4dBHEi8Wu43LWvsFtjBdI23g+TaoPbI+vDq7RK1YmMiDQMEesfwR4xxkc5UI3sxY4m8DcbP3lhssCNkyvSEuUSAZqKheLT7ZaaYT3MCf8O+Cs7QvP4t/jsuVhzZrKsbF+wcAAP//>)</li></ul> | 182.50 ns | 162.93 ns | 0.89 | 0.15 | False | | |
|<ul><li>[Property_Set_class - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=false_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Reflection.Invoke.Property_Set_class.html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/runtime/System.Reflection/Invoke.cs#L223-#L230>)</li><li>[ADX - Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACoRV227bMAx9z1fozfbmuM6lbpPCA9ruocPQrUsyDFhRBErMJGptyZDkJhn28aN8q92kK/xi8xxSFA9Jx6DJfCEpX25ISKI9pwlb2veWhJU62QCN1ElCGbcenItOnHMzFkeXMqdbu/PAKu1LkaS3IgJj1gwkRBWiNJV6xhIDRVSDxle77/cHXf+02x/N/POxfzo+HXlnvWB0Hgw++v7Y96vzgEfHfYfd3tnMD8a9wXg4+F3RaRKZDH4xHomt8nq+d5lEwdDr+zd97/s29u5ArqrMGNcQH6X3Rjc9b8bWIFsOMePZLrR+LjKuM6/f94cl/5BKZRIMX6i+oRpTi6QyuaJLCFsJ1Cxvmr1Qt4yXISvuFOQzHnoYVUIqzK0ioTnoE4kZYNlqNONfMYIhoNRSzBPBRQVqUNog073SkHgTWMWw1Exw7wt/Fk/g3UmRgtT7+RT0fBlTpSrXdF0cWrQQflVABCuaxXnY0jTdCKm/0QRUISs+ixjsScZ/ZJDBWGnJ+Nol+ZfhlRaH3Hfek9YlFpaquwuGXewFy+28L27DJe8I4/SGbkjFHujmSmB8LAU02UcbovRphf+P3mU2xRFlgzRdDmVveZRJdR4uOrdA0R8S4Fp1/pLtBgEyQ4VNSUkYFnLXyJWZ7EneO2HRRDVUKZMjxdQI2bbmo3FgzXM6sJa3OmTj8L62VX3fTtMsIKaxNfF+hmZhdS3jexzNI1jtEFfF0mOc2OUCdJr3vRZ8xdaZpKb71aQaGlOZ4v1t8jWuQhbn78VGDF/WY0uHa4FtA3Im0vKtRpmCJNV7+yD23VrM9ik47buYDTnVKD351Ni3yFFZklDJ/gChcj1P6M7O+aYBXPLBIYv9qwBu3SBurQPGSaV4xHqS1+S38kMEFA59KPFikd24bGG/xBama6QNHLcIWhxZH16dXaKFWJjIo0DBnrD8IeMcZHOVCN7MWOKPA3Gz+ZYbLAjZMr0hNlEgGaiwXi0u2WmmY9zBn/H/grO0Lz/zv47NlYO2wpSPi/MPAAD//w==>)</li></ul> | 170.59 ns | 153.70 ns | 0.90 | 0.07 | True | | |
|<ul><li>[Method0_NoParms - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=false_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Reflection.Invoke.Method0_NoParms.html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/runtime/System.Reflection/Invoke.cs#L100-#L107>)</li><li>[ADX - Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACoRV227bMAx9z1fozfbmuM5l6Q0e0HYPHYZ2XZJhwIoiUGImUWtJhiQ3ybCPH+Vb7SZd4ReJPKQoniM6AUNmc0XFYk0iEu8E5Wzh3jsKlvpoDTTWR5wy4Tx4550kx2YsiS9UDne2JyOntC8kT29kDNZsGCiIK482VJkp49YVUwMGl24/7A+64adu/3QanpyFo7MwDHqD8Hh0HH4MQ9xV54GID8cOu73jKQb2BmfDwe8KTnlsK/jFRCw3OuiFwQWPR8OgH173g++bJLgDtawqY8JAchDeO73uBVO2AtUKSJjItpHzc54JkwX9fjgs8ftQqvho+AINLdSaWiCdqSVdQNQqoEYFk+wFumGiTFlhJ6Ce8dD9rApSaW8VSyPAHCmsANtWezPxDTNYAFKt5IxLISunAW2sZ7LTBngwhmUCC8OkCL6KZ/kEwQ2YtYzD2a28w3J0FZeuihML/eCucsSwpFmS5yxNk7VU5pZy0AWn+M0TcMeZ+JFBBmfaKCZWPsl3FldaPHLfeY9XnzjYp+52NOyiEBy/8z6zjZBcDjboDdIQigLo5jRg/hRF3kQfVEMZ00r/H7LLaoojSnU0Q/Y5b0WURXUezjs3QDEeOAijO3/JZo0OMkV6bUtJFBVc155L+6zHuXCiQkG1q2Im9xRPRqq2NX8Xe9a8pj1reat9NL7c17ZK9O0y7fRhBnWJ97MwB7vr2NjD3jyD005xWUw8JohbTj+ved8rKZZslSlqpa/H1YuxnSnWb4OvcA6yJF8X4zB6mY0tHq4kygbUVKblqvYyDTw1O3cv991KTncpeO272PE4MUg9+dwYtojRGedUsT9AqFrNON26Od4KwCcfPDLfvUrg1wLxax4wT6rkI/aTvAa/VR96QOOjjxReLHYbly3sFyhhukLYwPOLpMWR9eHV2aW3IAsLeZRI2BO2P2JCgGqOEimaFSv8a6Dfjr3FGhtCNsysiUs0KAY6qkeLT7aGmQQH8Bf8ueBb2pXb/JfjCu2hrTDlz8X7BwAA//8=>)</li></ul> | 127.46 ns | 111.28 ns | 0.87 | 0.12 | True | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_29_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dfalse_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Improvement/System.Reflection.Invoke_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_29_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dfalse_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Improvement/System.Reflection.Invoke_2.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_29_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dfalse_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Improvement/System.Reflection.Invoke_3.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_29_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dfalse_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Improvement/System.Reflection.Invoke.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create aot directory 
mkdir -p $RunDir/artifacts/bin/aot/sgen
mkdir -p $RunDir/artifacts/bin/aot/pack
cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen
cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Reflection.Invoke*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Reflection.Invoke* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create aot directory
mkdir $RunDir\artifacts\bin\aot\sgen
mkdir $RunDir\artifacts\bin\aot\pack
xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y
xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Reflection.Invoke*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Reflection.Invoke* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200
```

</details>

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-1c458715-6632-44db-b91b-ef697e5d3b8b2455225684244fabf/96c4d00c-8c6a-4610-af33-10b891244f6d.zip?sv=2021-08-06&se=2023-09-18T15%3A39%3A46Z&sr=c&sp=rl&sig=yCzH%2BXaEajbTFloF2KlTQW3UtmXfiI0JncYzNRI96zE%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-024ab204-c662-4e83-be68-d0c2cb5560b94775df82ba14acb94/a12358d3-ffa9-4782-ac63-77e7a60a04e8.zip?sv=2021-08-06&se=2023-09-20T01%3A35%3A45Z&sr=c&sp=rl&sig=0NuGxZ%2B95Ns0SNxSYpZzqSnFv%2B1SzQt7vIMelFPyucE%3D>)
### System.Reflection.Invoke.Property_Set_int

#### ETL Files

#### Histogram

#### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 162.932819243921 < 172.9191889893661.
IsChangePoint: Marked as a change because one of 8/10/2023 8:47:51 AM, 8/19/2023 11:06:43 PM, 8/28/2023 11:06:53 PM falls between 8/19/2023 11:06:43 PM and 8/28/2023 11:06:53 PM.
IsImprovementStdDev: Marked as improvement because 3.754053971183192 (T) = (0 -166.08351976559032) / Math.Sqrt((65.56281530833336 / (15)) + (53.844010976661245 / (24))) is greater than 2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (15) + (24) - 2, .975) and 0.05493861829300823 = (175.73834142456062 - 166.08351976559032) / 175.73834142456062 is greater than 0.05.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
#### JIT Disasms

### System.Reflection.Invoke.Property_Set_class

#### ETL Files

#### Histogram

#### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 153.70037254464287 < 163.4229530140471.
IsChangePoint: Marked as a change because one of 8/19/2023 11:06:43 PM, 8/28/2023 11:06:53 PM falls between 8/19/2023 11:06:43 PM and 8/28/2023 11:06:53 PM.
IsImprovementStdDev: Marked as improvement because 6.355690085649129 (T) = (0 -154.85746128812627) / Math.Sqrt((77.87689273435619 / (15)) + (2.3530295991905366 / (24))) is greater than 2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (15) + (24) - 2, .975) and 0.08625362159593516 = (169.47532154228387 - 154.85746128812627) / 169.47532154228387 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```
#### JIT Disasms

### System.Reflection.Invoke.Method0_NoParms

#### ETL Files

#### Histogram

#### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 111.27739588976166 < 120.79180672913796.
IsChangePoint: Marked as a change because one of 8/10/2023 8:47:51 AM, 8/19/2023 11:06:43 PM, 8/28/2023 11:06:53 PM falls between 8/19/2023 11:06:43 PM and 8/28/2023 11:06:53 PM.
IsImprovementStdDev: Marked as improvement because 4.131041381488887 (T) = (0 -111.36047418373785) / Math.Sqrt((99.47358082014092 / (15)) + (4.770116378710474 / (24))) is greater than 2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (15) + (24) - 2, .975) and 0.08838168193490539 = (122.15690709254275 - 111.36047418373785) / 122.15690709254275 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```
#### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 22.04
Queue | TigerUbuntu
Baseline | [a429b0ca4fbb2ed7014815792f1cf1b5939eb567](https://github.com/dotnet/runtime/commit/a429b0ca4fbb2ed7014815792f1cf1b5939eb567)
Compare | [d74b52492d85a3a250654d670942e35f9f0be2e8](https://github.com/dotnet/runtime/commit/d74b52492d85a3a250654d670942e35f9f0be2e8)
Diff | [Diff](https://github.com/dotnet/runtime/compare/a429b0ca4fbb2ed7014815792f1cf1b5939eb567...d74b52492d85a3a250654d670942e35f9f0be2e8)
Configs | CompilationMode:tiered, LLVM:false, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono


### Improvements in System.Collections.IterateFor&lt;String&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio
-- | -- | -- | -- | -- | -- | -- | -- | --
|<ul><li>[List - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=false_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Collections.IterateFor(String).List(Size%3a%20512).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Collections/Iterate/IterateFor.cs#L73-#L81>)</li><li>[ADX - Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACoRVbU/bMBD+3l/hb0m2NKRpKFAWJGCamDY2RjtNGkIoba6tWWJHtrO20378zs4LCS1D/eLcPfdiP89dU1DkYSZiNl+RiCRbFmd0bt9ZAhbyYAVxIg+ymDLr3jntpQZb0DQ5FwZubY5HVmWf8yy/5glos6IgIKk9UsVCTWmmXUmsQOHRDvxg2PcP+8HJ1D8e+6PxMPDC40M/PDp56/tj36/rAUv2x4b9wdEUAwfDcTj8WcPjLNEd/KAs4WvpDXzvPEtGoRf4V4H3dZ16NyAWdWeUKUj3wgcnVwNvSpcgOgEpZcUmsr7PCqYKLwj8sMLvQmORjcInqK+h2tQByUIs4jlEnQYalDcpnqBryqqUNXYC4jcW3c0qIOf6VglXDNSBwA7w2RpvwT5hBg1AqgV/yDjjtVOBVNoz2UoFmXfJ0xTminImvY8KBDLwgYt3EyUoW555n6lU9oT+gTE5HAROnSRfluVLMeFX7UhgERepKVCZJisu1Jc4A1kSjL9ZCvZtwb4VUMBYmkouMV8aV1kcctd7jWSXWPho/c0o7KMqLLf3Os2tEKMNHfQCgwhFNfQNJ5g/R8W30XulUcV00v+H+aqbskQllXbIrgA6EVVTvfvT3jXEGA8ZMCV7f8l6hQ4yRa71k5IoKolvPBd6xm+NiqJSTo2rZsZ4yvnhoms1Q7JjNT3tWKtb7aJxjJ/b6gnotqlXEVUoUryfhln4upaO3e81Gaxuioty/VFG7GoVOu37XnK2oMsCxa/n4LYeH/0y5fll8CUuRZqac7kbo6dF2eHhkqNsQEx5Xp0aL5WQ5Wpr7+S+WfLpNgenexe9KycKqSdnrc2LGFlkWSxwVkkslg9ZvLENXgvAJW8cMts+S+A2AnEbHjBPLvgjvid5Dn6pP/SAxKGPBF4ssVuXLe3nKOF4ibCh45ZJy5JN8bp25S3JwkYeORL2C58/ooyBaK8SztodC/wLQb/egfMVPghZU7UiNpEgKMioWS0u2SiqUtzG73HP4Sxtq0/z/2Mz6aCtNJlxcf4BAAD//w==>)</li></ul> | 2.13 μs | 1.69 μs | 0.79 | 0.07 | True | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_29_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dfalse_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Improvement/System.Collections.IterateFor%28String%29_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_29_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dfalse_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Improvement/System.Collections.IterateFor%28String%29.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create aot directory 
mkdir -p $RunDir/artifacts/bin/aot/sgen
mkdir -p $RunDir/artifacts/bin/aot/pack
cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen
cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Collections.IterateFor&lt;String&gt;*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Collections.IterateFor&lt;String&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create aot directory
mkdir $RunDir\artifacts\bin\aot\sgen
mkdir $RunDir\artifacts\bin\aot\pack
xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y
xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Collections.IterateFor&lt;String&gt;*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Collections.IterateFor&lt;String&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200
```

</details>

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-1c458715-6632-44db-b91b-ef697e5d3b8b2455225684244fabf/96c4d00c-8c6a-4610-af33-10b891244f6d.zip?sv=2021-08-06&se=2023-09-18T15%3A39%3A46Z&sr=c&sp=rl&sig=yCzH%2BXaEajbTFloF2KlTQW3UtmXfiI0JncYzNRI96zE%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-024ab204-c662-4e83-be68-d0c2cb5560b94775df82ba14acb94/a12358d3-ffa9-4782-ac63-77e7a60a04e8.zip?sv=2021-08-06&se=2023-09-20T01%3A35%3A45Z&sr=c&sp=rl&sig=0NuGxZ%2B95Ns0SNxSYpZzqSnFv%2B1SzQt7vIMelFPyucE%3D>)
### System.Collections.IterateFor&lt;String&gt;.List(Size: 512)

#### ETL Files

#### Histogram

#### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 1.6884479868461715 < 2.0146552437783396.
IsChangePoint: Marked as a change because one of 8/19/2023 11:06:43 PM, 8/28/2023 11:06:53 PM falls between 8/19/2023 11:06:43 PM and 8/28/2023 11:06:53 PM.
IsImprovementStdDev: Marked as improvement because 9.049031991725354 (T) = (0 -1691.6849007724406) / Math.Sqrt((18894.777467569107 / (15)) + (1289.1230143875607 / (24))) is greater than 2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (15) + (24) - 2, .975) and 0.16237684294000015 = (2019.6252772071623 - 1691.6849007724406) / 2019.6252772071623 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```
#### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 22.04
Queue | TigerUbuntu
Baseline | [a429b0ca4fbb2ed7014815792f1cf1b5939eb567](https://github.com/dotnet/runtime/commit/a429b0ca4fbb2ed7014815792f1cf1b5939eb567)
Compare | [d74b52492d85a3a250654d670942e35f9f0be2e8](https://github.com/dotnet/runtime/commit/d74b52492d85a3a250654d670942e35f9f0be2e8)
Diff | [Diff](https://github.com/dotnet/runtime/compare/a429b0ca4fbb2ed7014815792f1cf1b5939eb567...d74b52492d85a3a250654d670942e35f9f0be2e8)
Configs | CompilationMode:tiered, LLVM:false, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono


### Improvements in System.Tests.Perf_String

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio
-- | -- | -- | -- | -- | -- | -- | -- | --
|<ul><li>[IndexerCheckPathLength - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=false_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Tests.Perf_String.IndexerCheckPathLength.html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Runtime/Perf.String.cs#L266-#L278>)</li><li>[ADX - Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACoRVbU/bMBD+3l/hb0m3NKRtKFCUScA+MG1sjHaaNIQqt7k2hsSubGdtp/34nZ0XElqG8sW+e+7F99xdUtBkNpeULxISkXjHacYW7r0jYamOEqCxOsoo485D97yTWmzO0vhCWrizPR05pXwhsvWNiMGINQMJcaVRmko9ZZlRxVSDxqM7CAbDXnDcG5xNg9NxMBoPT/zweBgMw/B9EIyDoIoHPD5sG/b6J1M07A/H4fBXBadZbDL4yXgsNsrvB/5FFo9CfxBcD/xvm9S/BbmsMmNcQ3oQ3j+77vtTtgLZMkgZz7eR82Oec537g0EQlvh9KJXZKHyGBgZqRC2QyuWSLiBqJVCj/En+DN0wXrqssBOQvzHovlcJa2FeFQvNQR9JzADLVmtz/hk9GABSLcUsE1xUSg1KG81kpzRk/hSvyvqeTbRkfOV/4jFsQV4lsHi6pTr5Anylk8p8vSoCF22Et0oRw5LmqXVdiiaJkPorzUAV1OI3T8G9y/n3HHIYKxvPI/ZmcKWkS+47b9HrEQfL1duOwh72g+N13ia4YWK7whi9wh1CsQ96lg30v8Zeb6IPNkVp03L/H87LbIoQZZM0Tfapb1mUSXUezjs3QNEeMuBadf6STYIKYmg1JSVRVFBeay7NdN/Z/omKRqpVFTNWU0yOkG2pHY89qc1pT1q+ah+NA/xSVvV+O02zhJiGhcb3GZiD1XWM7WGt9eC0XVwWi49x4pZLsNt875XgS7bKJdVMcHVXDY6pTHF+HXyF65Cl9lxsxeh5RbZ4uBLYNiCnYl2eai1TkK31zt3zfbsS090auu23mC050Ug9+dDYuYhReZZRyf4AoXI1y+jWtXjTAB551yXz3QsHXt0gXs0D+llL8Yj1JC/Br+WHGlA49JHEh8Vu47GF/AJbmK4QNux6hdMiZB28il1qC7IwkUeBhD1h+SPGOcjmKhG8mbHEnwfqzfZbJFgQsmE6IS5RIBmoqF4tHtlqplPcwx/xH4OztCuv9s/jctVFWSGy49L9BwAA//8=>)</li></ul> | 183.34 ns | 122.65 ns | 0.67 | 0.20 | True | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_29_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dfalse_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Improvement/System.Tests.Perf_String_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_29_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dfalse_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Improvement/System.Tests.Perf_String.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create aot directory 
mkdir -p $RunDir/artifacts/bin/aot/sgen
mkdir -p $RunDir/artifacts/bin/aot/pack
cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen
cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Tests.Perf_String*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Tests.Perf_String* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create aot directory
mkdir $RunDir\artifacts\bin\aot\sgen
mkdir $RunDir\artifacts\bin\aot\pack
xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y
xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Tests.Perf_String*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Tests.Perf_String* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200
```

</details>

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-1c458715-6632-44db-b91b-ef697e5d3b8b2455225684244fabf/96c4d00c-8c6a-4610-af33-10b891244f6d.zip?sv=2021-08-06&se=2023-09-18T15%3A39%3A46Z&sr=c&sp=rl&sig=yCzH%2BXaEajbTFloF2KlTQW3UtmXfiI0JncYzNRI96zE%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-024ab204-c662-4e83-be68-d0c2cb5560b94775df82ba14acb94/a12358d3-ffa9-4782-ac63-77e7a60a04e8.zip?sv=2021-08-06&se=2023-09-20T01%3A35%3A45Z&sr=c&sp=rl&sig=0NuGxZ%2B95Ns0SNxSYpZzqSnFv%2B1SzQt7vIMelFPyucE%3D>)
### System.Tests.Perf_String.IndexerCheckPathLength

#### ETL Files

#### Histogram

#### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 122.64780472805779 < 173.84499783211888.
IsChangePoint: Marked as a change because one of 8/10/2023 8:47:51 AM, 8/19/2023 11:06:43 PM, 8/28/2023 11:06:53 PM falls between 8/19/2023 11:06:43 PM and 8/28/2023 11:06:53 PM.
IsImprovementStdDev: Marked as improvement because 4.859761895780125 (T) = (0 -125.4876273151031) / Math.Sqrt((863.2363088327922 / (15)) + (42.46510124119732 / (24))) is greater than 2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (15) + (24) - 2, .975) and 0.2297439808273848 = (162.91677597001834 - 125.4876273151031) / 162.91677597001834 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```
#### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 22.04
Queue | TigerUbuntu
Baseline | [a429b0ca4fbb2ed7014815792f1cf1b5939eb567](https://github.com/dotnet/runtime/commit/a429b0ca4fbb2ed7014815792f1cf1b5939eb567)
Compare | [d74b52492d85a3a250654d670942e35f9f0be2e8](https://github.com/dotnet/runtime/commit/d74b52492d85a3a250654d670942e35f9f0be2e8)
Diff | [Diff](https://github.com/dotnet/runtime/compare/a429b0ca4fbb2ed7014815792f1cf1b5939eb567...d74b52492d85a3a250654d670942e35f9f0be2e8)
Configs | CompilationMode:tiered, LLVM:false, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono


### Improvements in System.Threading.Tests.Perf_EventWaitHandle

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio
-- | -- | -- | -- | -- | -- | -- | -- | --
|<ul><li>[Set_Reset - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_LLVM=false_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Threading.Tests.Perf_EventWaitHandle.Set_Reset.html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Threading/Perf.EventWaitHandle.cs#L21-#L27>)</li><li>[ADX - Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACoRVbW+bMBD+nl/hb8BGKCFplqZiUttNqjR16xKmSquqyA2XxBvYyDZNMu3H78xboUlX8QXuee7Ffu6OBDRZPErKlxsSknjPacqW9r0lYaVONkBjdZJSxq0H57yXFNycJfGFLOjWbjK2KvtSpNmNiMGYNQMJcY0oTaWOWGqgmGrQ+GoHfjDs+6f94CzyJ1N/PB2eeZPBIJiMT9/7/tT363zA4+O+o/7gQ4SOg+F0NPxZ02kamwruGI/FVnkD37tI4/HIC/zrwPu2TbxbkKu6MsY1JEfpg7PrgRexNciOQ8J4vgutH48517kXBP6o4h9SqUzHo2eqb6jG1CGpXK7oEsJOAQ3Lm+fP1C3jVciaOwf5hEkPo0rIhDlVLDQHfSKxAry2Bs35F4xgCCi1FItUcFGDGpQ2yHyvNKRetJHYAoyvvQgBVWRZfH4Cru8o09eUxwlgHXoxAwW6DpKty/RlM+FXDcSwonlSJKhM842Q+itNQZUC4/OYgD3L+fcccpgqLTG7S4ovw6ssDrnvvSWySyy8tP5uPOpjV1hu722ZWy5FbxinVxREKnZDv9AE42fY8W320daofDrh/6N8VU2ZomqVtsthA3Q8qqJ6D+e9G6DoDykKp3p/yXaDADGSmislYVgK3yCXZsZnRReFZTs1UK1MgZTzI2TXWgzJgbWo6cBaneqQjWP80lZPQLdMs4qYhqXG8xmahbdrGd/jaBHB6oa4LNcf48SuVqHTPu+V4Cu2ziXVTHA1q8fH3Ez5/jr5CpciS4r3cjeGz4uyo8OVwLYBGYmsemtQpiDN9N4+iH27FtE+A6d7FrMr5xqlJx9bmxc5Kk9TKtkfIFSuFynd2QXfNIBL3jnkcf8igNs0iNvogHEyKX7hfZKX5NfqQwQUDn0o8WCx3Tpsab/AFqZrpA0dtwxapmyS17krtBQLC/klULDfeP0h4xxke5UI3q5Y4i8EcbMDlxu8ELJlekNsokAyUGGzWlyy00wnuI0/4Z8GZ2lffRb/H5srB22lqRgX5x8AAAD//w==>)</li></ul> | 188.78 ns | 174.77 ns | 0.93 | 0.05 | True | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_29_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dfalse_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Improvement/System.Threading.Tests.Perf_EventWaitHandle_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_29_2023/refs/heads/main_x64_ubuntu%2022.04_LLVM%3Dfalse_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Improvement/System.Threading.Tests.Perf_EventWaitHandle.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create aot directory 
mkdir -p $RunDir/artifacts/bin/aot/sgen
mkdir -p $RunDir/artifacts/bin/aot/pack
cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen
cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Threading.Tests.Perf_EventWaitHandle*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Threading.Tests.Perf_EventWaitHandle* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create aot directory
mkdir $RunDir\artifacts\bin\aot\sgen
mkdir $RunDir\artifacts\bin\aot\pack
xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y
xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Threading.Tests.Perf_EventWaitHandle*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Threading.Tests.Perf_EventWaitHandle* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200
```

</details>

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-1c458715-6632-44db-b91b-ef697e5d3b8b2455225684244fabf/96c4d00c-8c6a-4610-af33-10b891244f6d.zip?sv=2021-08-06&se=2023-09-18T15%3A39%3A46Z&sr=c&sp=rl&sig=yCzH%2BXaEajbTFloF2KlTQW3UtmXfiI0JncYzNRI96zE%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-024ab204-c662-4e83-be68-d0c2cb5560b94775df82ba14acb94/a12358d3-ffa9-4782-ac63-77e7a60a04e8.zip?sv=2021-08-06&se=2023-09-20T01%3A35%3A45Z&sr=c&sp=rl&sig=0NuGxZ%2B95Ns0SNxSYpZzqSnFv%2B1SzQt7vIMelFPyucE%3D>)
### System.Threading.Tests.Perf_EventWaitHandle.Set_Reset

#### ETL Files

#### Histogram

#### Description of detection logic
```
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsRegressionBase: Marked as not a regression because the compare was not 5% greater than the baseline, or the value was too small.
IsImprovementBase: Marked as improvement because the compare was 5% less than the baseline, and the value was not too small.
IsImprovementCheck: Marked as improvement because the three check build points were 0.05 less than the baseline.
IsImprovementWindowed: Marked as improvement because 174.77120172634574 < 179.86277989835264.
IsChangePoint: Marked as a change because one of 8/14/2023 10:44:26 PM, 8/19/2023 11:06:43 PM, 8/28/2023 11:06:53 PM falls between 8/19/2023 11:06:43 PM and 8/28/2023 11:06:53 PM.
IsImprovementStdDev: Marked as improvement because 4.382339671626813 (T) = (0 -174.18632312974702) / Math.Sqrt((72.20886844637286 / (15)) + (6.091478911291735 / (24))) is greater than 2.026192463026769 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (15) + (24) - 2, .975) and 0.05360104255423476 = (184.05168534827874 - 174.18632312974702) / 184.05168534827874 is greater than 0.05.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

```
#### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	a429b0ca4fbb2ed7014815792f1cf1b5939eb567
Compare	d74b52492d85a3a250654d670942e35f9f0be2e8
Diff	Diff
Configs	CompilationMode:tiered, LLVM:false, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
Property_Set_int - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	182.50 ns	162.93 ns	0.89	0.15	False
Property_Set_class - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	170.59 ns	153.70 ns	0.90	0.07	True
Method0_NoParms - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	127.46 ns	111.28 ns	0.87	0.12	True

[Perf] Linux/x64: 6 Improvements on 8/20/2023 5:37:20 PM #20965

Description

Run Information

Improvements in System.Reflection.Invoke

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

Payloads

System.Reflection.Invoke.Property_Set_int

ETL Files

Histogram

Description of detection logic

JIT Disasms

System.Reflection.Invoke.Property_Set_class

ETL Files

Histogram

Description of detection logic

JIT Disasms

System.Reflection.Invoke.Method0_NoParms

ETL Files

Histogram

Description of detection logic

JIT Disasms

Docs

Run Information

Improvements in System.Collections.IterateFor<String>

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

Payloads

System.Collections.IterateFor<String>.List(Size: 512)

ETL Files

Histogram

Description of detection logic

JIT Disasms

Docs

Run Information

Improvements in System.Tests.Perf_String

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

Payloads

System.Tests.Perf_String.IndexerCheckPathLength

ETL Files

Histogram

Description of detection logic

JIT Disasms

Docs

Run Information

Improvements in System.Threading.Tests.Perf_EventWaitHandle

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

Payloads

System.Threading.Tests.Perf_EventWaitHandle.Set_Reset

ETL Files

Histogram

Description of detection logic

JIT Disasms

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions