[mono][Perf] Disabled HAS_CUSTOM_BLOCKS causing regressions on MonoAOT, MonoInterpreter arm64 on 8/23/2024 12:30:35 PM

### Run Information

Name | Value
-- | --
Architecture | arm64
OS | ubuntu 22.04
Queue | AmpereUbuntu
Baseline | [217525ae6f6a117a0780620ed4fb1b94e03fd4d6](https://github.com/dotnet/runtime/commit/217525ae6f6a117a0780620ed4fb1b94e03fd4d6)
Compare | [8fd46b2642bdc4897027901cc5212a1c5ed05020](https://github.com/dotnet/runtime/commit/8fd46b2642bdc4897027901cc5212a1c5ed05020)
Diff | [Diff](https://github.com/dotnet/runtime/compare/217525ae6f6a117a0780620ed4fb1b94e03fd4d6...8fd46b2642bdc4897027901cc5212a1c5ed05020)
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono


### Regressions in System.Collections.CopyTo&lt;Int32&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio
-- | -- | -- | -- | -- | -- | -- | -- | --
|<ul><li>[ReadOnlyMemory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Collections.CopyTo(Int32).ReadOnlyMemory(Size%3a%202048).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Collections/CopyTo.cs#L48-#L50>)</li><li>[ADX - Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpWU32/TMBDH3yfxP1h7SQLZmmVVOyoy0ZUNBisbbcQLQpObXBsj/4hsZ2smxN/OOSmj26QRXhLf6fu5s893ngI1lQYB0pqdn+S2AA3kpGI8n0GpSJIQL1dWgu3pSlomwHuoOtFUZkWj07A0vQJobnqCMvlIONZZwSxkFrMRJonvrQd9LyQe1QIXwb06BWM/UwEu5ltvXhsLYn+iOEeWKWlwXdapenMu7WF8vD/DhJeS11MQStf+nN3BiMRR/yj4u4FZJSdKLtmq0rSJ8c2bKFEy3lhTlYP3nSS/iGcZynPvxU6vR56BLy6+Tv8QuoJ/6qdKqvFl+r8InhB0qQG/G3RJuXHsMyC6PjGZbwDBMq2uBQbbopgBUdraf0KPlQ06yM6VueA3ornWLvqP5lSumIQu2quVSuuym7SoDcsov9JKKOfpCn6oF5rl77laUM7uGl8XbBbPumY4XZegcVhk08kPe3uicJBAp6rcrB7OSYrY3FJRkmOSUwtu5vw4ivt70WAvHqbR69HBcNQ/2h8M4+Hw4OhVFI2iyKWAtQWZkzlmBpMYqzNq/TM0ZM7rLxVU4DbjNtsYQUjYculbtVCKPz1C07PYDyHZ3cPe3cX/bgdkq2cbtLW70K6lGsRNVwu4U5lKCKpxqgnVq2tB135TJneUkLwMyKJ+VLfw/gUJN7XAKKVWP/D9eCKdgam4TTTeRO5v3U7rH9+ApiuMc4gbu4+lsaCgibuYrKDakltmC+Kbtu6tLCTrTPFKyORxxrr1m6RNgULLLIfEe4eXje9hvTEdQnxpAi/4DRi/NRWkBQAA>)</li></ul> | 211.29 ns | 467.41 ns | 2.21 | 0.07 | True | | |
|<ul><li>[Span - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Collections.CopyTo(Int32).Span(Size%3a%202048).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Collections/CopyTo.cs#L36-#L38>)</li><li>[ADX - Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpWUbW/TMBDH30/iO1h7kwTSNsseqchEVwYMVhhtxBuEJje5NkZ+iGxnaybEZ+eclLGu0ghvEt/p/7uzz3eeADWVBgHSmp2f5LYADeSsYjyfQqlIkhAvV1aCHehKWibA21SdaSqzotFpWJhBATQ3A0GZfCQc6axgFjKL2QiTxPdWRwdeSDyqBS6Ce3UKxn6iAlzM196sNhZEf6w4R5YpaXBd1ql6dSHtfnzan5VU+jN2B0MSRwcnwd+000qOlVywZaVpQ37zxkqUjDfWROXgfSfJL+JZhvLce7YzGJAn4MvLr5M/hK7gn/qJkmr0Of1fBM8FutSA3zW6oNw49gkQXR+ZzNeAYJlW1wKDPaCYAVHa2t+iR8oGHWQXylzyG9FcZhf9B3Mul0xCF+3VUqV12U1a1IZllF9pJZTzdAXf13PN8ndczSlnd42vCzaNp10znK9K0DgisunfzY4eKxwf0Kkq16vN6UgRm1kqSnJKcmrBTZofR/FBLzrqxcdp9HK4dzw8jPrx4dFedLL/IoqGUeRSwMqCzMkMM4NJjNUZtf5bNGTO6y8VVOA24zbbGEFI2GLhWzVXim8foelZ7IeQ7Pawd3fxv9sBedCzDdraXWjXUg3ipqsF3KlMJQTVONWE6uW1oCu/KZM7SkieB2ReP6pbeP9uhOtaYJRSqx/4amxJp2AqbhONN5H7D26n9Y9uQNMlxtnHjd3H0lhQ0MRdTFZQbcktswXxTVv3VhaSVaZ4JWTyOGPd+k3SpkChZZZD4r3By8ZXsF6bDiG+NIEX/Abs9/9/mgUAAA==>)</li></ul> | 189.66 ns | 443.54 ns | 2.34 | 0.10 | True | | |
|<ul><li>[Memory - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Collections.CopyTo(Int32).Memory(Size%3a%202048).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Collections/CopyTo.cs#L44-#L46>)</li><li>[ADX - Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpWUbW/TMBDH3yPxHay9SQLZmmVlGxWZ6MqAwQqjjXiD0OQm18bID9HZ2ZoJ8dm5JGXsQRrhTeI7/X939vnOU+C2QlCgnX3yk10VgMCOKyHzGZSGJQnzcuM0uAFW2gkF3l3VMXKdFa0OYWkHBfDcDhQX+p5wjFkhHGSOsjGhme+t94deyDyOihbBjToF6z5xBU3M1968tg7UzsRISaww2tK6rFPz6lS7vfhoZwrKYO3PxTWMWBwND4O/iWeVnhi9FKsKect+8yZGlUK21tTk4H1nyS/mOUHy3Hv6ZDBgj8BnZ1+nfwis4J/6qdFm/Dn9X4ROBlgi0HeDLrm0DfsISK6PQucbQIkMzYWiYLcoYUGVrvYf0GPjgh6yU2PP5KVqr7OP/oM90SuhoY/2fGXSuuwnLWorMi7P0SjTePqC7+sFivydNAsuxXXr64PN4lnfDCfrEpCGRLcdfLenJ4YGCDA15WZ1dz5SwuaOq5IdsZw7aGbNj6N4uB3tb8cHafRytHswehHt7B3G+8Pd6HkUjaKoSQFrBzpnc8oMNrEOM+78t2ToXNZfKqig2Uyz2dYIQiaWS9+ZhTHy4RHanqV+CNnWNvXuFv23eiC3erZFO7sP3bRUizTT1QHNqWylFEeaasZxdaH42m/L1BwlZM8Ctqjv1S28eTnCTS0oSonmB70bD6QzsJV0CdJN5P6t2+n840tAvqI4e7Sxm1hIBQVkzcVkBUfHroQrmG+7uneykK0zIyulk/sZ685vky4FCZ1wEhLvDV02vYP1xmwQ5msbeMFvf/NUyJwFAAA=>)</li></ul> | 214.67 ns | 467.25 ns | 2.18 | 0.10 | True | | |
|<ul><li>[ReadOnlySpan - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Collections.CopyTo(Int32).ReadOnlySpan(Size%3a%202048).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Collections/CopyTo.cs#L40-#L42>)</li><li>[ADX - Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpWUbW/TMBDH30/iO1h9kwSyNuu6h1ZkoisDBisbbcQbhCY3uTZGfohsZ2smxGfnnJTRbdIIbxLf6f+7s893ngI1pQYB0pqdn+Q2Bw3ktGQ8m0GhSBwTL1NWgu3pUlomwHuoOtVUpnmt07A0vRxoZnqCMvlIONZpziykFrMRJonvrQ8HXkg8qgUugnt1AsZ+pgJczDfevDIWRHeiOEeWKWlwXVSJen0u7X7/pDvDhJeSV/OCSn/O7mBE+tHgOPibflbKiZJLtio1rSN88yZKFIzX1lRl4H0n8S/iWYbyzHux0+uRZ+CLi6/TP4Qu4Z/6qZJqfJn8L4LnA11owO8GXVJuHPsMiK5PTGYbQLBUq2uBwbYoZkAUtvKf0GNlgxayc2Uu+I2oL7WN/qM5kysmoY32aqWSqmgnzSvDUsqvtBLKedqCH6qFZtl7rhaUs7va1wab9WdtM5ytC9A4KrLu44edPVE4RqATVWxWD6ckQWxuqSjICcmoBTdxfj/qD3ajw93+URINR3tHo4Ooe7B3PBgO915F0SiKXApYW5AZmWNmMLGxOqXWf4eGzHj1pYQS3GbcZmsjCAlbLn2rFkrxp0eoexb7ISSdXezdDv47LZCtnq3Rxm5Du5aqETddDeBOZUohqMapJlSvrgVd+3WZ3FFC8jIgi+pR3cL79yPc1AKjFFr9wNfjiXQGpuQ21ngTmb91O41/fAOarjDOPm7sPpbGgoIm7mLSnGpLbpnNiW+aujeykKxTxUsh48cZq8Zv4iYFCi2zHGLvLV42vobVxnQI8aUJvOA3n0euyqIFAAA=>)</li></ul> | 186.30 ns | 442.55 ns | 2.38 | 0.08 | True | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_27_2024/refs/heads/main_arm64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.CopyTo%28Int32%29_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_27_2024/refs/heads/main_arm64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.CopyTo%28Int32%29_2.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_27_2024/refs/heads/main_arm64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.CopyTo%28Int32%29_3.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_27_2024/refs/heads/main_arm64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.CopyTo%28Int32%29_4.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_27_2024/refs/heads/main_arm64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Collections.CopyTo%28Int32%29.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create aot directory 
mkdir -p $RunDir/artifacts/bin/aot/sgen
mkdir -p $RunDir/artifacts/bin/aot/pack
cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen
cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Collections.CopyTo&lt;Int32&gt;*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Collections.CopyTo&lt;Int32&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create aot directory
mkdir $RunDir\artifacts\bin\aot\sgen
mkdir $RunDir\artifacts\bin\aot\pack
xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y
xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Collections.CopyTo&lt;Int32&gt;*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Collections.CopyTo&lt;Int32&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200
```

</details>

<details>

### System.Collections.CopyTo&lt;Int32&gt;.ReadOnlyMemory(Size: 2048)

#### ETL Files

#### Histogram

#### JIT Disasms

### System.Collections.CopyTo&lt;Int32&gt;.Span(Size: 2048)

#### ETL Files

#### Histogram

#### JIT Disasms

### System.Collections.CopyTo&lt;Int32&gt;.Memory(Size: 2048)

#### ETL Files

#### Histogram

#### JIT Disasms

### System.Collections.CopyTo&lt;Int32&gt;.ReadOnlySpan(Size: 2048)

#### ETL Files

#### Histogram

#### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | arm64
OS | ubuntu 22.04
Queue | AmpereUbuntu
Baseline | [217525ae6f6a117a0780620ed4fb1b94e03fd4d6](https://github.com/dotnet/runtime/commit/217525ae6f6a117a0780620ed4fb1b94e03fd4d6)
Compare | [8fd46b2642bdc4897027901cc5212a1c5ed05020](https://github.com/dotnet/runtime/commit/8fd46b2642bdc4897027901cc5212a1c5ed05020)
Diff | [Diff](https://github.com/dotnet/runtime/compare/217525ae6f6a117a0780620ed4fb1b94e03fd4d6...8fd46b2642bdc4897027901cc5212a1c5ed05020)
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono


### Regressions in System.Memory.Span&lt;Char&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio
-- | -- | -- | -- | -- | -- | -- | -- | --
|<ul><li>[Clear - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Memory.Span(Char).Clear(Size%3a%20512).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Memory/Span.cs#L40-#L41>)</li><li>[ADX - Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpWUbW/TMBDH30/iO1h7kwSyNu26MSoy0XUDBiuMNuINQpObXBsjP0RnZ2smxGfHTkrZWmmEN23u9P/d2ffgCVBdIgiQRu/9JHc5IJCzkvFsCoUicUy8TBkJpoulNEyA91h1hlSmea1DWOhuDjTTXUGZ3BKOMM2ZgdTYbIRJ4nur44EXEo+isB/BRp2ANp+oABfzjTertAHRmYBQWHVmBZWvxznF086YA0V/xu5hSI56/eBvumkpx0ou2LJEapiS+ps3VqJgvLYmKgPvO4l/Ec8wK8+8Z3vdLnkCvrr6OvlDYAn/1E+UVKPPyf8il9IAFgj2d40uKNeOfQK0ro9MZmtAsBTVjbDBHlBMgyhM5e/QI2WCFrJLpa/4raib2Eb/QV/IJZPQRnu9VElVtJPmlWYp5deohHKetuD7ao4se8fVnHJ2X/vaYNP+tG2Gi1UBaFdD1nP7eJLHyq4NYKKK9dfjrUgsNjNUFOSUZNSA2zC/H/UHB9HxQf9lEr0a9k6GR4POyWGvF0WDF1E0jCKXAlYGZEZmNjPoWBtMqfHfWkNmvPpSQgnuMO6wtRGEhC0WvlFzpfjuFeqZtfMQkv0DO7v79n+/BfJgZmu0sdvQbqRqxG1XA7hb6VIIinapCcXljaArvy6Tu0pIngdkXm3VLdy8F+G6FjZKgeqHfWl2pFPQJTcx2k5k/oPuNP7RLSBd2jiH9mCbWGgLCkhcY1L78Bhyx0xOfN3UvZGFZJUqXgoZb2esGr+OmxRWaJjhEHvnttn29avWpkOIL3XgBb8BnXa9dpIFAAA=>)</li></ul> | 32.11 ns | 56.72 ns | 1.77 | 0.10 | True | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_27_2024/refs/heads/main_arm64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Memory.Span%28Char%29_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_27_2024/refs/heads/main_arm64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Memory.Span%28Char%29.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create aot directory 
mkdir -p $RunDir/artifacts/bin/aot/sgen
mkdir -p $RunDir/artifacts/bin/aot/pack
cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen
cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Memory.Span&lt;Char&gt;*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Memory.Span&lt;Char&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create aot directory
mkdir $RunDir\artifacts\bin\aot\sgen
mkdir $RunDir\artifacts\bin\aot\pack
xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y
xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Memory.Span&lt;Char&gt;*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Memory.Span&lt;Char&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200
```

</details>

<details>

### System.Memory.Span&lt;Char&gt;.Clear(Size: 512)

#### ETL Files

#### Histogram

#### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | arm64
OS | ubuntu 22.04
Queue | AmpereUbuntu
Baseline | [217525ae6f6a117a0780620ed4fb1b94e03fd4d6](https://github.com/dotnet/runtime/commit/217525ae6f6a117a0780620ed4fb1b94e03fd4d6)
Compare | [8fd46b2642bdc4897027901cc5212a1c5ed05020](https://github.com/dotnet/runtime/commit/8fd46b2642bdc4897027901cc5212a1c5ed05020)
Diff | [Diff](https://github.com/dotnet/runtime/compare/217525ae6f6a117a0780620ed4fb1b94e03fd4d6...8fd46b2642bdc4897027901cc5212a1c5ed05020)
Configs | CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono


### Regressions in System.Memory.Span&lt;Byte&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio
-- | -- | -- | -- | -- | -- | -- | -- | --
|<ul><li>[Clear - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_arm64_ubuntu 22.04_LLVM=true_MonoAOT=true_MonoInterpreter=false_RunKind=micro_mono/System.Memory.Span(Byte).Clear(Size%3a%20512).html>)</li><li>📝 - [Benchmark Source](<https://github.com/dotnet/performance/blob/main/src/benchmarks/micro/libraries/System.Memory/Span.cs#L40-#L41>)</li><li>[ADX - Test Multi Config Graph](<https://dataexplorer.azure.com/clusters/dotnetperf.westus/databases/PerformanceData?query=H4sIAAAAAAAACpWUbW/TMBDH30/iO1h7kwTSNuvWjlVkoi0DBi2MtuINQpObXBsjP0RnZ2smxGfHTspYO2mEN23u9P/d2ffgKVBdIAiQRh/8JLcZIJBRwXg6g1yROCZeqowE08FCGibA21WNkMokq3QIK93JgKa6IyiTe8IhJhkzkBibjTBJfG/TP/FC4lEU9iO4Vy9Am09UgIv52puX2oBoT0EoLNvznMpXo9LAeXvMgaI/Z3cwIL2jbvA33ayQYyVXbF0gNUxJ/c0bK5EzXllTlYL3ncS/iGeYlafes4NOhzwBTyZfp38ILOCf+qmSavh58b/IpTSAOYL93aIryrVjnwCt6yOT6RYQLEF1LWywBxTTIHJT+o/ooTJBA9ml0hN+I6omNtF/0BdyzSQ00V6t1aLMm0mzUrOE8itUQjlPU/B9uUSWvuNqSTm7q3xNsFl31jTDxSYHtKshq7ndneSxsmsDuFD59mt3KxYWmxsqcnJOUmrAbZjfjbonrajf6p4uorPB0dmge9ruHfdeRr3+iygaRJFLARsDMiVzmxl0rA0m1PhvrSFTXn4poAB3GHfYyghCwlYr36ilUvzxFaqZtfMQksOWnd1D+3/YAHkwsxVa201oN1IV4rarBtytdCEERbvUhOL6WtCNX5XJXSUkzwOyLPfqFt6/F+G2FjZKjuqHfWkeSWegC25itJ1I/Qfdqf3DG0C6tnGO7cHuY6EtKCBxjUkyiobcMpMRX9d1r2Uh2SSKF0LG+xnL2q/jOoUVGmY4xN4b22z7+pVb0yHElzrwgt92IY8ykgUAAA==>)</li></ul> | 20.75 ns | 32.54 ns | 1.57 | 0.16 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_27_2024/refs/heads/main_arm64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Memory.Span%28Byte%29_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/08_27_2024/refs/heads/main_arm64_ubuntu%2022.04_LLVM%3Dtrue_MonoAOT%3Dtrue_MonoInterpreter%3Dfalse_RunKind%3Dmicro_mono_Regression/System.Memory.Span%28Byte%29.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- AOT MONO build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release /p:CrossBuild=false /p:MonoLLVMUseCxx11Abi=false`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create aot directory 
mkdir -p $RunDir/artifacts/bin/aot/sgen
mkdir -p $RunDir/artifacts/bin/aot/pack
cp -r $RunDir/artifacts/obj/mono/$RunOS.$RunArch.Release/mono/* $RunDir/artifacts/bin/aot/sgen
cp -r $RunDir/artifacts/bin/microsoft.netcore.app.runtime.$RunOS-$RunArch/Release/* $RunDir/artifacts/bin/aot/pack

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Memory.Span&lt;Byte&gt;*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Memory.Span&lt;Byte&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir/artifacts/bin/aot/sgen/mini/mono-sgen --customruntimepack $RunDir/artifacts/bin/aot/pack --aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages --buildTimeout 1200
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create aot directory
mkdir $RunDir\artifacts\bin\aot\sgen
mkdir $RunDir\artifacts\bin\aot\pack
xcopy $RunDir\artifacts\obj\mono\$RunOS.$RunArch.Release\mono $RunDir\artifacts\bin\aot\sgen\ /e /y
xcopy $RunDir\artifacts\bin\microsoft.netcore.app.runtime.$RunOSId-$RunArch\Release $RunDir\artifacts\bin\aot\pack\ /e /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Memory.Span&lt;Byte&gt;*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack --aotcompilermode llvm --logBuildOutput --generateBinLog"

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter System.Memory.Span&lt;Byte&gt;* --anyCategories Libraries Runtime " --category-exclusion-filter NoAOT NoWASM --runtimes monoaotllvm --aotcompilerpath $RunDir\artifacts\bin\aot\sgen\mini\mono-sgen.exe --customruntimepack $RunDir\artifacts\bin\aot\pack -aotcompilermode llvm --logBuildOutput --generateBinLog " --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages --buildTimeout 1200
```

</details>

<details>

### System.Memory.Span&lt;Byte&gt;.Clear(Size: 512)

#### ETL Files

#### Histogram

#### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>

Name	Value
Architecture	arm64
OS	ubuntu 22.04
Queue	AmpereUbuntu
Baseline	217525ae6f6a117a0780620ed4fb1b94e03fd4d6
Compare	8fd46b2642bdc4897027901cc5212a1c5ed05020
Diff	Diff
Configs	CompilationMode:tiered, LLVM:true, MonoAOT:true, MonoInterpreter:false, RunKind:micro_mono

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
ReadOnlyMemory - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	211.29 ns	467.41 ns	2.21	0.07	True
Span - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	189.66 ns	443.54 ns	2.34	0.10	True
Memory - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	214.67 ns	467.25 ns	2.18	0.10	True
ReadOnlySpan - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	186.30 ns	442.55 ns	2.38	0.08	True

[mono][Perf] Disabled HAS_CUSTOM_BLOCKS causing regressions on MonoAOT, MonoInterpreter arm64 on 8/23/2024 12:30:35 PM #107308

Description

Run Information

Regressions in System.Collections.CopyTo<Int32>

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

System.Collections.CopyTo<Int32>.ReadOnlyMemory(Size: 2048)

ETL Files

Histogram

JIT Disasms

System.Collections.CopyTo<Int32>.Span(Size: 2048)

ETL Files

Histogram

JIT Disasms

System.Collections.CopyTo<Int32>.Memory(Size: 2048)

ETL Files

Histogram

JIT Disasms

System.Collections.CopyTo<Int32>.ReadOnlySpan(Size: 2048)

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Memory.Span<Char>

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

System.Memory.Span<Char>.Clear(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Run Information

Regressions in System.Memory.Span<Byte>

Repro

Prerequisites (Files either built locally (with build.(sh/cmd) or downloaded from payload above (if same system setup) (in this order))

System.Memory.Span<Byte>.Clear(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions