[Perf] Linux/x64: 8 Regressions on 6/16/2023 8:27:26 PM

### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 18.04
Queue | TigerUbuntu
Baseline | [36439c510b779103a4a8066359d0d63dc003eed3](https://github.com/dotnet/runtime/commit/36439c510b779103a4a8066359d0d63dc003eed3)
Compare | [fe88013164abfd9cfb3e1dc3b518acf4c7c924a9](https://github.com/dotnet/runtime/commit/fe88013164abfd9cfb3e1dc3b518acf4c7c924a9)
Diff | [Diff](https://github.com/dotnet/runtime/compare/36439c510b779103a4a8066359d0d63dc003eed3...fe88013164abfd9cfb3e1dc3b518acf4c7c924a9)
Configs | CompilationMode:tiered, LLVM:false, MonoAOT:false, MonoInterpreter:true, RunKind:micro_mono


### Regressions in System.Numerics.Tests.Perf_VectorOf&lt;Single&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true_RunKind=micro_mono/System.Numerics.Tests.Perf_VectorOf(Single).EqualityOperatorBenchmark.html>) | 21.64 ns | 22.96 ns | 1.06 | 0.25 | False | | |
[GreaterThanAnyBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true_RunKind=micro_mono/System.Numerics.Tests.Perf_VectorOf(Single).GreaterThanAnyBenchmark.html>) | 62.26 ns | 68.61 ns | 1.10 | 0.13 | False | | |
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true_RunKind=micro_mono/System.Numerics.Tests.Perf_VectorOf(Single).LessThanOrEqualAllBenchmark.html>) | 62.93 ns | 67.33 ns | 1.07 | 0.20 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_20_2023/refs/heads/main_x64_ubuntu%2018.04_LLVM%3Dfalse_MonoAOT%3Dfalse_MonoInterpreter%3Dtrue_RunKind%3Dmicro_mono_Regression/System.Numerics.Tests.Perf_VectorOf%28Single%29_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_20_2023/refs/heads/main_x64_ubuntu%2018.04_LLVM%3Dfalse_MonoAOT%3Dfalse_MonoInterpreter%3Dtrue_RunKind%3Dmicro_mono_Regression/System.Numerics.Tests.Perf_VectorOf%28Single%29_2.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_20_2023/refs/heads/main_x64_ubuntu%2018.04_LLVM%3Dfalse_MonoAOT%3Dfalse_MonoInterpreter%3Dtrue_RunKind%3Dmicro_mono_Regression/System.Numerics.Tests.Perf_VectorOf%28Single%29_3.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_20_2023/refs/heads/main_x64_ubuntu%2018.04_LLVM%3Dfalse_MonoAOT%3Dfalse_MonoInterpreter%3Dtrue_RunKind%3Dmicro_mono_Regression/System.Numerics.Tests.Perf_VectorOf%28Single%29.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-483cad49-3e0b-4be5-8c64-759dce2eef82f1193c53ee243b38f/0695374d-02e2-450d-a1cf-5dabf1f290cd.zip?sv=2021-08-06&se=2023-07-16T10%3A25%3A48Z&sr=c&sp=rl&sig=jOHYXShp1wI7PaYB5oLn7fejKzO9DjWHP%2Fh71pOuF5o%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b2f9cb67-23bf-45a2-886b-4167ae73170f6f4cda4b42c464697/b779026b-dced-4704-b0e3-47bc51ac8ad0.zip?sv=2021-08-06&se=2023-07-17T03%3A55%3A30Z&sr=c&sp=rl&sig=1t6SUhrzADBGMli%2BatJ9zcW9vZ5aOIrOKjTY8zyYDEI%3D>)

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Build files either built locally or downloaded from payload above)
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- Mono Runtime build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create mono dotnet
mkdir -p $RunDir/artifacts/dotnet-mono
$RunDir/build.sh -subset libs.pretest -configuration release -ci -arch $RunArch -testscope innerloop /p:RuntimeArtifactsPath=$RunDir/artifacts/bin/mono/$RunOS.$RunArch.Release /p:RuntimeFlavor=mono
cp $RunDir/artifacts/bin/runtime/net8.0-$RunOS-Release-$RunArch/* $RunDir/artifacts/bin/testhost/net8.0-$RunOS-Release-$RunArch/shared/Microsoft.NETCore.App/8.0.0 -rf
cp $RunDir/artifacts/bin/testhost/net8.0-$RunOS-Release-$RunArch/* $RunDir/artifacts/dotnet-mono -r
cp $RunDir/artifacts/bin/coreclr/$RunOS.$RunArch.Release/corerun $RunDir/artifacts/dotnet-mono/shared/Microsoft.NETCore.App/8.0.0/corerun

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# Use Interpreter
export MONO_ENV_OPTIONS="--interpreter"

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Single&gt;*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir/artifacts/dotnet-mono/shared/Microsoft.NETCore.App/8.0.0/corerun" 

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Single&gt;*' --anyCategories Libraries Runtime " --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir/artifacts/dotnet-mono/shared/Microsoft.NETCore.App/8.0.0/corerun --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create mono dotnet
mkdir -p $RunDir/artifacts/dotnet-mono
$RunDir/build.sh -subset libs.pretest -configuration release -ci -arch $RunArch -testscope innerloop /p:RuntimeArtifactsPath=$RunDir\artifacts\bin\mono\$RunOS.$RunArch.Release /p:RuntimeFlavor=mono
xcopy $RunDir\artifacts\bin\runtime\net8.0-$RunOS-Release-$RunArch\ $RunDir\artifacts\bin\testhost\net8.0-$RunOS-Release-$RunArch\shared\Microsoft.NETCore.App\8.0.0\ /e /y
xcopy $RunDir\artifacts\bin\testhost\net8.0-$RunOS-Release-$RunArch\ $RunDir\artifacts\dotnet-mono\ /e /y
xcopy $RunDir\artifacts\bin\coreclr\$RunOS.$RunArch.Release\corerun $RunDir\artifacts\dotnet-mono\shared\Microsoft.NETCore.App\8.0.0\corerun /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# Use Interpreter
export MONO_ENV_OPTIONS="--interpreter"

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Single&gt;*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir\artifacts\dotnet-mono\shared\Microsoft.NETCore.App\8.0.0\corerun.exe" 

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter 'System.Numerics.Tests.Perf_VectorOf&lt;Single&gt;*' --anyCategories Libraries Runtime " --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir\artifacts\dotnet-mono\shared\Microsoft.NETCore.App\8.0.0\corerun.exe --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages
```

</details>

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-483cad49-3e0b-4be5-8c64-759dce2eef82f1193c53ee243b38f/0695374d-02e2-450d-a1cf-5dabf1f290cd.zip?sv=2021-08-06&se=2023-07-16T10%3A25%3A48Z&sr=c&sp=rl&sig=jOHYXShp1wI7PaYB5oLn7fejKzO9DjWHP%2Fh71pOuF5o%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b2f9cb67-23bf-45a2-886b-4167ae73170f6f4cda4b42c464697/b779026b-dced-4704-b0e3-47bc51ac8ad0.zip?sv=2021-08-06&se=2023-07-17T03%3A55%3A30Z&sr=c&sp=rl&sig=1t6SUhrzADBGMli%2BatJ9zcW9vZ5aOIrOKjTY8zyYDEI%3D>)
### Histogram

#### System.Numerics.Tests.Perf_VectorOf&lt;Single&gt;.EqualityOperatorBenchmark

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 22.961168686519844 > 22.432131291200502.
IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 6/16/2023 2:41:30 PM, 6/19/2023 11:51:49 PM falls between 6/10/2023 7:23:52 PM and 6/19/2023 11:51:49 PM.
IsRegressionStdDev: Marked as regression because -5.831365337272258 (T) = (0 -22.90262975301555) / Math.Sqrt((0.306484120536753 / (36)) + (0.7102099924747179 / (10))) is less than -2.0153675744421933 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (36) + (10) - 2, .025) and -0.07736132758342205 = (21.258076716367153 - 22.90262975301555) / 21.258076716367153 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
### JIT Disasms

#### System.Numerics.Tests.Perf_VectorOf&lt;Single&gt;.GreaterThanAnyBenchmark

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 68.61231753296589 > 66.02875994659766.
IsChangePoint: Marked as a change because one of 4/12/2023 9:47:42 AM, 5/10/2023 6:18:38 PM, 6/16/2023 2:41:30 PM, 6/19/2023 11:51:49 PM falls between 6/10/2023 7:23:52 PM and 6/19/2023 11:51:49 PM.
IsRegressionStdDev: Marked as regression because -7.6976253704093285 (T) = (0 -67.65116996465267) / Math.Sqrt((4.406534870498472 / (36)) + (2.1295477212422504 / (10))) is less than -2.0153675744421933 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (36) + (10) - 2, .025) and -0.07054062148429666 = (63.19346375745632 - 67.65116996465267) / 63.19346375745632 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
### JIT Disasms

#### System.Numerics.Tests.Perf_VectorOf&lt;Single&gt;.LessThanOrEqualAllBenchmark

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 67.33174588935339 > 66.04630184495363.
IsChangePoint: Marked as a change because one of 4/24/2023 11:08:13 AM, 4/25/2023 3:46:39 AM, 5/17/2023 3:01:50 AM, 6/19/2023 3:58:06 AM, 6/19/2023 11:51:49 PM falls between 6/10/2023 7:23:52 PM and 6/19/2023 11:51:49 PM.
IsRegressionStdDev: Marked as regression because -6.348309240735888 (T) = (0 -67.66517230770738) / Math.Sqrt((7.801210606213135 / (44)) + (0.2223463529127457 / (2))) is less than -2.0153675744421933 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (2) - 2, .025) and -0.05306407253842166 = (64.25551309959687 - 67.66517230770738) / 64.25551309959687 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 18.04
Queue | TigerUbuntu
Baseline | [36439c510b779103a4a8066359d0d63dc003eed3](https://github.com/dotnet/runtime/commit/36439c510b779103a4a8066359d0d63dc003eed3)
Compare | [fe88013164abfd9cfb3e1dc3b518acf4c7c924a9](https://github.com/dotnet/runtime/commit/fe88013164abfd9cfb3e1dc3b518acf4c7c924a9)
Diff | [Diff](https://github.com/dotnet/runtime/compare/36439c510b779103a4a8066359d0d63dc003eed3...fe88013164abfd9cfb3e1dc3b518acf4c7c924a9)
Configs | CompilationMode:tiered, LLVM:false, MonoAOT:false, MonoInterpreter:true, RunKind:micro_mono


### Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true_RunKind=micro_mono/System.Runtime.Intrinsics.Tests.Perf_Vector128Of(Single).LessThanAllBenchmark.html>) | 26.32 ns | 28.81 ns | 1.09 | 0.18 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_20_2023/refs/heads/main_x64_ubuntu%2018.04_LLVM%3Dfalse_MonoAOT%3Dfalse_MonoInterpreter%3Dtrue_RunKind%3Dmicro_mono_Regression/System.Runtime.Intrinsics.Tests.Perf_Vector128Of%28Single%29_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_20_2023/refs/heads/main_x64_ubuntu%2018.04_LLVM%3Dfalse_MonoAOT%3Dfalse_MonoInterpreter%3Dtrue_RunKind%3Dmicro_mono_Regression/System.Runtime.Intrinsics.Tests.Perf_Vector128Of%28Single%29.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-483cad49-3e0b-4be5-8c64-759dce2eef82f1193c53ee243b38f/0695374d-02e2-450d-a1cf-5dabf1f290cd.zip?sv=2021-08-06&se=2023-07-16T10%3A25%3A48Z&sr=c&sp=rl&sig=jOHYXShp1wI7PaYB5oLn7fejKzO9DjWHP%2Fh71pOuF5o%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b2f9cb67-23bf-45a2-886b-4167ae73170f6f4cda4b42c464697/b779026b-dced-4704-b0e3-47bc51ac8ad0.zip?sv=2021-08-06&se=2023-07-17T03%3A55%3A30Z&sr=c&sp=rl&sig=1t6SUhrzADBGMli%2BatJ9zcW9vZ5aOIrOKjTY8zyYDEI%3D>)

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Build files either built locally or downloaded from payload above)
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- Mono Runtime build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create mono dotnet
mkdir -p $RunDir/artifacts/dotnet-mono
$RunDir/build.sh -subset libs.pretest -configuration release -ci -arch $RunArch -testscope innerloop /p:RuntimeArtifactsPath=$RunDir/artifacts/bin/mono/$RunOS.$RunArch.Release /p:RuntimeFlavor=mono
cp $RunDir/artifacts/bin/runtime/net8.0-$RunOS-Release-$RunArch/* $RunDir/artifacts/bin/testhost/net8.0-$RunOS-Release-$RunArch/shared/Microsoft.NETCore.App/8.0.0 -rf
cp $RunDir/artifacts/bin/testhost/net8.0-$RunOS-Release-$RunArch/* $RunDir/artifacts/dotnet-mono -r
cp $RunDir/artifacts/bin/coreclr/$RunOS.$RunArch.Release/corerun $RunDir/artifacts/dotnet-mono/shared/Microsoft.NETCore.App/8.0.0/corerun

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# Use Interpreter
export MONO_ENV_OPTIONS="--interpreter"

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir/artifacts/dotnet-mono/shared/Microsoft.NETCore.App/8.0.0/corerun" 

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;*' --anyCategories Libraries Runtime " --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir/artifacts/dotnet-mono/shared/Microsoft.NETCore.App/8.0.0/corerun --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create mono dotnet
mkdir -p $RunDir/artifacts/dotnet-mono
$RunDir/build.sh -subset libs.pretest -configuration release -ci -arch $RunArch -testscope innerloop /p:RuntimeArtifactsPath=$RunDir\artifacts\bin\mono\$RunOS.$RunArch.Release /p:RuntimeFlavor=mono
xcopy $RunDir\artifacts\bin\runtime\net8.0-$RunOS-Release-$RunArch\ $RunDir\artifacts\bin\testhost\net8.0-$RunOS-Release-$RunArch\shared\Microsoft.NETCore.App\8.0.0\ /e /y
xcopy $RunDir\artifacts\bin\testhost\net8.0-$RunOS-Release-$RunArch\ $RunDir\artifacts\dotnet-mono\ /e /y
xcopy $RunDir\artifacts\bin\coreclr\$RunOS.$RunArch.Release\corerun $RunDir\artifacts\dotnet-mono\shared\Microsoft.NETCore.App\8.0.0\corerun /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# Use Interpreter
export MONO_ENV_OPTIONS="--interpreter"

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir\artifacts\dotnet-mono\shared\Microsoft.NETCore.App\8.0.0\corerun.exe" 

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;*' --anyCategories Libraries Runtime " --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir\artifacts\dotnet-mono\shared\Microsoft.NETCore.App\8.0.0\corerun.exe --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages
```

</details>

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-483cad49-3e0b-4be5-8c64-759dce2eef82f1193c53ee243b38f/0695374d-02e2-450d-a1cf-5dabf1f290cd.zip?sv=2021-08-06&se=2023-07-16T10%3A25%3A48Z&sr=c&sp=rl&sig=jOHYXShp1wI7PaYB5oLn7fejKzO9DjWHP%2Fh71pOuF5o%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b2f9cb67-23bf-45a2-886b-4167ae73170f6f4cda4b42c464697/b779026b-dced-4704-b0e3-47bc51ac8ad0.zip?sv=2021-08-06&se=2023-07-17T03%3A55%3A30Z&sr=c&sp=rl&sig=1t6SUhrzADBGMli%2BatJ9zcW9vZ5aOIrOKjTY8zyYDEI%3D>)
### Histogram

#### System.Runtime.Intrinsics.Tests.Perf_Vector128Of&lt;Single&gt;.LessThanAllBenchmark

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.805491638127933 > 27.573140366158334.
IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 6/16/2023 2:41:30 PM, 6/19/2023 11:51:49 PM falls between 6/10/2023 7:23:52 PM and 6/19/2023 11:51:49 PM.
IsRegressionStdDev: Marked as regression because -7.9461206887734495 (T) = (0 -28.880167007472465) / Math.Sqrt((1.8678247215266321 / (36)) + (0.2253488184664335 / (10))) is less than -2.0153675744421933 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (36) + (10) - 2, .025) and -0.08114889170573276 = (26.71247894626994 - 28.880167007472465) / 26.71247894626994 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 18.04
Queue | TigerUbuntu
Baseline | [36439c510b779103a4a8066359d0d63dc003eed3](https://github.com/dotnet/runtime/commit/36439c510b779103a4a8066359d0d63dc003eed3)
Compare | [fe88013164abfd9cfb3e1dc3b518acf4c7c924a9](https://github.com/dotnet/runtime/commit/fe88013164abfd9cfb3e1dc3b518acf4c7c924a9)
Diff | [Diff](https://github.com/dotnet/runtime/compare/36439c510b779103a4a8066359d0d63dc003eed3...fe88013164abfd9cfb3e1dc3b518acf4c7c924a9)
Configs | CompilationMode:tiered, LLVM:false, MonoAOT:false, MonoInterpreter:true, RunKind:micro_mono


### Regressions in System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[SingleSerial - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true_RunKind=micro_mono/System.Buffers.Tests.RentReturnArrayPoolTests(Byte).SingleSerial(RentalSize%3a%204096%2c%20ManipulateArray%3a%20False%2c%20Async%3a%20False%2c%20UseSharedPool%3a%20False).html>) | 267.85 ns | 315.11 ns | 1.18 | 0.18 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_20_2023/refs/heads/main_x64_ubuntu%2018.04_LLVM%3Dfalse_MonoAOT%3Dfalse_MonoInterpreter%3Dtrue_RunKind%3Dmicro_mono_Regression/System.Buffers.Tests.RentReturnArrayPoolTests%28Byte%29_1.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_20_2023/refs/heads/main_x64_ubuntu%2018.04_LLVM%3Dfalse_MonoAOT%3Dfalse_MonoInterpreter%3Dtrue_RunKind%3Dmicro_mono_Regression/System.Buffers.Tests.RentReturnArrayPoolTests%28Byte%29.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-483cad49-3e0b-4be5-8c64-759dce2eef82f1193c53ee243b38f/0695374d-02e2-450d-a1cf-5dabf1f290cd.zip?sv=2021-08-06&se=2023-07-16T10%3A25%3A48Z&sr=c&sp=rl&sig=jOHYXShp1wI7PaYB5oLn7fejKzO9DjWHP%2Fh71pOuF5o%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b2f9cb67-23bf-45a2-886b-4167ae73170f6f4cda4b42c464697/b779026b-dced-4704-b0e3-47bc51ac8ad0.zip?sv=2021-08-06&se=2023-07-17T03%3A55%3A30Z&sr=c&sp=rl&sig=1t6SUhrzADBGMli%2BatJ9zcW9vZ5aOIrOKjTY8zyYDEI%3D>)

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Build files either built locally or downloaded from payload above)
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- Mono Runtime build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create mono dotnet
mkdir -p $RunDir/artifacts/dotnet-mono
$RunDir/build.sh -subset libs.pretest -configuration release -ci -arch $RunArch -testscope innerloop /p:RuntimeArtifactsPath=$RunDir/artifacts/bin/mono/$RunOS.$RunArch.Release /p:RuntimeFlavor=mono
cp $RunDir/artifacts/bin/runtime/net8.0-$RunOS-Release-$RunArch/* $RunDir/artifacts/bin/testhost/net8.0-$RunOS-Release-$RunArch/shared/Microsoft.NETCore.App/8.0.0 -rf
cp $RunDir/artifacts/bin/testhost/net8.0-$RunOS-Release-$RunArch/* $RunDir/artifacts/dotnet-mono -r
cp $RunDir/artifacts/bin/coreclr/$RunOS.$RunArch.Release/corerun $RunDir/artifacts/dotnet-mono/shared/Microsoft.NETCore.App/8.0.0/corerun

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# Use Interpreter
export MONO_ENV_OPTIONS="--interpreter"

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir/artifacts/dotnet-mono/shared/Microsoft.NETCore.App/8.0.0/corerun" 

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*' --anyCategories Libraries Runtime " --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir/artifacts/dotnet-mono/shared/Microsoft.NETCore.App/8.0.0/corerun --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create mono dotnet
mkdir -p $RunDir/artifacts/dotnet-mono
$RunDir/build.sh -subset libs.pretest -configuration release -ci -arch $RunArch -testscope innerloop /p:RuntimeArtifactsPath=$RunDir\artifacts\bin\mono\$RunOS.$RunArch.Release /p:RuntimeFlavor=mono
xcopy $RunDir\artifacts\bin\runtime\net8.0-$RunOS-Release-$RunArch\ $RunDir\artifacts\bin\testhost\net8.0-$RunOS-Release-$RunArch\shared\Microsoft.NETCore.App\8.0.0\ /e /y
xcopy $RunDir\artifacts\bin\testhost\net8.0-$RunOS-Release-$RunArch\ $RunDir\artifacts\dotnet-mono\ /e /y
xcopy $RunDir\artifacts\bin\coreclr\$RunOS.$RunArch.Release\corerun $RunDir\artifacts\dotnet-mono\shared\Microsoft.NETCore.App\8.0.0\corerun /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# Use Interpreter
export MONO_ENV_OPTIONS="--interpreter"

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir\artifacts\dotnet-mono\shared\Microsoft.NETCore.App\8.0.0\corerun.exe" 

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*' --anyCategories Libraries Runtime " --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir\artifacts\dotnet-mono\shared\Microsoft.NETCore.App\8.0.0\corerun.exe --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages
```

</details>

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-483cad49-3e0b-4be5-8c64-759dce2eef82f1193c53ee243b38f/0695374d-02e2-450d-a1cf-5dabf1f290cd.zip?sv=2021-08-06&se=2023-07-16T10%3A25%3A48Z&sr=c&sp=rl&sig=jOHYXShp1wI7PaYB5oLn7fejKzO9DjWHP%2Fh71pOuF5o%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b2f9cb67-23bf-45a2-886b-4167ae73170f6f4cda4b42c464697/b779026b-dced-4704-b0e3-47bc51ac8ad0.zip?sv=2021-08-06&se=2023-07-17T03%3A55%3A30Z&sr=c&sp=rl&sig=1t6SUhrzADBGMli%2BatJ9zcW9vZ5aOIrOKjTY8zyYDEI%3D>)
### Histogram

#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 315.1092134166666 > 275.02870830929487.
IsChangePoint: Marked as a change because one of 5/10/2023 2:00:36 PM, 6/16/2023 2:41:30 PM, 6/19/2023 11:51:49 PM falls between 6/10/2023 7:23:52 PM and 6/19/2023 11:51:49 PM.
IsRegressionStdDev: Marked as regression because -15.112362724225259 (T) = (0 -309.7821110517857) / Math.Sqrt((80.4990897068865 / (36)) + (87.61268256606785 / (10))) is less than -2.0153675744421933 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (36) + (10) - 2, .025) and -0.19300173508430907 = (259.6661026900296 - 309.7821110517857) / 259.6661026900296 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


---


### Run Information

Name | Value
-- | --
Architecture | x64
OS | ubuntu 18.04
Queue | TigerUbuntu
Baseline | [36439c510b779103a4a8066359d0d63dc003eed3](https://github.com/dotnet/runtime/commit/36439c510b779103a4a8066359d0d63dc003eed3)
Compare | [fe88013164abfd9cfb3e1dc3b518acf4c7c924a9](https://github.com/dotnet/runtime/commit/fe88013164abfd9cfb3e1dc3b518acf4c7c924a9)
Diff | [Diff](https://github.com/dotnet/runtime/compare/36439c510b779103a4a8066359d0d63dc003eed3...fe88013164abfd9cfb3e1dc3b518acf4c7c924a9)
Configs | CompilationMode:tiered, LLVM:false, MonoAOT:false, MonoInterpreter:true, RunKind:micro_mono


### Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Float

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[EqualityOperatorBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true_RunKind=micro_mono/System.Runtime.Intrinsics.Tests.Perf_Vector128Float.EqualityOperatorBenchmark.html>) | 26.30 ns | 28.71 ns | 1.09 | 0.17 | False | | |
[LessThanAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true_RunKind=micro_mono/System.Runtime.Intrinsics.Tests.Perf_Vector128Float.LessThanAllBenchmark.html>) | 26.23 ns | 28.77 ns | 1.10 | 0.22 | False | | |
[LessThanOrEqualAllBenchmark - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04_LLVM=false_MonoAOT=false_MonoInterpreter=true_RunKind=micro_mono/System.Runtime.Intrinsics.Tests.Perf_Vector128Float.LessThanOrEqualAllBenchmark.html>) | 26.96 ns | 28.64 ns | 1.06 | 0.23 | False | | |

![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_20_2023/refs/heads/main_x64_ubuntu%2018.04_LLVM%3Dfalse_MonoAOT%3Dfalse_MonoInterpreter%3Dtrue_RunKind%3Dmicro_mono_Regression/System.Runtime.Intrinsics.Tests.Perf_Vector128Float_1.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_20_2023/refs/heads/main_x64_ubuntu%2018.04_LLVM%3Dfalse_MonoAOT%3Dfalse_MonoInterpreter%3Dtrue_RunKind%3Dmicro_mono_Regression/System.Runtime.Intrinsics.Tests.Perf_Vector128Float_2.png>)
![graph](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_20_2023/refs/heads/main_x64_ubuntu%2018.04_LLVM%3Dfalse_MonoAOT%3Dfalse_MonoInterpreter%3Dtrue_RunKind%3Dmicro_mono_Regression/System.Runtime.Intrinsics.Tests.Perf_Vector128Float_3.png>)
[Test Report](<https://pvscmdupload.z22.web.core.windows.net/autofilereport/autofilereports/06_20_2023/refs/heads/main_x64_ubuntu%2018.04_LLVM%3Dfalse_MonoAOT%3Dfalse_MonoInterpreter%3Dtrue_RunKind%3Dmicro_mono_Regression/System.Runtime.Intrinsics.Tests.Perf_Vector128Float.html>)

### Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-483cad49-3e0b-4be5-8c64-759dce2eef82f1193c53ee243b38f/0695374d-02e2-450d-a1cf-5dabf1f290cd.zip?sv=2021-08-06&se=2023-07-16T10%3A25%3A48Z&sr=c&sp=rl&sig=jOHYXShp1wI7PaYB5oLn7fejKzO9DjWHP%2Fh71pOuF5o%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b2f9cb67-23bf-45a2-886b-4167ae73170f6f4cda4b42c464697/b779026b-dced-4704-b0e3-47bc51ac8ad0.zip?sv=2021-08-06&se=2023-07-17T03%3A55%3A30Z&sr=c&sp=rl&sig=1t6SUhrzADBGMli%2BatJ9zcW9vZ5aOIrOKjTY8zyYDEI%3D>)

<details>
   <summary>Repro Steps</summary>


#### Prerequisites (Build files either built locally or downloaded from payload above)
- Libraries build extracted to `runtime/artifacts` or build instructions: [Libraries README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/libraries/README.md) args: `-subset libs+libs.tests -rc release -configuration Release -arch $RunArch -framework net8.0`
- CoreCLR product build extracted to `runtime/artifacts/bin/coreclr/$RunOS.$RunArch.Release`, build instructions: [CoreCLR README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/coreclr/README.md) args: `-subset clr+libs -rc release -configuration Release -arch $RunArch -framework net8.0`
- Mono Runtime build extracted to `runtime/artifacts/bin/mono/$RunOS.$RunArch.Release`, build instructions: [MONO README](https://github.com/dotnet/runtime/blob/main/docs/workflow/building/mono/README.md) args: `-arch $RunArch -os $RunOS -s mono+libs+host+packs -c Release`
- Dotnet SDK installed for dotnet commands
- Running commands from the runtime folder

Linux
```cmd
# Set $RunDir to the runtime directory
RunDir=`pwd`

# Set the OS, arch, and OSId
RunOS='linux'
RunOSId='linux'
RunArch='x64'

# Create mono dotnet
mkdir -p $RunDir/artifacts/dotnet-mono
$RunDir/build.sh -subset libs.pretest -configuration release -ci -arch $RunArch -testscope innerloop /p:RuntimeArtifactsPath=$RunDir/artifacts/bin/mono/$RunOS.$RunArch.Release /p:RuntimeFlavor=mono
cp $RunDir/artifacts/bin/runtime/net8.0-$RunOS-Release-$RunArch/* $RunDir/artifacts/bin/testhost/net8.0-$RunOS-Release-$RunArch/shared/Microsoft.NETCore.App/8.0.0 -rf
cp $RunDir/artifacts/bin/testhost/net8.0-$RunOS-Release-$RunArch/* $RunDir/artifacts/dotnet-mono -r
cp $RunDir/artifacts/bin/coreclr/$RunOS.$RunArch.Release/corerun $RunDir/artifacts/dotnet-mono/shared/Microsoft.NETCore.App/8.0.0/corerun

# Create Core Root
$RunDir/src/tests/build.sh release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir/performance

# Use Interpreter
export MONO_ENV_OPTIONS="--interpreter"

# One line run:
python3 $RunDir/performance/scripts/benchmarks_ci.py --csproj $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Float*' --bdn-artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir/artifacts/dotnet-mono/shared/Microsoft.NETCore.App/8.0.0/corerun" 

# Individual Commands:
# Restore 
dotnet restore $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --packages $RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir/performance/artifacts/packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir/performance/src/benchmarks/micro/MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Float*' --anyCategories Libraries Runtime " --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir/artifacts/dotnet-mono/shared/Microsoft.NETCore.App/8.0.0/corerun --artifacts $RunDir/artifacts/BenchmarkDotNet.Artifacts --packages $RunDir/performance/artifacts/packages
```

Windows
```cmd
# Set $RunDir to the runtime directory
$RunDir="FullPathHere"

# Set the OS, arch, and OSId
RunOS='windows'
RunOSId='win'
RunArch='x64'

# Create mono dotnet
mkdir -p $RunDir/artifacts/dotnet-mono
$RunDir/build.sh -subset libs.pretest -configuration release -ci -arch $RunArch -testscope innerloop /p:RuntimeArtifactsPath=$RunDir\artifacts\bin\mono\$RunOS.$RunArch.Release /p:RuntimeFlavor=mono
xcopy $RunDir\artifacts\bin\runtime\net8.0-$RunOS-Release-$RunArch\ $RunDir\artifacts\bin\testhost\net8.0-$RunOS-Release-$RunArch\shared\Microsoft.NETCore.App\8.0.0\ /e /y
xcopy $RunDir\artifacts\bin\testhost\net8.0-$RunOS-Release-$RunArch\ $RunDir\artifacts\dotnet-mono\ /e /y
xcopy $RunDir\artifacts\bin\coreclr\$RunOS.$RunArch.Release\corerun $RunDir\artifacts\dotnet-mono\shared\Microsoft.NETCore.App\8.0.0\corerun /y

# Create Core Root
$RunDir\src\tests\build.cmd release $RunArch generatelayoutonly /p:LibrariesConfiguration=Release

# Clone performance 
git clone --branch main --depth 1 --quiet https://github.com/dotnet/performance.git $RunDir\performance

# Use Interpreter
export MONO_ENV_OPTIONS="--interpreter"

# One line run:
python3 $RunDir\performance\scripts\benchmarks_ci.py --csproj $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --incremental no --architecture $RunArch -f net8.0 --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Float*' --bdn-artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --bdn-arguments="--anyCategories Libraries Runtime  --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir\artifacts\dotnet-mono\shared\Microsoft.NETCore.App\8.0.0\corerun.exe" 

# Individual Commands:
# Restore 
dotnet restore $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --packages $RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Build
dotnet build $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore /p:NuGetPackageRoot=$RunDir\performance\artifacts\packages /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1

# Run
dotnet run --project $RunDir\performance\src\benchmarks\micro\MicroBenchmarks.csproj --configuration Release --framework net8.0 --no-restore --no-build -- --filter 'System.Runtime.Intrinsics.Tests.Perf_Vector128Float*' --anyCategories Libraries Runtime " --category-exclusion-filter NoInterpreter NoMono --logBuildOutput --generateBinLog --corerun $RunDir\artifacts\dotnet-mono\shared\Microsoft.NETCore.App\8.0.0\corerun.exe --artifacts $RunDir\artifacts\BenchmarkDotNet.Artifacts --packages $RunDir\performance\artifacts\packages
```

</details>

<details>


### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-483cad49-3e0b-4be5-8c64-759dce2eef82f1193c53ee243b38f/0695374d-02e2-450d-a1cf-5dabf1f290cd.zip?sv=2021-08-06&se=2023-07-16T10%3A25%3A48Z&sr=c&sp=rl&sig=jOHYXShp1wI7PaYB5oLn7fejKzO9DjWHP%2Fh71pOuF5o%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-b2f9cb67-23bf-45a2-886b-4167ae73170f6f4cda4b42c464697/b779026b-dced-4704-b0e3-47bc51ac8ad0.zip?sv=2021-08-06&se=2023-07-17T03%3A55%3A30Z&sr=c&sp=rl&sig=1t6SUhrzADBGMli%2BatJ9zcW9vZ5aOIrOKjTY8zyYDEI%3D>)
### Histogram

#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.EqualityOperatorBenchmark

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.707390845588364 > 27.58754357490882.
IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 6/16/2023 2:41:30 PM, 6/19/2023 11:51:49 PM falls between 6/10/2023 7:23:52 PM and 6/19/2023 11:51:49 PM.
IsRegressionStdDev: Marked as regression because -12.335355825724324 (T) = (0 -28.913156983676537) / Math.Sqrt((0.6035135420148112 / (36)) + (0.18129989453805523 / (10))) is less than -2.0153675744421933 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (36) + (10) - 2, .025) and -0.08659673661870154 = (26.608912036354177 - 28.913156983676537) / 26.608912036354177 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
### JIT Disasms

#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.LessThanAllBenchmark

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.769153340153522 > 27.532722200242173.
IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 6/16/2023 8:17:59 AM, 6/19/2023 11:51:49 PM falls between 6/10/2023 7:23:52 PM and 6/19/2023 11:51:49 PM.
IsRegressionStdDev: Marked as regression because -10.936492515665709 (T) = (0 -28.767043470051384) / Math.Sqrt((1.2274493625523875 / (35)) + (0.027984293045073584 / (11))) is less than -2.0153675744421933 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (35) + (11) - 2, .025) and -0.07960147366782658 = (26.64598388544111 - 28.767043470051384) / 26.64598388544111 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
### JIT Disasms

#### System.Runtime.Intrinsics.Tests.Perf_Vector128Float.LessThanOrEqualAllBenchmark

```log

```
### Description of detection logic
```
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 28.642428461395763 > 27.443418880279985.
IsChangePoint: Marked as a change because one of 4/12/2023 4:44:56 PM, 6/18/2023 10:20:40 PM, 6/19/2023 11:51:49 PM falls between 6/10/2023 7:23:52 PM and 6/19/2023 11:51:49 PM.
IsRegressionStdDev: Marked as regression because -3.837727332803318 (T) = (0 -29.478033113777077) / Math.Sqrt((1.399931135063203 / (43)) + (1.1942598470451902 / (3))) is less than -2.0153675744421933 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (3) - 2, .025) and -0.09341565755058069 = (26.959585689318192 - 29.478033113777077) / 26.959585689318192 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```
### JIT Disasms



### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>

Name	Value
Architecture	x64
OS	ubuntu 18.04
Queue	TigerUbuntu
Baseline	36439c510b779103a4a8066359d0d63dc003eed3
Compare	fe88013164abfd9cfb3e1dc3b518acf4c7c924a9
Diff	Diff
Configs	CompilationMode:tiered, LLVM:false, MonoAOT:false, MonoInterpreter:true, RunKind:micro_mono

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
EqualityOperatorBenchmark - Duration of single invocation	21.64 ns	22.96 ns	1.06	0.25	False
GreaterThanAnyBenchmark - Duration of single invocation	62.26 ns	68.61 ns	1.10	0.13	False
LessThanOrEqualAllBenchmark - Duration of single invocation	62.93 ns	67.33 ns	1.07	0.20	False

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector
EqualityOperatorBenchmark - Duration of single invocation	26.30 ns	28.71 ns	1.09	0.17	False
LessThanAllBenchmark - Duration of single invocation	26.23 ns	28.77 ns	1.10	0.22	False
LessThanOrEqualAllBenchmark - Duration of single invocation	26.96 ns	28.64 ns	1.06	0.23	False

[Perf] Linux/x64: 8 Regressions on 6/16/2023 8:27:26 PM #19018

Description

Run Information

Regressions in System.Numerics.Tests.Perf_VectorOf<Single>

Repro

Payloads

Prerequisites (Build files either built locally or downloaded from payload above)

Payloads

Histogram

System.Numerics.Tests.Perf_VectorOf<Single>.EqualityOperatorBenchmark

Description of detection logic

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.GreaterThanAnyBenchmark

Description of detection logic

JIT Disasms

System.Numerics.Tests.Perf_VectorOf<Single>.LessThanOrEqualAllBenchmark

Description of detection logic

JIT Disasms

Docs

Run Information

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>

Repro

Payloads

Prerequisites (Build files either built locally or downloaded from payload above)

Payloads

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Of<Single>.LessThanAllBenchmark

Description of detection logic

JIT Disasms

Docs

Run Information

Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

Repro

Payloads

Prerequisites (Build files either built locally or downloaded from payload above)

Payloads

Histogram

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleSerial(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)

Description of detection logic

JIT Disasms

Docs

Run Information

Regressions in System.Runtime.Intrinsics.Tests.Perf_Vector128Float

Repro

Payloads

Prerequisites (Build files either built locally or downloaded from payload above)

Payloads

Histogram

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.EqualityOperatorBenchmark

Description of detection logic

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.LessThanAllBenchmark

Description of detection logic

JIT Disasms

System.Runtime.Intrinsics.Tests.Perf_Vector128Float.LessThanOrEqualAllBenchmark

Description of detection logic

JIT Disasms

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions