Regression from hoisting out of nested loop

### Run Information

Architecture | x64
-- | --
OS | ubuntu 18.04
Baseline | [e5acd4dfd7b31ed790687e9f3da642fe1c964dc3](https://github.com/dotnet/runtime/commit/e5acd4dfd7b31ed790687e9f3da642fe1c964dc3)
Compare | [261574bf4121b40c7023c73571fb7a690397bd0f](https://github.com/dotnet/runtime/commit/261574bf4121b40c7023c73571fb7a690397bd0f)
Diff | [Diff](https://github.com/dotnet/runtime/compare/e5acd4dfd7b31ed790687e9f3da642fe1c964dc3...261574bf4121b40c7023c73571fb7a690397bd0f)


### Regressions in Benchstone.MDBenchI.MDGeneralArray

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Test - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/Benchstone.MDBenchI.MDGeneralArray.Test.html>) | 13.31 ms | 16.47 ms | 1.24 | 0.00 | False | | |
[Test2 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/Benchstone.MDBenchI.MDGeneralArray.Test2.html>) | 13.21 ms | 16.47 ms | 1.25 | 0.00 | False | | |

![graph](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/06_21_2022/refs/heads/main_x64_ubuntu%2018.04_Regression/Benchstone.MDBenchI.MDGeneralArray_1.png>)
![graph](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/06_21_2022/refs/heads/main_x64_ubuntu%2018.04_Regression/Benchstone.MDBenchI.MDGeneralArray_2.png>)
[Test Report](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/06_21_2022/refs/heads/main_x64_ubuntu%2018.04_Regression/Benchstone.MDBenchI.MDGeneralArray.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.MDBenchI.MDGeneralArray*'
```
<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-2c2522e5-bad2-4bc6-af3f-e1341acb859173822126bfe4aadbd/01e65af7-6b8d-48c9-93d4-962702eed215.zip?sv=2019-07-07&se=2022-07-14T09%3A32%3A48Z&sr=c&sp=rl&sig=cLIhYrSvZNhLp5vqCWRntxet9u0Eny2d0QJ4aJ48M%2Bc%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-130c437b-0f74-4db2-9348-bb2b88b53a8f8fbfdfcfb2e44bb8a/b712f5d6-f730-43a5-bb2f-30cf57fbc135.zip?sv=2019-07-07&se=2022-07-14T19%3A08%3A24Z&sr=c&sp=rl&sig=TWPP%2Fxp8aOTYtcwyN1zXRZtGBkCMo2%2F6B1koCeUWj5I%3D>)
### Histogram

#### Benchstone.MDBenchI.MDGeneralArray.Test

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.47376638701923 > 13.9781989521875.
IsChangePoint: Marked as a change because one of 6/14/2022 10:05:19 AM, 6/21/2022 6:07:15 AM falls between 6/12/2022 5:56:07 PM and 6/21/2022 6:07:15 AM.
IsRegressionStdDev: Marked as regression because -367.3133210148429 (T) = (0 -16562240.309642797) / Math.Sqrt((970113886.8242489 / (30)) + (1800460994.5065267 / (39))) is less than -1.9960083540247138 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (39) - 2, .025) and -0.24455339319226346 = (13307778.03526843 - 16562240.309642797) / 13307778.03526843 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Benchstone.MDBenchI.MDGeneralArray.Test2

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 16.472966578125 > 13.863741196189906.
IsChangePoint: Marked as a change because one of 6/14/2022 10:05:19 AM, 6/21/2022 6:07:15 AM falls between 6/12/2022 5:56:07 PM and 6/21/2022 6:07:15 AM.
IsRegressionStdDev: Marked as regression because -314.5082831379247 (T) = (0 -16561237.119994191) / Math.Sqrt((2077293600.8144262 / (30)) + (1676453099.0390358 / (39))) is less than -1.9960083540247138 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (39) - 2, .025) and -0.2518517315082016 = (13229391.870586464 - 16561237.119994191) / 13229391.870586464 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>
### Run Information

Architecture | x64
-- | --
OS | ubuntu 18.04
Baseline | [e5acd4dfd7b31ed790687e9f3da642fe1c964dc3](https://github.com/dotnet/runtime/commit/e5acd4dfd7b31ed790687e9f3da642fe1c964dc3)
Compare | [261574bf4121b40c7023c73571fb7a690397bd0f](https://github.com/dotnet/runtime/commit/261574bf4121b40c7023c73571fb7a690397bd0f)
Diff | [Diff](https://github.com/dotnet/runtime/compare/e5acd4dfd7b31ed790687e9f3da642fe1c964dc3...261574bf4121b40c7023c73571fb7a690397bd0f)


### Regressions in Burgers

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Test3 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/Burgers.Test3.html>) | 87.95 ms | 115.96 ms | 1.32 | 0.08 | False | | |
[Test1 - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/Burgers.Test1.html>) | 170.74 ms | 261.06 ms | 1.53 | 0.00 | False | | |

![graph](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/06_21_2022/refs/heads/main_x64_ubuntu%2018.04_Regression/Burgers_1.png>)
![graph](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/06_21_2022/refs/heads/main_x64_ubuntu%2018.04_Regression/Burgers_2.png>)
[Test Report](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/06_21_2022/refs/heads/main_x64_ubuntu%2018.04_Regression/Burgers.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Burgers*'
```
<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-2c2522e5-bad2-4bc6-af3f-e1341acb859173822126bfe4aadbd/01e65af7-6b8d-48c9-93d4-962702eed215.zip?sv=2019-07-07&se=2022-07-14T09%3A32%3A48Z&sr=c&sp=rl&sig=cLIhYrSvZNhLp5vqCWRntxet9u0Eny2d0QJ4aJ48M%2Bc%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-130c437b-0f74-4db2-9348-bb2b88b53a8f8fbfdfcfb2e44bb8a/b712f5d6-f730-43a5-bb2f-30cf57fbc135.zip?sv=2019-07-07&se=2022-07-14T19%3A08%3A24Z&sr=c&sp=rl&sig=TWPP%2Fxp8aOTYtcwyN1zXRZtGBkCMo2%2F6B1koCeUWj5I%3D>)
### Histogram

#### Burgers.Test3

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 115.955026975 > 92.70167878125.
IsChangePoint: Marked as a change because one of 6/14/2022 10:05:19 AM, 6/21/2022 6:07:15 AM falls between 6/12/2022 5:56:07 PM and 6/21/2022 6:07:15 AM.
IsRegressionStdDev: Marked as regression because -76.86974915808065 (T) = (0 -117696004.90405983) / Math.Sqrt((712968655004.949 / (30)) + (4743413455200.672 / (39))) is less than -1.9960083540247138 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (39) - 2, .025) and -0.3316230571523148 = (88385376.23083334 - 117696004.90405983) / 88385376.23083334 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### Burgers.Test1

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 261.05918285714284 > 179.29468991538465.
IsChangePoint: Marked as a change because one of 6/14/2022 10:05:19 AM, 6/21/2022 6:07:15 AM falls between 6/12/2022 5:56:07 PM and 6/21/2022 6:07:15 AM.
IsRegressionStdDev: Marked as regression because -1718.0951023682271 (T) = (0 -261284212.0427163) / Math.Sqrt((23363070275.099754 / (30)) + (77899970943.01614 / (39))) is less than -1.9960083540247138 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (39) - 2, .025) and -0.530140609621464 = (170758301.8186508 - 261284212.0427163) / 170758301.8186508 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>


### Run Information

Architecture | x64
-- | --
OS | ubuntu 18.04
Baseline | [e5acd4dfd7b31ed790687e9f3da642fe1c964dc3](https://github.com/dotnet/runtime/commit/e5acd4dfd7b31ed790687e9f3da642fe1c964dc3)
Compare | [261574bf4121b40c7023c73571fb7a690397bd0f](https://github.com/dotnet/runtime/commit/261574bf4121b40c7023c73571fb7a690397bd0f)
Diff | [Diff](https://github.com/dotnet/runtime/compare/e5acd4dfd7b31ed790687e9f3da642fe1c964dc3...261574bf4121b40c7023c73571fb7a690397bd0f)


### Regressions in Benchstone.BenchI.Array2

Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio | Baseline ETL | Compare ETL
-- | -- | -- | -- | -- | -- | -- | -- | -- | -- | --
[Test - Duration of single invocation](<https://pvscmdupload.blob.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 18.04/Benchstone.BenchI.Array2.Test.html>) | 679.53 ms | 906.73 ms | 1.33 | 0.00 | False | | |

![graph](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/06_21_2022/refs/heads/main_x64_ubuntu%2018.04_Regression/Benchstone.BenchI.Array2_1.png>)
[Test Report](<https://pvscmdupload.blob.core.windows.net/autofilereport/autofilereports/06_21_2022/refs/heads/main_x64_ubuntu%2018.04_Regression/Benchstone.BenchI.Array2.html>)

### Repro

```cmd
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchI.Array2*'
```
<details>

### Payloads

[Baseline](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-2c2522e5-bad2-4bc6-af3f-e1341acb859173822126bfe4aadbd/01e65af7-6b8d-48c9-93d4-962702eed215.zip?sv=2019-07-07&se=2022-07-14T09%3A32%3A48Z&sr=c&sp=rl&sig=cLIhYrSvZNhLp5vqCWRntxet9u0Eny2d0QJ4aJ48M%2Bc%3D>)
[Compare](<https://helixdi107v0xdeko0k025g8.blob.core.windows.net/helix-job-130c437b-0f74-4db2-9348-bb2b88b53a8f8fbfdfcfb2e44bb8a/b712f5d6-f730-43a5-bb2f-30cf57fbc135.zip?sv=2019-07-07&se=2022-07-14T19%3A08%3A24Z&sr=c&sp=rl&sig=TWPP%2Fxp8aOTYtcwyN1zXRZtGBkCMo2%2F6B1koCeUWj5I%3D>)
### Histogram

#### Benchstone.BenchI.Array2.Test

```log

```
### Description of detection logic
```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 906.7278614615384 > 712.94808081875.
IsChangePoint: Marked as a change because one of 6/14/2022 10:05:19 AM, 6/21/2022 6:07:15 AM falls between 6/12/2022 5:56:07 PM and 6/21/2022 6:07:15 AM.
IsRegressionStdDev: Marked as regression because -605.4595292637864 (T) = (0 -907427594.9044238) / Math.Sqrt((3461697173857.5376 / (30)) + (1015343504891.7698 / (39))) is less than -1.9960083540247138 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (30) + (39) - 2, .025) and -0.33497085726601056 = (679735883.3456594 - 907427594.9044238) / 679735883.3456594 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```

### Docs

[Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md)
[Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

</details>




Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Regression from hoisting out of nested loop #71059

Run Information

Regressions in Benchstone.MDBenchI.MDGeneralArray

Repro

Payloads

Histogram

Benchstone.MDBenchI.MDGeneralArray.Test

Description of detection logic

Description of detection logic

Docs

Regressions in Burgers

Repro

Payloads

Histogram

Burgers.Test3

Description of detection logic

Description of detection logic

Docs

Run Information

Regressions in Benchstone.BenchI.Array2

Repro

Payloads

Histogram

Benchstone.BenchI.Array2.Test

Description of detection logic

Docs

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Architecture	x64
OS	ubuntu 18.04
Baseline	e5acd4dfd7b31ed790687e9f3da642fe1c964dc3
Compare	261574bf4121b40c7023c73571fb7a690397bd0f
Diff	Diff

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test - Duration of single invocation	13.31 ms	16.47 ms	1.24	0.00	False
Test2 - Duration of single invocation	13.21 ms	16.47 ms	1.25	0.00	False

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Test3 - Duration of single invocation	87.95 ms	115.96 ms	1.32	0.08	False
Test1 - Duration of single invocation	170.74 ms	261.06 ms	1.53	0.00	False

Regression from hoisting out of nested loop #71059

Description

Run Information

Regressions in Benchstone.MDBenchI.MDGeneralArray

Repro

Payloads

Histogram

Benchstone.MDBenchI.MDGeneralArray.Test

Description of detection logic

Description of detection logic

Docs

Regressions in Burgers

Repro

Payloads

Histogram

Burgers.Test3

Description of detection logic

Description of detection logic

Docs

Run Information

Regressions in Benchstone.BenchI.Array2

Repro

Payloads

Histogram

Benchstone.BenchI.Array2.Test

Description of detection logic

Docs

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions