Test failure: JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.cmd

[SakeTao]

Failed in: runtime-coreclr r2r-extra 20250504.1

Failed tests:

R2R-CG2 osx arm64 Checked jitstress1_tiered @ osx.13.arm64.open
    - JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.cmd

Error message:

 DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /private/tmp/helix/working/A8B609A5/p/crossgen2/createdump

Return code:      1
Raw output file:      /tmp/helix/working/A8B609A5/w/AE6E0985/uploads/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/private/tmp/helix/working/A8B609A5/w/AE6E0985/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/IL-CG2/b425314.dll
23:56:04
Response file: /private/tmp/helix/working/A8B609A5/w/AE6E0985/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.dll.rsp
/private/tmp/helix/working/A8B609A5/w/AE6E0985/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/IL-CG2/b425314.dll
-o:/private/tmp/helix/working/A8B609A5/w/AE6E0985/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.dll
--targetarch:arm64
--targetos:osx
--verify-type-and-field-layout
--method-layout:random
-r:/tmp/helix/working/A8B609A5/p/System.*.dll
-r:/tmp/helix/working/A8B609A5/p/Microsoft.*.dll
-r:/tmp/helix/working/A8B609A5/p/xunit.*.dll
-r:/tmp/helix/working/A8B609A5/p/mscorlib.dll
-r:/tmp/helix/working/A8B609A5/p/netstandard.dll
Running CrossGen2:  /tmp/helix/working/A8B609A5/p/crossgen2/crossgen2 @/private/tmp/helix/working/A8B609A5/w/AE6E0985/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.dll.rsp   -r:/private/tmp/helix/working/A8B609A5/w/AE6E0985/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/IL-CG2/*.dll
Emitting R2R PE file: /private/tmp/helix/working/A8B609A5/w/AE6E0985/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.dll
Running R2RDump:  dotnet /tmp/helix/working/A8B609A5/p/R2RDump/R2RDump.dll --header --sc --in /private/tmp/helix/working/A8B609A5/w/AE6E0985/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.dll --out /private/tmp/helix/working/A8B609A5/w/AE6E0985/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.dll.r2rdump --val
23:56:04
in ReleaseLock
in takeLock
/tmp/helix/working/A8B609A5/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true b425314.dll ''
Timeout: The `CastClass' scenario exceeded the time limit (180s) without reaching the basic work thresholds.
Timeout: The `Unbox' scenario exceeded the time limit (180s) without reaching the basic work thresholds.
GenericMethod: Checks=40022194, Flips=55196664, Elapsed=00:00:03.1504940
2 exceptions were thrown
System.Exception: Timeout: The `CastClass' scenario exceeded the time limit (180s) without reaching the basic work thresholds.


System.Exception: Timeout: The `Unbox' scenario exceeded the time limit (180s) without reaching the basic work thresholds.


System.Exception: Failure
   at Mutate.TestEntryPoint()
Test FAILED
Xunit.Sdk.EqualException: Assert.Equal() Failure: Values differ
Expected: 100
Actual:   101
   at Xunit.Assert.Equal[T](T expected, T actual, IEqualityComparer`1 comparer) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/EqualityAsserts.cs:line 174
   at Xunit.Assert.Equal[T](T expected, T actual) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/EqualityAsserts.cs:line 96
   at __GeneratedMainWrapper.Main()
in ReleaseLock
Expected: 100
Actual: 101
END EXECUTION - FAILED
Test failed. Trying to see if dump file was created in /cores since 5/4/2025 11:56:04 PM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /private/tmp/helix/working/A8B609A5/w/AE6E0985/e/JIT/Regression/Regression_1/../CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 123
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor249|0_250(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

[SakeTao]

feel free to close it if it is a timed out issue.

[kunalspathak]

This seems to be failing in jitstressregs too since 5/3 - https://dev.azure.com/dnceng-public/public/_build/results?buildId=1030243&view=ms.vss-test-web.build-test-results-tab

export DOTNET_TieredCompilation=0
export DOTNET_JitStressRegs=1

[dotnet-policy-service]

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
See info in area-owners.md if you want to be subscribed.

[SakeTao]

Failed in: runtime-coreclr r2r-extra 20250511.1

Failed tests:

R2R-CG2 osx arm64 Checked jitstress2_tiered @ osx.13.arm64.open
    - JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.cmd

Error message:

 DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /private/tmp/helix/working/A39E08A5/p/crossgen2/createdump

Return code:      1
Raw output file:      /tmp/helix/working/A39E08A5/w/A1A208C9/uploads/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/private/tmp/helix/working/A39E08A5/w/A1A208C9/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/IL-CG2/b425314.dll
23:48:02
Response file: /private/tmp/helix/working/A39E08A5/w/A1A208C9/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.dll.rsp
/private/tmp/helix/working/A39E08A5/w/A1A208C9/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/IL-CG2/b425314.dll
-o:/private/tmp/helix/working/A39E08A5/w/A1A208C9/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.dll
--targetarch:arm64
--targetos:osx
--verify-type-and-field-layout
--method-layout:random
-r:/tmp/helix/working/A39E08A5/p/System.*.dll
-r:/tmp/helix/working/A39E08A5/p/Microsoft.*.dll
-r:/tmp/helix/working/A39E08A5/p/xunit.*.dll
-r:/tmp/helix/working/A39E08A5/p/mscorlib.dll
-r:/tmp/helix/working/A39E08A5/p/netstandard.dll
Running CrossGen2:  /tmp/helix/working/A39E08A5/p/crossgen2/crossgen2 @/private/tmp/helix/working/A39E08A5/w/A1A208C9/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.dll.rsp   -r:/private/tmp/helix/working/A39E08A5/w/A1A208C9/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/IL-CG2/*.dll
Emitting R2R PE file: /private/tmp/helix/working/A39E08A5/w/A1A208C9/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.dll
Running R2RDump:  dotnet /tmp/helix/working/A39E08A5/p/R2RDump/R2RDump.dll --header --sc --in /private/tmp/helix/working/A39E08A5/w/A1A208C9/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.dll --out /private/tmp/helix/working/A39E08A5/w/A1A208C9/e/JIT/Regression/CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.dll.r2rdump --val
23:48:02
in ReleaseLock
in takeLock
/tmp/helix/working/A39E08A5/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false -p System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true b425314.dll ''
CastClass: Checks=13322, Flips=3181550127, Elapsed=00:00:36.4442180
Timeout: The `Unbox' scenario exceeded the time limit (180s) without reaching the basic work thresholds.
GenericMethod: Checks=67558845, Flips=37254288, Elapsed=00:00:03.0400930
1 exceptions were thrown
System.Exception: Timeout: The `Unbox' scenario exceeded the time limit (180s) without reaching the basic work thresholds.


System.Exception: Failure
   at Mutate.TestEntryPoint()
Test FAILED
Xunit.Sdk.EqualException: Assert.Equal() Failure: Values differ
Expected: 100
Actual:   101
   at Xunit.Assert.Equal[T](T expected, T actual, IEqualityComparer`1 comparer) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/EqualityAsserts.cs:line 174
   at Xunit.Assert.Equal[T](T expected, T actual) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/EqualityAsserts.cs:line 96
   at __GeneratedMainWrapper.Main()
in ReleaseLock
Expected: 100
Actual: 101
END EXECUTION - FAILED
Test failed. Trying to see if dump file was created in /cores since 5/11/2025 11:48:02 PM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /private/tmp/helix/working/A39E08A5/w/A1A208C9/e/JIT/Regression/Regression_1/../CLR-x86-JIT/V2.0-Beta2/b425314/b425314/b425314.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 123
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor249|0_250(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

[kunalspathak]

I tried running the jitstressregs scenario in a loop for 100 times, but I am not able to repro this locally with the downloaded artifacts. But it seems to be consistently failing in CI. I am not sure why the crashdumps are not getting uploaded for them.

[kunalspathak]

4158fca..6a3747b is the commit range between which it started failing. I am wondering if #115134 is anything to do with the timeouts we are seeing, given the test verifies box/unbox behavior. @am11 ?