[wasm] AOT: `System.Globalization.Calendars.Hybrid.WASM.Tests` and `System.Globalization.Hybrid.WASM.Tests` getting terminated

[radical]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=456551
Build error leg or test failing: normal-System.Globalization.Calendars.Hybrid.WASM.Tests.WorkItemExecution
Pull request: #94217

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "MONO.*src/mono/mono/metadata/icall.c:618. <disabled>",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

This is failing on rolling builds too, and is unrelated to the linked PR. Changes since the last passing rolling build - 8d59c90...920cd6e which includes #87672 .

The assertion is

runtime/src/mono/mono/metadata/icall.c

Lines 6176 to 6180 in ba65769

	void
	ves_icall_System_Environment_FailFast (MonoStringHandle message, MonoExceptionHandle exception, MonoStringHandle errorSource, MonoError *error)
	{
	if (MONO_HANDLE_IS_NULL (errorSource)) {
	g_warning ("Process terminated.");

cc @kouvel

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=456551
Error message validated: MONO.*src/mono/mono/metadata/icall.c:618. <disabled>
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 10/31/2023 4:57:48 PM UTC

Report

Build	Definition	Test	Pull Request
504118	dotnet/runtime	WasmTestOnBrowser-Invariant.Tests.WorkItemExecution	#95910
501644	dotnet/runtime	normal-System.Text.Json.Tests.WorkItemExecution	#95292
501422	dotnet/runtime	Workloads-NoWebcil-Wasm.Build.Tests.IcuTests.WorkItemExecution	#95610
488625	dotnet/runtime	Workloads-Wasm.Build.Tests.IcuTests.WorkItemExecution	#95610
487764	dotnet/runtime	normal-Microsoft.Extensions.FileProviders.Physical.Tests.WorkItemExecution	#95324
486016	dotnet/runtime	normal-System.ComponentModel.Tests.WorkItemExecution	#95324

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	3	6

Tagging subscribers to 'arch-wasm': @lewing
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=456551
Build error leg or test failing: normal-System.Globalization.Calendars.Hybrid.WASM.Tests.WorkItemExecution
Pull request: #94217

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "MONO.*src/mono/mono/metadata/icall.c:6180 <disabled>",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

This is failing on rolling builds too, and is unrelated to the linked PR. Changes since the last passing rolling build - 8d59c90...920cd6e which includes #87672 .

cc @kouvel

Author:	radical
Assignees:	-
Labels:	arch-wasm, blocking-clean-ci, Known Build Error
Milestone:	-

[radical]

This might be a related failure too - #87672 (comment) .

Tagging subscribers to this area: @mangod9
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=456551
Build error leg or test failing: normal-System.Globalization.Calendars.Hybrid.WASM.Tests.WorkItemExecution
Pull request: #94217

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "MONO.*src/mono/mono/metadata/icall.c:618. <disabled>",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

This is failing on rolling builds too, and is unrelated to the linked PR. Changes since the last passing rolling build - 8d59c90...920cd6e which includes #87672 .

cc @kouvel

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=456551
Error message validated: MONO.*src/mono/mono/metadata/icall.c:6180 <disabled>
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 10/31/2023 4:38:57 PM UTC

Author:	radical
Assignees:	-
Labels:	arch-wasm, area-System.Threading, blocking-clean-ci, untriaged, Known Build Error, needs-area-label
Milestone:	-

[radical]

cc @pavelsavara @maraf

[ilonatommy]

I can't reproduce the same error. When we run wasm-library-aot-tests we add /p:BuildAOTTestsOnHelix=true /p:RunAOTCompilation=true. When reproducing this gives us an error AOT is not supported without IL trimming (PublishTrimmed=true required), so I added it. Am I missing something else? Log of such a run differs a lot:

/workspaces/runtime/src/mono/wasm/build/WasmApp.Native.targets(689,5): error : Precompiling failed for /workspaces/runtime/artifacts/bin/System.Globalization.Calendars.Hybrid.WASM.Tests/Release/net9.0-browser/browser-wasm/AppBundle/wasm_build/obj/wasm/for-build/aot-in/Microsoft.CSharp.dll with exit code 1. [/workspaces/runtime/artifacts/bin/System.Globalization.Calendars.Hybrid.WASM.Tests/Release/net9.0-browser/browser-wasm/AppBundle/publish/ProxyProjectForAOTOnHelix.proj]
  /workspaces/runtime/src/mono/wasm/build/WasmApp.Native.targets(689,5): error : Failed to load method 0x600005d from '/workspaces/runtime/artifacts/bin/System.Globalization.Calendars.Hybrid.WASM.Tests/Release/net9.0-browser/browser-wasm/AppBundle/wasm_build/obj/wasm/for-build/aot-in/Microsoft.CSharp.dll' due to Could not resolve type with token 01000015 from typeref (expected class 'System.Collections.Generic.IEqualityComparer`1' in assembly 'System.Runtime, Version=9.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a') assembly:System.Runtime, Version=9.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a type:System.Collections.Generic.IEqualityComparer`1 member:(null). [/workspaces/runtime/artifacts/bin/System.Globalization.Calendars.Hybrid.WASM.Tests/Release/net9.0-browser/browser-wasm/AppBundle/publish/ProxyProjectForAOTOnHelix.proj]
  /workspaces/runtime/src/mono/wasm/build/WasmApp.Native.targets(689,5): error : Run with MONO_LOG_LEVEL=debug for more information. [/workspaces/runtime/artifacts/bin/System.Globalization.Calendars.Hybrid.WASM.Tests/Release/net9.0-browser/browser-wasm/AppBundle/publish/ProxyProjectForAOTOnHelix.proj]
....
 /workspaces/runtime/src/mono/wasm/build/WasmApp.Native.targets(689,5): error : Could not load signature of Microsoft.DotNet.XHarness.TestRunners.Common.TestRunner:WriteResultsToFile due to: Could not resolve type with token 01000019 from typeref (expected class 'System.IO.TextWriter' in assembly 'System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e') assembly:System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e type:System.IO.TextWriter member:(null) [/workspaces/runtime/artifacts/bin/System.Globalization.Calendars.Hybrid.WASM.Tests/Release/net9.0-browser/browser-wasm/AppBundle/publish/ProxyProjectForAOTOnHelix.proj]
  /workspaces/runtime/src/mono/wasm/build/WasmApp.Native.targets(689,5): error : Can't find custom attr constructor image: /workspaces/runtime/artifacts/bin/System.Globalization.Calendars.Hybrid.WASM.Tests/Release/net9.0-browser/browser-wasm/AppBundle/wasm_build/obj/wasm/for-build/aot-in/Microsoft.DotNet.XHarness.TestRunners.Common.dll mtoken: 0x0a00000a due to: Could not resolve type with token 01000011 from typeref (expected class 'System.Runtime.CompilerServices.AsyncStateMachineAttribute' in assembly 'System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e') assembly:System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e type:System.Runtime.CompilerServices.AsyncStateMachineAttribute member:(null) [/workspaces/runtime/artifacts/bin/System.Globalization.Calendars.Hybrid.WASM.Tests/Release/net9.0-browser/browser-wasm/AppBundle/publish/ProxyProjectForAOTOnHelix.proj]
  /workspaces/runtime/src/mono/wasm/build/WasmApp.Native.targets(689,5): error : Failed to load custom attributes from method System.Threading.Tasks.Task`1<System.Collections.Generic.List`1<string>> Microsoft.DotNet.XHarness.TestRunners.Common.ApplicationEntryPoint:GetIgnoredCategories () due to Could not resolve type with token 01000011 from typeref (expected class 'System.Runtime.CompilerServices.AsyncStateMachineAttribute' in assembly 'System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e') assembly:System.Private.CoreLib, Version=9.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e type:System.Runtime.CompilerServices.AsyncStateMachineAttribute member:(null) [/workspaces/runtime/artifacts/bin/System.Globalization.Calendars.Hybrid.WASM.Tests/Release/net9.0-browser/browser-wasm/AppBundle/publish/ProxyProjectForAOTOnHelix.proj]
  /workspaces/runtime/src/mono/wasm/build/WasmApp.Native.targets(689,5): error : FullAOT cannot continue if there are loader errors. [/workspaces/runtime/artifacts/bin/System.Globalization.Calendars.Hybrid.WASM.Tests/Release/net9.0-browser/browser-wasm/AppBundle/publish/ProxyProjectForAOTOnHelix.proj]

[radical]

Can you share how exactly you are running the tests?

• /p:BuildAOTTestsOnHelix=true - this isn't required. Use it if you are not able to reproduce without it. Essentially, it uses the same proxy project that we use on helix, for your local run too.

[radical]

Running this on macos with v8 11.6.6, I get:

  info: console.info: Initializing dotnet version 9.0.0-dev commit hash e4fbdb907bb187d7b5ba0668a84347c1058e3219
  info: [MONO] Process terminated.
  info: [MONO] Encountered infinite recursion while looking up resource 'Arg_NullReferenceException' in System.Private.CoreLib. Verify the installation of .NET is complete and does not need repairing, and that the state of the process has not become corrupted.
  info: Process v8 exited with 1

.. with a fresh build of e4fbdb9 .