Tests failing with 0xC0000142 14 Windows ARM64 checked coreclr test runs

[ericstj]

The run log from helix is https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-54890-merge-4746bd2a9072476897/profiler.gc/4a2812f6-4351-4f10-bb7f-d6339b705ee0.log?sv=2019-07-07&se=2021-07-20T03%3A47%3A09Z&sr=c&sp=rl&sig=DxAU9hk8WxZk31w0QVu09XUj6lqHsxrYIz8sgvrP%2BU4%3D

Interesting portion:

2021-06-30T05:05:13.574Z	INFO   	executor(771)	_execute_command	running %HELIX_CORRELATION_PAYLOAD%\scripts\950a34405e0340fea670d6e22f8326c7\execute.cmd in D:\h\w\A02A08CF\w\B08A097A\e max 1800 seconds
2021-06-30T05:05:14.320Z	INFO   	job(38)	wait	Work item's process exited normally.
...
2021-06-30T05:11:04.931Z	INFO   	executor(744)	_dump_file_upload	No dump files to upload
2021-06-30T05:11:04.937Z	INFO   	executor(815)	_execute_command	Finished _execute_command, exit code: 3221225794
2021-06-30T05:11:04.952Z	INFO   	executor(843)	_upload_single_file	Uploading the file console.845014af.log

Not sure what that last execute is since there was a previous log about the workitem completing successfully, but the return value 3221225794, is 0xC0000142 which seems to be the failure.

Log content is useless: https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-54890-merge-4746bd2a9072476897/profiler.gc/console.845014af.log?sv=2019-07-07&se=2021-07-20T03%3A47%3A09Z&sr=c&sp=rl&sig=DxAU9hk8WxZk31w0QVu09XUj6lqHsxrYIz8sgvrP%2BU4%3D

Tagging subscribers to this area: @tommcdon
See info in area-owners.md if you want to be subscribed.

Issue Details

---

The run log from helix is https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-54890-merge-4746bd2a9072476897/profiler.gc/4a2812f6-4351-4f10-bb7f-d6339b705ee0.log?sv=2019-07-07&se=2021-07-20T03%3A47%3A09Z&sr=c&sp=rl&sig=DxAU9hk8WxZk31w0QVu09XUj6lqHsxrYIz8sgvrP%2BU4%3D

Interesting portion:

2021-06-30T05:05:13.574Z	INFO   	executor(771)	_execute_command	running %HELIX_CORRELATION_PAYLOAD%\scripts\950a34405e0340fea670d6e22f8326c7\execute.cmd in D:\h\w\A02A08CF\w\B08A097A\e max 1800 seconds
2021-06-30T05:05:14.320Z	INFO   	job(38)	wait	Work item's process exited normally.
...
2021-06-30T05:11:04.931Z	INFO   	executor(744)	_dump_file_upload	No dump files to upload
2021-06-30T05:11:04.937Z	INFO   	executor(815)	_execute_command	Finished _execute_command, exit code: 3221225794
2021-06-30T05:11:04.952Z	INFO   	executor(843)	_upload_single_file	Uploading the file console.845014af.log

Not sure what that last execute is since there was a previous log about the workitem completing successfully, but the return value 3221225794, is 0xC0000142 which seems to be the failure.

Log content is useless: https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-54890-merge-4746bd2a9072476897/profiler.gc/console.845014af.log?sv=2019-07-07&se=2021-07-20T03%3A47%3A09Z&sr=c&sp=rl&sig=DxAU9hk8WxZk31w0QVu09XUj6lqHsxrYIz8sgvrP%2BU4%3D

Author:	ericstj
Assignees:	-
Labels:	area-Diagnostics-coreclr, untriaged
Milestone:	-

[ericstj]

Seems to be similar issue effecting multiple tests.

https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-54950-merge-f076bf138036491bb1/profiler.transitions/e4c162e4-747e-49cb-abdb-f41c8fdf7ee9.log?sv=2019-07-07&se=2021-07-20T21%3A27%3A04Z&sr=c&sp=rl&sig=itwnIxMu85FQLVsObrGLZ%2B%2BcAYBsFJCuI6S5K61o9gA%3D

2021-06-30T21:50:04.929Z	INFO   	executor(815)	_execute_command	Finished _execute_command, exit code: 3221225794

https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-54950-merge-62be768a085a4868ab/PayloadGroup0/00d8698c-bbf1-425d-bc05-8bd9402b3034.log?sv=2019-07-07&se=2021-07-21T01%3A04%3A45Z&sr=c&sp=rl&sig=mRk%2ByTyPYELUmmFk2hJzrenPoFO3KuujTIUKYgt1I5o%3D

2021-07-01T01:21:09.749Z	INFO   	executor(815)	_execute_command	Finished _execute_command, exit code: 3221225794

0xC0000142 is either STATUS_DLL_INIT_FAILED or ERROR_DEVICE_NO_RESOURCES.

Given lack of a dump, I'm suspecting the latter. @MattGal @ViktorHofer do we have any resource issues on Windows ARM64 machines?

Tagging subscribers to this area: @hoyosjs
See info in area-owners.md if you want to be subscribed.

Issue Details

---

The run log from helix is https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-54890-merge-4746bd2a9072476897/profiler.gc/4a2812f6-4351-4f10-bb7f-d6339b705ee0.log?sv=2019-07-07&se=2021-07-20T03%3A47%3A09Z&sr=c&sp=rl&sig=DxAU9hk8WxZk31w0QVu09XUj6lqHsxrYIz8sgvrP%2BU4%3D

Interesting portion:

2021-06-30T05:05:13.574Z	INFO   	executor(771)	_execute_command	running %HELIX_CORRELATION_PAYLOAD%\scripts\950a34405e0340fea670d6e22f8326c7\execute.cmd in D:\h\w\A02A08CF\w\B08A097A\e max 1800 seconds
2021-06-30T05:05:14.320Z	INFO   	job(38)	wait	Work item's process exited normally.
...
2021-06-30T05:11:04.931Z	INFO   	executor(744)	_dump_file_upload	No dump files to upload
2021-06-30T05:11:04.937Z	INFO   	executor(815)	_execute_command	Finished _execute_command, exit code: 3221225794
2021-06-30T05:11:04.952Z	INFO   	executor(843)	_upload_single_file	Uploading the file console.845014af.log

Not sure what that last execute is since there was a previous log about the workitem completing successfully, but the return value 3221225794, is 0xC0000142 which seems to be the failure.

Log content is useless: https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-54890-merge-4746bd2a9072476897/profiler.gc/console.845014af.log?sv=2019-07-07&se=2021-07-20T03%3A47%3A09Z&sr=c&sp=rl&sig=DxAU9hk8WxZk31w0QVu09XUj6lqHsxrYIz8sgvrP%2BU4%3D

Author:	ericstj
Assignees:	-
Labels:	area-Infrastructure-coreclr, untriaged
Milestone:	-

[hoyosjs]

Odd, 0xC0000142 is either STATUS_DLL_INIT_FAILED or ERROR_DEVICE_NO_RESOURCES. I'll ask dnceng to check on this device.

[ericstj]

Yeah, all seem to be on DDARM64-119. 2 new instances here: https://dev.azure.com/dnceng/public/_build/results?buildId=1214460&view=ms.vss-test-web.build-test-results-tab&runId=36263728&resultId=102813&paneView=dotnet-dnceng.dnceng-build-release-tasks.helix-test-information-tab