The active test run was aborted. Reason: Test host process crashed

[fanyang-mono]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=351450

Build leg reported

chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution

Pull Request

dotnet/runtime#89217

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The active test run was aborted. Reason: Test host process crashed",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build	Definition	Step Name	Console log	Pull Request
1035007	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78140
1034620	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78458
1034237	dotnet/roslyn	Run Integration Tests	Log
1034065	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#76691
1033010	dotnet/roslyn	Run Integration Tests	Log
1032686	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78420
1032636	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78401
1032417	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78401
1031089	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78357
1031921	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77088
1030021	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78376
1029927	dotnet/roslyn	Run Integration Tests	Log
1029925	dotnet/roslyn	Run Integration Tests	Log
1029907	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78369
1029899	dotnet/roslyn	Run Integration Tests	Log
1028890	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78357
2697948	dotnet-fsharp	CmdLine@2	Log
1029076	dotnet/roslyn	Run Integration Tests	Log
2697752	dotnet-fsharp	CmdLine@2	Log
1028734	dotnet/roslyn	Run Integration Tests	Log
1028647	dotnet/roslyn	Run Integration Tests	Log
2696596	dotnet-fsharp	CmdLine	Log
1027081	dotnet/roslyn	Run Integration Tests	Log
1026935	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78220
1024848	dotnet/roslyn	Run Integration Tests	Log
1024264	dotnet/roslyn	Run Integration Tests	Log
1024242	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78213
1024156	dotnet/roslyn	Run Integration Tests	Log
1023228	dotnet/roslyn	Run Integration Tests	Log
1022065	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78220
1020803	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78205
1020781	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78208
1020569	dotnet/roslyn	Run Integration Tests	Log
1020430	dotnet/roslyn	Run Integration Tests	Log
1019623	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78186
2688805	dotnet-fsharp	CmdLine	Log
1018026	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78167
1016599	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78154
1016601	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78154
1014204	dotnet/roslyn	Run Integration Tests	Log
1012624	dotnet/roslyn	Run Integration Tests	Log
1010308	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77568
1010304	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77568
1009837	dotnet/roslyn	Run Integration Tests	Log
1008803	dotnet/roslyn	Run Integration Tests	Log
1008229	dotnet/roslyn	Run Integration Tests	Log

Build	Definition	Test	Pull Request
1035154	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48609
1035010	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.Listener.ResponseHeaderTests.AddingControlCharactersToHeadersThrows
1034754	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48697
1034405	dotnet/roslyn	workitem_9.WorkItemExecution	dotnet/roslyn#78436
1033821	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48697
1033729	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48813
1032667	dotnet/roslyn	workitem_6.WorkItemExecution	dotnet/roslyn#78424
1031911	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	dotnet/sdk#48752
1030360	dotnet/aspnetcore	Microsoft.AspNetCore.Http.Abstractions.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#61745
1031447	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1030340	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#48777
1029908	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48773
2697816	dotnet-aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
2697785	dotnet-roslyn	workitem_203.WorkItemExecution
1027246	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48735
1027155	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48731
1027076	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48690
1026964	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#48725
1026526	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1025043	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48689
1024954	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#47076
2693348	dotnet-aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1023300	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48640
1023289	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48611
1023164	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61503
1023178	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48587
1023168	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#48637
1021108	dotnet/sdk	Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.Aspire	dotnet/sdk#48028
1020922	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48589
1020766	dotnet/aspnetcore	Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth(args: ["--interactivity Auto"])	dotnet/aspnetcore#61554
1020770	dotnet/roslyn	workitem_273.WorkItemExecution
2690458	dotnet-aspnetcore	Microsoft.AspNetCore.Authentication.Test--net10.0.WorkItemExecution
1019892	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61316
1019981	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48556
1019718	dotnet/aspnetcore	Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth(args: ["--interactivity Auto"])
2689266	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#49269
1018918	dotnet/aspnetcore	Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth(args: ["--interactivity Auto"])	dotnet/aspnetcore#61402
1018909	dotnet/aspire	Aspire.Hosting.Seq.Tests.WorkItemExecution
1018363	dotnet/sdk	dotnet.Tests.dll.25.WorkItemExecution	dotnet/sdk#48501
1018164	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1017988	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48494
1017695	dotnet/roslyn	workitem_7.WorkItemExecution	dotnet/roslyn#78134
1017569	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#48494
1017353	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48486
1016809	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48472
1016553	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48454
1016364	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1016293	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48447
1015954	dotnet/aspnetcore	Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth
1015665	dotnet/roslyn	workitem_7.WorkItemExecution	dotnet/roslyn#78111
1015325	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48430
1015239	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48393
1014294	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#48412
1015036	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48425
1014974	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48362
2685693	dotnet-aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1014302	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#48413
1014093	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61463
2685332	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#49129
1013461	dotnet/roslyn	workitem_146.WorkItemExecution	dotnet/roslyn#78111
1013477	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48274
1013491	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1013432	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1013247	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48385
1012824	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48363
1012531	dotnet/roslyn	workitem_273.WorkItemExecution
1012395	dotnet/aspnetcore	Microsoft.AspNetCore.App.Analyzers.Test--net10.0.WorkItemExecution	dotnet/aspnetcore#61428
1012414	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48356
1012227	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1011518	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61270
2683475	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#48610
1010767	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61306
1010510	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48298
1010475	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48305
1010372	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48298
2682841	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#48610
1010182	dotnet/aspire	Aspire.Hosting.Nats.Tests.WorkItemExecution
1010094	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48277
1009247	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48246
1009236	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48087
1008533	dotnet/sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	dotnet/sdk#48226
1008115	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#45520
1008009	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#48085
1007851	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#48225
2681148	dotnet-aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1007531	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48151
1007494	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#48150

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
5	20	133

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 2/8/2024 9:24:30 PM UTC

[andriipatsula]

Hello @fanyang-mono, could you please update the "ErrorMessage" : "" by following the step by step documentation on how to create a known issue

[fanyang-mono]

Updated.

[pavelsavara]

This is duplicate of dotnet/runtime#89409, except here it's not only wasm debugger

[dougbu]

@pavelsavara and @fanyang-mono, should this issue be closed in favour of dotnet/runtime#94560❔ if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

[pavelsavara]

@pavelsavara and @fanyang-mono, should this issue be closed in favour of

You mean dotnet/runtime#89409

I think we should keep this one, because this one has some hits which are not just wasm debugger related.
Here we see other repo failures, on roslyn and aspnetcore CI.

if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

I have not investigated it myself yet. But got questions which could help to narrow it down

• are there crash dump files on the machine ?
• are there some hints on what's going on in the log files before crash ?
• is this OOM or stack overflow in disguise ?
• did we run out of disk space or number of inodes ?
• hit some limit in docker container ?
• is this always the same OS, version, image ?
• could this be hardware issue ?

[fanyang-mono]

This issue was originally created to track issues happened to wasm debugger tests (belonging to dotnet/runtime repo). However, the error message was generic enough to include issues from other repos, such as dotnet/roslyn and dotnet/aspnetcore. We need insights from owners from dotnet/roslyn and dotnet/aspnetcore to confirm that they are aware of these issue. And if they are okay to close this issue as well. We could close then.

[mitchdenny]

We just got an instance of this in the dotnet/aspire repo. It wasn't a WASM related failure for us. Just looks like the test process crashed and took a few tests with it.

[nagilson]

@marcpopMSFT was working on getting the test infrastructure to generate crash dumps when it times out to help with investigation. I think it was generating the dumps but not yet correctly uploading them to the artifacts.

We are waiting to hear from the infra team on an issue with this.