The Operation will be canceled. The next steps may not contain expected logs.

[tarekgh]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=696281

Build leg reported

Build / browser-wasm linux Release LibraryTests / Send to Helix

Pull Request

dotnet/runtime#103009

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The Operation will be canceled. The next steps may not contain expected logs.",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=696281
Error message validated: [The Operation will be canceled. The next steps may not contain expected logs.]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 6/4/2024 8:08:48 PM UTC

Report

Build	Definition	Step Name	Console log	Pull Request
1385986	dotnet/runtime	Zip	Log	dotnet/runtime#124967
1385910	dotnet/maui	Controls Image,ImageButton,IndicatorView,InputTransparent,IsEnabled,IsVisible	Log	dotnet/maui#34790
1385965	dotnet/runtime	Send to Helix	Log
1385954	dotnet/runtime	Send to Helix	Log	dotnet/runtime#127022
2954890	dotnet-sdk	Run AoT Tests	Log	#60250
1385964	dotnet/runtime	AOT compile CoreCLR tests	Log
2954889	dotnet-sdk	Run TestBuild Tests	Log	#60249
2954903	dotnet-runtime	Send job to Helix (Unix)	Log
2954811	dotnet-maui	Controls (vlatest) Shell	Log
2954896	dotnet-sdk	Run Tests in Helix	Log	#60251
2954897	dotnet-sdk	Run Tests in Helix	Log	#60252
1385823	dotnet/maui	Controls WebView	Log
2954870	dotnet-docker-tools	🟪 Clean public/dotnet/* (pruneEol > 15d)	Log
2954877	dotnet-sdk	Build	Log
2954804	dotnet-sdk	Build	Log	#60242
2954848	dotnet-sdk	Run Tests in Helix	Log	#60248
2954847	dotnet-sdk	Run Tests in Helix	Log	#60247
1385862	dotnet/runtime	Send tests to Helix (Unix)	Log
2954810	dotnet-maui	Provision Android SDK - Common Packages	Log
2954833	dotnet-roslyn	VSBuild	Log
2954805	dotnet-sdk	Run AoT Tests	Log	#60243
1385666	dotnet/maui	Controls WebView	Log	dotnet/maui#34844
1385664	dotnet/maui	Controls WebView	Log	dotnet/maui#31790
1385785	dotnet/roslyn	Test	Log	dotnet/roslyn#83227
2954740	dotnet-runtime	Send job to Helix (Unix)	Log
2954758	dotnet-aspnetcore	Run build.cmd helix target	Log
1385739	dotnet/aspnetcore	Run Quarantined Tests	Log
2954737	dotnet-dotnet-monitor	Build	Log
2954691	dotnet-sdk	Run AoT Tests	Log	#60242
2954705	dotnet-diagnostics	Test (test_fedora)	Log
2954696	dotnet-dotnet-monitor	Build	Log
2954692	dotnet-sdk	Run AoT Tests	Log	#60243
1385636	dotnet/roslyn	Test	Log	dotnet/roslyn#83227
1385618	dotnet/runtime	AOT compile CoreCLR tests	Log
1385617	dotnet/aspnetcore	Run Quarantined Tests	Log
2954666	dotnet-roslyn	Test	Log
2954656	dotnet-aspnetcore	Run build.cmd helix target	Log	#60241
2954635	dotnet-aspnetcore	Run build.cmd helix target	Log	#60239
2954599	dotnet-runtime	Send job to Helix (Unix)	Log
2954597	dotnet-sdk	1ES PT Pre-Job (1ES PT)	Log	#60234
2954592	dotnet-winforms	Clear NuGet http cache (if exists)	Log	#60230
2954596	dotnet-sdk	Build	Log	#60233
2954594	dotnet-aspnetcore	🛡 Guardian: Post Analysis	Log	#60232
2954593	dotnet-efcore	Send job to helix	Log	#60231
2954595	dotnet-sdk	Build	Log	#60233
2954544	dotnet-aspnetcore	Run build.cmd helix target	Log	#60227
2954542	dotnet-sdk	Run Tests in Helix	Log	#60224
2954541	dotnet-sdk	Run Tests in Helix	Log	#60225
2954543	dotnet-efcore	Send job to helix	Log	#60226
2954514	dotnet-dotnet	Build	Log	#60220
2954510	dotnet-runtime	Install workload using artifacts	Log
2953881	dotnet-dotnet	Checkout dotnet-dotnet@internal/release/10.0.107 to s	Log
2954407	dotnet-maui	Controls Shell	Log
2954470	dotnet-dotnet-monitor	Build	Log
1385278	dotnet/maui	Controls WebView	Log
1385324	dotnet/runtime	Send tests to Helix (Unix)	Log
1385320	dotnet/runtime	Send tests to Helix (Unix)	Log
1385314	dotnet/runtime	Send tests to Helix (Unix)	Log
2954427	dotnet-runtime	Send job to Helix (Unix)	Log
2954433	dotnet-aspnetcore	Run build.cmd helix target	Log
1385310	dotnet/aspnetcore	Run build.cmd helix target	Log
2954406	dotnet-maui	Run Integration Tests - Blazor	Log
1385254	dotnet/runtime	Send to Helix	Log
2954390	dotnet-runtime	ComponentGovernanceComponentDetection@0	Log
2954319	dotnet-maui	Controls (vlatest) Shell	Log
2954400	dotnet-runtime	Send to Helix	Log
1385275	dotnet/aspnetcore	Run Quarantined Tests	Log	dotnet/aspnetcore#66135
1385211	dotnet/maui	Controls WebView	Log
2954326	dotnet-sdk	Run TestBuild Tests	Log	#60216
1385233	dotnet/runtime	Send to Helix	Log
2954320	dotnet-maui	DeviceTestsMacCatalyst_CoreCLR (Windows)	Log
1385176	dotnet/maui	Controls Shell	Log	dotnet/maui#35028
2954327	dotnet-sdk	Run AoT Tests	Log	#59942
2954331	dotnet-sdk	Run Tests in Helix	Log	#60217
2954332	dotnet-sdk	Run Tests in Helix	Log	#60218
2954329	dotnet-efcore	Send tests to helix	Log
2954301	dotnet-runtime	Send job to Helix (Unix)	Log
1385212	dotnet/maui	DeviceTestsMacCatalyst_CoreCLR (Windows)	Log
1385177	dotnet/runtime	Send tests to Helix (Unix)	Log
1384827	dotnet/maui	Controls Layout	Log	dotnet/maui#34980
2954276	dotnet-docker-tools	🟪 Clean public/dotnet/* (pruneEol > 15d)	Log
1384804	dotnet/maui	Controls CollectionView	Log	dotnet/maui#35001
1384850	dotnet/maui	Controls WebView	Log	dotnet/maui#34573
1384780	dotnet/runtime	Send tests to Helix (Unix)	Log
2954246	dotnet-roslyn	Test	Log
1384769	dotnet/maui	Controls WebView	Log
1384766	dotnet/maui	Controls WebView	Log
1384193	dotnet/maui	Controls CollectionView	Log	dotnet/maui#34923
1384155	dotnet/maui	Controls Shell	Log	dotnet/maui#31159
2954059	dotnet-maui	Controls WebView	Log
2954168	dotnet-roslyn	Test	Log
2954130	dotnet-runtime	Send job to Helix (Unix)	Log
1384687	dotnet/runtime	Run Native AOT Test App Tests	Log	dotnet/runtime#127068
2954145	dotnet-aspnetcore	Run build.cmd helix target	Log
1384924	dotnet/runtime	Send to Helix	Log	dotnet/runtime#126596
1384975	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#126904
2954126	dotnet-roslyn	Test	Log
1384955	dotnet/runtime	Send tests to Helix (Windows)	Log	dotnet/runtime#126852
1384910	dotnet/runtime	Send to Helix	Log	dotnet/runtime#125180
1384904	dotnet/runtime	Send to Helix	Log	dotnet/runtime#127033
Displaying 100 of 2843 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
45	670	2843

[dkurepa]

These appear to be timeout cancellations, and most of them are happening on the same runtime leg that uses OSX.1200.ARM64.Open, looking at grafana, they do indeed appear to be quite high. Will check with the team on what we can do about this

[dkurepa]

For pipelines experiencing timeouts on osx.1200.arm64.open we recommend using osx.14.arm64.open, as this queue has a lot more machines

[dkurepa]

There is also a number of Publish Using Darc timeouts, these are in 99% of cases AzDo Api issues. During the Publish Using Darc job, we queue up a Maestro Promotion pipeline, that downloads the artifacts from the build calling it, and publishes them where they need to go. While publishing is happening, the build pipeline keeps busy waiting for the promotion pipeline to be done, checking the status of it every 60 seconds. In cases where this times out, the build most likely did get promoted, the AzDo API just kept telling us the wrong thing

[ivanpovazan]

@dkurepa for context, the same timeouts are also caught with this tracking #1883
where I asked about potentially bumping the queues to osx.13.amd/arm64, would that suffice?
(bumping to osx.14 is not an option right now as we still want testing on osx.13 which is the minimum supported OS version)

[CarnaViire]

For the "known issues" folks: the timeout here is reported twice, making BA red despite the tracking issue. E.g.:

1️⃣ dotnet/runtime#117255

2️⃣ dotnet/runtime#117800

cc @AlitzelMendez