NativeAOT iOS/osx/tvos legs are timing out on many PRs

[jkotas]

Example from #93773

Known Issue Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Report

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	0	0

Tagging subscribers to this area: @agocke, @MichalStrehovsky, @jkotas
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Example from #93773

Author:	jkotas
Assignees:	-
Labels:	blocking-clean-ci, area-NativeAOT-coreclr
Milestone:	-

[jkotas]

@agocke @ivanpovazan Is it intentional that we run all flavors in PR CI? There does not seem to be enough capacity for it, leading to frequent timeouts.

[ivanpovazan]

Yes, on Friday OSX.1200.Amd64.Open helix queue seemed to be pretty backed up, causing timeouts for all runtime flavours. We enabled ios/tvos lanes with NativeAOT to run functional smoke tests by default, as we wanted to catch any regression early-on regarding the iOS platforms support during preparation for RC releases (introduced by: 55828b9).

These lanes run only functional smoke tests in the following setup:

• The tvos-arm64 lane executes one functional test on a device - https://helix.dot.net/api/jobs/7e15e9f6-646a-4323-b76e-f6e05dbd479d/workitems?api-version=2019-06-17
• The ios-arm64 lane executes two functional tests on a device - https://helix.dot.net/api/jobs/a45cba58-70c0-4609-8cb4-1652ae01a7a5/workitems?api-version=2019-06-17

This was called out previously here: https://github.com/dotnet/runtime/pull/87773/files#r1291590026
and here: #87773 (comment)

If this started affecting CI capacity we might consider enabling these lanes in the runtime-nativeaot-outerloop pipeline instead (PS: they are already enabled in runtime-extra-platforms).

[ivanpovazan]

/cc: @steveisok

[steveisok]

Around snap time we have this issue due to increased number of overall work items. Let's see if this continues and go from there.

Tagging subscribers to 'os-tvos': @steveisok, @akoeplinger
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Example from #93773

Known Issue Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Report

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	0	0

Author:	jkotas
Assignees:	-
Labels:	os-mac-os-x, blocking-clean-ci, untriaged, os-ios, os-tvos, area-NativeAOT-coreclr
Milestone:	-

[akoeplinger]

Seems like we no longer see these timeouts, closing.