superpmi-collect failing for smoke_tests with error MSB4184: The expression "[System.IO.Directory]::GetDirectories(/mnt/vss/_work/1/s/payload/workitem/collectAssembliesDirectory/smoke_tests)" cannot be evaluated

[jakobbotsch]

See for example https://dev.azure.com/dnceng/internal/_build/results?buildId=2298235&view=results

"Send job to Helix" fails with

2023-10-22T20:22:38.5505223Z ========================== Starting Command Output ===========================
2023-10-22T20:22:38.5524303Z [command]/usr/bin/bash --noprofile --norc /mnt/vss/_work/_temp/54769a59-5346-4872-ba95-62435e4d7b32.sh
2023-10-22T20:22:41.7190221Z /mnt/vss/_work/1/s/src/coreclr/scripts/superpmi-collect.proj(183,27): error MSB4184: The expression "[System.IO.Directory]::GetDirectories(/mnt/vss/_work/1/s/payload/workitem/collectAssembliesDirectory/smoke_tests)" cannot be evaluated. Could not find a part of the path '/mnt/vss/_work/1/s/payload/workitem/collectAssembliesDirectory/smoke_tests'.
2023-10-22T20:22:41.7258152Z ##[error]src/coreclr/scripts/superpmi-collect.proj(183,27): error MSB4184: The expression "[System.IO.Directory]::GetDirectories(/mnt/vss/_work/1/s/payload/workitem/collectAssembliesDirectory/smoke_tests)" cannot be evaluated. Could not find a part of the path '/mnt/vss/_work/1/s/payload/workitem/collectAssembliesDirectory/smoke_tests'.
2023-10-22T20:22:41.7267755Z 
2023-10-22T20:22:41.7268010Z Build FAILED.
2023-10-22T20:22:41.7268127Z 
2023-10-22T20:22:41.7271052Z /mnt/vss/_work/1/s/src/coreclr/scripts/superpmi-collect.proj(183,27): error MSB4184: The expression "[System.IO.Directory]::GetDirectories(/mnt/vss/_work/1/s/payload/workitem/collectAssembliesDirectory/smoke_tests)" cannot be evaluated. Could not find a part of the path '/mnt/vss/_work/1/s/payload/workitem/collectAssembliesDirectory/smoke_tests'.
2023-10-22T20:22:41.7273739Z     0 Warning(s)
2023-10-22T20:22:41.7273962Z     1 Error(s)
2023-10-22T20:22:41.7274074Z 
2023-10-22T20:22:41.7274270Z Time Elapsed 00:00:01.88
2023-10-22T20:22:41.7495746Z Build failed with exit code 1. Check errors above.
2023-10-22T20:22:41.7620205Z ##[section]Finishing: Send job to Helix (Unix)

cc @dotnet/jit-contrib @TIHan can you take a look?

Tagging subscribers to this area: @JulieLeeMSFT, @jakobbotsch
See info in area-owners.md if you want to be subscribed.

Issue Details

---

See for example https://dev.azure.com/dnceng/internal/_build/results?buildId=2298235&view=results

"Send job to Helix" fails with

2023-10-22T20:22:38.5505223Z ========================== Starting Command Output ===========================
2023-10-22T20:22:38.5524303Z [command]/usr/bin/bash --noprofile --norc /mnt/vss/_work/_temp/54769a59-5346-4872-ba95-62435e4d7b32.sh
2023-10-22T20:22:41.7190221Z /mnt/vss/_work/1/s/src/coreclr/scripts/superpmi-collect.proj(183,27): error MSB4184: The expression "[System.IO.Directory]::GetDirectories(/mnt/vss/_work/1/s/payload/workitem/collectAssembliesDirectory/smoke_tests)" cannot be evaluated. Could not find a part of the path '/mnt/vss/_work/1/s/payload/workitem/collectAssembliesDirectory/smoke_tests'.
2023-10-22T20:22:41.7258152Z ##[error]src/coreclr/scripts/superpmi-collect.proj(183,27): error MSB4184: The expression "[System.IO.Directory]::GetDirectories(/mnt/vss/_work/1/s/payload/workitem/collectAssembliesDirectory/smoke_tests)" cannot be evaluated. Could not find a part of the path '/mnt/vss/_work/1/s/payload/workitem/collectAssembliesDirectory/smoke_tests'.
2023-10-22T20:22:41.7267755Z 
2023-10-22T20:22:41.7268010Z Build FAILED.
2023-10-22T20:22:41.7268127Z 
2023-10-22T20:22:41.7271052Z /mnt/vss/_work/1/s/src/coreclr/scripts/superpmi-collect.proj(183,27): error MSB4184: The expression "[System.IO.Directory]::GetDirectories(/mnt/vss/_work/1/s/payload/workitem/collectAssembliesDirectory/smoke_tests)" cannot be evaluated. Could not find a part of the path '/mnt/vss/_work/1/s/payload/workitem/collectAssembliesDirectory/smoke_tests'.
2023-10-22T20:22:41.7273739Z     0 Warning(s)
2023-10-22T20:22:41.7273962Z     1 Error(s)
2023-10-22T20:22:41.7274074Z 
2023-10-22T20:22:41.7274270Z Time Elapsed 00:00:01.88
2023-10-22T20:22:41.7495746Z Build failed with exit code 1. Check errors above.
2023-10-22T20:22:41.7620205Z ##[section]Finishing: Send job to Helix (Unix)

cc @dotnet/jit-contrib @TIHan can you take a look?

Author:	jakobbotsch
Assignees:	-
Labels:	area-CodeGen-coreclr, untriaged, needs-area-label
Milestone:	-

[TIHan]

It looks like building the nativeaot smoke_tests is failing in CI:

/mnt/vss/_work/1/s/.dotnet/sdk/8.0.100-rtm.23506.1/Sdks/Microsoft.NET.Sdk/targets/Microsoft.PackageDependencyResolution.targets(266,5): error NETSDK1004: Assets file '/mnt/vss/_work/1/s/artifacts/obj/ILLink.Tasks/project.assets.json' not found. Run a NuGet package restore to generate this file. [/mnt/vss/_work/1/s/src/tools/illink/src/ILLink.Tasks/ILLink.Tasks.csproj::TargetFramework=net8.0] [/mnt/vss/_work/1/s/src/tests/build.proj]

Building locally is working fine. Still investigating.

[TIHan]

This isn't making a lot of sense. The product build in CI does include project.assets.json:

      "fileName": "./obj/ILLink.Tasks/project.assets.json",
      "SPDXID": "SPDXRef-File--obj-ILLink.Tasks-project.assets.json-8C1B234623FDCADEF8B11E819D79CCAF0834FFA4",

[TIHan]

#91468 is what caused this failure. Let me see if there is a way I can get around this.

[TIHan]

I was able to resolve the ILLink issue by just building the tool. However, for some reason, when building the smoke_tests, the .ilc.rsp files are not being generated.

[TIHan]

Turns out I was running the wrong pipeline.... Simply building ILLink before building the smoke_tests fixes this.