[release/7.0][wasm] Multiple `JIT.*` runtime test failures on rolling builds

[radical]

Occurrences:

Day	Run	OS	Details
9/23	Rolling run 28406 (7.0)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	1x JIT.* failures
9/23	Rolling run 28106 (7.0)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	3x JIT.* failures
9/23	Rolling run 27711 (7.0)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	3x JIT.* failures
9/22	Rolling run 27252 (7.0)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	3x JIT.* failures
9/22	Rolling run 25951 (7.0)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	4x JIT.* failures
9/21	Rolling run 25763 (7.0)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	2x JIT.* failures
9/21	Rolling run 25169 (7.0)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	8x JIT.* failures
9/20	Rolling run 23284 (7.0)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	2x JIT.* failures
9/19	Rolling run 22992 (7.0)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	5x JIT.* failures
9/19	Rolling run 22495 (7.0)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	2x JIT failures & 1x Loader failure
9/17-9/18	no runs
9/16	Rolling run 20657 (7.0-rc2)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	2x JIT.* failures
9/16	Rolling run 20304 (7.0)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	3x JIT.* failures
9/16	Rolling run 20115 (7.0-rc2)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	1x Loader.* failure
9/15	Rolling run 18463 (7.0)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	1x JIT.* failure
9/15	Rolling run 18930 (7.0-rc2)	Mono Browser wasm Release @ Ubuntu.1804.Amd64.Open	2x JIT.* failures

Original report

• Failing build.

JIT.HardwareIntrinsics.Arm.AdvSimd:

    JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/AdvSimd_Part6_r.sh [FAIL]
      
      Return code:      1
      Raw output file:      /datadisks/disk1/work/B2CE09D6/w/ABBA093D/uploads/Reports/JIT.HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/AdvSimd_Part6_r.output.txt
      Raw output:
      BEGIN EXECUTION
      MSBuild version 17.4.0-preview-22416-02+5d102ae37 for .NET
        AppDir: /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/WasmApp/
        TestBinDir: /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r
        ArtifactsBinDir: 
        Generated app bundle at /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/WasmApp/
      /datadisks/disk1/work/B2CE09D6/p/dotnet-cli/sdk/7.0.100-rc.1.22425.9/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.RuntimeIdentifierInference.targets(219,5): message NETSDK1057: You are using a preview version of .NET. See: https://aka.ms/dotnet-support-policy [/datadisks/disk1/work/B2CE09D6/p/wasm-test-runner/WasmTestRunner.proj]
      Test Harness Exitcode is : 1
      To run the test:
      > set CORE_ROOT=/datadisks/disk1/work/B2CE09D6/p
      > /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/AdvSimd_Part6_r.sh
      Expected: True
      Actual:   False
      Stack Trace:
           at JIT_HardwareIntrinsics._Arm_AdvSimd_AdvSimd_Part6_r_AdvSimd_Part6_r_._Arm_AdvSimd_AdvSimd_Part6_r_AdvSimd_Part6_r_sh()
           at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
           at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
      Output:
        
        Return code:      1
        Raw output file:      /datadisks/disk1/work/B2CE09D6/w/ABBA093D/uploads/Reports/JIT.HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/AdvSimd_Part6_r.output.txt
        Raw output:
        BEGIN EXECUTION
        MSBuild version 17.4.0-preview-22416-02+5d102ae37 for .NET
          AppDir: /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/WasmApp/
          TestBinDir: /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r
          ArtifactsBinDir: 
          Generated app bundle at /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/WasmApp/
        /datadisks/disk1/work/B2CE09D6/p/dotnet-cli/sdk/7.0.100-rc.1.22425.9/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.RuntimeIdentifierInference.targets(219,5): message NETSDK1057: You are using a preview version of .NET. See: https://aka.ms/dotnet-support-policy [/datadisks/disk1/work/B2CE09D6/p/wasm-test-runner/WasmTestRunner.proj]
        Test Harness Exitcode is : 1
        To run the test:
        > set CORE_ROOT=/datadisks/disk1/work/B2CE09D6/p
        > /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/AdvSimd_Part6_r.sh

JIT.HardwareIntrinsics.X86.General:

    JIT/HardwareIntrinsics/X86/General/VectorUnused_r/VectorUnused_r.sh [FAIL]
      
      Return code:      1
      Raw output file:      /datadisks/disk1/work/B2CE09D6/w/AF3E0916/uploads/Reports/JIT.HardwareIntrinsics/X86/General/VectorUnused_r/VectorUnused_r.output.txt
      Raw output:
      BEGIN EXECUTION
      MSBuild version 17.4.0-preview-22416-02+5d102ae37 for .NET
      /datadisks/disk1/work/B2CE09D6/p/wasm-test-runner/WasmTestRunner.proj : error : Failed to resolve SDK 'Microsoft.Build.NoTargets/1.0.53'. Package restore was successful but a package with the ID of "Microsoft.Build.NoTargets" was not installed.
      /datadisks/disk1/work/B2CE09D6/p/wasm-test-runner/WasmTestRunner.proj : error MSB4236: The SDK 'Microsoft.Build.NoTargets/1.0.53' specified could not be found.
      Test Harness Exitcode is : 1
      To run the test:
      > set CORE_ROOT=/datadisks/disk1/work/B2CE09D6/p
      > /datadisks/disk1/work/B2CE09D6/w/AF3E0916/e/JIT/HardwareIntrinsics/X86/General/VectorUnused_r/VectorUnused_r.sh
      Expected: True
      Actual:   False
      Stack Trace:
           at JIT_HardwareIntrinsics._X86_General_VectorUnused_r_VectorUnused_r_._X86_General_VectorUnused_r_VectorUnused_r_sh()
           at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
           at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
      Output:
        
        Return code:      1
        Raw output file:      /datadisks/disk1/work/B2CE09D6/w/AF3E0916/uploads/Reports/JIT.HardwareIntrinsics/X86/General/VectorUnused_r/VectorUnused_r.output.txt
        Raw output:
        BEGIN EXECUTION
        MSBuild version 17.4.0-preview-22416-02+5d102ae37 for .NET
        /datadisks/disk1/work/B2CE09D6/p/wasm-test-runner/WasmTestRunner.proj : error : Failed to resolve SDK 'Microsoft.Build.NoTargets/1.0.53'. Package restore was successful but a package with the ID of "Microsoft.Build.NoTargets" was not installed.
        /datadisks/disk1/work/B2CE09D6/p/wasm-test-runner/WasmTestRunner.proj : error MSB4236: The SDK 'Microsoft.Build.NoTargets/1.0.53' specified could not be found.
        Test Harness Exitcode is : 1
        To run the test:
        > set CORE_ROOT=/datadisks/disk1/work/B2CE09D6/p
        > /datadisks/disk1/work/B2CE09D6/w/AF3E0916/e/JIT/HardwareIntrinsics/X86/General/VectorUnused_r/VectorUnused_r.sh
  Finished:    JIT.HardwareIntrinsics.XUnitWrapper

JIT.HardwareIntrinsics.X86.Ssse3:

      Unhandled exception: System.IO.IOException: Connection timed out : 'Global\msbuild-server-launch-aCL7KKV98jx3O3fvRayafjy8_eCkKjpwtyjOVymKcEE'
         at System.Threading.Mutex.CreateMutexCore(Boolean initiallyOwned, String name, Boolean& createdNew)
         at Microsoft.Build.Experimental.MSBuildClient.TryLaunchServer()
         at Microsoft.Build.Experimental.MSBuildClient.Execute(CancellationToken cancellationToken)
         at Microsoft.Build.CommandLine.MSBuildClientApp.Execute(String[] commandLine, String msbuildLocation, CancellationToken cancellationToken)
         at Microsoft.Build.CommandLine.MSBuildApp.Main(String[] args)
         at Microsoft.DotNet.Cli.Utils.MSBuildForwardingAppWithoutLogging.ExecuteInProc(String[] arguments)
      
      Return code:      82
      Raw output file:      /datadisks/disk1/work/B2CE09D6/w/B25B099A/uploads/Reports/JIT.HardwareIntrinsics/X86/Ssse3/Ssse3_ro/Ssse3_ro.output.txt
...

JIT.Regression.CLR-x86-JIT.V1-M12-M13:

    JIT/Regression/CLR-x86-JIT/V1-M13-RTM/b92289/b92289/b92289.sh [FAIL]
      Unhandled exception: System.IO.IOException: Connection timed out : 'Global\msbuild-server-launch-aCL7KKV98jx3O3fvRayafjy8_eCkKjpwtyjOVymKcEE'
         at System.Threading.Mutex.CreateMutexCore(Boolean initiallyOwned, String name, Boolean& createdNew)
         at Microsoft.Build.Experimental.MSBuildClient.TryLaunchServer()
         at Microsoft.Build.Experimental.MSBuildClient.Execute(CancellationToken cancellationToken)
         at Microsoft.Build.CommandLine.MSBuildClientApp.Execute(String[] commandLine, String msbuildLocation, CancellationToken cancellationToken)
         at Microsoft.Build.CommandLine.MSBuildApp.Main(String[] args)
         at Microsoft.DotNet.Cli.Utils.MSBuildForwardingAppWithoutLogging.ExecuteInProc(String[] arguments)

... followed by lot of failures ...

Report

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	0	0

Tagging subscribers to 'arch-wasm': @lewing
See info in area-owners.md if you want to be subscribed.

Issue Details

---

• Failing build.

JIT.HardwareIntrinsics.Arm.AdvSimd:

    JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/AdvSimd_Part6_r.sh [FAIL]
      
      Return code:      1
      Raw output file:      /datadisks/disk1/work/B2CE09D6/w/ABBA093D/uploads/Reports/JIT.HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/AdvSimd_Part6_r.output.txt
      Raw output:
      BEGIN EXECUTION
      MSBuild version 17.4.0-preview-22416-02+5d102ae37 for .NET
        AppDir: /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/WasmApp/
        TestBinDir: /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r
        ArtifactsBinDir: 
        Generated app bundle at /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/WasmApp/
      /datadisks/disk1/work/B2CE09D6/p/dotnet-cli/sdk/7.0.100-rc.1.22425.9/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.RuntimeIdentifierInference.targets(219,5): message NETSDK1057: You are using a preview version of .NET. See: https://aka.ms/dotnet-support-policy [/datadisks/disk1/work/B2CE09D6/p/wasm-test-runner/WasmTestRunner.proj]
      Test Harness Exitcode is : 1
      To run the test:
      > set CORE_ROOT=/datadisks/disk1/work/B2CE09D6/p
      > /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/AdvSimd_Part6_r.sh
      Expected: True
      Actual:   False
      Stack Trace:
           at JIT_HardwareIntrinsics._Arm_AdvSimd_AdvSimd_Part6_r_AdvSimd_Part6_r_._Arm_AdvSimd_AdvSimd_Part6_r_AdvSimd_Part6_r_sh()
           at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
           at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
      Output:
        
        Return code:      1
        Raw output file:      /datadisks/disk1/work/B2CE09D6/w/ABBA093D/uploads/Reports/JIT.HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/AdvSimd_Part6_r.output.txt
        Raw output:
        BEGIN EXECUTION
        MSBuild version 17.4.0-preview-22416-02+5d102ae37 for .NET
          AppDir: /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/WasmApp/
          TestBinDir: /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r
          ArtifactsBinDir: 
          Generated app bundle at /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/WasmApp/
        /datadisks/disk1/work/B2CE09D6/p/dotnet-cli/sdk/7.0.100-rc.1.22425.9/Sdks/Microsoft.NET.Sdk/targets/Microsoft.NET.RuntimeIdentifierInference.targets(219,5): message NETSDK1057: You are using a preview version of .NET. See: https://aka.ms/dotnet-support-policy [/datadisks/disk1/work/B2CE09D6/p/wasm-test-runner/WasmTestRunner.proj]
        Test Harness Exitcode is : 1
        To run the test:
        > set CORE_ROOT=/datadisks/disk1/work/B2CE09D6/p
        > /datadisks/disk1/work/B2CE09D6/w/ABBA093D/e/JIT/HardwareIntrinsics/Arm/AdvSimd/AdvSimd_Part6_r/AdvSimd_Part6_r.sh

JIT.HardwareIntrinsics.X86.General:

    JIT/HardwareIntrinsics/X86/General/VectorUnused_r/VectorUnused_r.sh [FAIL]
      
      Return code:      1
      Raw output file:      /datadisks/disk1/work/B2CE09D6/w/AF3E0916/uploads/Reports/JIT.HardwareIntrinsics/X86/General/VectorUnused_r/VectorUnused_r.output.txt
      Raw output:
      BEGIN EXECUTION
      MSBuild version 17.4.0-preview-22416-02+5d102ae37 for .NET
      /datadisks/disk1/work/B2CE09D6/p/wasm-test-runner/WasmTestRunner.proj : error : Failed to resolve SDK 'Microsoft.Build.NoTargets/1.0.53'. Package restore was successful but a package with the ID of "Microsoft.Build.NoTargets" was not installed.
      /datadisks/disk1/work/B2CE09D6/p/wasm-test-runner/WasmTestRunner.proj : error MSB4236: The SDK 'Microsoft.Build.NoTargets/1.0.53' specified could not be found.
      Test Harness Exitcode is : 1
      To run the test:
      > set CORE_ROOT=/datadisks/disk1/work/B2CE09D6/p
      > /datadisks/disk1/work/B2CE09D6/w/AF3E0916/e/JIT/HardwareIntrinsics/X86/General/VectorUnused_r/VectorUnused_r.sh
      Expected: True
      Actual:   False
      Stack Trace:
           at JIT_HardwareIntrinsics._X86_General_VectorUnused_r_VectorUnused_r_._X86_General_VectorUnused_r_VectorUnused_r_sh()
           at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
           at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)
      Output:
        
        Return code:      1
        Raw output file:      /datadisks/disk1/work/B2CE09D6/w/AF3E0916/uploads/Reports/JIT.HardwareIntrinsics/X86/General/VectorUnused_r/VectorUnused_r.output.txt
        Raw output:
        BEGIN EXECUTION
        MSBuild version 17.4.0-preview-22416-02+5d102ae37 for .NET
        /datadisks/disk1/work/B2CE09D6/p/wasm-test-runner/WasmTestRunner.proj : error : Failed to resolve SDK 'Microsoft.Build.NoTargets/1.0.53'. Package restore was successful but a package with the ID of "Microsoft.Build.NoTargets" was not installed.
        /datadisks/disk1/work/B2CE09D6/p/wasm-test-runner/WasmTestRunner.proj : error MSB4236: The SDK 'Microsoft.Build.NoTargets/1.0.53' specified could not be found.
        Test Harness Exitcode is : 1
        To run the test:
        > set CORE_ROOT=/datadisks/disk1/work/B2CE09D6/p
        > /datadisks/disk1/work/B2CE09D6/w/AF3E0916/e/JIT/HardwareIntrinsics/X86/General/VectorUnused_r/VectorUnused_r.sh
  Finished:    JIT.HardwareIntrinsics.XUnitWrapper

JIT.HardwareIntrinsics.X86.Ssse3:

      Unhandled exception: System.IO.IOException: Connection timed out : 'Global\msbuild-server-launch-aCL7KKV98jx3O3fvRayafjy8_eCkKjpwtyjOVymKcEE'
         at System.Threading.Mutex.CreateMutexCore(Boolean initiallyOwned, String name, Boolean& createdNew)
         at Microsoft.Build.Experimental.MSBuildClient.TryLaunchServer()
         at Microsoft.Build.Experimental.MSBuildClient.Execute(CancellationToken cancellationToken)
         at Microsoft.Build.CommandLine.MSBuildClientApp.Execute(String[] commandLine, String msbuildLocation, CancellationToken cancellationToken)
         at Microsoft.Build.CommandLine.MSBuildApp.Main(String[] args)
         at Microsoft.DotNet.Cli.Utils.MSBuildForwardingAppWithoutLogging.ExecuteInProc(String[] arguments)
      
      Return code:      82
      Raw output file:      /datadisks/disk1/work/B2CE09D6/w/B25B099A/uploads/Reports/JIT.HardwareIntrinsics/X86/Ssse3/Ssse3_ro/Ssse3_ro.output.txt
...

JIT.Regression.CLR-x86-JIT.V1-M12-M13:

    JIT/Regression/CLR-x86-JIT/V1-M13-RTM/b92289/b92289/b92289.sh [FAIL]
      Unhandled exception: System.IO.IOException: Connection timed out : 'Global\msbuild-server-launch-aCL7KKV98jx3O3fvRayafjy8_eCkKjpwtyjOVymKcEE'
         at System.Threading.Mutex.CreateMutexCore(Boolean initiallyOwned, String name, Boolean& createdNew)
         at Microsoft.Build.Experimental.MSBuildClient.TryLaunchServer()
         at Microsoft.Build.Experimental.MSBuildClient.Execute(CancellationToken cancellationToken)
         at Microsoft.Build.CommandLine.MSBuildClientApp.Execute(String[] commandLine, String msbuildLocation, CancellationToken cancellationToken)
         at Microsoft.Build.CommandLine.MSBuildApp.Main(String[] args)
         at Microsoft.DotNet.Cli.Utils.MSBuildForwardingAppWithoutLogging.ExecuteInProc(String[] arguments)

... followed by lot of failures ...

Author:	radical
Assignees:	-
Labels:	arch-wasm, blocking-clean-ci, area-VM-meta-mono, test-failure
Milestone:	-

[stephentoub]

Also on PRs in main, e.g.
https://github.com/dotnet/runtime/pull/75318/checks?check_run_id=8279068492
https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-75318-merge-3cb5f6cbea0a472187/JIT.HardwareIntrinsics.General.Vector256/1/console.f2f14acf.log?helixlogtype=result

      > /datadisks/disk1/work/B89F09F9/w/BCB50A0C/e/JIT/HardwareIntrinsics/General/Vector256_1/Vector256_1_ro/Vector256_1_ro.sh
      Expected: True
      Actual:   False
      Stack Trace:
           at JIT_HardwareIntrinsics._General_Vector256_1_Vector256_1_ro_Vector256_1_ro_._General_Vector256_1_Vector256_1_ro_Vector256_1_ro_sh()
           at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
           at System.Reflection.MethodInvoker.Invoke(Object obj, IntPtr* args, BindingFlags invokeAttr)

[stephentoub]

And:
https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-pull-75212-merge-244fe847cfa44a98ac/JIT.HardwareIntrinsics.General.Vector256/1/console.480092cf.log?helixlogtype=result
https://dev.azure.com/dnceng-public/public/_build/results?buildId=10368&view=ms.vss-test-web.build-test-results-tab&runId=209152&resultId=102987&paneView=dotnet-dnceng.dnceng-anon-build-release-tasks.helix-anon-test-information-tab

[radical]

And build, log:

    JIT/Regression/JitBlue/Runtime_74126/Runtime_74126/Runtime_74126.sh [FAIL]
      
      Unhandled Exception:
      System.NullReferenceException: Object reference not set to an instance of an object
         at Runtime_74126.GetVtor[Vector256`1](Vector256`1 vtor)
         at Runtime_74126.Main()
      [ERROR] FATAL UNHANDLED EXCEPTION: System.NullReferenceException: Object reference not set to an instance of an object
         at Runtime_74126.GetVtor[Vector256`1](Vector256`1 vtor)
         at Runtime_74126.Main()
      
      Return code:      1
      Raw output file:      /datadisks/disk1/work/B6FB09E0/w/BC8609F2/uploads/Reports/JIT.Regression/JitBlue/Runtime_74126/Runtime_74126/Runtime_74126.output.txt
      Raw output:
      BEGIN EXECUTION
      /datadisks/disk1/work/B6FB09E0/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false Runtime_74126.dll ''
      Expected: 100
      Actual: 1
      END EXECUTION - FAILED
...

[lewing]

This seems to have come in with the new sdk

[lewing]

cc @rainersigwald