Test failure: System.Collections.Immutable.Tests

[BruceForstall]

Failure in libraries System.Collections.Immutable.Tests: release libraries, checked coreclr with:

set COMPlus_TieredCompilation=0
set COMPlus_JitStressRegs=0x80

Windows arm64

E.g.,

build -s libs+libs.tests -runtimeConfiguration checked -c Release -arch arm64 /p:ArchiveTests=true

(the /p:ArchiveTests=true is required to build the RunTests.cmd wrapper scripts)

c:\bugs\System.Collections.Immutable.Tests\net5.0-Release>call .\RunTests.cmd -r C:\bugs\testhost\net5.0-Windows_NT-Release-arm64

pushd c:\bugs\System.Collections.Immutable.Tests\net5.0-Release\
"C:\bugs\testhost\net5.0-Windows_NT-Release-arm64\dotnet.exe" exec --runtimeconfig System.Collections.Immutable.Tests.runtimeconfig.json --depsfile System.Collections.Immutable.Tests.deps.json xunit.console.dll System.Collections.Immutable.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing
popd
===========================================================================================================

c:\bugs\System.Collections.Immutable.Tests\net5.0-Release>"C:\bugs\testhost\net5.0-Windows_NT-Release-arm64\dotnet.exe" exec --runtimeconfig System.Collections.Immutable.Tests.runtimeconfig.json --depsfile System.Collections.Immutable.Tests.deps.json xunit.console.dll System.Collections.Immutable.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing
  Discovering: System.Collections.Immutable.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Collections.Immutable.Tests (found 937 of 941 test cases)
  Starting:    System.Collections.Immutable.Tests (parallel test collections = on, max threads = 8)
    System.Collections.Immutable.Tests.ImmutableDictionaryTest.ToImmutableDictionary [FAIL]
      Assert.Equal() Failure
      Expected: 1
      Actual:   0
      Stack Trace:
        C:\gh\runtime2\src\libraries\System.Collections.Immutable\tests\ImmutableDictionaryTest.cs(181,0): at System.Collections.Immutable.Tests.ImmutableDictionaryTest.ToImmutableDictionary()
  Finished:    System.Collections.Immutable.Tests
=== TEST EXECUTION SUMMARY ===
   System.Collections.Immutable.Tests  Total: 1907, Errors: 0, Failed: 1, Skipped: 0, Time: 25.043s
----- end Fri 06/12/2020 12:56:21.60 ----- exit code 1 ----------------------------------------------------------

There's a similar failure in DataContractJsonSerializerTests.DCJS_Dictionary_UseSimpleDictionaryFormat_VariousKeyTypes:

C:\dotnetbuild\work\B6A7099A\w\9DEE091A\e>call RunTests.cmd --runtime-path C:\dotnetbuild\work\B6A7099A\p 
----- start Thu 06/11/2020 23:44:55.74 ===============  To repro directly: ===================================================== 
pushd C:\dotnetbuild\work\B6A7099A\w\9DEE091A\e\
"C:\dotnetbuild\work\B6A7099A\p\dotnet.exe" exec --runtimeconfig System.Runtime.Serialization.Json.ReflectionOnly.Tests.runtimeconfig.json --depsfile System.Runtime.Serialization.Json.ReflectionOnly.Tests.deps.json xunit.console.dll System.Runtime.Serialization.Json.ReflectionOnly.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing 
popd
===========================================================================================================

C:\dotnetbuild\work\B6A7099A\w\9DEE091A\e>"C:\dotnetbuild\work\B6A7099A\p\dotnet.exe" exec --runtimeconfig System.Runtime.Serialization.Json.ReflectionOnly.Tests.runtimeconfig.json --depsfile System.Runtime.Serialization.Json.ReflectionOnly.Tests.deps.json xunit.console.dll System.Runtime.Serialization.Json.ReflectionOnly.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing  
  Discovering: System.Runtime.Serialization.Json.ReflectionOnly.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Runtime.Serialization.Json.ReflectionOnly.Tests (found 170 test cases)
  Starting:    System.Runtime.Serialization.Json.ReflectionOnly.Tests (parallel test collections = on, max threads = 46)
    DataContractJsonSerializerTests.DCJS_Dictionary_UseSimpleDictionaryFormat_VariousKeyTypes [FAIL]
      Assert.Equal() Failure
      Expected: 1
      Actual:   0
      Stack Trace:
        /_/src/libraries/System.Runtime.Serialization.Json/tests/DataContractJsonSerializer.cs(507,0): at DataContractJsonSerializerTests.DCJS_Dictionary_UseSimpleDictionaryFormat_VariousKeyTypes()
  Finished:    System.Runtime.Serialization.Json.ReflectionOnly.Tests
=== TEST EXECUTION SUMMARY ===
   System.Runtime.Serialization.Json.ReflectionOnly.Tests  Total: 170, Errors: 0, Failed: 1, Skipped: 0, Time: 10.806s
----- end Thu 06/11/2020 23:45:11.22 ----- exit code 1 ----------------------------------------------------------

and:

C:\h\w\B6A7099A\w\A7C7097D\e>call RunTests.cmd --runtime-path C:\h\w\B6A7099A\p 
----- start Thu 06/11/2020 23:44:57.08 ===============  To repro directly: ===================================================== 
pushd C:\h\w\B6A7099A\w\A7C7097D\e\
"C:\h\w\B6A7099A\p\dotnet.exe" exec --runtimeconfig System.Runtime.Serialization.Json.Tests.runtimeconfig.json --depsfile System.Runtime.Serialization.Json.Tests.deps.json xunit.console.dll System.Runtime.Serialization.Json.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing 
popd
===========================================================================================================

C:\h\w\B6A7099A\w\A7C7097D\e>"C:\h\w\B6A7099A\p\dotnet.exe" exec --runtimeconfig System.Runtime.Serialization.Json.Tests.runtimeconfig.json --depsfile System.Runtime.Serialization.Json.Tests.deps.json xunit.console.dll System.Runtime.Serialization.Json.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing  
  Discovering: System.Runtime.Serialization.Json.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Runtime.Serialization.Json.Tests (found 170 test cases)
  Starting:    System.Runtime.Serialization.Json.Tests (parallel test collections = on, max threads = 46)
    DataContractJsonSerializerTests.DCJS_Dictionary_UseSimpleDictionaryFormat_VariousKeyTypes [FAIL]
      Assert.Equal() Failure
      Expected: 1
      Actual:   0
      Stack Trace:
        /_/src/libraries/System.Runtime.Serialization.Json/tests/DataContractJsonSerializer.cs(507,0): at DataContractJsonSerializerTests.DCJS_Dictionary_UseSimpleDictionaryFormat_VariousKeyTypes()
  Finished:    System.Runtime.Serialization.Json.Tests
=== TEST EXECUTION SUMMARY ===
   System.Runtime.Serialization.Json.Tests  Total: 170, Errors: 0, Failed: 1, Skipped: 0, Time: 13.475s
----- end Thu 06/11/2020 23:45:15.24 ----- exit code 1 ----------------------------------------------------------

Tagging subscribers to this area: @eiriktsarpalis
Notify danmosemsft if you want to be subscribed.