[6.0] Android test failure: Failed to install mobile app

[carlossanlop]

Found in the internal->public merge PR for 6.0: #83404

Lots of tests affected by the exact same failure message.

• Queue: Build Android x64 Release AllSubsets_Mono_RuntimeTests
• Job: https://dev.azure.com/dnceng-public/public/_build/results?buildId=204115&view=logs&j=b6f63eff-75cc-59ca-fdbf-d2121601a613&t=92df95dc-ad7c-5fec-a8b4-c8301b7a2225
• Log file example: https://helixre107v0xd1eu3ibi6ka.blob.core.windows.net/dotnet-runtime-refs-pull-83404-merge-a043263a5a864fcdaa/JIT/1/console.22d84e79.log?helixlogtype=result
• Callstack:

Microsoft.DotNet.XUnitConsoleRunner v2.5.0 (64-bit .NET 6.0.14)
  Discovering: JIT.opt.XUnitWrapper (method display = ClassAndMethod, method display options = None)
  Discovered:  JIT.opt.XUnitWrapper (found 80 test cases)
  Starting:    JIT.opt.XUnitWrapper (parallel test collections = off, max threads = 2)
    JIT/opt/AssertionPropagation/ArrBoundBinaryOp/ArrBoundBinaryOp.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
        
    JIT/opt/AssertionPropagation/ArrBoundMinLength/ArrBoundMinLength.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
        
    JIT/opt/AssertionPropagation/ArrBoundUnsigned/ArrBoundUnsigned.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
        
    JIT/opt/Casts/shared/shared.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----

...
and goes on and on...

{
  "ErrorMessage": "The following constructor parameters did not have matching fixture data: _Global globalVar",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": false
}

Report

Build	Definition	Test	Pull Request
1027363	dotnet/runtime	Loader.classloader.WorkItemExecution
1025960	dotnet/runtime	PayloadGroup0.WorkItemExecution
1025626	dotnet/runtime	JIT/RyuJIT/DoWhileBndChk/DoWhileBndChk.sh
1024414	dotnet/runtime	PayloadGroup0.WorkItemExecution	#114633
1024193	dotnet/runtime	PayloadGroup0.WorkItemExecution
1023955	dotnet/runtime	PayloadGroup0.WorkItemExecution
1023237	dotnet/runtime	Regressions/coreclr/15650/interfacecctor/interfacecctor.sh
1015761	dotnet/runtime	PayloadGroup0.WorkItemExecution	#114633
1017254	dotnet/runtime	PayloadGroup0.WorkItemExecution
1017227	dotnet/runtime	PayloadGroup0.WorkItemExecution
1016458	dotnet/runtime	PayloadGroup0.WorkItemExecution
1016396	dotnet/runtime	PayloadGroup0.WorkItemExecution
1016086	dotnet/runtime	PayloadGroup0.WorkItemExecution
1014531	dotnet/runtime	PayloadGroup0.WorkItemExecution
1014026	dotnet/runtime	PayloadGroup0.WorkItemExecution
1013784	dotnet/runtime	PayloadGroup0.WorkItemExecution
1013746	dotnet/runtime	Loader.classloader.generics.WorkItemExecution
1011261	dotnet/runtime	PayloadGroup0.WorkItemExecution
1008937	dotnet/runtime	PayloadGroup0.WorkItemExecution
1008163	dotnet/runtime	PayloadGroup0.WorkItemExecution
1006102	dotnet/runtime	PayloadGroup0.WorkItemExecution
1005296	dotnet/runtime	PayloadGroup0.WorkItemExecution
1004551	dotnet/runtime	PayloadGroup0.WorkItemExecution
1004581	dotnet/runtime	PayloadGroup0.WorkItemExecution
1004300	dotnet/runtime	PayloadGroup0.WorkItemExecution
1004326	dotnet/runtime	PayloadGroup0.WorkItemExecution
1003241	dotnet/runtime	nativeaot.SmokeTests.DynamicGenerics.WorkItemExecution
1002815	dotnet/runtime	PayloadGroup0.WorkItemExecution
1002851	dotnet/runtime	PayloadGroup0.WorkItemExecution
999180	dotnet/runtime	PayloadGroup0.WorkItemExecution

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	6	30

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 6/28/2023 6:30:52 PM UTC

Tagging subscribers to 'arch-android': @steveisok, @akoeplinger
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Found in the internal->public merge PR for 6.0: #83404

Lots of tests affected by the exact same failure message.

• Queue: Build Android x64 Release AllSubsets_Mono_RuntimeTests
• Job: https://dev.azure.com/dnceng-public/public/_build/results?buildId=204115&view=logs&j=b6f63eff-75cc-59ca-fdbf-d2121601a613&t=92df95dc-ad7c-5fec-a8b4-c8301b7a2225
• Log file example: https://helixre107v0xd1eu3ibi6ka.blob.core.windows.net/dotnet-runtime-refs-pull-83404-merge-a043263a5a864fcdaa/JIT/1/console.22d84e79.log?helixlogtype=result
• Callstack:

Microsoft.DotNet.XUnitConsoleRunner v2.5.0 (64-bit .NET 6.0.14)
  Discovering: JIT.opt.XUnitWrapper (method display = ClassAndMethod, method display options = None)
  Discovered:  JIT.opt.XUnitWrapper (found 80 test cases)
  Starting:    JIT.opt.XUnitWrapper (parallel test collections = off, max threads = 2)
    JIT/opt/AssertionPropagation/ArrBoundBinaryOp/ArrBoundBinaryOp.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
        
    JIT/opt/AssertionPropagation/ArrBoundMinLength/ArrBoundMinLength.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
        
    JIT/opt/AssertionPropagation/ArrBoundUnsigned/ArrBoundUnsigned.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
        
    JIT/opt/Casts/shared/shared.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_opt._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----

...
and goes on and on...

{
  "ErrorMessage": "The following constructor parameters did not have matching fixture data: _Global globalVar",
  "BuildRetry": false,
  "ErrorPattern": "",
  "ExcludeConsoleLog": false
}

Author:	carlossanlop
Assignees:	-
Labels:	arch-x64, os-android, area-VM-meta-mono
Milestone:	-

[steveisok]

@fanyang-mono does this happen in main as well?

[fanyang-mono]

@steveisok No I haven't seen apps failing to install for quite a while, since we introduced recovery mechanism. I checked that that code doesn't exit in release/6.0 branch.

Comparing
https://github.com/dotnet/runtime/blob/release/6.0/src/tests/Common/Coreclr.TestWrapper/MobileAppHandler.cs
and
https://github.com/dotnet/runtime/blob/main/src/tests/Common/Coreclr.TestWrapper/MobileAppHandler.cs

I am not sure if helix support that feature for 6.0. @premun

[premun]

Seems like the version of Arcade on the 6.0 branch does have this backported: https://github.com/dotnet/arcade/blob/0c93c1cb1ef9c9d5c1a59f4ab98c2f7e37f12197/src/Microsoft.DotNet.Helix/Sdk/tools/xharness-runner/xharness-runner.apple.sh

[fanyang-mono]

Seems like the version of Arcade on the 6.0 branch does have this backported: https://github.com/dotnet/arcade/blob/0c93c1cb1ef9c9d5c1a59f4ab98c2f7e37f12197/src/Microsoft.DotNet.Helix/Sdk/tools/xharness-runner/xharness-runner.apple.sh

I assume that the functionality for Android is backported as well?

[premun]

For Helix SDK, everything would be backported together

[carlossanlop]

Seen again in the latest 6.0 dependency flow PR: #83513

• Queue: Build Android x64 Release AllSubsets_Mono_RuntimeTests
• Job: https://dev.azure.com/dnceng-public/public/_build/results?buildId=211182&view=logs&j=b6f63eff-75cc-59ca-fdbf-d2121601a613&t=92df95dc-ad7c-5fec-a8b4-c8301b7a2225
• Log: https://helixre107v0xd1eu3ibi6ka.blob.core.windows.net/dotnet-runtime-refs-pull-83513-merge-e97b6a304a96472ea2/JIT.Methodical.eh/1/console.74b538d3.log?helixlogtype=result

Starting:    JIT.Methodical.XUnitWrapper (parallel test collections = off, max threads = 2)
    JIT/Methodical/eh/basics/emptyfinally_d/emptyfinally_d.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_Methodical._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----
        
    JIT/Methodical/eh/basics/multihandler_d/multihandler_d.sh [FAIL]
      System.AggregateException : One or more errors occurred. (Failed to install mobile app.
      Expected: True
      Actual:   False) (The following constructor parameters did not have matching fixture data: _Global globalVar)
      ---- Failed to install mobile app.
      Expected: True
      Actual:   False
      ---- The following constructor parameters did not have matching fixture data: _Global globalVar
      Stack Trace:
        
        ----- Inner Stack Trace #1 (Xunit.Sdk.TrueException) -----
           at JIT_Methodical._Global..ctor()
        ----- Inner Stack Trace #2 (Xunit.Sdk.TestClassException) -----