Expand test coverage for native AOT on android #121217

sbomer · 2025-10-30T20:47:29Z

Enables building native AOT smoke tests for android with one APK per test project
Adds marker files to set expected exit code when running through helix
Adds a runtime-androidemulator job for native AOT smoke tests
Expands libraries test coverage to include non-smoke tests
Sets up appcontext base directory in test host
Calls managed main through a pinvoke when running Exe project in the runtime tests

Fixes #120715

- Expand native AOT smoke tests to all libraries tests - Add job for runtime smoke tests using native AOT on emulator

Move NDK compiler logic to a shared props file and import it in test and build projects to unify Android NativeAOT and Mono builds.

- Set ASSETS_DIR for crypto tests (using same pattern as existing crypto test) - Set AppContext.BaseDirectory We should probably change crypto tests to use just AppContext.BaseDirectory.

- Use ReferenceXUnitWrapperGenerator != false to define SINGLE_FILE_TEST_RUNNER (android & singlefile targets) instead of IsFunctionalTest - Condition SingleFileTestRunner compile and TrimmerRootAssembly (TestUtilities) on wrapper/generator and SkipTestUtilitiesReference - Add Android NativeAOT publish/trim settings and set NativeLib/CustomNativeMain for android nativeaot - Make DisableImplicitFrameworkReferences respect preexisting value and add explicit DisableImplicitFrameworkReferences=false in nativeaot tests dir - Import testing\tests.targets when TargetsAndroid is true - Update many NativeAOT smoke tests Main signatures to public static int Main(string[] args) to match runner invocation

- Ensure they have Main entry point - Tighten MSBuild conditions: - Only set NativeLib/CustomNativeMain for Android when OutputType == Exe - Only import testing/tests.targets for Android when using MicrosoftNETSdk and building executables - Make TestNativeAOT/UseNativeAOTRuntime defaults apply when TestBuildMode == nativeaot and only include monodroid-nativeaot.cs for executable/XUnit-wrapper cases

This reverts commit 4ed06ec.

- Avoid importing logic for SharedLibrary - Fix library filename - Set HasMergedInTests to ensure projects build

This reverts commit 37b7b4e.

This import is now covered by the IsMergedTestRunnerAssembly property. Fixes a warning about a double import. Fixes issue where mono runtime tests are getting incorrect assembly name due to this undesired import.

Copilot

Pull Request Overview

This PR adds support for running NativeAOT tests on Android by implementing the necessary infrastructure changes. The changes enable Android NativeAOT tests to build, package as APKs, and run on Android devices/emulators through Helix.

Key Changes

Adds Android-specific build configuration for NativeAOT tests
Implements custom entry point handling for NativeAOT on Android via monodroid-nativeaot.cs template
Configures CI/CD pipelines to build and run NativeAOT tests on Android
Excludes several tests that are incompatible with Android NativeAOT

Reviewed Changes

Copilot reviewed 26 out of 27 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
src/tests/nativeaot/Directory.Build.props	Adds Android-specific build properties including library import generator settings and test runner configuration
src/tests/Directory.Build.props	Enables aggressive trimming for Android NativeAOT, similar to iOS/tvOS
src/tests/Directory.Build.targets	Adds logic to skip OutputType inference and handle DisableImplicitFrameworkReferences for Android NativeAOT
src/tests/build.proj	Imports Android NDK compiler properties and adds RuntimeFlavor resolution for Android builds
src/tests/Common/mergedrunner*.targets	Adds ExpectedExitCode file generation and conditions for mobile targets
src/tests/Common/helixpublishwitharcade.proj	Reads ExpectedExitCode from file for Android test payloads
src/tasks/AndroidAppBuilder/Templates/monodroid-nativeaot.cs	Implements entry point execution via `__managed__Main` for Android NativeAOT tests
eng/testing/Android/AndroidNdkCompiler.props	New file that centralizes Android NDK compiler/linker path configuration
src/mono/msbuild/android/build/AndroidBuild.props	Imports centralized AndroidNdkCompiler.props instead of defining CppCompilerAndLinker locally
eng/testing/tests.*.targets	Updates conditions to use ReferenceXUnitWrapperGenerator and adds NativeAOT-specific properties for Android
eng/pipelines/extra-platforms/*.yml	Adds new Android NativeAOT CI jobs and removes /p:RunSmokeTestsOnly=true
eng/pipelines/common/platform-matrix.yml	Parameterizes runtimeFlavor for Android platforms
src/tests/nativeaot/SmokeTests/*/?.csproj	Marks several smoke tests as unsupported on Android with explanatory comments
src/tests/issues.targets	Excludes nativeaot/SmokeTests/UnitTests from Android NativeAOT
src/libraries/tests.proj	Excludes multiple library test projects that fail on Android NativeAOT
src/libraries//tests/.cs	Adds ActiveIssue attributes for tests that fail on Android NativeAOT
src/libraries/Microsoft.Extensions.Hosting/tests/UnitTests/HostApplicationBuilderTests.cs	Removes trailing whitespace

src/tests/nativeaot/SmokeTests/SharedLibrary/SharedLibrary.csproj

src/tests/nativeaot/SmokeTests/Exceptions/Exceptions.cs

src/tests/nativeaot/Directory.Build.props

- Clean up ReferenceXUnitWrapperGenerator condition - Disable tests for android via runtime check - Disable unsupported ISA tests - Add comment for disabled SharedLibrary test

sbomer · 2025-11-04T22:10:35Z

/azp run runtime-androidemulator

sbomer · 2025-11-04T22:10:43Z

/azp run runtime-android

azure-pipelines · 2025-11-04T22:10:44Z

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines · 2025-11-04T22:10:53Z

Azure Pipelines successfully started running 1 pipeline(s).

And fix resulting duplicate imports due to build.proj getting these settings.

sbomer · 2025-11-06T17:09:04Z

/azp run runtime-androidemulator

sbomer · 2025-11-06T17:09:11Z

/azp run runtime-android

azure-pipelines · 2025-11-06T17:09:15Z

Azure Pipelines successfully started running 1 pipeline(s).

azure-pipelines · 2025-11-06T17:09:20Z

Azure Pipelines successfully started running 1 pipeline(s).

sbomer added 30 commits October 13, 2025 17:21

Add more native AOT on android ci test coverage

3bf76d6

- Expand native AOT smoke tests to all libraries tests - Add job for runtime smoke tests using native AOT on emulator

Remove --cross argument, fix and disable some libs tests

432572c

Remove --cross argument, fix and disable some libs tests

214d1f9

Set runtimeFlavor to coreclr

a9eeff0

Parameterize runtimeFlavor in Android job definitions

5253ab2

Remove runtimeFlavor: coreclr from Android emulator pipeline

9d8577b

Fix typo in runtimeFlavor parameter name

fef0415

Add 'nativeaot' arg to testBuildArgs for Android emulator

c509f51

Increase timeout to 180

4cbbff5

Refactor Android NDK compiler selection for test builds

c1292f1

Move NDK compiler logic to a shared props file and import it in test and build projects to unify Android NativeAOT and Mono builds.

Increase timeout to 240

dfbf8ea

Pass RuntimeFlavor to AndroidAppBuilderTask

b8abeba

Check TestBuildMode instead

cc1d5c3

Fix a few test failures

2b7f252

- Set ASSETS_DIR for crypto tests (using same pattern as existing crypto test) - Set AppContext.BaseDirectory We should probably change crypto tests to use just AppContext.BaseDirectory.

Set Environment.CurrentDirectory to app files directory

1ee5f13

Exclude tests failing due to missing calli marshalling support

cce4d9a

Exclude tests failing due to missing crypto shim export

e6338fb

Disable directory apk build for smoke tests

eec6deb

Try using merged test runners

4ed06ec

Revert "Try using merged test runners"

cbcca7d

This reverts commit 4ed06ec.

Add Merged marker for smoke tests

37b7b4e

Try merged wrappers again

9e89dda

- Avoid importing logic for SharedLibrary - Fix library filename - Set HasMergedInTests to ensure projects build

Revert "Add Merged marker for smoke tests"

3a266b8

This reverts commit 37b7b4e.

Fix some issues with non-standalone build

a0c0cd6

Remove buildAllTestsAsStandalone

55b18f5

Set expected exit code

8e60575

Remove redundant import

9f6e630

This import is now covered by the IsMergedTestRunnerAssembly property. Fixes a warning about a double import. Fixes issue where mono runtime tests are getting incorrect assembly name due to this undesired import.

Fix mono test build

d4d4ad3

dotnet deleted a comment from azure-pipelines bot Nov 3, 2025

Copilot AI reviewed Nov 3, 2025

View reviewed changes

jkotas reviewed Nov 3, 2025

View reviewed changes

src/tests/nativeaot/SmokeTests/SharedLibrary/SharedLibrary.csproj Show resolved Hide resolved

This was referenced Nov 3, 2025

Failed to install runtime_python_requirements #114924

Open

slow macOS - "##[error]The job running on agent Azure Pipelines 9 ran longer than the maximum time of 60 minutes." dotnet/dnceng#1883

Open

MichalStrehovsky reviewed Nov 4, 2025

View reviewed changes

src/tests/nativeaot/SmokeTests/Exceptions/Exceptions.cs Outdated Show resolved Hide resolved

src/tests/nativeaot/Directory.Build.props Outdated Show resolved Hide resolved

build-analysis bot mentioned this pull request Nov 4, 2025

HardwareIntrinsics_General_r.cmd - The system cannot find the path specified #121344

Closed

sbomer added 2 commits November 4, 2025 14:07

PR feedback and cleanup

910abed

- Clean up ReferenceXUnitWrapperGenerator condition - Disable tests for android via runtime check - Disable unsupported ISA tests - Add comment for disabled SharedLibrary test

Add comment about runtime tests

776f3e1

dotnet deleted a comment from azure-pipelines bot Nov 4, 2025

sbomer added 2 commits November 5, 2025 16:42

Try to fix condition for SingleFileTestRunner, fix test failure

61e4a37

Move shared props out of nativeaot dir

216417e

And fix resulting duplicate imports due to build.proj getting these settings.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Expand test coverage for native AOT on android #121217

Expand test coverage for native AOT on android #121217

sbomer commented Oct 30, 2025 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

sbomer commented Nov 4, 2025

Uh oh!

sbomer commented Nov 4, 2025

Uh oh!

azure-pipelines bot commented Nov 4, 2025

Uh oh!

azure-pipelines bot commented Nov 4, 2025

Uh oh!

sbomer commented Nov 6, 2025

Uh oh!

sbomer commented Nov 6, 2025

Uh oh!

azure-pipelines bot commented Nov 6, 2025

Uh oh!

azure-pipelines bot commented Nov 6, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Expand test coverage for native AOT on android #121217

Are you sure you want to change the base?

Expand test coverage for native AOT on android #121217

Conversation

sbomer commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull Request Overview

Key Changes

Reviewed Changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

sbomer commented Nov 4, 2025

Uh oh!

sbomer commented Nov 4, 2025

Uh oh!

azure-pipelines bot commented Nov 4, 2025

Uh oh!

azure-pipelines bot commented Nov 4, 2025

Uh oh!

sbomer commented Nov 6, 2025

Uh oh!

sbomer commented Nov 6, 2025

Uh oh!

azure-pipelines bot commented Nov 6, 2025

Uh oh!

azure-pipelines bot commented Nov 6, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

sbomer commented Oct 30, 2025 •

edited

Loading