[ai] Skill for running device tests #33484
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Remove List-Simulators.ps1 (duplicates Start-Emulator.ps1 functionality) - Update Run-DeviceTests.ps1 to use shared Start-Emulator.ps1 for device management - Add support for local dotnet tool (xharness via dotnet tool manifest) - Update SKILL.md to document dependencies and remove List-Simulators references - Net result: -59 lines while improving reusability and alignment with existing scripts Tested: Successfully builds and runs Core device tests on iOS simulator
Contributor
There was a problem hiding this comment.
Pull request overview
This PR introduces a new developer skill for running .NET MAUI device tests locally on iOS simulators. It provides comprehensive documentation and a PowerShell automation script to streamline the process of building, running, and managing device tests using xharness and the .NET SDK.
Changes:
- Added complete skill documentation with prerequisites, usage scenarios, and examples for running device tests on iOS simulators
- Added
Run-DeviceTests.ps1script that automates building device test projects, managing iOS simulators, executing tests via xharness, and reporting results - Integrated with existing shared infrastructure scripts for simulator management and common utilities
Reviewed changes
Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.
| File | Description |
|---|---|
.github/skills/run-device-tests/SKILL.md |
Comprehensive documentation for the device tests skill including usage instructions, available test projects, workflow, and examples |
.github/skills/run-device-tests/scripts/Run-DeviceTests.ps1 |
PowerShell script that handles building device test projects, managing iOS simulators, running tests with xharness, and reporting test results |
Enhanced the device test script to extract and validate the simulator UDID and dynamically detect the iOS version from the booted simulator. Both --target (with version) and --device (UDID) are now passed to XHarness for more reliable simulator selection, especially on ARM64 Macs. Updated documentation to explain the new detection and targeting logic.
Contributor
|
I prompted Copilot to run labeled device tests on Android, then followed up with iOS - and it worked flawlessly. 
|
kubaflo
approved these changes
Jan 27, 2026
This was referenced Jan 28, 2026
kubaflo
added
the
area-ai-agents
rmarinho
added a commit
that referenced
this pull request
Jan 29, 2026
### Description of Change This pull request introduces a new developer skill for running .NET MAUI device tests locally on iOS simulators. It adds comprehensive documentation and two PowerShell scripts to streamline building, running, and managing device tests using xharness and the .NET SDK. The scripts automate simulator selection, build configuration, and test execution, making it easier for developers to verify iOS compatibility and run targeted tests. **Skill documentation and workflow:** - Added `.github/skills/run-device-tests/SKILL.md` with detailed instructions, prerequisites, usage scenarios, supported projects, example commands, and workflow for running device tests on iOS simulators using xharness and PowerShell. **Device test automation scripts:** - Added `Run-DeviceTests.ps1` script to build and run specified MAUI device test projects on iOS simulators, supporting options for iOS version selection, test filtering, build-only mode, and output directory customization. The script also summarizes test results and failed tests. - Added `List-Simulators.ps1` script to enumerate available iOS simulators, with support for filtering by iOS version and showing only booted simulators, helping users select appropriate test targets. --------- Co-authored-by: Shane Neuville <shneuvil@microsoft.com> Co-authored-by: Jakub Florkowski <kubaflo123@gmail.com>
kubaflo
added a commit
to kubaflo/maui
that referenced
this pull request
Feb 2, 2026
### Description of Change This pull request introduces a new developer skill for running .NET MAUI device tests locally on iOS simulators. It adds comprehensive documentation and two PowerShell scripts to streamline building, running, and managing device tests using xharness and the .NET SDK. The scripts automate simulator selection, build configuration, and test execution, making it easier for developers to verify iOS compatibility and run targeted tests. **Skill documentation and workflow:** - Added `.github/skills/run-device-tests/SKILL.md` with detailed instructions, prerequisites, usage scenarios, supported projects, example commands, and workflow for running device tests on iOS simulators using xharness and PowerShell. **Device test automation scripts:** - Added `Run-DeviceTests.ps1` script to build and run specified MAUI device test projects on iOS simulators, supporting options for iOS version selection, test filtering, build-only mode, and output directory customization. The script also summarizes test results and failed tests. - Added `List-Simulators.ps1` script to enumerate available iOS simulators, with support for filtering by iOS version and showing only booted simulators, helping users select appropriate test targets. --------- Co-authored-by: Shane Neuville <shneuvil@microsoft.com> Co-authored-by: Jakub Florkowski <kubaflo123@gmail.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description of Change
This pull request introduces a new developer skill for running .NET MAUI device tests locally on iOS simulators. It adds comprehensive documentation and two PowerShell scripts to streamline building, running, and managing device tests using xharness and the .NET SDK. The scripts automate simulator selection, build configuration, and test execution, making it easier for developers to verify iOS compatibility and run targeted tests.
Skill documentation and workflow:
.github/skills/run-device-tests/SKILL.mdwith detailed instructions, prerequisites, usage scenarios, supported projects, example commands, and workflow for running device tests on iOS simulators using xharness and PowerShell.Device test automation scripts:
Run-DeviceTests.ps1script to build and run specified MAUI device test projects on iOS simulators, supporting options for iOS version selection, test filtering, build-only mode, and output directory customization. The script also summarizes test results and failed tests.List-Simulators.ps1script to enumerate available iOS simulators, with support for filtering by iOS version and showing only booted simulators, helping users select appropriate test targets.