Skip to content

Add Interop 2024 Goals and Roadmap #19

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jgraham merged 3 commits into from
Mar 12, 2024
Merged

Add Interop 2024 Goals and Roadmap #19

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
100e222
Add Interop 2024 Goals and Roadmap
jgraham Jan 30, 2024
6097744
Update roadmap
jgraham Jan 30, 2024
30a801e
Apply suggestions from code review
jgraham Feb 27, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 25 additions & 5 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,10 +1,30 @@
# interop-2023-mobile-testing
Mobile Testing Investigation in Interop 2023
# interop-mobile-testing
Mobile Testing Investigation in Interop

## Scope
## 2024 Investigation

### Scope

Do the work so that by Interop 2025 the dashboard has a mobile view, with at least "experimental" versions of browsers, and the mobile view is considered as reliable as desktop.

### Roadmap

1. Formulate and implement a plan for getting iOS WebKit Results onto the dashboard
1. For each mobile browser, investigate and catalogue test failures relative to desktop
1. Reduce the number of unexplained mobile test failures relative to desktop to 0
1.
* Update the Interop infrastructure to consume mobile results and create a mobile specific results CSV (similar to desktop-stable and desktop-experimental)
* Provide a UI on wpt.fyi to present the mobile-specific interop scores

### Scoring

Each roadmap item will be scored equally and comprise 25% of the total investigation score

## 2023 Investigation
### Scope
Do the infrastructure work required to allow us to accept future Interop proposals that test mobile-specific functionality which can't be scored using the current desktop-only wpt CI.

## Roadmap
### Roadmap

1. Write up the requirements and options for testing on mobile (e.g. provide dedicated hardware, use vendor results, use mobile-simulation mode in desktop browsers etc.) along with pros and cons of each.
1. Do a feasability study into the options (e.g. if resources are required can any participant help provide those).
Expand All @@ -14,7 +34,7 @@ Do the infrastructure work required to allow us to accept future Interop proposa

Complete success would look like mobile results being available on wpt.fyi by the end of Interop 2023. Working out how such results would be used as part of a future Interop metric is explicitly out of scope, as are the addition of additional test APIs to support testing specific mobile features.

## Original Rationale
### Original Rationale

From the proposal: https://github.com/web-platform-tests/interop/issues/201

Expand Down