Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automation: Limit tests to not run on docs only changes #23834

Merged
merged 3 commits into from
Jul 9, 2020

Conversation

mkaz
Copy link
Member

@mkaz mkaz commented Jul 9, 2020

#23535 Description

Add filters for E2E, mobile, and performance tests to not run on documentation only changes, defined by *.md files in /docs/ and /packages/ directory

How has this been tested?

Trying to figure out how to test. Ideally make a change to a markdown file and confirm that the E2E, Mobile, and Performance tests don't run, and don't block the PR.

Types of changes

Github Actions workflow update adding exclude paths

@mkaz mkaz added the [Package] Project management automation /packages/project-management-automation label Jul 9, 2020
@youknowriad
Copy link
Contributor

The downside is the Github config to mark jobs as "Required". Now, we're forced to remove these tests from the required checks and just count on the "merger" to ensure these are passing before merging.

@mkaz
Copy link
Member Author

mkaz commented Jul 9, 2020

@youknowriad That was going to be my question, I wanted to test if they get skipped does that mean they are considered passed or not. Is there a way to return true?

@mkaz
Copy link
Member Author

mkaz commented Jul 9, 2020

@youknowriad We could remove the exclusion on the push to master check, but I suppose that doesn't really help, since its after the code got merged in.

@youknowriad
Copy link
Contributor

i removed these tests from the "required" ones. I think it's essentially a Github issue, they shouuld allow an option that says "all checks" are required (and all would be dependent on the PR)

@github-actions
Copy link

github-actions bot commented Jul 9, 2020

Size Change: 0 B

Total Size: 1.14 MB

ℹ️ View Unchanged
Filename Size Change
build/a11y/index.js 1.14 kB 0 B
build/annotations/index.js 3.67 kB 0 B
build/api-fetch/index.js 3.39 kB 0 B
build/autop/index.js 2.82 kB 0 B
build/blob/index.js 620 B 0 B
build/block-directory/index.js 7.67 kB 0 B
build/block-directory/style-rtl.css 944 B 0 B
build/block-directory/style.css 945 B 0 B
build/block-editor/index.js 115 kB 0 B
build/block-editor/style-rtl.css 10.8 kB 0 B
build/block-editor/style.css 10.8 kB 0 B
build/block-library/editor-rtl.css 7.54 kB 0 B
build/block-library/editor.css 7.54 kB 0 B
build/block-library/index.js 130 kB 0 B
build/block-library/style-rtl.css 7.75 kB 0 B
build/block-library/style.css 7.76 kB 0 B
build/block-library/theme-rtl.css 728 B 0 B
build/block-library/theme.css 729 B 0 B
build/block-serialization-default-parser/index.js 1.88 kB 0 B
build/block-serialization-spec-parser/index.js 3.1 kB 0 B
build/blocks/index.js 48.2 kB 0 B
build/components/index.js 199 kB 0 B
build/components/style-rtl.css 15.9 kB 0 B
build/components/style.css 15.8 kB 0 B
build/compose/index.js 9.56 kB 0 B
build/core-data/index.js 11.4 kB 0 B
build/data-controls/index.js 1.29 kB 0 B
build/data/index.js 8.46 kB 0 B
build/date/index.js 5.38 kB 0 B
build/deprecated/index.js 772 B 0 B
build/dom-ready/index.js 569 B 0 B
build/dom/index.js 3.23 kB 0 B
build/edit-navigation/index.js 10.8 kB 0 B
build/edit-navigation/style-rtl.css 1.08 kB 0 B
build/edit-navigation/style.css 1.08 kB 0 B
build/edit-post/index.js 304 kB 0 B
build/edit-post/style-rtl.css 5.59 kB 0 B
build/edit-post/style.css 5.58 kB 0 B
build/edit-site/index.js 16.6 kB 0 B
build/edit-site/style-rtl.css 3.03 kB 0 B
build/edit-site/style.css 3.03 kB 0 B
build/edit-widgets/index.js 9.35 kB 0 B
build/edit-widgets/style-rtl.css 2.45 kB 0 B
build/edit-widgets/style.css 2.45 kB 0 B
build/editor/editor-styles-rtl.css 537 B 0 B
build/editor/editor-styles.css 539 B 0 B
build/editor/index.js 45 kB 0 B
build/editor/style-rtl.css 3.78 kB 0 B
build/editor/style.css 3.78 kB 0 B
build/element/index.js 4.65 kB 0 B
build/escape-html/index.js 733 B 0 B
build/format-library/index.js 7.72 kB 0 B
build/format-library/style-rtl.css 547 B 0 B
build/format-library/style.css 548 B 0 B
build/hooks/index.js 2.13 kB 0 B
build/html-entities/index.js 622 B 0 B
build/i18n/index.js 3.56 kB 0 B
build/is-shallow-equal/index.js 709 B 0 B
build/keyboard-shortcuts/index.js 2.51 kB 0 B
build/keycodes/index.js 1.94 kB 0 B
build/list-reusable-blocks/index.js 3.12 kB 0 B
build/list-reusable-blocks/style-rtl.css 476 B 0 B
build/list-reusable-blocks/style.css 476 B 0 B
build/media-utils/index.js 5.32 kB 0 B
build/notices/index.js 1.79 kB 0 B
build/nux/index.js 3.4 kB 0 B
build/nux/style-rtl.css 671 B 0 B
build/nux/style.css 668 B 0 B
build/plugins/index.js 2.56 kB 0 B
build/primitives/index.js 1.4 kB 0 B
build/priority-queue/index.js 789 B 0 B
build/redux-routine/index.js 2.85 kB 0 B
build/rich-text/index.js 13.9 kB 0 B
build/server-side-render/index.js 2.71 kB 0 B
build/shortcode/index.js 1.7 kB 0 B
build/token-list/index.js 1.27 kB 0 B
build/url/index.js 4.06 kB 0 B
build/viewport/index.js 1.85 kB 0 B
build/warning/index.js 1.13 kB 0 B
build/wordcount/index.js 1.17 kB 0 B

compressed-size-action

@mkaz
Copy link
Member Author

mkaz commented Jul 9, 2020

@youknowriad I'm not sure it is necessary to remove those tests as being "required". They didn't run on this PR, so they might just be skipped altogether. Worth testing to see, harder to rely on a person having to remember to check.

@youknowriad
Copy link
Contributor

I'm not sure it is necessary to remove those tests as being "required".

It is necessary, otherwise you'll never be able to merge this PR (unless you're an admin). We had this issue already with other checks.

@mkaz mkaz merged commit 3eecf7c into master Jul 9, 2020
@mkaz mkaz deleted the update/actions-limit-tests branch July 9, 2020 16:28
@github-actions github-actions bot added this to the Gutenberg 8.6 milestone Jul 9, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
[Package] Project management automation /packages/project-management-automation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants