Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dynamic run for run-aqa GH action #130

Merged
merged 19 commits into from
Sep 12, 2022
Merged

Conversation

j-braley
Copy link
Contributor

Addresses #125.

Adds in functionality to run tests in parallel. This is accomplished by having a new function generate parallelList.mk and updating the runAqaTest() function run the suite of tests if the target includes -f parallelList.mk.

Any GitHub action which leverages this action handles distributing the parallelList.mk generated to child jobs (e.g., upload artifact/ download artifact).

Please let me know any questions, comments, or concerns 😄!

@j-braley
Copy link
Contributor Author

Just submitted the ECA.

Copy link
Contributor

@karianna karianna left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Functions could also do with more comments explaining roughly what each one does

action.yml Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
@j-braley
Copy link
Contributor Author

Since the release is upon us, I might turn this into a draft since I will need to point aqa-systemtest and STF to the correct release versions for verification testing.

@j-braley j-braley marked this pull request as draft July 18, 2022 21:44
@j-braley j-braley marked this pull request as ready for review August 9, 2022 15:42
@j-braley
Copy link
Contributor Author

j-braley commented Aug 9, 2022

I believe I have addressed most comments raised to the best of my knowledge.

Please let me know if there are any other changes required to get this across the finish line.

Here is a run using my latest changes.

Thanks!! 😄

src/aqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated Show resolved Hide resolved
@karianna
Copy link
Contributor

@j-braley Looks like more failing GH Actions though.

@j-braley
Copy link
Contributor Author

Updated GH action to run _DaaLoadTest_daa1_5m instead of _DaaLoadTest_daa1 for sys tests + bumped up windows version. Changes based on changes found in #131.

@j-braley
Copy link
Contributor Author

@karianna or @smlambert can I get an approval to run the extra GH actions?

I made changes to the underlying action to run _DaaLoadTest_daa1_5m instead of _DaaLoadTest_daa1 based on #131. Also bumped up the windows version (also found in the linked PR).

src/aqa.ts Outdated Show resolved Hide resolved
src/runaqa.ts Outdated

await setupTestEnv(version, jdksource, customizedSdkUrl, sdkdir, buildList, aqatestsRepo, openj9Repo, tkgRepo, vendorTestParams, aqasystemtestsRepo);
process.chdir('TKG');
process.env.PARALLEL_OPTIONS = `PARALLEL_OPTIONS=TEST=${buildList} TEST_TIME= NUM_MACHINES=${numMachines}`;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TEST should equal to the test target.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe BUILD_LIST here would be the target? Since the values of BUILD_LIST would be one of openjdk, functional, system, perf. Or am I mistaken? If the verbiage does not make sense that could be adjusted. However, I believe that this value matches what is set in the env variable BUILD_LIST.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

BUILD_LIST is not the target, it is the directory to be compiled. Some target and BUILD_LIST happen to share the same name, for example functional, but target also could be sanity.functional which is different from BUILD_LIST

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the explanation. I will update the code.

@sophia-guo
Copy link
Contributor

Enable github action runs and wait for the results

src/aqa.ts Outdated Show resolved Hide resolved
* @param {string} jdksource Source for JDK
* @param {[string]} customizedSdkUrl Download link for JDK binaries
* @param {[string]} sdkdir Directory for SDK
* @param {[string]} buildList AQAvit Test suite
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we also add @param target: string, customTarget: string ?

src/runaqa.ts Outdated Show resolved Hide resolved
action.yml Outdated Show resolved Hide resolved
@sophia-guo
Copy link
Contributor

To make it easy to use/understand the example workflow can also be committed. As action.yml itself can not clearly demo how the feature is used.

@j-braley j-braley requested review from karianna, sophia-guo and smlambert and removed request for smlambert, karianna and sophia-guo September 10, 2022 00:44
@j-braley
Copy link
Contributor Author

j-braley commented Sep 10, 2022

Apparently, I am learning that GitHub has limits on reviewers 😦

@sophia-guo so she can review as well.

@j-braley j-braley requested review from renfeiw and removed request for sophia-guo September 10, 2022 00:53
@karianna
Copy link
Contributor

@j-braley you'll need to rebase again sorry!

Copy link
Contributor

@sophia-guo sophia-guo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants