forked from openshift/rosa
-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
OCM-6307 | test: Setup e2e tests code
- Loading branch information
Showing
127 changed files
with
6,137 additions
and
3,631 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,13 @@ | ||
| approvers: | ||
| - xueli181114 | ||
| - yasun1 | ||
| - yuwang-RH | ||
| - radtriste | ||
| reviewers: | ||
| - yasun1 | ||
| - xueli181114 | ||
| - yuwang-RH | ||
| - tzhou5 | ||
| - yingzhanredhat | ||
| - mgahagan73 | ||
| - radtriste |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,74 @@ | ||
| # ROSA CLI Function Verification Testing | ||
| This package is the automation package for Function Verification Testing on the ROSA CLI. | ||
|
|
||
| ## Structure of tests | ||
| ```sh | ||
| tests | ||
| |____e2e | ||
| |____e2e_suite_test.go ---- test suite for all the e2e tests | ||
| |____... ---- other tests organized in domain files | ||
| |____utils | ||
| | |____common ---- package which contains common methods | ||
| | | |____constants ---- package for all constants | ||
| | |____config ---- package which contains tests configuration methods | ||
| | |____exec ---- exec contains the different services to run the commands | ||
| | | |____rosacli ---- ROSA CLI specific services/commands | ||
| | |____log ---- tests logger | ||
| | | ||
| |____prow_ci.sh | ||
| ``` | ||
|
|
||
| ## Contibute to ROSA CLI tests | ||
|
|
||
| Please read the structure and contribute code to the correct place | ||
|
|
||
| ### Contribute to day2 | ||
|
|
||
| * Create the case in rosa/tests/e2e/<feature name>_test.go | ||
| * Label the case with ***CI.Day2*** | ||
| * Label the case with importance ***CI.Critical*** or ***CI.High*** | ||
| * Don't need to run creation step, just in BeforeEach step call function ***config.GetClusterID()*** it will load the clusterID prepared from env or cluster_id file | ||
| * Code for day2 actions and check step | ||
| * Every case need to recover the cluster after the case run finished unless it's un-recoverable | ||
|
|
||
| ### Labels | ||
|
|
||
| * Label your case with the ***CI.Feature<feature name>*** defined in rosa/tests/ci/labels/features.go | ||
| * Label your case with importance defined in rosa/tests/ci/labels/importance.go | ||
| * Label your case with ***CI.Day1Post/CI.Day2/CI.Day3*** defined in rosa/tests/ci/labels/runtime.go, according to the case runtime | ||
| * Label your case with ***CI.Exclude*** if it fails CI all the time and you can't fix it in time | ||
| * Label you case with ***CI.NonClassicCluster/CI.NonHCPCluster*** if it does not fit a type of cluster | ||
|
|
||
| ## Running | ||
|
|
||
| ### Prerequisite | ||
|
|
||
| Please read repo's [README.md](../README.md) | ||
| For the test cases, we need `make install` to make the rosa command line installed to local | ||
|
|
||
| #### Users and Tokens | ||
|
|
||
| Please login ocm and aws cli prior to launching the tests. | ||
|
|
||
| #### Global variables | ||
|
|
||
| To declare the cluster id, use the below variable:: | ||
| * export CLUSTER_ID = <cluster_id> | ||
|
|
||
| ### Running a local CI simulation | ||
|
|
||
| This feature allows for running tests through a case filter to simulate CI. Anyone can customize the case label filter to select the specific cases that would be run. | ||
|
|
||
| * Run day2 or day1-post cases with profile | ||
| * Run ginkgo run command | ||
| * `ginkgo run --label-filter '(Critical,High)&&(day1-post,day2)&&!Exclude' tests/e2e` | ||
| * Run a specified case to debug | ||
| * `ginkgo -focus <case id> tests/e2e` | ||
|
|
||
| ### Set log level | ||
|
|
||
| * Log level defined in rosa/tests/utils/log/logger.go | ||
|
|
||
| ```golang | ||
| Logger.logger.SetLevel() | ||
| ``` |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,20 @@ | ||
| package labels | ||
|
|
||
| import ( | ||
| . "github.com/onsi/ginkgo/v2" | ||
| ) | ||
|
|
||
| var FeatureCluster = Label("feature-cluster") | ||
| var FeatureRoles = Label("feature-roles") | ||
| var FeatureIDP = Label("feature-idp") | ||
| var FeatureIngress = Label("feature-ingress") | ||
| var FeatureKubeletConfig = Label("feature-kubeletconfig") | ||
| var FeatureMachinepool = Label("feature-machinepool") | ||
| var FeatureNetworkVerifier = Label("feature-networkverifier") | ||
| var FeatureNodePool = Label("feature-nodepool") | ||
| var FeatureOidcConfig = Label("feature-oidcconfig") | ||
| var FeatureOidcProvider = Label("feature-oidcprovider") | ||
| var FeatureRegion = Label("feature-region") | ||
| var FeatureUser = Label("feature-user") | ||
|
|
||
| var FeatureCLI = Label("feature-cli") // For tests related to command line directly |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,13 @@ | ||
| package labels | ||
|
|
||
| import ( | ||
| . "github.com/onsi/ginkgo/v2" | ||
| ) | ||
|
|
||
| // importance | ||
| var Critical = Label("Critical") | ||
| var High = Label("High") | ||
| var Medium = Label("Medium") | ||
| var Low = Label("Low") | ||
|
|
||
| var NonPreRelease = Label("NonPreRelease") |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,14 @@ | ||
| package labels | ||
|
|
||
| import ( | ||
| . "github.com/onsi/ginkgo/v2" | ||
| ) | ||
|
|
||
| // Cluster Type | ||
| var NonClassicCluster = Label("NonClassicCluster") | ||
| var NonHCPCluster = Label("NonHCPCluster") | ||
|
|
||
| // exclude | ||
| var Exclude = Label("Exclude") | ||
|
|
||
| var MigrationToVerify = Label("MigrationToVerify") |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,19 @@ | ||
| package labels | ||
|
|
||
| import ( | ||
| . "github.com/onsi/ginkgo/v2" | ||
| ) | ||
|
|
||
| // day1/day1-post and day2 | ||
| var Day1 = Label("day1") | ||
| var Day1Prepare = Label("day1-prepare") | ||
| var Day1Negative = Label("day1-negative") | ||
| var Day1Post = Label("day1-post") | ||
| var Day2 = Label("day2") | ||
| var Upgrade = Label("upgrade") | ||
|
|
||
| // day3 : the test cases will destroy default resource | ||
| var Day3 = Label("day3") | ||
|
|
||
| // destroy | ||
| var Destroy = Label("destroy") |
Oops, something went wrong.