Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

kubetest/eks: download "aws-k8s-tester" binary, use upstream image #10040

Merged
merged 4 commits into from
Nov 6, 2018
Merged

Conversation

gyuho
Copy link
Member

@gyuho gyuho commented Nov 6, 2018

  • awstester has been renamed to aws-k8s-tester
  • Switch back to upstream gcr.io/k8s-testimages/kubekins-e2e image, let kubetest automatically download binaries
  • Update aws-k8s-tester dependency to latest

ref. #9814

/cc @krzyzacy @d-nishi

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files. area/config Issues or PRs related to code in /config labels Nov 6, 2018
kubetest/eks/eks.go Outdated Show resolved Hide resolved
@krzyzacy
Copy link
Member

krzyzacy commented Nov 6, 2018

at high level: why download the binary at runtime? this can potentially make your tests flaky and waste of network resources?

@gyuho
Copy link
Member Author

gyuho commented Nov 6, 2018

@krzyzacy @BenTheElder

I think downloading on demand is more maintainable.

If we build our own image with aws-k8s-tester, we need keep it in sync with gcr.io/k8s-testimages/kubekins-e2e (whenever changes happen in the upstream). On the other hand, if we download binaries on test runs, we just update the download URL whenever we release new features to our plugin, and the base test image will always be up-to-date.

I am trying to do something similar to:

test-infra/kubetest/kops.go

Lines 294 to 298 in 7b85b7b

// Download kops from kopsBaseURL if kopsPath is not set
if *kopsPath == "" {
if *kopsBaseURL == "" {
return nil, errors.New("--kops or --kops-base-url must be set")
}

Signed-off-by: Gyuho Lee <leegyuho@amazon.com>
@d-nishi
Copy link

d-nishi commented Nov 6, 2018

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Nov 6, 2018
@k8s-ci-robot
Copy link
Contributor

LGTM label has been added.

Git tree hash: 28233a68b584814fff613b2c5f510c45ef673b2a

@BenTheElder
Copy link
Member

Network resources shouldn't be an issue, downloading can be flakier though is worth noting. Seems like a reasonable route to me, if they experience too many related flakes it can always be revisited.

@krzyzacy
Copy link
Member

krzyzacy commented Nov 6, 2018

do we care about cleaning up those downloaded binaries?

@k8s-ci-robot k8s-ci-robot removed the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Nov 6, 2018
@gyuho
Copy link
Member Author

gyuho commented Nov 6, 2018

@krzyzacy Just added :)

@krzyzacy
Copy link
Member

krzyzacy commented Nov 6, 2018

/lgtm
/hold

Maybe as a follow up, add some comments/docs on all the envs, if you are expect other people to use your deployer.
(feel free to /hold cancel)

@k8s-ci-robot k8s-ci-robot added do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. lgtm "Looks good to me", indicates that a PR is ready to be merged. labels Nov 6, 2018
@k8s-ci-robot
Copy link
Contributor

LGTM label has been added.

Git tree hash: c789810830cb6b2cf8e72f5d36fa20f4fbd963a4

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Nov 6, 2018
@gyuho
Copy link
Member Author

gyuho commented Nov 6, 2018

/hold cancel

@k8s-ci-robot k8s-ci-robot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Nov 6, 2018
@gyuho
Copy link
Member Author

gyuho commented Nov 6, 2018

/hold

@k8s-ci-robot k8s-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Nov 6, 2018
"awstester" was renamed to "aws-k8s-tester"

Signed-off-by: Gyuho Lee <leegyuho@amazon.com>
Signed-off-by: Gyuho Lee <leegyuho@amazon.com>
Signed-off-by: Gyuho Lee <leegyuho@amazon.com>
@k8s-ci-robot k8s-ci-robot removed the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Nov 6, 2018
@gyuho
Copy link
Member Author

gyuho commented Nov 6, 2018

/hold cancel

@k8s-ci-robot k8s-ci-robot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Nov 6, 2018
@gyuho
Copy link
Member Author

gyuho commented Nov 6, 2018

@krzyzacy @d-nishi PTAL. Documented all environmental variables.

Copy link
Member

@BenTheElder BenTheElder left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Nov 6, 2018
@k8s-ci-robot
Copy link
Contributor

LGTM label has been added.

Git tree hash: 0adf35006dab4c6bd10ab61532561b1070777e4c

@d-nishi
Copy link

d-nishi commented Nov 6, 2018

/lgtm

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: BenTheElder, d-nishi, gyuho, krzyzacy

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:
  • OWNERS [BenTheElder,krzyzacy]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot merged commit 0427f40 into kubernetes:master Nov 6, 2018
@k8s-ci-robot
Copy link
Contributor

@gyuho: Updated the job-config configmap using the following files:

  • key k8s-aws-eks-1.10.yaml using file config/jobs/kubernetes/sig-aws/eks/k8s-aws-eks-1.10.yaml

In response to this:

  • awstester has been renamed to aws-k8s-tester
  • Switch back to upstream gcr.io/k8s-testimages/kubekins-e2e image, let kubetest automatically download binaries
  • Update aws-k8s-tester dependency to latest

ref. #9814

/cc @krzyzacy @d-nishi

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/config Issues or PRs related to code in /config cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. size/XXL Denotes a PR that changes 1000+ lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants