Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

list all currently supported Kubernetes versions #13775

Merged
merged 5 commits into from
May 27, 2022

Conversation

prezha
Copy link
Contributor

@prezha prezha commented Mar 13, 2022

fixes #13773

examples:

  • minikube config defaults
$ minikube config defaults --help
list displays all valid default settings for PROPERTY_NAME
Acceptable fields: 

 * driver
 * kubernetes-version

Options:
  -o, --output='': Output format. Accepted values: [json, yaml]

Usage:
  minikube config defaults PROPERTY_NAME [flags] [options]

Use "minikube options" for a list of global command-line options (applies to all commands).
$ minikube config defaults kubernetes-version
* v1.23.5
* v1.23.4
* v1.23.3
...
* v1.16.2
* v1.16.1
* v1.16.0
$ minikube config defaults kubernetes-version --output json
["v1.23.5","v1.23.4","v1.23.3","v1.23.2","v1.23.1","v1.23.0","v1.23.0-rc.1","v1.23.0-rc.0","v1.23.0-beta.0","v1.23.0-alpha.4","v1.23.0-alpha.3","v1.23.0-alpha.2","v1.23.0-alpha.1","v1.22.8","v1.22.7","v1.22.6","v1.22.5","v1.22.4","v1.22.3","v1.22.2","v1.22.1","v1.22.0","v1.22.0-rc.0","v1.22.0-beta.2","v1.22.0-beta.1","v1.22.0-beta.0","v1.22.0-alpha.3","v1.22.0-alpha.2","v1.22.0-alpha.1","v1.21.11","v1.21.10","v1.21.9","v1.21.8","v1.21.7","v1.21.6","v1.21.5","v1.21.4","v1.21.3","v1.21.2","v1.21.1","v1.21.0","v1.21.0-rc.0","v1.21.0-beta.1","v1.21.0-beta.0","v1.21.0-alpha.3","v1.21.0-alpha.2","v1.21.0-alpha.1","v1.20.15","v1.20.14","v1.20.13","v1.20.12","v1.20.11","v1.20.10","v1.20.9","v1.20.8","v1.20.7","v1.20.6","v1.20.5","v1.20.4","v1.20.3","v1.20.2","v1.20.1","v1.20.0","v1.20.0-rc.0","v1.20.0-beta.2","v1.20.0-beta.1","v1.20.0-beta.0","v1.20.0-alpha.3","v1.20.0-alpha.2","v1.20.0-alpha.1","v1.19.16","v1.19.15","v1.19.14","v1.19.13","v1.19.12","v1.19.11","v1.19.10","v1.19.9","v1.19.8","v1.19.7","v1.19.6","v1.19.5","v1.19.4","v1.19.3","v1.19.2","v1.19.1","v1.19.0","v1.19.0-rc.4","v1.19.0-rc.3","v1.19.0-rc.2","v1.19.0-rc.1","v1.19.0-beta.2","v1.19.0-beta.1","v1.19.0-beta.0","v1.19.0-alpha.3","v1.19.0-alpha.2","v1.19.0-alpha.1","v1.18.20","v1.18.19","v1.18.18","v1.18.17","v1.18.16","v1.18.15","v1.18.14","v1.18.13","v1.18.12","v1.18.10","v1.18.9","v1.18.8","v1.18.6","v1.18.5","v1.18.5-rc.1","v1.18.4","v1.18.3","v1.18.2","v1.18.1","v1.18.0","v1.18.0-rc.1","v1.18.0-beta.2","v1.18.0-beta.1","v1.18.0-alpha.5","v1.18.0-alpha.3","v1.18.0-alpha.2","v1.18.0-alpha.1","v1.17.17","v1.17.16","v1.17.15","v1.17.14","v1.17.13","v1.17.12","v1.17.11","v1.17.9","v1.17.8","v1.17.8-rc.1","v1.17.7","v1.17.6","v1.17.5","v1.17.4","v1.17.3","v1.17.2","v1.17.1","v1.17.0","v1.17.0-rc.2","v1.17.0-rc.1","v1.17.0-beta.2","v1.17.0-beta.1","v1.17.0-alpha.3","v1.17.0-alpha.2","v1.17.0-alpha.1","v1.16.15","v1.16.14","v1.16.13","v1.16.12","v1.16.12-rc.1","v1.16.11","v1.16.10","v1.16.9","v1.16.8","v1.16.7","v1.16.6","v1.16.5","v1.16.4","v1.16.3","v1.16.2","v1.16.1","v1.16.0"]
$ minikube config defaults kubernetes-version --output yaml
- v1.23.5
- v1.23.4
- v1.23.3
...
- v1.16.2
- v1.16.1
- v1.16.0
  • catching cluster created by older minikube cluster then restarted with newer minikube that deprecated support for the original k8s cluster version (similar as for trying to start a new cluster with unsupported k8s version)
$ minikube-1.25.2 start --profile k8s-1.16.0 --kubernetes-version v1.16.0 --driver kvm2
😄  [k8s-1.16.0] minikube v1.25.2 on Opensuse-Tumbleweed
✨  Using the kvm2 driver based on user configuration
👍  Starting control plane node k8s-1.16.0 in cluster k8s-1.16.0
🔥  Creating kvm2 VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
🐳  Preparing Kubernetes v1.16.0 on Docker 20.10.12 ...
    ▪ kubelet.housekeeping-interval=5m
    ▪ Generating certificates and keys ...
    ▪ Booting up control plane ...
    ▪ Configuring RBAC rules ...
🔎  Verifying Kubernetes components...
    ▪ Using image gcr.io/k8s-minikube/storage-provisioner:v5
🌟  Enabled addons: storage-provisioner, default-storageclass
💡  kubectl not found. If you need it, try: 'minikube kubectl -- get pods -A'
🏄  Done! kubectl is now configured to use "k8s-1.16.0" cluster and "default" namespace by default
$ minikube-1.25.2 stop --profile k8s-1.16.0
✋  Stopping node "k8s-1.16.0"  ...
🛑  1 node stopped.
$ minikube start --profile k8s-1.16.0
😄  [k8s-1.16.0] minikube v1.25.2 on Opensuse-Tumbleweed
❗  Specified Kubernetes version 1.16.0 is less than the oldest supported version: v1.17.0. Use `minikube version --kubernetes` for details.
❗  You can force an unsupported Kubernetes version via the --force flag

❌  Exiting due to K8S_OLD_UNSUPPORTED: Kubernetes 1.16.0 is not supported by this release of minikube
$ minikube start --profile k8s-1.16.0 --force
😄  [k8s-1.16.0] minikube v1.25.2 on Opensuse-Tumbleweed
❗  minikube skips various validations when --force is supplied; this may lead to unexpected behavior
🆕  Kubernetes 1.23.3 is now available. If you would like to upgrade, specify: --kubernetes-version=v1.23.3
✨  Using the kvm2 driver based on existing profile
👍  Starting control plane node k8s-1.16.0 in cluster k8s-1.16.0
🔄  Restarting existing kvm2 VM for "k8s-1.16.0" ...
🐳  Preparing Kubernetes v1.16.0 on Docker 20.10.12 ...
    ▪ kubelet.housekeeping-interval=5m
🔎  Verifying Kubernetes components...
    ▪ Using image gcr.io/k8s-minikube/storage-provisioner:v5
🌟  Enabled addons: storage-provisioner, default-storageclass

❗  /home/prezha/bin/k8s/kubectl is version 1.23.4, which may have incompatibilites with Kubernetes 1.16.0.
    ▪ Want kubectl v1.16.0? Try 'minikube kubectl -- get pods -A'
🏄  Done! kubectl is now configured to use "k8s-1.16.0" cluster and "default" namespace by default
  • start new cluster with too-new k8s version
$ minikube start --profile k8s-1.24.0-alpha.3 --kubernetes-version v1.24.0-alpha.3 --driver kvm2
😄  [k8s-1.24.0-alpha.3] minikube v1.25.2 on Opensuse-Tumbleweed
❗  Specified Kubernetes version 1.24.0-alpha.3 is newer than the newest supported version: v1.23.4. Use `minikube version --kubernetes` for details.
✨  Using the kvm2 driver based on user configuration
👍  Starting control plane node k8s-1.24.0-alpha.3 in cluster k8s-1.24.0-alpha.3
🔥  Creating kvm2 VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
🐳  Preparing Kubernetes v1.24.0-alpha.3 on Docker 20.10.12 ...
    ▪ kubelet.housekeeping-interval=5m
    ▪ Generating certificates and keys ...
    ▪ Booting up control plane ...
    ▪ Configuring RBAC rules ...
🔎  Verifying Kubernetes components...
    ▪ Using image gcr.io/k8s-minikube/storage-provisioner:v5
🌟  Enabled addons: storage-provisioner, default-storageclass
💡  kubectl not found. If you need it, try: 'minikube kubectl -- get pods -A'
🏄  Done! kubectl is now configured to use "k8s-1.24.0-alpha.3" cluster and "default" namespace by default

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Mar 13, 2022
@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Mar 13, 2022
@prezha
Copy link
Contributor Author

prezha commented Mar 13, 2022

/ok-to-test

@k8s-ci-robot k8s-ci-robot added the ok-to-test Indicates a non-member PR verified by an org member that is safe to test. label Mar 13, 2022
@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 53.6s    | 52.8s               |
| enable ingress | 28.0s    | 28.7s               |
+----------------+----------+---------------------+

Times for minikube start: 54.3s 52.0s 52.9s 55.3s 53.4s
Times for minikube (PR 13775) start: 56.4s 51.1s 52.0s 52.1s 52.5s

Times for minikube ingress: 30.0s 28.5s 29.1s 26.5s 26.1s
Times for minikube (PR 13775) ingress: 28.5s 29.5s 26.6s 29.6s 29.5s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 26.0s    | 26.0s               |
| enable ingress | 47.2s    | 23.4s               |
+----------------+----------+---------------------+

Times for minikube start: 27.1s 25.4s 25.1s 25.9s 26.3s
Times for minikube (PR 13775) start: 26.5s 25.7s 25.5s 26.2s 25.9s

Times for minikube ingress: 21.9s 83.4s 82.9s 21.9s 25.9s
Times for minikube (PR 13775) ingress: 21.9s 22.9s 26.9s 22.9s 22.4s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 41.9s    | 43.8s               |
| enable ingress | 22.7s    | 34.7s               |
+----------------+----------+---------------------+

Times for minikube start: 34.8s 41.5s 46.2s 46.0s 41.2s
Times for minikube (PR 13775) start: 45.5s 41.6s 44.8s 41.4s 45.8s

Times for minikube ingress: 18.9s 23.4s 19.0s 18.9s 33.4s
Times for minikube (PR 13775) ingress: 49.4s 23.4s 18.9s 52.9s 28.9s

@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
Hyper-V_Windows TestStartStop/group/default-k8s-different-port/serial/Pause (gopogh) 1.48 (chart)
Docker_Linux_containerd TestNoKubernetes/serial/Stop (gopogh) 1.52 (chart)
Docker_Linux TestKubernetesUpgrade (gopogh) 3.97 (chart)
Docker_Linux TestPause/serial/Pause (gopogh) 6.62 (chart)
Docker_Windows TestRunningBinaryUpgrade (gopogh) 17.31 (chart)
Docker_Windows TestPause/serial/Pause (gopogh) 24.73 (chart)
Docker_macOS TestStartStop/group/embed-certs/serial/SecondStart (gopogh) 29.82 (chart)
Docker_Windows TestNetworkPlugins/group/enable-default-cni/Start (gopogh) 37.89 (chart)
Docker_Linux TestNetworkPlugins/group/kindnet/Start (gopogh) 43.05 (chart)
Docker_macOS TestNetworkPlugins/group/kindnet/Start (gopogh) 58.87 (chart)
Docker_macOS TestNetworkPlugins/group/calico/Start (gopogh) 62.10 (chart)
Docker_macOS TestNetworkPlugins/group/kubenet/DNS (gopogh) 66.10 (chart)
Hyper-V_Windows TestNoKubernetes/serial/StartWithK8s (gopogh) 68.89 (chart)
Docker_Linux TestNetworkPlugins/group/calico/Start (gopogh) 76.16 (chart)
Docker_macOS TestNetworkPlugins/group/bridge/DNS (gopogh) 78.12 (chart)
Docker_Linux TestNetworkPlugins/group/enable-default-cni/DNS (gopogh) 78.15 (chart)
Docker_macOS TestNetworkPlugins/group/enable-default-cni/DNS (gopogh) 79.63 (chart)
Docker_Linux TestNetworkPlugins/group/bridge/DNS (gopogh) 80.13 (chart)
Docker_Linux TestNetworkPlugins/group/kubenet/DNS (gopogh) 80.79 (chart)
Docker_Windows TestAddons/parallel/MetricsServer (gopogh) 84.62 (chart)
Docker_macOS TestDownloadOnly/v1.16.0/preload-exists (gopogh) 100.00 (chart)
Docker_Windows TestFunctional/parallel/ServiceCmd (gopogh) 100.00 (chart)
Docker_Windows TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (gopogh) 100.00 (chart)
Docker_Windows TestNoKubernetes/serial/Start (gopogh) 100.00 (chart)
Hyper-V_Windows TestMultiNode/serial/PingHostFrom2Pods (gopogh) 100.00 (chart)
Hyper-V_Windows TestMultiNode/serial/RestartKeepsNodes (gopogh) 100.00 (chart)

To see the flake rates of all tests by environment, click here.

@csantanapr
Copy link
Member

What about adding the listing under “minikube config” there some config that list the list of possible values like driver

@spowelljr
Copy link
Member

spowelljr commented Mar 14, 2022

One problem I see is the output of the list in JSON and YAML. For example, if the user wanted to get the latest k8s version with JSON they simply can't do supportedKubernetesVersions[0] because the output isn't a true JSON array, it's just a string. It would require them to do some string manipulation which I don't think is ideal.

@prezha
Copy link
Contributor Author

prezha commented Mar 14, 2022

One problem I see is the output of the list in JSON and YAML. For example, if the user wanted to get the latest k8s version with JSON they simply can't do supportedKubernetesVersions[0] because the output isn't a true JSON array, it's just a string. It would require them to do some string manipulation which I don't think is ideal.

thanks @spowelljr, I've amended pr to address this

examples:

$ minikube version --kubernetes --output json
{"commit":"e100c39e78654a803850c4cc14abfcd510099129-dirty","minikubeVersion":"v1.25.2","supportedKubernetesVersions":["v1.23.3","v1.23.2","v1.23.1","v1.23.0","v1.23.0-rc.1","v1.23.0-rc.0","v1.23.0-beta.0","v1.23.0-alpha.4","v1.23.0-alpha.3","v1.23.0-alpha.2","v1.23.0-alpha.1","v1.22.7","v1.22.6","v1.22.5","v1.22.4","v1.22.3","v1.22.2","v1.22.1","v1.22.0","v1.22.0-rc.0","v1.22.0-beta.2","v1.22.0-beta.1","v1.22.0-beta.0","v1.22.0-alpha.3","v1.22.0-alpha.2","v1.22.0-alpha.1","v1.21.10","v1.21.9","v1.21.8","v1.21.7","v1.21.6","v1.21.5","v1.21.4","v1.21.3","v1.21.2","v1.21.1","v1.21.0","v1.21.0-rc.0","v1.21.0-beta.1","v1.21.0-beta.0","v1.21.0-alpha.3","v1.21.0-alpha.2","v1.21.0-alpha.1","v1.20.15","v1.20.14","v1.20.13","v1.20.12","v1.20.11","v1.20.10","v1.20.9","v1.20.8","v1.20.7","v1.20.6","v1.20.5","v1.20.4","v1.20.3","v1.20.2","v1.20.1","v1.20.0","v1.20.0-rc.0","v1.20.0-beta.2","v1.20.0-beta.1","v1.20.0-beta.0","v1.20.0-alpha.3","v1.20.0-alpha.2","v1.20.0-alpha.1","v1.19.16","v1.19.15","v1.19.14","v1.19.13","v1.19.12","v1.19.11","v1.19.10","v1.19.9","v1.19.8","v1.19.7","v1.19.6","v1.19.5","v1.19.4","v1.19.3","v1.19.2","v1.19.1","v1.19.0","v1.19.0-rc.4","v1.19.0-rc.3","v1.19.0-rc.2","v1.19.0-rc.1","v1.19.0-beta.2","v1.19.0-beta.1","v1.19.0-beta.0","v1.19.0-alpha.3","v1.19.0-alpha.2","v1.19.0-alpha.1","v1.18.20","v1.18.19","v1.18.18","v1.18.17","v1.18.16","v1.18.15","v1.18.14","v1.18.13","v1.18.12","v1.18.10","v1.18.9","v1.18.8","v1.18.6","v1.18.5","v1.18.5-rc.1","v1.18.4","v1.18.3","v1.18.2","v1.18.1","v1.18.0","v1.18.0-rc.1","v1.18.0-beta.2","v1.18.0-beta.1","v1.18.0-alpha.5","v1.18.0-alpha.3","v1.18.0-alpha.2","v1.18.0-alpha.1","v1.17.17","v1.17.16","v1.17.15","v1.17.14","v1.17.13","v1.17.12","v1.17.11","v1.17.9","v1.17.8","v1.17.8-rc.1","v1.17.7","v1.17.6","v1.17.5","v1.17.4","v1.17.3","v1.17.2","v1.17.1","v1.17.0","v1.17.0-rc.2","v1.17.0-rc.1","v1.17.0-beta.2","v1.17.0-beta.1","v1.17.0-alpha.3","v1.17.0-alpha.2","v1.17.0-alpha.1","v1.16.15","v1.16.14","v1.16.13","v1.16.12","v1.16.12-rc.1","v1.16.11","v1.16.10","v1.16.9","v1.16.8","v1.16.7","v1.16.6","v1.16.5","v1.16.4","v1.16.3","v1.16.2","v1.16.1","v1.16.0"]}
$ minikube version --kubernetes --output yaml
commit: e100c39e78654a803850c4cc14abfcd510099129-dirty
minikubeVersion: v1.25.2
supportedKubernetesVersions:
- v1.23.3
- v1.23.2
- v1.23.1
...
- v1.16.2
- v1.16.1
- v1.16.0

@prezha
Copy link
Contributor Author

prezha commented Mar 14, 2022

What about adding the listing under “minikube config” there some config that list the list of possible values like driver

thanks @csantanapr, yes, that might be an option too

in latest coming i've moved it to the minikube config defaults kubernetes-version

so, either this or the previous commit (using minikube version --kubernetes) should be ok - whatever we finally decide to use

example outputs:

$ minikube config defaults kubernetes-version
* v1.23.3
* v1.23.2
* v1.23.1
...
* v1.16.2
* v1.16.1
* v1.16.0
$ minikube config defaults kubernetes-version -o json
["v1.23.3","v1.23.2","v1.23.1","v1.23.0","v1.23.0-rc.1","v1.23.0-rc.0","v1.23.0-beta.0","v1.23.0-alpha.4","v1.23.0-alpha.3","v1.23.0-alpha.2","v1.23.0-alpha.1","v1.22.7","v1.22.6","v1.22.5","v1.22.4","v1.22.3","v1.22.2","v1.22.1","v1.22.0","v1.22.0-rc.0","v1.22.0-beta.2","v1.22.0-beta.1","v1.22.0-beta.0","v1.22.0-alpha.3","v1.22.0-alpha.2","v1.22.0-alpha.1","v1.21.10","v1.21.9","v1.21.8","v1.21.7","v1.21.6","v1.21.5","v1.21.4","v1.21.3","v1.21.2","v1.21.1","v1.21.0","v1.21.0-rc.0","v1.21.0-beta.1","v1.21.0-beta.0","v1.21.0-alpha.3","v1.21.0-alpha.2","v1.21.0-alpha.1","v1.20.15","v1.20.14","v1.20.13","v1.20.12","v1.20.11","v1.20.10","v1.20.9","v1.20.8","v1.20.7","v1.20.6","v1.20.5","v1.20.4","v1.20.3","v1.20.2","v1.20.1","v1.20.0","v1.20.0-rc.0","v1.20.0-beta.2","v1.20.0-beta.1","v1.20.0-beta.0","v1.20.0-alpha.3","v1.20.0-alpha.2","v1.20.0-alpha.1","v1.19.16","v1.19.15","v1.19.14","v1.19.13","v1.19.12","v1.19.11","v1.19.10","v1.19.9","v1.19.8","v1.19.7","v1.19.6","v1.19.5","v1.19.4","v1.19.3","v1.19.2","v1.19.1","v1.19.0","v1.19.0-rc.4","v1.19.0-rc.3","v1.19.0-rc.2","v1.19.0-rc.1","v1.19.0-beta.2","v1.19.0-beta.1","v1.19.0-beta.0","v1.19.0-alpha.3","v1.19.0-alpha.2","v1.19.0-alpha.1","v1.18.20","v1.18.19","v1.18.18","v1.18.17","v1.18.16","v1.18.15","v1.18.14","v1.18.13","v1.18.12","v1.18.10","v1.18.9","v1.18.8","v1.18.6","v1.18.5","v1.18.5-rc.1","v1.18.4","v1.18.3","v1.18.2","v1.18.1","v1.18.0","v1.18.0-rc.1","v1.18.0-beta.2","v1.18.0-beta.1","v1.18.0-alpha.5","v1.18.0-alpha.3","v1.18.0-alpha.2","v1.18.0-alpha.1","v1.17.17","v1.17.16","v1.17.15","v1.17.14","v1.17.13","v1.17.12","v1.17.11","v1.17.9","v1.17.8","v1.17.8-rc.1","v1.17.7","v1.17.6","v1.17.5","v1.17.4","v1.17.3","v1.17.2","v1.17.1","v1.17.0","v1.17.0-rc.2","v1.17.0-rc.1","v1.17.0-beta.2","v1.17.0-beta.1","v1.17.0-alpha.3","v1.17.0-alpha.2","v1.17.0-alpha.1","v1.16.15","v1.16.14","v1.16.13","v1.16.12","v1.16.12-rc.1","v1.16.11","v1.16.10","v1.16.9","v1.16.8","v1.16.7","v1.16.6","v1.16.5","v1.16.4","v1.16.3","v1.16.2","v1.16.1","v1.16.0"]
$ minikube config defaults kubernetes-version -o yaml
- v1.23.3
- v1.23.2
- v1.23.1
...
- v1.16.2
- v1.16.1
- v1.16.0

@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 52.4s    | 52.6s               |
| enable ingress | 28.9s    | 29.1s               |
+----------------+----------+---------------------+

Times for minikube (PR 13775) ingress: 30.1s 28.5s 30.6s 27.0s 29.1s
Times for minikube ingress: 29.0s 31.1s 31.1s 26.5s 26.5s

Times for minikube start: 54.7s 50.6s 52.9s 51.8s 52.2s
Times for minikube (PR 13775) start: 51.2s 52.7s 52.9s 53.0s 53.2s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 26.9s    | 25.5s               |
| enable ingress | 24.0s    | 23.4s               |
+----------------+----------+---------------------+

Times for minikube start: 30.6s 25.7s 25.8s 25.8s 26.6s
Times for minikube (PR 13775) start: 25.6s 25.8s 25.2s 25.3s 25.7s

Times for minikube ingress: 26.9s 22.4s 23.5s 23.4s 23.9s
Times for minikube (PR 13775) ingress: 22.9s 23.0s 22.9s 21.9s 26.4s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 41.5s    | 42.9s               |
| enable ingress | 26.9s    | 21.7s               |
+----------------+----------+---------------------+

Times for minikube start: 34.6s 41.2s 45.0s 41.3s 45.6s
Times for minikube (PR 13775) start: 46.3s 41.0s 41.3s 40.7s 45.3s

Times for minikube ingress: 19.9s 23.4s 48.9s 23.4s 18.9s
Times for minikube (PR 13775) ingress: 19.0s 22.9s 23.4s 24.4s 19.0s

@k8s-ci-robot k8s-ci-robot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. and removed size/M Denotes a PR that changes 30-99 lines, ignoring generated files. labels Mar 14, 2022
@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
Docker_macOS TestDownloadOnly/v1.23.4-rc.0/preload-exists (gopogh) 0.00 (chart)
Docker_macOS TestDownloadOnlyKic (gopogh) 6.85 (chart)
Docker_macOS TestDownloadOnly/v1.23.3/preload-exists (gopogh) 6.85 (chart)
Docker_Linux TestNetworkPlugins/group/auto/DNS (gopogh) 6.96 (chart)
Docker_Cloud_Shell TestStartStop/group/cloud-shell/serial/AddonExistsAfterStop (gopogh) 10.00 (chart)
Docker_Cloud_Shell TestStartStop/group/cloud-shell/serial/EnableAddonAfterStop (gopogh) 10.00 (chart)
Docker_Cloud_Shell TestStartStop/group/cloud-shell/serial/Stop (gopogh) 10.00 (chart)
Docker_Cloud_Shell TestStartStop/group/cloud-shell/serial/UserAppExistsAfterStop (gopogh) 10.89 (chart)
Hyperkit_macOS TestFunctional/parallel/DashboardCmd (gopogh) 11.39 (chart)
Docker_Cloud_Shell TestStartStop/group/cloud-shell/serial/SecondStart (gopogh) 11.76 (chart)
Docker_Windows TestNoKubernetes/serial/StartWithStopK8s (gopogh) 31.13 (chart)
Docker_macOS TestStartStop/group/embed-certs/serial/SecondStart (gopogh) 31.25 (chart)
Docker_Linux_containerd TestStartStop/group/no-preload/serial/DeployApp (gopogh) 31.67 (chart)
Docker_Linux_containerd TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (gopogh) 31.67 (chart)
Docker_Linux_containerd TestStartStop/group/no-preload/serial/FirstStart (gopogh) 32.23 (chart)
Docker_Linux_containerd TestStartStop/group/no-preload/serial/SecondStart (gopogh) 32.79 (chart)
Docker_Windows TestKubernetesUpgrade (gopogh) 33.94 (chart)
Docker_Windows TestNetworkPlugins/group/enable-default-cni/Start (gopogh) 35.16 (chart)
Docker_Linux_containerd TestStartStop/group/embed-certs/serial/DeployApp (gopogh) 38.33 (chart)
Docker_Linux_containerd TestStartStop/group/embed-certs/serial/FirstStart (gopogh) 38.33 (chart)
Docker_Linux_containerd TestStartStop/group/embed-certs/serial/SecondStart (gopogh) 39.17 (chart)
Docker_Linux_containerd TestStartStop/group/embed-certs/serial/UserAppExistsAfterStop (gopogh) 39.17 (chart)
Docker_Linux TestFunctional/serial/ComponentHealth (gopogh) 43.04 (chart)
Docker_Windows TestNetworkPlugins/group/kindnet/Start (gopogh) 46.74 (chart)
Docker_Windows TestNetworkPlugins/group/bridge/Start (gopogh) 50.00 (chart)
Docker_Linux_containerd TestNetworkPlugins/group/kindnet/DNS (gopogh) 54.55 (chart)
Docker_Linux_containerd TestStartStop/group/default-k8s-different-port/serial/DeployApp (gopogh) 55.37 (chart)
Docker_Linux_containerd TestStartStop/group/default-k8s-different-port/serial/FirstStart (gopogh) 55.37 (chart)
Docker_Linux_containerd TestStartStop/group/default-k8s-different-port/serial/SecondStart (gopogh) 55.74 (chart)
Docker_Linux_containerd TestStartStop/group/default-k8s-different-port/serial/UserAppExistsAfterStop (gopogh) 55.74 (chart)
More tests... Continued...

Too many tests failed - See test logs for more details.

To see the flake rates of all tests by environment, click here.

@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 53.0s    | 52.9s               |
| enable ingress | 30.2s    | 31.4s               |
+----------------+----------+---------------------+

Times for minikube start: 54.3s 52.6s 52.7s 53.0s 52.5s
Times for minikube (PR 13775) start: 53.3s 51.8s 52.9s 52.9s 53.7s

Times for minikube (PR 13775) ingress: 37.6s 30.1s 30.1s 28.6s 30.6s
Times for minikube ingress: 30.6s 29.6s 30.6s 29.2s 31.1s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 27.3s    | 27.1s               |
| enable ingress | 22.8s    | 23.3s               |
+----------------+----------+---------------------+

Times for minikube start: 30.3s 26.4s 26.8s 26.8s 26.3s
Times for minikube (PR 13775) start: 26.8s 27.6s 27.2s 26.6s 27.2s

Times for minikube ingress: 21.9s 22.4s 23.9s 22.4s 23.5s
Times for minikube (PR 13775) ingress: 23.9s 23.5s 22.9s 23.0s 23.4s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 42.6s    | 42.6s               |
| enable ingress | 21.2s    | 25.1s               |
+----------------+----------+---------------------+

Times for minikube ingress: 20.9s 19.0s 22.9s 23.9s 19.0s
Times for minikube (PR 13775) ingress: 23.0s 22.9s 33.0s 23.4s 23.0s

Times for minikube start: 35.0s 46.9s 42.9s 42.1s 46.2s
Times for minikube (PR 13775) start: 41.6s 43.0s 43.4s 43.3s 41.6s

@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 52.5s    | 52.0s               |
| enable ingress | 28.5s    | 31.3s               |
+----------------+----------+---------------------+

Times for minikube ingress: 29.1s 29.1s 29.6s 26.0s 28.5s
Times for minikube (PR 13775) ingress: 29.6s 30.5s 29.5s 37.1s 29.5s

Times for minikube (PR 13775) start: 52.3s 51.6s 52.3s 52.2s 51.3s
Times for minikube start: 53.8s 52.2s 52.1s 52.3s 52.3s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 26.6s    | 26.1s               |
| enable ingress | 36.8s    | 22.6s               |
+----------------+----------+---------------------+

Times for minikube (PR 13775) ingress: 22.9s 20.9s 21.9s 22.9s 24.4s
Times for minikube ingress: 33.4s 22.0s 24.0s 82.4s 22.5s

Times for minikube (PR 13775) start: 26.3s 25.7s 25.8s 26.3s 26.4s
Times for minikube start: 26.9s 27.1s 26.2s 26.4s 26.6s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 40.0s    | 44.1s               |
| enable ingress | 24.9s    | 22.9s               |
+----------------+----------+---------------------+

Times for minikube ingress: 33.4s 24.4s 19.9s 23.4s 23.4s
Times for minikube (PR 13775) ingress: 23.9s 23.4s 29.0s 18.9s 19.4s

Times for minikube start: 30.5s 41.2s 45.1s 41.8s 41.3s
Times for minikube (PR 13775) start: 41.9s 41.5s 45.9s 45.8s 45.2s

@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
Docker_macOS TestDownloadOnly/v1.23.4-rc.0/preload-exists (gopogh) 0.00 (chart)
KVM_Linux_containerd TestAddons/Setup (gopogh) 0.00 (chart)
KVM_Linux_containerd TestCertExpiration (gopogh) 0.00 (chart)
KVM_Linux_containerd TestCertOptions (gopogh) 0.00 (chart)
KVM_Linux_containerd TestErrorSpam/setup (gopogh) 0.00 (chart)
KVM_Linux_containerd TestForceSystemdEnv (gopogh) 0.00 (chart)
KVM_Linux_containerd TestForceSystemdFlag (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/CertSync (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/CpCmd (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/FileSync (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/ImageCommands/ImageBuild (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/ImageCommands/ImageListJson (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/ImageCommands/ImageListShort (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/ImageCommands/ImageListTable (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/ImageCommands/ImageListYaml (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/ImageCommands/ImageLoadDaemon (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/ImageCommands/ImageLoadFromFile (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/ImageCommands/ImageReloadDaemon (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/ImageCommands/ImageSaveToFile (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/MountCmd/any-port (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/MountCmd/specific-port (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/MySQL (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/NodeLabels (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/NonActiveRuntimeDisabled (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/PersistentVolumeClaim (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/ServiceCmd (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/ServiceCmdConnect (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/SSHCmd (gopogh) 0.00 (chart)
KVM_Linux_containerd TestFunctional/parallel/StatusCmd (gopogh) 0.00 (chart)
More tests... Continued...

Too many tests failed - See test logs for more details.

To see the flake rates of all tests by environment, click here.

@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
Docker_Linux TestAddons/parallel/Registry (gopogh) 1.34 (chart)
Docker_Linux TestFunctional/parallel/DashboardCmd (gopogh) 1.34 (chart)
Docker_Linux TestFunctional/parallel/PersistentVolumeClaim (gopogh) 1.34 (chart)
Docker_Linux TestMultiNode/serial/DeployApp2Nodes (gopogh) 1.34 (chart)
Docker_Linux TestMultiNode/serial/PingHostFrom2Pods (gopogh) 1.34 (chart)
Docker_Linux TestNetworkPlugins/group/cilium/Start (gopogh) 1.34 (chart)
Docker_Linux_containerd TestNoKubernetes/serial/Stop (gopogh) 2.33 (chart)
Docker_Linux TestNetworkPlugins/group/auto/DNS (gopogh) 5.37 (chart)
Hyperkit_macOS TestFunctional/parallel/DashboardCmd (gopogh) 10.14 (chart)
Docker_Linux_containerd TestNetworkPlugins/group/auto/Start (gopogh) 12.71 (chart)
Docker_Linux_containerd TestAddons/parallel/Registry (gopogh) 13.82 (chart)
Docker_Linux_containerd TestPause/serial/Start (gopogh) 20.81 (chart)
Docker_Linux_containerd TestOffline (gopogh) 22.82 (chart)
Docker_Linux_containerd TestNetworkPlugins/group/custom-weave/Start (gopogh) 23.14 (chart)
Docker_Linux TestNetworkPlugins/group/false/DNS (gopogh) 26.17 (chart)
Docker_Linux_containerd TestFunctional/parallel/ServiceCmdConnect (gopogh) 26.79 (chart)
Docker_Linux_containerd TestFunctional/parallel/DashboardCmd (gopogh) 28.86 (chart)
Docker_Linux_containerd TestFunctional/parallel/MountCmd/any-port (gopogh) 28.86 (chart)
Docker_Linux_containerd TestFunctional/parallel/MySQL (gopogh) 28.86 (chart)
Docker_Linux_containerd TestFunctional/parallel/PersistentVolumeClaim (gopogh) 28.86 (chart)
Docker_Linux_containerd TestFunctional/parallel/ServiceCmd (gopogh) 28.86 (chart)
Docker_Linux_containerd TestFunctional/parallel/TunnelCmd/serial/AccessDirect (gopogh) 28.86 (chart)
Docker_Linux_containerd TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (gopogh) 28.86 (chart)
Docker_Linux_containerd TestFunctional/serial/ExtraConfig (gopogh) 28.86 (chart)
Docker_Linux_containerd TestFunctional/serial/SoftStart (gopogh) 28.86 (chart)
Docker_Linux_containerd TestFunctional/serial/StartWithProxy (gopogh) 28.86 (chart)
Docker_Linux_containerd TestMultiNode/serial/DeployApp2Nodes (gopogh) 28.86 (chart)
Docker_Linux_containerd TestMultiNode/serial/PingHostFrom2Pods (gopogh) 28.86 (chart)
Docker_Linux_containerd TestStartStop/group/no-preload/serial/UserAppExistsAfterStop (gopogh) 33.04 (chart)
Docker_Linux TestNetworkPlugins/group/kindnet/Start (gopogh) 39.60 (chart)
More tests... Continued...

Too many tests failed - See test logs for more details.

To see the flake rates of all tests by environment, click here.

@k8s-ci-robot k8s-ci-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Apr 5, 2022
@prezha prezha force-pushed the list-supported-k8s-versions branch from 4d572ef to 66e7291 Compare April 6, 2022 15:35
@k8s-ci-robot k8s-ci-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Apr 6, 2022
@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+-------------------+----------+---------------------+
|      COMMAND      | MINIKUBE | MINIKUBE (PR 13775) |
+-------------------+----------+---------------------+
| minikube start    | 51.7s    | 51.2s               |
| ⚠️  enable ingress | 30.4s    | 45.7s ⚠️             |
+-------------------+----------+---------------------+

Times for minikube start: 54.8s 50.4s 51.2s 50.1s 51.9s
Times for minikube (PR 13775) start: 50.0s 51.4s 51.1s 52.4s 51.0s

Times for minikube ingress: 29.0s 34.6s 30.6s 26.1s 31.6s
Times for minikube (PR 13775) ingress: 26.5s 112.5s 29.0s 30.1s 30.1s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 24.6s    | 24.5s               |
| enable ingress | 24.2s    | 22.9s               |
+----------------+----------+---------------------+

Times for minikube (PR 13775) ingress: 22.9s 22.9s 22.9s 23.0s 22.9s
Times for minikube ingress: 22.9s 22.9s 26.4s 26.0s 22.9s

Times for minikube start: 24.8s 24.9s 24.6s 24.7s 24.1s
Times for minikube (PR 13775) start: 24.2s 24.2s 24.1s 24.8s 25.1s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 41.2s    | 41.4s               |
| enable ingress | 23.0s    | 25.0s               |
+----------------+----------+---------------------+

Times for minikube start: 39.6s 44.0s 39.2s 39.8s 43.4s
Times for minikube (PR 13775) start: 39.4s 43.1s 44.2s 40.5s 39.7s

Times for minikube ingress: 23.4s 27.9s 23.4s 22.4s 17.9s
Times for minikube (PR 13775) ingress: 23.4s 18.9s 28.4s 21.9s 32.4s

@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
Docker_Linux_containerd TestStartStop/group/newest-cni/serial/Pause (gopogh) 3.17 (chart)
Docker_Linux TestStartStop/group/no-preload/serial/Pause (gopogh) 4.55 (chart)
Docker_Linux_containerd TestNetworkPlugins/group/auto/Start (gopogh) 8.87 (chart)
Docker_Linux TestNetworkPlugins/group/false/DNS (gopogh) 33.12 (chart)
Docker_Linux_containerd TestNetworkPlugins/group/kindnet/Start (gopogh) 47.15 (chart)
Docker_macOS TestNetworkPlugins/group/custom-weave/Start (gopogh) 48.53 (chart)
Docker_Windows TestNetworkPlugins/group/kubenet/Start (gopogh) 50.62 (chart)
Hyper-V_Windows TestNoKubernetes/serial/StartWithK8s (gopogh) 60.43 (chart)
Docker_Windows TestNoKubernetes/serial/Start (gopogh) 61.84 (chart)
Docker_Linux TestNetworkPlugins/group/calico/Start (gopogh) 74.68 (chart)
Docker_Linux_containerd TestNetworkPlugins/group/enable-default-cni/DNS (gopogh) 78.29 (chart)
Docker_Windows TestFunctional/parallel/TunnelCmd/serial/WaitService/IngressIP (gopogh) 78.57 (chart)
Docker_Linux_containerd TestNetworkPlugins/group/bridge/DNS (gopogh) 79.70 (chart)
Docker_Linux_containerd TestNetworkPlugins/group/calico/Start (gopogh) 80.49 (chart)
Docker_macOS TestDownloadOnly/v1.16.0/preload-exists (gopogh) 100.00 (chart)
Docker_Windows TestFunctional/parallel/ServiceCmd (gopogh) 100.00 (chart)
Docker_Windows TestNetworkPlugins/group/cilium/Start (gopogh) 100.00 (chart)
Docker_Windows TestSkaffold (gopogh) 100.00 (chart)
Hyper-V_Windows TestMultiNode/serial/PingHostFrom2Pods (gopogh) 100.00 (chart)
Hyper-V_Windows TestMultiNode/serial/RestartKeepsNodes (gopogh) 100.00 (chart)
Hyper-V_Windows TestSkaffold (gopogh) 100.00 (chart)

To see the flake rates of all tests by environment, click here.

@sharifelgamal
Copy link
Collaborator

This minikube config defaults version seems like the right choice. Can you change the PR description to reflect the current state of the PR?

@prezha
Copy link
Contributor Author

prezha commented Apr 15, 2022

This minikube config defaults version seems like the right choice. Can you change the PR description to reflect the current state of the PR?

thanks @sharifelgamal, sure, i've updated the pr's description accordingly

@k8s-ci-robot k8s-ci-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Apr 19, 2022
@prezha prezha force-pushed the list-supported-k8s-versions branch from 66e7291 to 138dc9d Compare April 20, 2022 14:01
@k8s-ci-robot k8s-ci-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Apr 20, 2022
@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 51.1s    | 50.8s               |
| enable ingress | 29.7s    | 29.1s               |
+----------------+----------+---------------------+

Times for minikube (PR 13775) start: 50.4s 50.5s 50.6s 51.8s 50.9s
Times for minikube start: 51.9s 50.7s 50.6s 51.1s 50.9s

Times for minikube ingress: 29.6s 30.0s 31.1s 31.1s 26.6s
Times for minikube (PR 13775) ingress: 28.0s 30.6s 27.1s 29.1s 30.5s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 24.5s    | 24.7s               |
| enable ingress | 22.9s    | 23.7s               |
+----------------+----------+---------------------+

Times for minikube start: 24.4s 25.0s 24.2s 23.8s 25.2s
Times for minikube (PR 13775) start: 24.0s 25.7s 24.5s 24.0s 25.5s

Times for minikube ingress: 23.4s 22.9s 22.0s 22.4s 23.9s
Times for minikube (PR 13775) ingress: 26.4s 24.0s 22.9s 22.9s 22.4s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 42.6s    | 39.7s               |
| enable ingress | 22.6s    | 22.6s               |
+----------------+----------+---------------------+

Times for minikube start: 41.9s 43.6s 43.8s 43.7s 40.2s
Times for minikube (PR 13775) start: 39.7s 39.4s 39.4s 39.5s 40.6s

Times for minikube ingress: 22.4s 17.9s 22.4s 18.0s 32.4s
Times for minikube (PR 13775) ingress: 21.9s 22.4s 23.4s 22.4s 22.9s


opts := &github.ListOptions{PerPage: 100}
for (opts.Page+1)*100 <= 300 {
rls, resp, err := ghc.Repositories.ListReleases(context.Background(), "kubernetes", "kubernetes", opts)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@prezha one of the use cases of this feature would be in the minikube GUI, when we load the page to create a cluster we can list all supported kubernetes versions, this will make a http call (not very cheap) in the gui.

i suggest this code to only reference the constants and if needed add some sort of automation (in Makefile) to generate this list. instead of making the call each single time.

is that reasonable?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@medyagh that's a good use case as well

this func (exposed via CLI) takes ~1.7sec to produce a fresh list of all currently acceptable k8s versions, which indeed is not that cheap

now, the release cadence for minikube is ~monthly, whereas k8s (supporting the last 3 of its minor versions) has it more frequently, and therefore we/user could end up with the outdated static list (especially if a user did not upgrade to the latest minikube version)

i'd suggest keeping this func/cli functionality as-is in this pr, and for the GUI use case, we could ship minikube releases with a "hardcoded" list of all supported k8s versions (known at the time of the release) and also have eg, a "Refresh" link/button nearby to call this func again so that the GUI can regenerate and cache results for later reuse?

what do you think?

Copy link
Member

@spowelljr spowelljr Apr 29, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As the person working on the GUI, on GUI startup we could make a call to this function and cache the result. So by the time the user gets around to starting the cluster with a custom k8s version, the list will already be cached and will be able to validate the users input with no latency. I'm not arguing the solution either way, but stating that I don't believe this will impact the GUI.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@spowelljr yes, thanks, that sounds like a good/optimal solution to me

@medyagh would you agree then that we keep this func[tionality] as-is in this pr and Steven will call it as needed and also cache results on the gui side?

@k8s-ci-robot k8s-ci-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label May 11, 2022
@prezha prezha force-pushed the list-supported-k8s-versions branch from 138dc9d to 97dfef3 Compare May 11, 2022 12:01
@k8s-ci-robot k8s-ci-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label May 11, 2022
@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
Docker_Linux TestStartStop/group/old-k8s-version/serial/AddonExistsAfterStop (gopogh) 0.00 (chart)
Docker_Linux TestStartStop/group/old-k8s-version/serial/SecondStart (gopogh) 0.00 (chart)
Docker_Linux TestStartStop/group/old-k8s-version/serial/UserAppExistsAfterStop (gopogh) 0.00 (chart)
Docker_Linux TestStartStop/group/old-k8s-version/serial/VerifyKubernetesImages (gopogh) 0.00 (chart)
Docker_Linux TestKubernetesUpgrade (gopogh) 5.00 (chart)
Docker_Linux TestStartStop/group/old-k8s-version/serial/Pause (gopogh) 9.00 (chart)
Docker_Linux TestPause/serial/Pause (gopogh) 9.09 (chart)
Docker_Linux TestFunctional/serial/ComponentHealth (gopogh) 36.00 (chart)
Docker_Linux TestNetworkPlugins/group/kindnet/Start (gopogh) 42.00 (chart)
Docker_Linux TestNetworkPlugins/group/calico/Start (gopogh) 67.00 (chart)
Docker_Linux TestNetworkPlugins/group/bridge/DNS (gopogh) 74.23 (chart)
Docker_Linux TestNetworkPlugins/group/enable-default-cni/DNS (gopogh) 74.75 (chart)
Docker_Linux TestNetworkPlugins/group/kubenet/DNS (gopogh) 76.29 (chart)

To see the flake rates of all tests by environment, click here.

@k8s-ci-robot k8s-ci-robot added the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label May 11, 2022
@prezha prezha force-pushed the list-supported-k8s-versions branch from 97dfef3 to cf3d33a Compare May 20, 2022 16:32
@k8s-ci-robot k8s-ci-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label May 20, 2022
@minikube-pr-bot
Copy link

kvm2 driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 52.5s    | 53.2s               |
| enable ingress | 29.6s    | 29.7s               |
+----------------+----------+---------------------+

Times for minikube start: 53.9s 51.8s 53.0s 52.1s 51.6s
Times for minikube (PR 13775) start: 55.1s 55.3s 52.6s 50.4s 52.4s

Times for minikube ingress: 29.2s 31.6s 28.7s 29.2s 29.5s
Times for minikube (PR 13775) ingress: 29.6s 28.6s 30.1s 30.1s 30.2s

docker driver with docker runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 26.3s    | 25.3s               |
| enable ingress | 22.9s    | 22.8s               |
+----------------+----------+---------------------+

Times for minikube start: 29.2s 26.2s 25.4s 25.2s 25.5s
Times for minikube (PR 13775) start: 25.0s 25.5s 24.7s 25.2s 25.9s

Times for minikube ingress: 23.0s 21.5s 24.0s 23.0s 23.0s
Times for minikube (PR 13775) ingress: 24.0s 22.0s 22.0s 24.0s 22.0s

docker driver with containerd runtime

+----------------+----------+---------------------+
|    COMMAND     | MINIKUBE | MINIKUBE (PR 13775) |
+----------------+----------+---------------------+
| minikube start | 35.0s    | 33.7s               |
| enable ingress | 21.7s    | 24.0s               |
+----------------+----------+---------------------+

Times for minikube ingress: 22.5s 18.9s 22.5s 22.5s 22.0s
Times for minikube (PR 13775) ingress: 32.0s 21.9s 18.5s 29.0s 18.5s

Times for minikube start: 31.4s 42.7s 30.1s 30.0s 41.0s
Times for minikube (PR 13775) start: 29.7s 40.8s 32.7s 32.5s 32.7s

@minikube-pr-bot
Copy link

These are the flake rates of all failed tests.

Environment Failed Tests Flake Rate (%)
Hyperkit_macOS TestSkaffold (gopogh) 0.00 (chart)
KVM_Linux_containerd TestNetworkPlugins/group/custom-weave/NetCatPod (gopogh) 0.00 (chart)
Docker_Linux_containerd TestNetworkPlugins/group/custom-weave/Start (gopogh) 23.46 (chart)
Hyper-V_Windows TestNoKubernetes/serial/StartWithK8s (gopogh) 46.74 (chart)
Docker_Windows TestAddons/Setup (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/CertSync (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/CpCmd (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/DockerEnv/powershell (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/FileSync (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/ImageCommands/ImageBuild (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/ImageCommands/ImageListJson (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/ImageCommands/ImageListShort (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/ImageCommands/ImageListTable (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/ImageCommands/ImageListYaml (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/ImageCommands/ImageLoadDaemon (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/ImageCommands/ImageLoadFromFile (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/ImageCommands/ImageReloadDaemon (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/ImageCommands/ImageSaveDaemon (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/ImageCommands/ImageSaveToFile (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/ImageCommands/ImageTagAndLoadDaemon (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/ImageCommands/Setup (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/MySQL (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/NodeLabels (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/NonActiveRuntimeDisabled (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/PersistentVolumeClaim (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/SSHCmd (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/StatusCmd (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/TunnelCmd/serial/WaitService/Setup (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/UpdateContextCmd/no_changes (gopogh) 48.57 (chart)
Docker_Windows TestFunctional/parallel/UpdateContextCmd/no_clusters (gopogh) 48.57 (chart)
More tests... Continued...

Too many tests failed - See test logs for more details.

To see the flake rates of all tests by environment, click here.

@spowelljr spowelljr merged commit 771db45 into kubernetes:master May 27, 2022
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: prezha, spowelljr

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. ok-to-test Indicates a non-member PR verified by an org member that is safe to test. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

list all currently supported Kubernetes versions
7 participants