Skip to content

Releases: kubernetes-sigs/kind

v0.15.0

02 Sep 01:31
Compare
Choose a tag to compare

v0.15.0 contains important fixes for cluster reboots and various other improvements.

Breaking Changes

  • The default node image is a Kubernetes v1.25.0 image: kindest/node:v1.25.0@sha256:428aaa17ec82ccde0131cb2d1ca6547d13cf5fdabcc0bbecf749baa935387cbf

New Features

  • New single letter flag aliases -n for --name and -A for --all, in-line with kubectl etc.
  • Optimized image loading to re-tag images when the image contents are identical to previously loaded images but the tags are different
  • Support for Kubernetes 1.25, fix for handling rootless + 1.25
  • Containerd 1.6.7
  • Go 1.19
  • Updated base image distro to latest, NOTE: depend on the contents of the image at your own risk! our images enable running Kubernetes with KIND, we reserve the right to switch distros etc as needed
  • Support for Podman 4.0 / netavark
  • enhanced pre-release versions to include commit counts

New Node images have been built for kind v0.15.0, please use these exact images (IE like kindest/node:v1.25.0@sha256:428aaa17ec82ccde0131cb2d1ca6547d13cf5fdabcc0bbecf749baa935387cbf including the digest) or build your own as we may need to change the image format again in the future 😅

Images built for this release:

  • 1.25: kindest/node:v1.25.0@sha256:428aaa17ec82ccde0131cb2d1ca6547d13cf5fdabcc0bbecf749baa935387cbf
  • 1.24: kindest/node:v1.24.4@sha256:adfaebada924a26c2c9308edd53c6e33b3d4e453782c0063dc0028bdebaddf98
  • 1.23: kindest/node:v1.23.10@sha256:f047448af6a656fae7bc909e2fab360c18c487ef3edc93f06d78cdfd864b2d12
  • 1.22: kindest/node:v1.22.13@sha256:4904eda4d6e64b402169797805b8ec01f50133960ad6c19af45173a27eadf959
  • 1.21: kindest/node:v1.21.14@sha256:f9b4d3d1112f24a7254d2ee296f177f628f9b4c1b32f0006567af11b91c1f301
  • 1.20: kindest/node:v1.20.15@sha256:d67de8f84143adebe80a07672f370365ec7d23f93dc86866f0e29fa29ce026fe
  • 1.19: kindest/node:v1.19.16@sha256:707469aac7e6805e52c3bde2a8a8050ce2b15decff60db6c5077ba9975d28b98
  • 1.18: kindest/node:v1.18.20@sha256:61c9e1698c1cb19c3b1d8151a9135b379657aee23c59bde4a8d87923fcb43a91

NOTE: These node images support amd64 and arm64. It remains possible to build custom images for other architectures (see the docs).

Fixes

  • Fixed rebooted node certificates
  • Fixed snapshotter selection on ZFS + overlayfs-fuse
  • Podman provider now includes node names in no_proxy env, matching the docker provider
  • Assorted documentation fixes
  • Fixed Kubernetes 1.13 configuration
    • NOTE: This will be the last release supporting Kubernetes versions below v1.15.0

Contributors

Thank you to everyone who contributed to this release! ❤️

Users whose commits are in this release (alphabetically by user name)

And thank you very much to everyone else not listed here who contributed in other ways like filing issues, giving feedback, testing fixes, helping users in slack, etc. 🙏

v0.14.0

19 May 20:58
Compare
Choose a tag to compare

v0.14.0 is quick follow-up to v0.13.0, upgrading packages and fixing cgroups on some non-systemd-based hosts such as WSL2 and Alpine based tools like colima and rancher-desktop.

Besides the cgroups fix, the update to the latest version of the local-path-provisioner may be a desirable upgrade worth noting with various downstream improvements.

Be sure to see the previous release notes as well!

Breaking Changes

NOTE: The systemd change is from KIND v0.13.0, but we're re-iterating it here since v0.13.0 was so recent.

  • systemd cgroups driver will be used for Kubernetes v1.24.0+ (rather than 1.21.0+ when kubeadm changed the default, which we previously overrode).
    • NOTE: You must use kind v0.13.0+ with Kubernetes v1.24.0+ images, and if you built your own Kubernetes v1.24.0+ image
      with a previous kind version you will need to re-built when switching to kind v0.13.0+.
    • NOTE: You do not need to be using systemd on the host machine, In kind v0.13.0 we had a bug related to this, it should be fixed this release. systemd is used inside the kind node containers but should not be necessary on the host. We are now using it for Kubernetes pods in addition to running kubelet, containerd etc.
    • KIND will continue to use cgroupfs for Kubernetes versions prior to v1.24.0.
  • The default node image is a Kubernetes v1.24.0 image: kindest/node:v1.24.0@sha256:0866296e693efe1fed79d5e6c7af8df71fc73ae45e3679af05342239cdc5bc8e

New Features

  • digest image references should be populated when loading images
  • base image updates
    • crictl v1.24.0
  • kind binary built with Go 1.18.2
  • all kindnetd dependencies updated to latest
  • updated haproxy image
  • latest local-path-provisioner v0.0.22 with updated packaging
  • support for Kubernetes v1.25.0-alpha pre-releases builds without the old kubeadm node taint
  • updated cgroupsv2 CI to Fedora 36

New Node images have been built for kind v0.14.0, please use these exact images (IE like kindest/node:v1.24.0@sha256:0866296e693efe1fed79d5e6c7af8df71fc73ae45e3679af05342239cdc5bc8e including the digest) or build your own as we may need to change the image format again in the future 😅

Images built for this release:

  • 1.24: kindest/node:v1.24.0@sha256:0866296e693efe1fed79d5e6c7af8df71fc73ae45e3679af05342239cdc5bc8e
  • 1.23: kindest/node:v1.23.6@sha256:b1fa224cc6c7ff32455e0b1fd9cbfd3d3bc87ecaa8fcb06961ed1afb3db0f9ae
  • 1.22: kindest/node:v1.22.9@sha256:8135260b959dfe320206eb36b3aeda9cffcb262f4b44cda6b33f7bb73f453105
  • 1.21: kindest/node:v1.21.12@sha256:f316b33dd88f8196379f38feb80545ef3ed44d9197dca1bfd48bcb1583210207
  • 1.20: kindest/node:v1.20.15@sha256:6f2d011dffe182bad80b85f6c00e8ca9d86b5b8922cdf433d53575c4c5212248
  • 1.19: kindest/node:v1.19.16@sha256:d9c819e8668de8d5030708e484a9fdff44d95ec4675d136ef0a0a584e587f65c
  • 1.18: kindest/node:v1.18.20@sha256:738cdc23ed4be6cc0b7ea277a2ebcc454c8373d7d8fb991a7fcdbd126188e6d7

NOTE: these node images support amd64 and arm64. It remains possible to build custom images for other architectures (see the docs).

Fixes

  • fixed running kind with kubernetes v1.24.0+ on some non-systemd-based hosts
  • setting migrated kubelet flags in kubelet config where possible, for now we set both the old flags and the config, in some future release we'll set only kubelet config where possible
  • fixed kong ingress name in docs

Contributors

Thank you to everyone who contributed to this release! ❤️

Users whose commits are in this release (alphabetically by user name)

A special shoutout to these folks who helped report, test, and review the systemd cgroups fix:

And thank you very much to everyone else not listed here who contributed in other ways like filing issues, giving feedback, testing fixes, helping users in slack, etc. 🙏

v0.13.0

10 May 19:40
Compare
Choose a tag to compare

v0.13.0 is all about cgroups -- We're making the switch to the systemd cgroup driver to align with current Kubernetes container runtime recommendations and kubeadm defaults.

Breaking Changes

  • systemd cgroups driver will be used for Kubernetes v1.24.0+ (rather than 1.21.0+ when kubeadm changed the default, which we previously overrode).
    • NOTE: You must use kind v0.13.0+ with Kubernetes v1.24.0+ images, and if you built your own Kubernetes v1.24.0+ image
      with a previous kind version you will need to re-built when switching to kind v0.13.0+.
    • NOTE: You do not need to be using systemd on the host machine, systemd is used inside the kind node containers. We are now using it for Kubernetes pods in addition to running kubelet, containerd etc.
      • UPDATE: There is a bug on hosts that are (cgroupv1, not-systemd) #2765, a fix is pending and the next release will address this. See the linked issue for discussion and workarounds in the meantime.
      • UPDATE: v0.14.0 is released with a fix for this bug. Upgrading should be the preferred solution, but if you need to use v0.13.0 for some reason, see the issue linked above for other workarounds.
    • KIND will continue to use cgroupfs for Kubernetes versions prior to v1.24.0.
  • The default node image is a Kubernetes v1.24.0 image: kindest/node:v1.24.0@sha256:406fd86d48eaf4c04c7280cd1d2ca1d61e7d0d61ddef0125cb097bc7b82ed6a1

New Features

  • Limited support for PPC64LE architecture (you will need to build your own node images)
  • kind export logs now dumps a list of images on each node
  • Base image updates
    • Containerd version 1.6.4
    • CNI plugins 1.1.1
  • kind binary built with Go 1.18
  • General Go dependency updates
  • registry.k8s.io is used as the primary mirror for k8s.gcr.io in kind nodes / image building
    • If registry.k8s.io is not reachable, the node runtime is configured to fallback to k8s.gcr.io directly as the next endpoint

New Node images have been built for kind v0.13.0, please use these exact images (IE like kindest/node:v1.24.0@sha256:406fd86d48eaf4c04c7280cd1d2ca1d61e7d0d61ddef0125cb097bc7b82ed6a1 including the digest) or build your own as we may need to change the image format again in the future 😅

Images built for this release:

  • 1.24: kindest/node:v1.24.0@sha256:406fd86d48eaf4c04c7280cd1d2ca1d61e7d0d61ddef0125cb097bc7b82ed6a1
  • 1.23: kindest/node:v1.23.6@sha256:1af0f1bee4c3c0fe9b07de5e5d3fafeb2eec7b4e1b268ae89fcab96ec67e8355
  • 1.22: kindest/node:v1.22.9@sha256:6e57a6b0c493c7d7183a1151acff0bfa44bf37eb668826bf00da5637c55b6d5e
  • 1.21: kindest/node:v1.21.12@sha256:ae05d44cc636ee961068399ea5123ae421790f472c309900c151a44ee35c3e3e
  • 1.20: kindest/node:v1.20.15@sha256:a6ce604504db064c5e25921c6c0fffea64507109a1f2a512b1b562ac37d652f3
  • 1.19: kindest/node:v1.19.16@sha256:dec41184d10deca01a08ea548197b77dc99eeacb56ff3e371af3193c86ca99f4
  • 1.18: kindest/node:v1.18.20@sha256:38a8726ece5d7867fb0ede63d718d27ce2d41af519ce68be5ae7fcca563537ed

NOTE: these node images support amd64 and arm64. It remains possible to build custom images for other architectures (see the docs).

Fixes

  • In cgroup v1, unmount cgroups that are not supported by the runtime used to create nodes
  • Pinned metallb to a stable version in documentation

Contributors

Thank you to everyone who contributed to this release! ❤️

Users whose commits are in this release (alphabetically by user name)

Contributors since v0.12.0:

v0.12.0

07 Mar 11:57
Compare
Choose a tag to compare

v0.12.0 has been focused on stability, with improvements and fixes for support rootless and cgroupsv2, and bringing support for s390x architectures.

Breaking Changes

  • The default node image is a Kubernetes v1.23.4 image: kindest/node:v1.23.4@sha256:0e34f0d0fd448aa2f2819cfd74e99fe5793a6e4938b328f657c8e3f81ee0dfb9
  • The haproxy image used for multiple control-plane cluster is distroless now

New Features

  • Pods running at different nodes have different product_uuid
  • Support for s390x architectures
  • Adapt kind to handle the label migration from node-role.kubernetes.io/master to node-role.kubernetes.io/control-plane
  • Base image updates
    • Containerd version 1.5.10
    • Crictl 1.23.0
    • CNI plugins 1.1.0
    • Containerd containerd/fuse-overlayfs-snapshotter 1.0.4

New Node images have been built for kind v0.12.0, please use these exact images (IE like kindest/node:v1.23.4@sha256:0e34f0d0fd448aa2f2819cfd74e99fe5793a6e4938b328f657c8e3f81ee0dfb9 including the digest) or build your own as we may need to change the image format again in the future 😅

Images built for this release:

  • 1.23: kindest/node:v1.23.4@sha256:0e34f0d0fd448aa2f2819cfd74e99fe5793a6e4938b328f657c8e3f81ee0dfb9
  • 1.22: kindest/node:v1.22.7@sha256:1dfd72d193bf7da64765fd2f2898f78663b9ba366c2aa74be1fd7498a1873166
  • 1.21: kindest/node:v1.21.10@sha256:84709f09756ba4f863769bdcabe5edafc2ada72d3c8c44d6515fc581b66b029c
  • 1.20: kindest/node:v1.20.15@sha256:393bb9096c6c4d723bb17bceb0896407d7db581532d11ea2839c80b28e5d8deb
  • 1.19: kindest/node:v1.19.16@sha256:81f552397c1e6c1f293f967ecb1344d8857613fb978f963c30e907c32f598467
  • 1.18: kindest/node:v1.18.20@sha256:e3dca5e16116d11363e31639640042a9b1bd2c90f85717a7fc66be34089a8169
  • 1.17: kindest/node:v1.17.17@sha256:e477ee64df5731aa4ef4deabbafc34e8d9a686b49178f726563598344a3898d5
  • 1.16: kindest/node:v1.16.15@sha256:64bac16b83b6adfd04ea3fbcf6c9b5b893277120f2b2cbf9f5fa3e5d4c2260cc
  • 1.15: kindest/node:v1.15.12@sha256:9dfc13db6d3fd5e5b275f8c4657ee6a62ef9cb405546664f2de2eabcfd6db778
  • 1.14: kindest/node:v1.14.10@sha256:b693339da2a927949025869425e20daf80111ccabf020d4021a23c00bae29d82

NOTE: these node images support amd64 and arm64 now. It remains possible to build custom images for other architectures (see the docs).

Fixes

  • Enable sysctl route_localnet on node images to allow nodes dns to work
  • Only mount /dev/fuse on rootless environments
  • Fixed node labels assignments from configuration
  • Fix docker+cgroup2+rootless initialization
  • Fix sysbox runtime regression on docker in docker
  • Fix support on distros without systemd and WSL2
  • Fix kind load docker-image if all images are already present

Contributors

Thank you to everyone who contributed to this release! ❤️

Users whose commits are in this release (alphabetically by user name)

Contributors since v0.11.1:

v0.11.1

28 May 00:46
Compare
Choose a tag to compare

v0.11.1 fixes a security vulnerability in runc <=1.0.0-rc94

For full release notes please see v0.11.0

New Features

  • Base image updates
    • Containerd sandbox image to pause v3.5
    • Containerd version 1.5.2 / runc rc95
    • Ubuntu 21.04
  • Documented support for installing kind via macports.

New Node images have been built for kind v0.11.1, please use these exact images (IE like kindest/node:v1.21.1@sha256:fae9a58f17f18f06aeac9772ca8b5ac680ebbed985e266f711d936e91d113bad including the digest) or build your own as we may need to change the image format again in the future 😅

Images built for this release:

  • 1.21: kindest/node:v1.21.1@sha256:69860bda5563ac81e3c0057d654b5253219618a22ec3a346306239bba8cfa1a6
  • 1.20: kindest/node:v1.20.7@sha256:cbeaf907fc78ac97ce7b625e4bf0de16e3ea725daf6b04f930bd14c67c671ff9
  • 1.19: kindest/node:v1.19.11@sha256:07db187ae84b4b7de440a73886f008cf903fcf5764ba8106a9fd5243d6f32729
  • 1.18: kindest/node:v1.18.19@sha256:7af1492e19b3192a79f606e43c35fb741e520d195f96399284515f077b3b622c
  • 1.17: kindest/node:v1.17.17@sha256:66f1d0d91a88b8a001811e2f1054af60eef3b669a9a74f9b6db871f2f1eeed00
  • 1.16: kindest/node:v1.16.15@sha256:83067ed51bf2a3395b24687094e283a7c7c865ccc12a8b1d7aa673ba0c5e8861
  • 1.15: kindest/node:v1.15.12@sha256:b920920e1eda689d9936dfcf7332701e80be12566999152626b2c9d730397a95
  • 1.14: kindest/node:v1.14.10@sha256:f8a66ef82822ab4f7569e91a5bccaf27bceee135c1457c512e54de8c6f7219f8

Additionally the following image is known to work well:

  • 1.22: kindest/node:v1.22.0@sha256:b8bda84bb3a190e6e028b1760d277454a72267a5454b57db34437c34a588d047
  • 1.23: kindest/node:v1.23.0@sha256:49824ab1727c04e56a21a5d8372a402fcd32ea51ac96a2706a12af38934f81ac

NOTE: these node images support amd64 and arm64 now. It remains possible to build custom images for other architectures (see the docs).

v0.11.0

18 May 20:07
Compare
Choose a tag to compare

v0.11.0 brings in much sought after support for multi-arch, rootless, dual stack along with a couple of performance fixes.

Breaking Changes

  • The default node image is a Kubernetes v1.21.1 image: kindest/node:v1.21.1@sha256:fae9a58f17f18f06aeac9772ca8b5ac680ebbed985e266f711d936e91d113bad
  • Dropped support for building node images with bazel going forward as part of reducing the build maintenance for Kubernetes. The --type flag is deprecated.
  • The kind build node-image --kube-root flag is deprecated in favor of an argument, using the flag will print a warning. In a future release the flag will be removed.

New Features

  • kind build node-image now supports --arch for cross compiling node images
  • pre-built node images now support arm64 in addition to amd64 (they are multi-arch)
  • Support for running kind with cgroupv2, rootless docker and rootless podman. Please checkout our guide at https://kind.sigs.k8s.io/docs/user/rootless/
  • kindnetd supports dual-stack networking now enabled by default since kubernetes v1.21
  • Internal kubeconfig is now automatically exposed on the control plane nodes for in-cluster access.

New Node images have been built for kind v0.11.0, please use these exact images (IE like kindest/node:v1.21.1@sha256:fae9a58f17f18f06aeac9772ca8b5ac680ebbed985e266f711d936e91d113bad including the digest) or build your own as we may need to change the image format again in the future 😅

Images built for this release:

  • 1.21: kindest/node:v1.21.1@sha256:fae9a58f17f18f06aeac9772ca8b5ac680ebbed985e266f711d936e91d113bad
  • 1.20: kindest/node:v1.20.7@sha256:e645428988191fc824529fd0bb5c94244c12401cf5f5ea3bd875eb0a787f0fe9
  • 1.19: kindest/node:v1.19.11@sha256:7664f21f9cb6ba2264437de0eb3fe99f201db7a3ac72329547ec4373ba5f5911
  • 1.18: kindest/node:v1.18.19@sha256:530378628c7c518503ade70b1df698b5de5585dcdba4f349328d986b8849b1ee
  • 1.17: kindest/node:v1.17.17@sha256:c581fbf67f720f70aaabc74b44c2332cc753df262b6c0bca5d26338492470c17
  • 1.16: kindest/node:v1.16.15@sha256:430c03034cd856c1f1415d3e37faf35a3ea9c5aaa2812117b79e6903d1fc9651
  • 1.15: kindest/node:v1.15.12@sha256:8d575f056493c7778935dd855ded0e95c48cb2fab90825792e8fc9af61536bf9
  • 1.14: kindest/node:v1.14.10@sha256:6033e04bcfca7c5f2a9c4ce77551e1abf385bcd2709932ec2f6a9c8c0aff6d4f

NOTE: these node images support amd64 and arm64 now. It remains possible to build custom images for other architectures (see the docs).

Fixes

  • handle Kubernetes / kubeadm 1.21 breaking cgroups config change.
  • kindnetd now tolerates NoSchedule
  • Fixed kube-proxy CrashLoops by skipping setting nf_conntrack_max
  • Fixed an issue with SIGPIPE errors sometimes failing node startup
  • kind export logs now only exports the version once instead of per node
  • kind export logs always prints export path even if some logs fail to save
  • Fixed a bug where kubeadmConfigPatches weren't merging correctly with generated arguments.
  • Fixed base image build potentially breaking due to file permissions being affected by umask settings on the host.
  • Improved podman support for custom portmaps and zfs, btrfs storage drivers.
  • Fixes for zfs, btrfs storage drivers on docker

Contributors

Thank you to everyone who contributed to this release! ❤️

Users whose commits are in this release (alphabetically by user name)

v0.10.0

23 Jan 00:14
Compare
Choose a tag to compare

In v0.10.0 the most important changes we're "shipping" are about improving sustainability:

Additionally we're trying a new approach to tracking priorities for v0.11.0 which you can see in our issue tracker.

Otherwise we've made a number of bug fixes and minor improvements.

Some users may appreciate the ability to run kind v0.10.0 (NOT the currently installed v0.7.0) in the free Google Cloud Shell for quick demos, workshops, etc.

Simply install kind somewhere under $HOME and add it to your $PATH to use it in cloud shell:

GO111MODULE=on go get sigs.k8s.io/kind@v0.10.0
export PATH="$(go env GOPATH)/bin:${PATH}"
kind create cluster

To persist this PATH for future usage you can edit your $HOME/.bashrc in cloudshell.

Breaking Changes

  • The default node image is a Kubernetes v1.20.2 image: kindest/node:v1.20.2@sha256:8f7ea6e7642c0da54f04a7ee10431549c0257315b3a634f6ef2fecaaedb19bab
  • We're only actively supporting Kubernetes v1.14.0+, however limited best effort functionality still encompases v1.13.0 for now.
  • Images from KIND v0.8.0+ should continue to work for now, but lack various improvements.
  • udev is explicitly disabled at the node level, though as always please try not to depend on the inner details of nodes beyond providing a particular Kubernetes version with kind
  • IPv6 pod subnet defaults to /56 instead of /64 (a necessary fix for newer Kubernetes, see #1903)

New Features

  • kind export logs now includes the kind version
  • Node images compiled without dockershim for Kubernetes v1.19+ possible, reducing size
  • Reduced kind binary size further (~7MB) with improved build options
  • Improved zsh completion
  • Experimental github actions CI for podman, docker, cgroupsv2
  • Expanded WSL2 documentation
  • Revamped contributor guide
  • Improved docs site implementation, including table of contents generation
  • Updated dependencies
  • New Loadbalancer user guide
  • Better support for running in nested container environments when using images built with v0.10.0+
    • This enables cloud shell support

New Node images have been built for kind v0.10.0, please use these exact images (IE like v1.20.2:@sha256:8f7ea6e7642c0da54f04a7ee10431549c0257315b3a634f6ef2fecaaedb19bab including the digest) or build your own as we may need to change the image format again in the future 😅

Images built for this release:

  • 1.20: kindest/node:v1.20.2@sha256:8f7ea6e7642c0da54f04a7ee10431549c0257315b3a634f6ef2fecaaedb19bab
  • 1.19: kindest/node:v1.19.7@sha256:a70639454e97a4b733f9d9b67e12c01f6b0297449d5b9cbbef87473458e26dca
  • 1.18: kindest/node:v1.18.15@sha256:5c1b980c4d0e0e8e7eb9f36f7df525d079a96169c8a8f20d8bd108c0d0889cc4
  • 1.17: kindest/node:v1.17.17@sha256:7b6369d27eee99c7a85c48ffd60e11412dc3f373658bc59b7f4d530b7056823e
  • 1.16: kindest/node:v1.16.15@sha256:c10a63a5bda231c0a379bf91aebf8ad3c79146daca59db816fb963f731852a99
  • 1.15: kindest/node:v1.15.12@sha256:67181f94f0b3072fb56509107b380e38c55e23bf60e6f052fbd8052d26052fb5
  • 1.14: kindest/node:v1.14.10@sha256:3fbed72bcac108055e46e7b4091eb6858ad628ec51bf693c21f5ec34578f6180

Fixes

  • Fixed development scripts when CDPATH is in use
  • Fixed building node images with bazel when CWD is not within the source directory
  • Disabled fancy terminal output when in st (see #1924)
  • Fixed various typos
  • Improved cgroups handling
  • Improved some error messages

Contributors

Thank you to everyone who contributed to this release! ❤️

Users whose commits are in this release (alphabetically by user name)

v0.9.0

15 Sep 00:34
Compare
Choose a tag to compare

v0.9.0 Focuses on stability enhancements following v0.8.0 / v0.8.1, a new wave of features will ship in v0.10.0.

Breaking changes have been kept to a minimum, primarily that Kubernetes v1.12.X is no longer supported to make way for some fixes requiring beta-grade kubeadm.

Breaking Changes

  • The default node image is a Kubernetes v1.19.1 image: kindest/node:v1.19.1@sha256:98cf5288864662e37115e362b23e4369c8c4a408f99cbc06e58ac30ddc721600
  • Node images built with kind v0.9.0 require using kind v0.9.0+.
    • These images should mostly work with older releases but may not work offline.
    • Images from kind v0.8.0+ should still work but lack some internal improvements
  • Support has been dropped for Kubernetes older than v1.13.0.
    • A detailed support policy is in the works. The Kubernetes project only supports v1.16+ currently.
    • UPDATE: Kubernetes v1.14+ is required for multi-node clusters. See #1744 (comment)
  • Building Kubernetes with bazel will only work with Kubernetes v1.15+
    • Building without bazel still works back to v1.13.0
  • v1alpha3 kind config is no longer supported. Please upgrade to v1alpha4 (which was already the current version in previous releases)
  • Capital letters in cluster names are explicitly rejected by kind, in order to prevent encountering upstream issues with name validation

UPDATE: If you are hitting label key and value greater than maximum size (4096 bytes), key: containerd: invalid argument (containerd/cri#1572), then try the following KIND config:

kind: Cluster
apiVersion: kind.x-k8s.io/v1alpha4
containerdConfigPatches:
- |-
  [plugins."io.containerd.grpc.v1.cri".containerd]
  disable_snapshot_annotations = true

See: https://kind.sigs.k8s.io/docs/user/configuration/#getting-started for how to use a KIND config file.

New Features

  • NFS volumes should now work
  • Kubernetes RuntimeConfig is now first class in kind config
  • Upgraded dependencies across the board
  • Nodes now have a tenative providerID value set. We commit to the kind:// prefix but the rest of the contents may change.
  • The base image is tentatively multi-arch by default. The node image is still not as of yet.
  • More values are automatically included in no_proxy when proxies are detected
  • The default CNI shoult automatically match MTU to the underlying bridge
  • Binaries are now stripped of debugger (not stacktrace) info for smaller binaries

New Node images have been built for kind v0.9.0, please use these exact images (IE like v1.19.1:@sha256:98cf5288864662e37115e362b23e4369c8c4a408f99cbc06e58ac30ddc721600 including the digest) or build your own as we may need to change the image format again in the future 😅

Images built for this release:

  • 1.19: kindest/node:v1.19.1@sha256:98cf5288864662e37115e362b23e4369c8c4a408f99cbc06e58ac30ddc721600
  • 1.18: kindest/node:v1.18.8@sha256:f4bcc97a0ad6e7abaf3f643d890add7efe6ee4ab90baeb374b4f41a4c95567eb
  • 1.17: kindest/node:v1.17.11@sha256:5240a7a2c34bf241afb54ac05669f8a46661912eab05705d660971eeb12f6555
  • 1.16: kindest/node:v1.16.15@sha256:a89c771f7de234e6547d43695c7ab047809ffc71a0c3b65aa54eda051c45ed20
  • 1.15: kindest/node:v1.15.12@sha256:d9b939055c1e852fe3d86955ee24976cab46cba518abcb8b13ba70917e6547a6
  • 1.14: kindest/node:v1.14.10@sha256:ce4355398a704fca68006f8a29f37aafb49f8fc2f64ede3ccd0d9198da910146
  • 1.13: kindest/node:v1.13.12@sha256:1c1a48c2bfcbae4d5f4fa4310b5ed10756facad0b7a2ca93c7a4b5bae5db29f5

Fixes

  • Limited fixes related to HA mode and restart support
  • Fixed issues with ipv6 network overlap
  • Fixed bugs with NO_PROXY generation
  • Mitigated issues with concurrent cluster creation on clean hosts
  • KUBECONFIG writing has retries to mitigate concurrency / locking issues
  • Docker data root on ZFS should be fixed
  • Fixed building with bazel in kubernetes 1.20 development
  • Implemented assorted workarounds for breaking bugs in podman v2.X
  • Upstream CNI fixes identified by the project have been upstreamed and picked up to mitigate excessive iptables calls in testing
  • Replaced broken component IP auto-detection with explicit addresses to work around upstream Kubernetes limitations (pending an agreement on how to move forward upstream)
  • Fixed some issues with userns-remap support
  • Fixed port forwarding in some cases

Contributors

Thanks again to everyone who contributed to this release! ❤️

Users whose commits are in this release (alphabetically by user name)

v0.8.1

02 May 00:14
Compare
Choose a tag to compare

This is a tiny patch release to pick up the fix for Can't create ipv4 clusters if ipv6 is disabled at kernel level.

For full release notes please see v0.8.0.

Most users will not need to upgrade to this release, this bug is only known to occur on hosts with the ipv6.disable=1 kernel parameter.

v0.8.0

01 May 03:10
Compare
Choose a tag to compare

v0.8.0 Most importantly brings persistent clusters that automatically come back
up after dockerd / host restarts. It also brings a number of fixes to networking
in general, experimental podman backend support, improved failure output, and more.

Breaking Changes

  • The default node image is a Kubernetes v1.18.2 image: kindest/node:v1.18.2@sha256:7b27a6d0f2517ff88ba444025beae41491b016bc6af573ba467b70c5e8e0d85f
  • KIND v0.8.0 requires node images built with v0.8.0+.
    • These new images should be mostly backwards compatible for kind v0.5.0+
  • The default docker network for nodes is now kind instead of the default docker bridge
    • This enabled many fixes, however if you were running things alongside kind you may need to pass --net=kind
    • Your host DNS resolver should just work now ™️ in many cases
    • IPv6 clusters no longer require modifying docker daemon config
    • Docker networks must have a free IPv6 /64 in the [ULA] range, that is you may
      not create other docker networks consuming the entire ULA range. You can work
      around this by precreating the kind network with some totally other range if you wish.
  • You may need to migrate to the new featureGates config field when setting feature gates, this should be easier to use though!

NOTE: If you've been experimenting with kind > v0.7.0 installed from HEAD, you may need to docker network rm kind before
creating IPv6 clusters.

New Features

  • Clusters should not be broken by dockerd restarts / restarting your host!
  • Host DNS should just work ™️
  • IPv6 Clusters no longer require modifying docker daemon settings
  • Kubernetes 1.18+ should work on hosts using the iptables nft backend
  • kind delete clusters --all for deleting all your clusters
  • New top level featureGates field in Cluster config for enabling feature gates
  • Upgraded dependencies broadly, including library packages, go, containerd, CNI, etc...
  • NO_COLOR (no-color.org) support
  • Experimental podman support
    • These clusters do not survive host reboots
    • Requires rootful mode
    • Experimental
  • Improved output on failures, including command output without needing to set -v
  • Experimentally cross-building the base image for AMD64 + ARM by default
  • More Documentation! Guide to working with KIND offline, Ingress and more!
  • New download host and experimental nightly builds
  • Support for Dynamic PV in Kubernetes 1.11.X
  • New top level featureGates config option for controlling cluster featuregates
  • Shiny new WorkGroup-K8s-Infra based infrastructure for Kubernetes CI builds
  • Support for KIND_CLUSTER_NAME environment variable isntead of --name

New Node have been Images for kind v0.8.0, please use these exact images (IE like v1.18.2:@sha256:7b27a6d0f2517ff88ba444025beae41491b016bc6af573ba467b70c5e8e0d85f including the digest) or build your own as we may need to change the image format again in the future 😅

Images built for this release:

  • 1.18: kindest/node:v1.18.2@sha256:7b27a6d0f2517ff88ba444025beae41491b016bc6af573ba467b70c5e8e0d85f
  • 1.17: kindest/node:v1.17.5@sha256:ab3f9e6ec5ad8840eeb1f76c89bb7948c77bbf76bcebe1a8b59790b8ae9a283a
  • 1.16: kindest/node:v1.16.9@sha256:7175872357bc85847ec4b1aba46ed1d12fa054c83ac7a8a11f5c268957fd5765
  • 1.15: kindest/node:v1.15.11@sha256:6cc31f3533deb138792db2c7d1ffc36f7456a06f1db5556ad3b6927641016f50
  • 1.14: kindest/node:v1.14.10@sha256:6cd43ff41ae9f02bb46c8f455d5323819aec858b99534a290517ebc181b443c6
  • 1.13: kindest/node:v1.13.12@sha256:214476f1514e47fe3f6f54d0f9e24cfb1e4cda449529791286c7161b7f9c08e7
  • 1.12: kindest/node:v1.12.10@sha256:faeb82453af2f9373447bb63f50bae02b8020968e0889c7fa308e19b348916cb
  • 1.11: kindest/node:v1.11.10@sha256:74c8740710649a3abb169e7f348312deff88fc97d74cfb874c5095ab3866bb42

EDIT: 1.11.X does not work. See: #1565

Fixes

  • Avoid potentially slow sync during bootstrap
  • Fixed some occasional flakes when exporting logs
  • Simple output mode automatically activated on Travis CI to avoid broken PTY behavior
  • Fixed image import on ARM
  • Fixed abspath resolution in cluster config on Windows
  • Fixed DNS resolution on some systems
  • Fixed building Kubernetes with Bazel
  • Fixed using kind on ZFS / BTRFS backed host docker
  • Updated Conformance Certification

Contributors

Thanks again to everyone who contributed to this release! ❤️

Users whose commits are in this release (alphabetically by user name)