feature request: Take a snapshot of a cluster

[owenthereal]

Steps to reproduce the issue:

This is a feature request not an issue.

I would like to be able to take a snapshot of the cluster and reuse it for CI for a faster boot time. I have functional tests that run on a minikube cluster but the tests require installation of a bunch of software, e.g. ingress-nginx, cert-manager etc. I'm wondering whether there is a way to "pre-burn" a minikube image by taking a snapshot of a running cluster. The image includes a version of the minikube k8s and software that I install on it. The image is then used in CI to avoid reinstalling all the basic software every time. This would immensely shorten the CI time.

Full output of failed command:

N/A

Full output of minikube start command used, if not already included:

N/A

Optional: Full output of minikube logs command:

N/A

[afbjorklund]

Did you check out the minikube cache command already ?

[owenthereal]

minikube cache adds/deletes/loads an image to/from minikube. What I wanted is to burn the whole cluster with software that I install into the cluster as an image so that it can be reused elsewhere, e.g. CI.

[afbjorklund]

You did not mention what platform and driver this was for. I'm not sure the "pause" feature will survive such a "burn"...

We talked about adding the suspend/resume feature earlier, but ended up adding the pause/unpause feature instead.
In theory the VirtualBox driver should support it, but I have only done it locally - and there is no minikube support for it

There might be other "kubernetes backup" software, to take snapshots of running clusters. Maybe they can be integrated.

[owenthereal]

You did not mention what platform and driver this was for

I'm looking for this feature for Linux with the Docker driver mainly. A quick google shows that it is possible and easy to do: https://stackoverflow.com/questions/26331651/how-can-i-backup-a-docker-container-with-its-data-volumes.

Regarding other drivers, most of them should have the feature of snapshotting or suspending/resuming as you mentioned.

There might be other "kubernetes backup" software, to take snapshots of running clusters. Maybe they can be integrated.

I would love to see the integration of such software. Any pointers?

[afbjorklund]

Something like https://github.com/vmware-tanzu/velero perhaps ?

[owenthereal]

I checked https://github.com/vmware-tanzu/velero and it's cloud provider specific. I'm unclear how that would apply for minikube.

[medyagh]

this is a good idea ! we have plans to explore the idea of freezing a cluster to potentially start minikube faster with a frozen cluster.

this is on our roadmap to explore.
both
@ilya-zuyev @priyawadhwa are looking into this.

[priyawadhwa]

Yup, we are aiming to have a design for this this quarter. I will update this issue as we know more!