Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failed to start kvm2 VM :: Unable to set XATTR - Operation not permitted #14272

Closed
aschulth opened this issue Jun 3, 2022 · 4 comments
Closed

Failed to start kvm2 VM :: Unable to set XATTR - Operation not permitted #14272

aschulth opened this issue Jun 3, 2022 · 4 comments
Labels
co/kvm2-driver KVM2 driver related issues kind/support Categorizes issue or PR as a support question. os/linux

Comments

@aschulth
Copy link

aschulth commented Jun 3, 2022 •
edited
Loading

What Happened?

Starting minikube on Debian 11 (on ChromeOS) throws the following error:

Failed to start kvm2 VM. Running "minikube delete" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: error creating VM: virError(Code=38, Domain=0, Message='Unable to set XATTR trusted.libvirt.security.dac on /var/lib/libvirt/qemu/domain-10-minikube/master-key.aes: Operation not permitted')

Points of interest:

  • Fresh Linux environment (Debian GNU/Linux 11)
  • Google Chrome Version 102.0.5005.75 (Official Build) (64-bit)
  • It worked before but did stop working on new ChromeOS version.

Attach the log file

* ==> Audit <==
* |---------|-----------------|----------|------|---------|--------------------------------|--------------------------------|
| Command |      Args       | Profile  | User | Version |           Start Time           |            End Time            |
|---------|-----------------|----------|------|---------|--------------------------------|--------------------------------|
| config  | set driver kvm2 | minikube | as   | v1.25.2 | Fri, 03 Jun 2022 13:51:03 CEST | Fri, 03 Jun 2022 13:51:03 CEST |
| delete  |                 | minikube | as   | v1.25.2 | Fri, 03 Jun 2022 13:51:12 CEST | Fri, 03 Jun 2022 13:51:13 CEST |
| delete  |                 | minikube | as   | v1.25.2 | Fri, 03 Jun 2022 15:13:53 CEST | Fri, 03 Jun 2022 15:13:54 CEST |
| delete  |                 | minikube | as   | v1.25.2 | Fri, 03 Jun 2022 15:14:12 CEST | Fri, 03 Jun 2022 15:14:13 CEST |
| delete  |                 | minikube | as   | v1.25.2 | Fri, 03 Jun 2022 15:14:46 CEST | Fri, 03 Jun 2022 15:14:47 CEST |
|---------|-----------------|----------|------|---------|--------------------------------|--------------------------------|

* 
* ==> Last Start <==
* Log file created at: 2022/06/03 15:14:58
Running on machine: penguin
Binary: Built with gc go1.17.7 for linux/amd64
Log line format: [IWEF]mmdd hh:mm:ss.uuuuuu threadid file:line] msg
I0603 15:14:58.315067    7633 out.go:297] Setting OutFile to fd 1 ...
I0603 15:14:58.315161    7633 out.go:349] isatty.IsTerminal(1) = false
I0603 15:14:58.315171    7633 out.go:310] Setting ErrFile to fd 2...
I0603 15:14:58.315177    7633 out.go:349] isatty.IsTerminal(2) = false
I0603 15:14:58.315276    7633 root.go:315] Updating PATH: /home/as/.minikube/bin
I0603 15:14:58.315571    7633 out.go:304] Setting JSON to false
I0603 15:14:58.316864    7633 start.go:112] hostinfo: {"hostname":"penguin","uptime":5881,"bootTime":1654256217,"procs":35,"os":"linux","platform":"debian","platformFamily":"debian","platformVersion":"11.3","kernelVersion":"5.10.110-15808-ge5740beba59b","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"guest","hostId":"b03517f4-9020-4ac7-8477-60e941898923"}
I0603 15:14:58.316945    7633 start.go:122] virtualization:  guest
I0603 15:14:58.436196    7633 out.go:176] * minikube v1.25.2 on Debian 11.3 (amd64)
I0603 15:14:58.437009    7633 notify.go:193] Checking for updates...
I0603 15:14:58.437341    7633 driver.go:344] Setting default libvirt URI to qemu:///system
I0603 15:14:58.615940    7633 out.go:176] * Using the kvm2 driver based on user configuration
I0603 15:14:58.616048    7633 start.go:281] selected driver: kvm2
I0603 15:14:58.616069    7633 start.go:798] validating driver "kvm2" against <nil>
I0603 15:14:58.616120    7633 start.go:809] status for kvm2: {Installed:true Healthy:true Running:true NeedsImprovement:false Error:<nil> Reason: Fix: Doc: Version:}
I0603 15:14:58.618690    7633 install.go:52] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0603 15:14:58.619279    7633 install.go:117] Validating docker-machine-driver-kvm2, PATH=/home/as/.minikube/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
I0603 15:14:58.685205    7633 install.go:137] /home/as/.minikube/bin/docker-machine-driver-kvm2 version is 1.25.2
I0603 15:14:58.685442    7633 start_flags.go:288] no existing cluster config was found, will generate one from the flags 
I0603 15:14:58.691144    7633 start_flags.go:369] Using suggested 2200MB memory alloc based on sys=6603MB, container=0MB
I0603 15:14:58.691682    7633 start_flags.go:397] setting extra-config: kubelet.housekeeping-interval=5m
I0603 15:14:58.691825    7633 start_flags.go:813] Wait components to verify : map[apiserver:true system_pods:true]
I0603 15:14:58.691916    7633 cni.go:93] Creating CNI manager for ""
I0603 15:14:58.691959    7633 cni.go:167] CNI unnecessary in this configuration, recommending no CNI
I0603 15:14:58.692001    7633 start_flags.go:302] config:
{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/as:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false}
I0603 15:14:58.692550    7633 iso.go:123] acquiring lock: {Name:mk5a528889834b74ee7058032a0d6de530a14cd6 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0603 15:14:58.814707    7633 out.go:176] * Starting control plane node minikube in cluster minikube
I0603 15:14:58.814810    7633 preload.go:132] Checking if preload exists for k8s version v1.23.3 and runtime docker
I0603 15:14:58.814921    7633 preload.go:148] Found local preload: /home/as/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v17-v1.23.3-docker-overlay2-amd64.tar.lz4
I0603 15:14:58.814941    7633 cache.go:57] Caching tarball of preloaded images
I0603 15:14:58.815197    7633 preload.go:174] Found /home/as/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v17-v1.23.3-docker-overlay2-amd64.tar.lz4 in cache, skipping download
I0603 15:14:58.815238    7633 cache.go:60] Finished verifying existence of preloaded tar for  v1.23.3 on docker
I0603 15:14:58.815902    7633 profile.go:148] Saving config to /home/as/.minikube/profiles/minikube/config.json ...
I0603 15:14:58.815977    7633 lock.go:35] WriteFile acquiring /home/as/.minikube/profiles/minikube/config.json: {Name:mkd31f2ce2a75b89facd04de89c56786a4d3d7d6 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0603 15:14:58.816337    7633 cache.go:208] Successfully downloaded all kic artifacts
I0603 15:14:58.816379    7633 start.go:313] acquiring machines lock for minikube: {Name:mk517ad21dd1ed4bd3f1f92118cdd45711d4f54b Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0603 15:14:58.816547    7633 start.go:317] acquired machines lock for "minikube" in 137.687µs
I0603 15:14:58.816595    7633 start.go:89] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.25.2.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.23.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/as:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false} &{Name: IP: Port:8443 KubernetesVersion:v1.23.3 ContainerRuntime:docker ControlPlane:true Worker:true}
I0603 15:14:58.816801    7633 start.go:126] createHost starting for "" (driver="kvm2")
I0603 15:14:58.822515    7633 out.go:203] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0603 15:14:58.822821    7633 main.go:130] libmachine: Found binary path at /home/as/.minikube/bin/docker-machine-driver-kvm2
I0603 15:14:58.822914    7633 main.go:130] libmachine: Launching plugin server for driver kvm2
I0603 15:14:58.857250    7633 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:41225
I0603 15:14:58.858471    7633 main.go:130] libmachine: () Calling .GetVersion
I0603 15:14:58.860904    7633 main.go:130] libmachine: Using API Version  1
I0603 15:14:58.861010    7633 main.go:130] libmachine: () Calling .SetConfigRaw
I0603 15:14:58.861753    7633 main.go:130] libmachine: () Calling .GetMachineName
I0603 15:14:58.862198    7633 main.go:130] libmachine: (minikube) Calling .GetMachineName
I0603 15:14:58.862611    7633 main.go:130] libmachine: (minikube) Calling .DriverName
I0603 15:14:58.862989    7633 start.go:160] libmachine.API.Create for "minikube" (driver="kvm2")
I0603 15:14:58.863045    7633 client.go:168] LocalClient.Create starting
I0603 15:14:58.863142    7633 main.go:130] libmachine: Reading certificate data from /home/as/.minikube/certs/ca.pem
I0603 15:14:58.863226    7633 main.go:130] libmachine: Decoding PEM data...
I0603 15:14:58.863277    7633 main.go:130] libmachine: Parsing certificate...
I0603 15:14:58.863457    7633 main.go:130] libmachine: Reading certificate data from /home/as/.minikube/certs/cert.pem
I0603 15:14:58.863530    7633 main.go:130] libmachine: Decoding PEM data...
I0603 15:14:58.863576    7633 main.go:130] libmachine: Parsing certificate...
I0603 15:14:58.863633    7633 main.go:130] libmachine: Running pre-create checks...
I0603 15:14:58.863665    7633 main.go:130] libmachine: (minikube) Calling .PreCreateCheck
I0603 15:14:58.864916    7633 main.go:130] libmachine: (minikube) Calling .GetConfigRaw
I0603 15:14:58.865854    7633 main.go:130] libmachine: Creating machine...
I0603 15:14:58.865891    7633 main.go:130] libmachine: (minikube) Calling .Create
I0603 15:14:58.866159    7633 main.go:130] libmachine: (minikube) Creating KVM machine...
I0603 15:14:58.878817    7633 main.go:130] libmachine: (minikube) DBG | found existing default KVM network
I0603 15:14:58.880749    7633 main.go:130] libmachine: (minikube) DBG | I0603 15:14:58.880000    7655 network.go:288] reserving subnet 192.168.39.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.39.0:0xc000206280] misses:0}
I0603 15:14:58.880894    7633 main.go:130] libmachine: (minikube) DBG | I0603 15:14:58.880277    7655 network.go:235] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0603 15:14:58.998741    7633 main.go:130] libmachine: (minikube) DBG | trying to create private KVM network mk-minikube 192.168.39.0/24...
I0603 15:14:59.064691    7633 main.go:130] libmachine: (minikube) DBG | private KVM network mk-minikube 192.168.39.0/24 created
I0603 15:14:59.064730    7633 main.go:130] libmachine: (minikube) DBG | I0603 15:14:59.064668    7655 common.go:107] Making disk image using store path: /home/as/.minikube
I0603 15:14:59.064746    7633 main.go:130] libmachine: (minikube) Setting up store path in /home/as/.minikube/machines/minikube ...
I0603 15:14:59.064785    7633 main.go:130] libmachine: (minikube) Building disk image from file:///home/as/.minikube/cache/iso/amd64/minikube-v1.25.2.iso
I0603 15:14:59.064803    7633 main.go:130] libmachine: (minikube) Downloading /home/as/.minikube/cache/boot2docker.iso from file:///home/as/.minikube/cache/iso/amd64/minikube-v1.25.2.iso...
I0603 15:14:59.065079    7633 main.go:130] libmachine: (minikube) DBG | I0603 15:14:59.064980    7655 common.go:114] Creating ssh key: /home/as/.minikube/machines/minikube/id_rsa...
I0603 15:14:59.151586    7633 main.go:130] libmachine: (minikube) DBG | I0603 15:14:59.151452    7655 common.go:120] Creating raw disk image: /home/as/.minikube/machines/minikube/minikube.rawdisk...
I0603 15:14:59.151623    7633 main.go:130] libmachine: (minikube) DBG | Writing magic tar header
I0603 15:14:59.151646    7633 main.go:130] libmachine: (minikube) DBG | Writing SSH key tar header
I0603 15:14:59.151664    7633 main.go:130] libmachine: (minikube) DBG | I0603 15:14:59.151590    7655 common.go:134] Fixing permissions on /home/as/.minikube/machines/minikube ...
I0603 15:14:59.151733    7633 main.go:130] libmachine: (minikube) DBG | Checking permissions on dir: /home/as/.minikube/machines/minikube
I0603 15:14:59.151754    7633 main.go:130] libmachine: (minikube) DBG | Checking permissions on dir: /home/as/.minikube/machines
I0603 15:14:59.151782    7633 main.go:130] libmachine: (minikube) DBG | Checking permissions on dir: /home/as/.minikube
I0603 15:14:59.151796    7633 main.go:130] libmachine: (minikube) Setting executable bit set on /home/as/.minikube/machines/minikube (perms=drwx------)
I0603 15:14:59.151812    7633 main.go:130] libmachine: (minikube) Setting executable bit set on /home/as/.minikube/machines (perms=drwxr-xr-x)
I0603 15:14:59.151824    7633 main.go:130] libmachine: (minikube) Setting executable bit set on /home/as/.minikube (perms=drwxr-xr-x)
I0603 15:14:59.151862    7633 main.go:130] libmachine: (minikube) DBG | Checking permissions on dir: /home/as
I0603 15:14:59.151888    7633 main.go:130] libmachine: (minikube) Setting executable bit set on /home/as (perms=drwxr-xr-x)
I0603 15:14:59.151916    7633 main.go:130] libmachine: (minikube) DBG | Checking permissions on dir: /home
I0603 15:14:59.151943    7633 main.go:130] libmachine: (minikube) Creating domain...
I0603 15:14:59.151959    7633 main.go:130] libmachine: (minikube) DBG | Skipping /home - not owner
I0603 15:14:59.155453    7633 main.go:130] libmachine: (minikube) define libvirt domain using xml: 
I0603 15:14:59.155480    7633 main.go:130] libmachine: (minikube) <domain type='kvm'>
I0603 15:14:59.155489    7633 main.go:130] libmachine: (minikube)   <name>minikube</name>
I0603 15:14:59.155499    7633 main.go:130] libmachine: (minikube)   <memory unit='MiB'>2200</memory>
I0603 15:14:59.155510    7633 main.go:130] libmachine: (minikube)   <vcpu>2</vcpu>
I0603 15:14:59.155521    7633 main.go:130] libmachine: (minikube)   <features>
I0603 15:14:59.155531    7633 main.go:130] libmachine: (minikube)     <acpi/>
I0603 15:14:59.155540    7633 main.go:130] libmachine: (minikube)     <apic/>
I0603 15:14:59.155549    7633 main.go:130] libmachine: (minikube)     <pae/>
I0603 15:14:59.155556    7633 main.go:130] libmachine: (minikube)     
I0603 15:14:59.155563    7633 main.go:130] libmachine: (minikube)   </features>
I0603 15:14:59.155569    7633 main.go:130] libmachine: (minikube)   <cpu mode='host-passthrough'>
I0603 15:14:59.155575    7633 main.go:130] libmachine: (minikube)   
I0603 15:14:59.155589    7633 main.go:130] libmachine: (minikube)   </cpu>
I0603 15:14:59.155601    7633 main.go:130] libmachine: (minikube)   <os>
I0603 15:14:59.155611    7633 main.go:130] libmachine: (minikube)     <type>hvm</type>
I0603 15:14:59.155621    7633 main.go:130] libmachine: (minikube)     <boot dev='cdrom'/>
I0603 15:14:59.155632    7633 main.go:130] libmachine: (minikube)     <boot dev='hd'/>
I0603 15:14:59.155644    7633 main.go:130] libmachine: (minikube)     <bootmenu enable='no'/>
I0603 15:14:59.155652    7633 main.go:130] libmachine: (minikube)   </os>
I0603 15:14:59.155662    7633 main.go:130] libmachine: (minikube)   <devices>
I0603 15:14:59.155673    7633 main.go:130] libmachine: (minikube)     <disk type='file' device='cdrom'>
I0603 15:14:59.155687    7633 main.go:130] libmachine: (minikube)       <source file='/home/as/.minikube/machines/minikube/boot2docker.iso'/>
I0603 15:14:59.155697    7633 main.go:130] libmachine: (minikube)       <target dev='hdc' bus='scsi'/>
I0603 15:14:59.155720    7633 main.go:130] libmachine: (minikube)       <readonly/>
I0603 15:14:59.155730    7633 main.go:130] libmachine: (minikube)     </disk>
I0603 15:14:59.155741    7633 main.go:130] libmachine: (minikube)     <disk type='file' device='disk'>
I0603 15:14:59.155756    7633 main.go:130] libmachine: (minikube)       <driver name='qemu' type='raw' cache='default' io='threads' />
I0603 15:14:59.155781    7633 main.go:130] libmachine: (minikube)       <source file='/home/as/.minikube/machines/minikube/minikube.rawdisk'/>
I0603 15:14:59.155792    7633 main.go:130] libmachine: (minikube)       <target dev='hda' bus='virtio'/>
I0603 15:14:59.155802    7633 main.go:130] libmachine: (minikube)     </disk>
I0603 15:14:59.155813    7633 main.go:130] libmachine: (minikube)     <interface type='network'>
I0603 15:14:59.155824    7633 main.go:130] libmachine: (minikube)       <source network='mk-minikube'/>
I0603 15:14:59.155835    7633 main.go:130] libmachine: (minikube)       <model type='virtio'/>
I0603 15:14:59.155845    7633 main.go:130] libmachine: (minikube)     </interface>
I0603 15:14:59.155855    7633 main.go:130] libmachine: (minikube)     <interface type='network'>
I0603 15:14:59.155868    7633 main.go:130] libmachine: (minikube)       <source network='default'/>
I0603 15:14:59.155877    7633 main.go:130] libmachine: (minikube)       <model type='virtio'/>
I0603 15:14:59.155887    7633 main.go:130] libmachine: (minikube)     </interface>
I0603 15:14:59.155895    7633 main.go:130] libmachine: (minikube)     <serial type='pty'>
I0603 15:14:59.155907    7633 main.go:130] libmachine: (minikube)       <target port='0'/>
I0603 15:14:59.155916    7633 main.go:130] libmachine: (minikube)     </serial>
I0603 15:14:59.155941    7633 main.go:130] libmachine: (minikube)     <console type='pty'>
I0603 15:14:59.155961    7633 main.go:130] libmachine: (minikube)       <target type='serial' port='0'/>
I0603 15:14:59.155973    7633 main.go:130] libmachine: (minikube)     </console>
I0603 15:14:59.155984    7633 main.go:130] libmachine: (minikube)     <rng model='virtio'>
I0603 15:14:59.155997    7633 main.go:130] libmachine: (minikube)       <backend model='random'>/dev/random</backend>
I0603 15:14:59.156006    7633 main.go:130] libmachine: (minikube)     </rng>
I0603 15:14:59.156016    7633 main.go:130] libmachine: (minikube)     
I0603 15:14:59.156024    7633 main.go:130] libmachine: (minikube)     
I0603 15:14:59.156033    7633 main.go:130] libmachine: (minikube)   </devices>
I0603 15:14:59.156042    7633 main.go:130] libmachine: (minikube) </domain>
I0603 15:14:59.156085    7633 main.go:130] libmachine: (minikube) 
I0603 15:14:59.285625    7633 main.go:130] libmachine: (minikube) DBG | domain minikube has defined MAC address 52:54:00:36:f8:33 in network default
I0603 15:14:59.287609    7633 main.go:130] libmachine: (minikube) DBG | domain minikube has defined MAC address 52:54:00:3a:08:c7 in network mk-minikube
I0603 15:14:59.287680    7633 main.go:130] libmachine: (minikube) Ensuring networks are active...
I0603 15:14:59.297151    7633 main.go:130] libmachine: (minikube) Ensuring network default is active
I0603 15:14:59.298334    7633 main.go:130] libmachine: (minikube) Ensuring network mk-minikube is active
I0603 15:14:59.300083    7633 main.go:130] libmachine: (minikube) Getting domain xml...
I0603 15:14:59.305587    7633 main.go:130] libmachine: (minikube) Creating domain...
I0603 15:14:59.336630    7633 main.go:130] libmachine: (minikube) DBG | unable to start VM: error creating VM: virError(Code=38, Domain=0, Message='Unable to set XATTR trusted.libvirt.security.dac on /var/lib/libvirt/qemu/domain-9-minikube/master-key.aes: Operation not permitted')
I0603 15:14:59.336927    7633 client.go:171] LocalClient.Create took 473.860881ms
I0603 15:15:01.338264    7633 start.go:129] duration metric: createHost completed in 2.521413037s
I0603 15:15:01.338414    7633 start.go:80] releasing machines lock for "minikube", held for 2.521832747s
W0603 15:15:01.338583    7633 start.go:570] error starting host: creating host: create: Error creating machine: Error in driver during machine creation: error creating VM: virError(Code=38, Domain=0, Message='Unable to set XATTR trusted.libvirt.security.dac on /var/lib/libvirt/qemu/domain-9-minikube/master-key.aes: Operation not permitted')
I0603 15:15:01.340189    7633 main.go:130] libmachine: Found binary path at /home/as/.minikube/bin/docker-machine-driver-kvm2
I0603 15:15:01.340361    7633 main.go:130] libmachine: Launching plugin server for driver kvm2
I0603 15:15:01.377623    7633 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:38779
I0603 15:15:01.378454    7633 main.go:130] libmachine: () Calling .GetVersion
I0603 15:15:01.379304    7633 main.go:130] libmachine: Using API Version  1
I0603 15:15:01.379365    7633 main.go:130] libmachine: () Calling .SetConfigRaw
I0603 15:15:01.379978    7633 main.go:130] libmachine: () Calling .GetMachineName
I0603 15:15:01.380877    7633 main.go:130] libmachine: Found binary path at /home/as/.minikube/bin/docker-machine-driver-kvm2
I0603 15:15:01.380944    7633 main.go:130] libmachine: Launching plugin server for driver kvm2
I0603 15:15:01.399104    7633 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:40917
I0603 15:15:01.399581    7633 main.go:130] libmachine: () Calling .GetVersion
I0603 15:15:01.400196    7633 main.go:130] libmachine: Using API Version  1
I0603 15:15:01.400230    7633 main.go:130] libmachine: () Calling .SetConfigRaw
I0603 15:15:01.400952    7633 main.go:130] libmachine: () Calling .GetMachineName
I0603 15:15:01.401346    7633 main.go:130] libmachine: (minikube) Calling .GetState
I0603 15:15:01.406965    7633 main.go:130] libmachine: (minikube) Calling .DriverName
I0603 15:15:01.527544    7633 out.go:176] * Deleting "minikube" in kvm2 ...
I0603 15:15:01.527676    7633 main.go:130] libmachine: (minikube) Calling .Remove
I0603 15:15:01.528499    7633 main.go:130] libmachine: (minikube) DBG | Removing machine...
I0603 15:15:01.541827    7633 main.go:130] libmachine: (minikube) DBG | Trying to delete the networks (if possible)
I0603 15:15:01.553233    7633 main.go:130] libmachine: (minikube) DBG | Checking if network mk-minikube exists...
I0603 15:15:01.554051    7633 main.go:130] libmachine: (minikube) DBG | Network mk-minikube exists
I0603 15:15:01.554150    7633 main.go:130] libmachine: (minikube) DBG | Trying to list all domains...
I0603 15:15:01.554867    7633 main.go:130] libmachine: (minikube) DBG | Listed all domains: total of 1 domains
I0603 15:15:01.554942    7633 main.go:130] libmachine: (minikube) DBG | Trying to get name of domain...
I0603 15:15:01.555008    7633 main.go:130] libmachine: (minikube) DBG | Got domain name: minikube
I0603 15:15:01.555054    7633 main.go:130] libmachine: (minikube) DBG | Skipping domain as it is us...
I0603 15:15:01.555112    7633 main.go:130] libmachine: (minikube) DBG | Trying to delete network mk-minikube...
I0603 15:15:01.555656    7633 main.go:130] libmachine: (minikube) DBG | Destroying active network mk-minikube
I0603 15:15:01.632356    7633 main.go:130] libmachine: (minikube) DBG | Undefining inactive network mk-minikube
I0603 15:15:01.632935    7633 main.go:130] libmachine: (minikube) DBG | Network mk-minikube deleted
I0603 15:15:01.632960    7633 main.go:130] libmachine: (minikube) DBG | Checking if the domain needs to be deleted
I0603 15:15:01.632981    7633 main.go:130] libmachine: (minikube) Successfully deleted networks
I0603 15:15:01.633177    7633 main.go:130] libmachine: (minikube) Domain minikube exists, removing...
I0603 15:15:01.633374    7633 main.go:130] libmachine: (minikube) Domain minikube already destroyed, skipping...
I0603 15:15:01.633911    7633 main.go:130] libmachine: (minikube) Removing static IP address...
I0603 15:15:01.633941    7633 main.go:130] libmachine: (minikube) Removed static IP address
I0603 15:15:01.633966    7633 main.go:130] libmachine: (minikube) DBG | skip deleting static IP from network mk-minikube - couldn't find host DHCP lease matching {name: "", mac: "", ip: ""}
W0603 15:15:01.634410    7633 out.go:241] ! StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: error creating VM: virError(Code=38, Domain=0, Message='Unable to set XATTR trusted.libvirt.security.dac on /var/lib/libvirt/qemu/domain-9-minikube/master-key.aes: Operation not permitted')
I0603 15:15:01.634439    7633 start.go:585] Will try again in 5 seconds ...
I0603 15:15:06.635174    7633 start.go:313] acquiring machines lock for minikube: {Name:mk517ad21dd1ed4bd3f1f92118cdd45711d4f54b Clock:{} Delay:500ms Timeout:13m0s Cancel:<nil>}
I0603 15:15:06.635834    7633 start.go:317] acquired machines lock for "minikube" in 519.639µs
I0603 15:15:06.635956    7633 start.go:89] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.25.2.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.30@sha256:02c921df998f95e849058af14de7045efc3954d90320967418a0d1f182bbc0b2 Memory:2200 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.23.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[{Component:kubelet Key:housekeeping-interval Value:5m}] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.23.3 ContainerRuntime:docker ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/home/as:/minikube-host Mount9PVersion:9p2000.L MountGID:docker MountIP: MountMSize:262144 MountOptions:[] MountPort:0 MountType:9p MountUID:docker BinaryMirror: DisableOptimizations:false} &{Name: IP: Port:8443 KubernetesVersion:v1.23.3 ContainerRuntime:docker ControlPlane:true Worker:true}
I0603 15:15:06.636214    7633 start.go:126] createHost starting for "" (driver="kvm2")
I0603 15:15:06.752137    7633 out.go:203] * Creating kvm2 VM (CPUs=2, Memory=2200MB, Disk=20000MB) ...
I0603 15:15:06.752527    7633 main.go:130] libmachine: Found binary path at /home/as/.minikube/bin/docker-machine-driver-kvm2
I0603 15:15:06.752683    7633 main.go:130] libmachine: Launching plugin server for driver kvm2
I0603 15:15:06.791929    7633 main.go:130] libmachine: Plugin server listening at address 127.0.0.1:33041
I0603 15:15:06.792809    7633 main.go:130] libmachine: () Calling .GetVersion
I0603 15:15:06.793686    7633 main.go:130] libmachine: Using API Version  1
I0603 15:15:06.793744    7633 main.go:130] libmachine: () Calling .SetConfigRaw
I0603 15:15:06.794332    7633 main.go:130] libmachine: () Calling .GetMachineName
I0603 15:15:06.794674    7633 main.go:130] libmachine: (minikube) Calling .GetMachineName
I0603 15:15:06.794963    7633 main.go:130] libmachine: (minikube) Calling .DriverName
I0603 15:15:06.795252    7633 start.go:160] libmachine.API.Create for "minikube" (driver="kvm2")
I0603 15:15:06.795295    7633 client.go:168] LocalClient.Create starting
I0603 15:15:06.795373    7633 main.go:130] libmachine: Reading certificate data from /home/as/.minikube/certs/ca.pem
I0603 15:15:06.795428    7633 main.go:130] libmachine: Decoding PEM data...
I0603 15:15:06.795459    7633 main.go:130] libmachine: Parsing certificate...
I0603 15:15:06.795564    7633 main.go:130] libmachine: Reading certificate data from /home/as/.minikube/certs/cert.pem
I0603 15:15:06.795609    7633 main.go:130] libmachine: Decoding PEM data...
I0603 15:15:06.795636    7633 main.go:130] libmachine: Parsing certificate...
I0603 15:15:06.795679    7633 main.go:130] libmachine: Running pre-create checks...
I0603 15:15:06.795697    7633 main.go:130] libmachine: (minikube) Calling .PreCreateCheck
I0603 15:15:06.796045    7633 main.go:130] libmachine: (minikube) Calling .GetConfigRaw
I0603 15:15:06.796671    7633 main.go:130] libmachine: Creating machine...
I0603 15:15:06.796696    7633 main.go:130] libmachine: (minikube) Calling .Create
I0603 15:15:06.796908    7633 main.go:130] libmachine: (minikube) Creating KVM machine...
I0603 15:15:06.804081    7633 main.go:130] libmachine: (minikube) DBG | found existing default KVM network
I0603 15:15:06.804997    7633 main.go:130] libmachine: (minikube) DBG | I0603 15:15:06.804698    7716 network.go:288] reserving subnet 192.168.39.0 for 1m0s: &{mu:{state:0 sema:0} read:{v:{m:map[] amended:true}} dirty:map[192.168.39.0:0xc00018c5d0] misses:0}
I0603 15:15:06.805065    7633 main.go:130] libmachine: (minikube) DBG | I0603 15:15:06.804879    7716 network.go:235] using free private subnet 192.168.39.0/24: &{IP:192.168.39.0 Netmask:255.255.255.0 Prefix:24 CIDR:192.168.39.0/24 Gateway:192.168.39.1 ClientMin:192.168.39.2 ClientMax:192.168.39.254 Broadcast:192.168.39.255 Interface:{IfaceName: IfaceIPv4: IfaceMTU:0 IfaceMAC:}}
I0603 15:15:06.929509    7633 main.go:130] libmachine: (minikube) DBG | trying to create private KVM network mk-minikube 192.168.39.0/24...
I0603 15:15:07.029282    7633 main.go:130] libmachine: (minikube) DBG | private KVM network mk-minikube 192.168.39.0/24 created
I0603 15:15:07.029324    7633 main.go:130] libmachine: (minikube) Setting up store path in /home/as/.minikube/machines/minikube ...
I0603 15:15:07.029382    7633 main.go:130] libmachine: (minikube) DBG | I0603 15:15:07.029247    7716 common.go:107] Making disk image using store path: /home/as/.minikube
I0603 15:15:07.029395    7633 main.go:130] libmachine: (minikube) Building disk image from file:///home/as/.minikube/cache/iso/amd64/minikube-v1.25.2.iso
I0603 15:15:07.029416    7633 main.go:130] libmachine: (minikube) Downloading /home/as/.minikube/cache/boot2docker.iso from file:///home/as/.minikube/cache/iso/amd64/minikube-v1.25.2.iso...
I0603 15:15:07.029634    7633 main.go:130] libmachine: (minikube) DBG | I0603 15:15:07.029580    7716 common.go:114] Creating ssh key: /home/as/.minikube/machines/minikube/id_rsa...
I0603 15:15:07.161133    7633 main.go:130] libmachine: (minikube) DBG | I0603 15:15:07.160989    7716 common.go:120] Creating raw disk image: /home/as/.minikube/machines/minikube/minikube.rawdisk...
I0603 15:15:07.161180    7633 main.go:130] libmachine: (minikube) DBG | Writing magic tar header
I0603 15:15:07.161196    7633 main.go:130] libmachine: (minikube) DBG | Writing SSH key tar header
I0603 15:15:07.161210    7633 main.go:130] libmachine: (minikube) DBG | I0603 15:15:07.161178    7716 common.go:134] Fixing permissions on /home/as/.minikube/machines/minikube ...
I0603 15:15:07.161331    7633 main.go:130] libmachine: (minikube) DBG | Checking permissions on dir: /home/as/.minikube/machines/minikube
I0603 15:15:07.161374    7633 main.go:130] libmachine: (minikube) Setting executable bit set on /home/as/.minikube/machines/minikube (perms=drwx------)
I0603 15:15:07.161397    7633 main.go:130] libmachine: (minikube) Setting executable bit set on /home/as/.minikube/machines (perms=drwxr-xr-x)
I0603 15:15:07.161613    7633 main.go:130] libmachine: (minikube) DBG | Checking permissions on dir: /home/as/.minikube/machines
I0603 15:15:07.161628    7633 main.go:130] libmachine: (minikube) Setting executable bit set on /home/as/.minikube (perms=drwxr-xr-x)
I0603 15:15:07.161642    7633 main.go:130] libmachine: (minikube) Setting executable bit set on /home/as (perms=drwxr-xr-x)
I0603 15:15:07.161650    7633 main.go:130] libmachine: (minikube) Creating domain...
I0603 15:15:07.161666    7633 main.go:130] libmachine: (minikube) DBG | Checking permissions on dir: /home/as/.minikube
I0603 15:15:07.161675    7633 main.go:130] libmachine: (minikube) DBG | Checking permissions on dir: /home/as
I0603 15:15:07.161687    7633 main.go:130] libmachine: (minikube) DBG | Checking permissions on dir: /home
I0603 15:15:07.161696    7633 main.go:130] libmachine: (minikube) DBG | Skipping /home - not owner
I0603 15:15:07.164698    7633 main.go:130] libmachine: (minikube) define libvirt domain using xml: 
I0603 15:15:07.164739    7633 main.go:130] libmachine: (minikube) <domain type='kvm'>
I0603 15:15:07.164753    7633 main.go:130] libmachine: (minikube)   <name>minikube</name>
I0603 15:15:07.164774    7633 main.go:130] libmachine: (minikube)   <memory unit='MiB'>2200</memory>
I0603 15:15:07.164786    7633 main.go:130] libmachine: (minikube)   <vcpu>2</vcpu>
I0603 15:15:07.164798    7633 main.go:130] libmachine: (minikube)   <features>
I0603 15:15:07.164807    7633 main.go:130] libmachine: (minikube)     <acpi/>
I0603 15:15:07.164817    7633 main.go:130] libmachine: (minikube)     <apic/>
I0603 15:15:07.164825    7633 main.go:130] libmachine: (minikube)     <pae/>
I0603 15:15:07.164835    7633 main.go:130] libmachine: (minikube)     
I0603 15:15:07.164843    7633 main.go:130] libmachine: (minikube)   </features>
I0603 15:15:07.164865    7633 main.go:130] libmachine: (minikube)   <cpu mode='host-passthrough'>
I0603 15:15:07.164886    7633 main.go:130] libmachine: (minikube)   
I0603 15:15:07.164897    7633 main.go:130] libmachine: (minikube)   </cpu>
I0603 15:15:07.164904    7633 main.go:130] libmachine: (minikube)   <os>
I0603 15:15:07.164911    7633 main.go:130] libmachine: (minikube)     <type>hvm</type>
I0603 15:15:07.164916    7633 main.go:130] libmachine: (minikube)     <boot dev='cdrom'/>
I0603 15:15:07.164922    7633 main.go:130] libmachine: (minikube)     <boot dev='hd'/>
I0603 15:15:07.164928    7633 main.go:130] libmachine: (minikube)     <bootmenu enable='no'/>
I0603 15:15:07.164934    7633 main.go:130] libmachine: (minikube)   </os>
I0603 15:15:07.164939    7633 main.go:130] libmachine: (minikube)   <devices>
I0603 15:15:07.164946    7633 main.go:130] libmachine: (minikube)     <disk type='file' device='cdrom'>
I0603 15:15:07.164962    7633 main.go:130] libmachine: (minikube)       <source file='/home/as/.minikube/machines/minikube/boot2docker.iso'/>
I0603 15:15:07.164970    7633 main.go:130] libmachine: (minikube)       <target dev='hdc' bus='scsi'/>
I0603 15:15:07.164975    7633 main.go:130] libmachine: (minikube)       <readonly/>
I0603 15:15:07.164981    7633 main.go:130] libmachine: (minikube)     </disk>
I0603 15:15:07.164987    7633 main.go:130] libmachine: (minikube)     <disk type='file' device='disk'>
I0603 15:15:07.164994    7633 main.go:130] libmachine: (minikube)       <driver name='qemu' type='raw' cache='default' io='threads' />
I0603 15:15:07.165001    7633 main.go:130] libmachine: (minikube)       <source file='/home/as/.minikube/machines/minikube/minikube.rawdisk'/>
I0603 15:15:07.165008    7633 main.go:130] libmachine: (minikube)       <target dev='hda' bus='virtio'/>
I0603 15:15:07.165013    7633 main.go:130] libmachine: (minikube)     </disk>
I0603 15:15:07.165019    7633 main.go:130] libmachine: (minikube)     <interface type='network'>
I0603 15:15:07.165026    7633 main.go:130] libmachine: (minikube)       <source network='mk-minikube'/>
I0603 15:15:07.165033    7633 main.go:130] libmachine: (minikube)       <model type='virtio'/>
I0603 15:15:07.165050    7633 main.go:130] libmachine: (minikube)     </interface>
I0603 15:15:07.165057    7633 main.go:130] libmachine: (minikube)     <interface type='network'>
I0603 15:15:07.165063    7633 main.go:130] libmachine: (minikube)       <source network='default'/>
I0603 15:15:07.165069    7633 main.go:130] libmachine: (minikube)       <model type='virtio'/>
I0603 15:15:07.165075    7633 main.go:130] libmachine: (minikube)     </interface>
I0603 15:15:07.165081    7633 main.go:130] libmachine: (minikube)     <serial type='pty'>
I0603 15:15:07.165086    7633 main.go:130] libmachine: (minikube)       <target port='0'/>
I0603 15:15:07.165097    7633 main.go:130] libmachine: (minikube)     </serial>
I0603 15:15:07.165107    7633 main.go:130] libmachine: (minikube)     <console type='pty'>
I0603 15:15:07.165115    7633 main.go:130] libmachine: (minikube)       <target type='serial' port='0'/>
I0603 15:15:07.165120    7633 main.go:130] libmachine: (minikube)     </console>
I0603 15:15:07.165126    7633 main.go:130] libmachine: (minikube)     <rng model='virtio'>
I0603 15:15:07.165132    7633 main.go:130] libmachine: (minikube)       <backend model='random'>/dev/random</backend>
I0603 15:15:07.165138    7633 main.go:130] libmachine: (minikube)     </rng>
I0603 15:15:07.165143    7633 main.go:130] libmachine: (minikube)     
I0603 15:15:07.165151    7633 main.go:130] libmachine: (minikube)     
I0603 15:15:07.165157    7633 main.go:130] libmachine: (minikube)   </devices>
I0603 15:15:07.165163    7633 main.go:130] libmachine: (minikube) </domain>
I0603 15:15:07.165168    7633 main.go:130] libmachine: (minikube) 
I0603 15:15:07.291966    7633 main.go:130] libmachine: (minikube) DBG | domain minikube has defined MAC address 52:54:00:72:3b:f6 in network default
I0603 15:15:07.294082    7633 main.go:130] libmachine: (minikube) Ensuring networks are active...
I0603 15:15:07.294177    7633 main.go:130] libmachine: (minikube) DBG | domain minikube has defined MAC address 52:54:00:69:b2:35 in network mk-minikube
I0603 15:15:07.304704    7633 main.go:130] libmachine: (minikube) Ensuring network default is active
I0603 15:15:07.306336    7633 main.go:130] libmachine: (minikube) Ensuring network mk-minikube is active
I0603 15:15:07.308752    7633 main.go:130] libmachine: (minikube) Getting domain xml...
I0603 15:15:07.318944    7633 main.go:130] libmachine: (minikube) Creating domain...
I0603 15:15:07.373231    7633 main.go:130] libmachine: (minikube) DBG | unable to start VM: error creating VM: virError(Code=38, Domain=0, Message='Unable to set XATTR trusted.libvirt.security.dac on /var/lib/libvirt/qemu/domain-10-minikube/master-key.aes: Operation not permitted')
I0603 15:15:07.373662    7633 client.go:171] LocalClient.Create took 578.347961ms
I0603 15:15:09.374424    7633 start.go:129] duration metric: createHost completed in 2.738163918s
I0603 15:15:09.374558    7633 start.go:80] releasing machines lock for "minikube", held for 2.738654389s
W0603 15:15:09.375239    7633 out.go:241] * Failed to start kvm2 VM. Running "minikube delete" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: error creating VM: virError(Code=38, Domain=0, Message='Unable to set XATTR trusted.libvirt.security.dac on /var/lib/libvirt/qemu/domain-10-minikube/master-key.aes: Operation not permitted')
I0603 15:15:09.493075    7633 out.go:176] 
W0603 15:15:09.493497    7633 out.go:241] X Exiting due to GUEST_PROVISION: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: error creating VM: virError(Code=38, Domain=0, Message='Unable to set XATTR trusted.libvirt.security.dac on /var/lib/libvirt/qemu/domain-10-minikube/master-key.aes: Operation not permitted')
W0603 15:15:09.493584    7633 out.go:241] * 
W0603 15:15:09.497025    7633 out.go:241] ╭─────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                             │
│    * If the above advice does not help, please let us know:                                 │
│      https://github.com/kubernetes/minikube/issues/new/choose                               │
│                                                                                             │
│    * Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.    │
│                                                                                             │
╰─────────────────────────────────────────────────────────────────────────────────────────────╯

*

Operating System

Debian Bullseye (on ChromeOS)

Driver

kvm2
@afbjorklund
Copy link
Collaborator

Does it work with other VMs ? Maybe an issue for ChromeOS ?

@afbjorklund afbjorklund added co/kvm2-driver KVM2 driver related issues os/linux kind/support Categorizes issue or PR as a support question. labels Jun 4, 2022
@aschulth
Copy link
Author

aschulth commented Jun 7, 2022 •
edited
Loading

@afbjorklund sorry for the late reply. After some googling it seems to me that since the upgrade to Debian 11 on ChromeOS minikube doesn't start correctly. Here is some more context:

  • I removed the Linux development environment from my Chromebook.
  • After removing it I turned it on again so I am looking at a fresh Linux environment.
  • I upgraded the Linux environment (sudo apt update && sudo apt upgrade)
  • I resized the Linux partition to 40G:
Filesystem      Size  Used Avail Use% Mounted on
/dev/vdb         40G  2.1G   38G   6% /
  • I checked for virtualization support:
as@penguin:~$ egrep -q 'vmx|svm' /proc/cpuinfo && echo yes || echo no
yes

as@penguin:~$ virt-host-validate
  QEMU: Checking for hardware virtualization                                 : PASS
  QEMU: Checking if device /dev/kvm exists                                   : PASS
  QEMU: Checking if device /dev/kvm is accessible                            : PASS
  QEMU: Checking if device /dev/vhost-net exists                             : WARN (Load the 'vhost_net' module to improve performance of virtio networking)
  QEMU: Checking if device /dev/net/tun exists                               : PASS
  QEMU: Checking for cgroup 'cpu' controller support                         : PASS
  QEMU: Checking for cgroup 'cpuacct' controller support                     : PASS
  QEMU: Checking for cgroup 'cpuset' controller support                      : PASS
  QEMU: Checking for cgroup 'memory' controller support                      : PASS
  QEMU: Checking for cgroup 'devices' controller support                     : PASS
  QEMU: Checking for cgroup 'blkio' controller support                       : PASS
  QEMU: Checking for device assignment IOMMU support                         : WARN (No ACPI DMAR table found, IOMMU either disabled in BIOS or not supported by this hardware platform)
  QEMU: Checking for secure guest support                                    : WARN (Unknown if this platform has Secure Guest support)
   LXC: Checking for Linux >= 2.6.26                                         : PASS
   LXC: Checking for namespace ipc                                           : PASS
   LXC: Checking for namespace mnt                                           : PASS
   LXC: Checking for namespace pid                                           : PASS
   LXC: Checking for namespace uts                                           : PASS
   LXC: Checking for namespace net                                           : PASS
   LXC: Checking for namespace user                                          : PASS
   LXC: Checking for cgroup 'cpu' controller support                         : PASS
   LXC: Checking for cgroup 'cpuacct' controller support                     : PASS
   LXC: Checking for cgroup 'cpuset' controller support                      : PASS
   LXC: Checking for cgroup 'memory' controller support                      : PASS
   LXC: Checking for cgroup 'devices' controller support                     : PASS
   LXC: Checking for cgroup 'freezer' controller support                     : PASS
   LXC: Checking for cgroup 'blkio' controller support                       : PASS
   LXC: Checking if device /sys/fs/fuse/connections exists                   : PASS
  • I checked that my user is part of the kvm group:
as@penguin:~$ groups
as chronos-access android-everybody dialout cdrom floppy sudo audio video plugdev users kvm
  • I installed minikube as per documentation:
as@penguin:~$ command -v minikube
/usr/local/bin/minikube
  • Issuing minkube start yields the following error:
❌  Exiting due to GUEST_PROVISION: Failed to start host: driver start: ensuring active networks: starting network default: virError(Code=38, Domain=19, Message='Cannot check dnsmasq binary /usr/sbin/dnsmasq: No such file or directory')

  • Installing dnsmasq.

  • Issuing minikube start now yields the original error:

❌  Exiting due to GUEST_PROVISION: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: error creating VM: virError(Code=38, Domain=0, Message='Unable to set XATTR trusted.libvirt.security.dac on /var/lib/libvirt/qemu/domain-2-minikube/master-key.aes: Operation not permitted')

@aschulth
Copy link
Author

I solved the installation issue. The solution is a variation of what is recommended elsewhere. For future reference, here is what I did:

  1. Install minikube and kvm as per installation instructions.
  2. Change qemu.conf to include the following lines:
user = "root"
group = "root"
dynamic_ownership = 0
remember_owner = 0
  1. Restart the chromebook

@klaases
Copy link
Contributor

klaases commented Jul 27, 2022

Hi @aschulth, thanks for the update and glad that you found a resolution for Debian 11 on Chrome OS. We will keep this issue available so that others may find it helpful as well.

Closing out for now to help clear up the queue.

@klaases klaases closed this as completed Jul 27, 2022
@afbjorklund afbjorklund mentioned this issue Jan 23, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
co/kvm2-driver KVM2 driver related issues kind/support Categorizes issue or PR as a support question. os/linux
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@afbjorklund @aschulth @klaases