Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fedora 32, kvm: COMMAND_FAILED: 'python-nftables' failed #8772

Open
slinkydeveloper opened this issue Jul 20, 2020 · 12 comments
Open

Fedora 32, kvm: COMMAND_FAILED: 'python-nftables' failed #8772

slinkydeveloper opened this issue Jul 20, 2020 · 12 comments
Labels
co/kvm2-driver KVM2 driver related issues kind/support Categorizes issue or PR as a support question. lifecycle/frozen Indicates that an issue or PR should not be auto-closed due to staleness. long-term-support Long-term support issues that can't be fixed in code needs-solution-message Issues where where offering a solution for an error would be helpful

Comments

@slinkydeveloper
Copy link

slinkydeveloper commented Jul 20, 2020 •
edited
Loading

Steps to reproduce the issue:

  1. Just run minikube start --vm-driver=kvm2 without any previous minikube data (no ~/.minikube dir)

Fedora 32, kernel 5.7.8-200.fc32.x86_64

Full output of failed command:

W0720 10:52:12.825632   17987 root.go:246] Error reading config file at /home/slinkydeveloper/.minikube/config/config.json: open /home/slinkydeveloper/.minikube/config/config.json: no such file or directory
I0720 10:52:12.826004   17987 out.go:170] Setting JSON to false
I0720 10:52:12.840057   17987 start.go:101] hostinfo: {"hostname":"localhost.localdomain","uptime":9167,"bootTime":1595225965,"procs":372,"os":"linux","platform":"fedora","platformFamily":"fedora","platformVersion":"32","kernelVersion":"5.7.8-200.fc32.x86_64","virtualizationSystem":"kvm","virtualizationRole":"host","hostid":"339db0ca-59f8-4ccd-9174-6bc13fec0ada"}
I0720 10:52:12.841860   17987 start.go:111] virtualization: kvm host
😄  minikube v1.12.1 on Fedora 32
I0720 10:52:12.842113   17987 notify.go:125] Checking for updates...
I0720 10:52:12.842149   17987 driver.go:257] Setting default libvirt URI to qemu:///system
✨  Using the kvm2 driver based on user configuration
I0720 10:52:12.908049   17987 start.go:217] selected driver: kvm2
I0720 10:52:12.908058   17987 start.go:621] validating driver "kvm2" against <nil>
I0720 10:52:12.908078   17987 start.go:632] status for kvm2: {Installed:true Healthy:true NeedsImprovement:false Error:<nil> Fix: Doc:}
I0720 10:52:12.908122   17987 install.go:49] acquiring lock: {Name:mk900956b073697a4aa6c80a27c6bb0742a99a53 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I0720 10:52:12.908423   17987 install.go:115] Validating docker-machine-driver-kvm2, PATH=hidden
W0720 10:52:12.908493   17987 install.go:59] docker-machine-driver-kvm2: exec: "docker-machine-driver-kvm2": executable file not found in $PATH
💾  Downloading driver docker-machine-driver-kvm2:
I0720 10:52:12.908608   17987 download.go:78] Downloading: https://github.com/kubernetes/minikube/releases/download/v1.12.1/docker-machine-driver-kvm2?checksum=file:https://github.com/kubernetes/minikube/releases/download/v1.12.1/docker-machine-driver-kvm2.sha256 -> /home/slinkydeveloper/.minikube/bin/docker-machine-driver-kvm2
    > docker-machine-driver-kvm2.sha256: 65 B / 65 B [-------] 100.00% ? p/s 0s
    > docker-machine-driver-kvm2: 13.80 MiB / 13.80 MiB  100.00% 2.47 MiB p/s 6
I0720 10:52:22.691658   17987 start_flags.go:223] no existing cluster config was found, will generate one from the flags 
I0720 10:52:22.691735   17987 start_flags.go:237] Using suggested 6000MB memory alloc based on sys=31859MB, container=0MB
I0720 10:52:22.691806   17987 start_flags.go:594] Wait components to verify : map[apiserver:true system_pods:true]
I0720 10:52:22.691823   17987 cni.go:74] Creating CNI manager for ""
I0720 10:52:22.691829   17987 cni.go:117] CNI unnecessary in this configuration, recommending no CNI
I0720 10:52:22.691832   17987 start_flags.go:340] config:
{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.18.3 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true]}
I0720 10:52:22.691890   17987 iso.go:118] acquiring lock: {Name:mkdfc12b30a3c2ab8d56de425744103e88d4fc7b Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
💿  Downloading VM boot image ...
I0720 10:52:22.692007   17987 download.go:78] Downloading: https://storage.googleapis.com/minikube/iso/minikube-v1.12.0.iso?checksum=file:https://storage.googleapis.com/minikube/iso/minikube-v1.12.0.iso.sha256 -> /home/slinkydeveloper/.minikube/cache/iso/minikube-v1.12.0.iso
    > minikube-v1.12.0.iso.sha256: 65 B / 65 B [-------------] 100.00% ? p/s 0s
    > minikube-v1.12.0.iso: 173.57 MiB / 173.57 MiB  100.00% 2.41 MiB p/s 1m12s
👍  Starting control plane node minikube in cluster minikube
I0720 10:53:37.179236   17987 preload.go:95] Checking if preload exists for k8s version v1.18.3 and runtime docker
I0720 10:53:37.386107   17987 preload.go:120] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v4-v1.18.3-docker-overlay2-amd64.tar.lz4
I0720 10:53:37.386201   17987 cache.go:51] Caching tarball of preloaded images
I0720 10:53:37.386282   17987 preload.go:95] Checking if preload exists for k8s version v1.18.3 and runtime docker
I0720 10:53:37.590949   17987 preload.go:120] Found remote preload: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v4-v1.18.3-docker-overlay2-amd64.tar.lz4
💾  Downloading Kubernetes v1.18.3 preload ...
I0720 10:53:37.591432   17987 download.go:78] Downloading: https://storage.googleapis.com/minikube-preloaded-volume-tarballs/preloaded-images-k8s-v4-v1.18.3-docker-overlay2-amd64.tar.lz4 -> /home/slinkydeveloper/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v4-v1.18.3-docker-overlay2-amd64.tar.lz4
    > preloaded-images-k8s-v4-v1.18.3-docker-overlay2-amd64.tar.lz4: 526.27 MiB
I0720 10:57:24.132920   17987 preload.go:158] saving checksum for preloaded-images-k8s-v4-v1.18.3-docker-overlay2-amd64.tar.lz4 ...
I0720 10:57:24.389432   17987 preload.go:175] verifying checksumm of /home/slinkydeveloper/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v4-v1.18.3-docker-overlay2-amd64.tar.lz4 ...
I0720 10:57:25.326813   17987 cache.go:54] Finished verifying existence of preloaded tar for  v1.18.3 on docker
I0720 10:57:25.327021   17987 profile.go:150] Saving config to /home/slinkydeveloper/.minikube/profiles/minikube/config.json ...
I0720 10:57:25.327104   17987 lock.go:35] WriteFile acquiring /home/slinkydeveloper/.minikube/profiles/minikube/config.json: {Name:mk6ffb5a797a5b01f7aac5573c4b8c8535ec5150 Clock:{} Delay:500ms Timeout:1m0s Cancel:<nil>}
I0720 10:57:25.327234   17987 cache.go:178] Successfully downloaded all kic artifacts
I0720 10:57:25.327249   17987 start.go:241] acquiring machines lock for minikube: {Name:mk0a9c7eb352eb1c53d02d9deee8d33f25d3bf80 Clock:{} Delay:500ms Timeout:15m0s Cancel:<nil>}
I0720 10:57:25.327303   17987 start.go:245] acquired machines lock for "minikube" in 46.6µs
I0720 10:57:25.327318   17987 start.go:85] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.12.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.18.3 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.3 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true]} &{Name: IP: Port:8443 KubernetesVersion:v1.18.3 ControlPlane:true Worker:true}
I0720 10:57:25.327347   17987 start.go:122] createHost starting for "" (driver="kvm2")
🔥  Creating kvm2 VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
I0720 10:57:25.327459   17987 main.go:115] libmachine: Found binary path at /home/slinkydeveloper/.minikube/bin/docker-machine-driver-kvm2
I0720 10:57:25.327486   17987 main.go:115] libmachine: Launching plugin server for driver kvm2
I0720 10:57:25.340282   17987 main.go:115] libmachine: Plugin server listening at address 127.0.0.1:35741
I0720 10:57:25.340606   17987 main.go:115] libmachine: () Calling .GetVersion
I0720 10:57:25.340957   17987 main.go:115] libmachine: Using API Version  1
I0720 10:57:25.340969   17987 main.go:115] libmachine: () Calling .SetConfigRaw
I0720 10:57:25.341200   17987 main.go:115] libmachine: () Calling .GetMachineName
I0720 10:57:25.341276   17987 main.go:115] libmachine: (minikube) Calling .GetMachineName
I0720 10:57:25.341344   17987 main.go:115] libmachine: (minikube) Calling .DriverName
I0720 10:57:25.341400   17987 start.go:158] libmachine.API.Create for "minikube" (driver="kvm2")
I0720 10:57:25.341421   17987 client.go:161] LocalClient.Create starting
I0720 10:57:25.341449   17987 main.go:115] libmachine: Creating CA: /home/slinkydeveloper/.minikube/certs/ca.pem
I0720 10:57:25.450091   17987 main.go:115] libmachine: Creating client certificate: /home/slinkydeveloper/.minikube/certs/cert.pem
I0720 10:57:25.523154   17987 main.go:115] libmachine: Running pre-create checks...
I0720 10:57:25.523168   17987 main.go:115] libmachine: (minikube) Calling .PreCreateCheck
I0720 10:57:25.523416   17987 main.go:115] libmachine: (minikube) Calling .GetConfigRaw
I0720 10:57:25.523655   17987 main.go:115] libmachine: Creating machine...
I0720 10:57:25.523663   17987 main.go:115] libmachine: (minikube) Calling .Create
I0720 10:57:25.523752   17987 main.go:115] libmachine: (minikube) Creating KVM machine...
I0720 10:57:25.639286   17987 main.go:115] libmachine: (minikube) Setting up store path in /home/slinkydeveloper/.minikube/machines/minikube ...
I0720 10:57:25.639345   17987 main.go:115] libmachine: (minikube) Building disk image from file:///home/slinkydeveloper/.minikube/cache/iso/minikube-v1.12.0.iso
I0720 10:57:25.639476   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:25.639341   18194 common.go:99] Making disk image using store path: /home/slinkydeveloper/.minikube
I0720 10:57:25.639532   17987 main.go:115] libmachine: (minikube) Downloading /home/slinkydeveloper/.minikube/cache/boot2docker.iso from file:///home/slinkydeveloper/.minikube/cache/iso/minikube-v1.12.0.iso...
I0720 10:57:25.889917   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:25.889824   18194 common.go:106] Creating ssh key: /home/slinkydeveloper/.minikube/machines/minikube/id_rsa...
I0720 10:57:26.168088   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:26.168006   18194 common.go:112] Creating raw disk image: /home/slinkydeveloper/.minikube/machines/minikube/minikube.rawdisk...
I0720 10:57:26.168111   17987 main.go:115] libmachine: (minikube) DBG | Writing magic tar header
I0720 10:57:26.168120   17987 main.go:115] libmachine: (minikube) DBG | Writing SSH key tar header
I0720 10:57:26.168133   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:26.168082   18194 common.go:126] Fixing permissions on /home/slinkydeveloper/.minikube/machines/minikube ...
I0720 10:57:26.168144   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper/.minikube/machines/minikube
I0720 10:57:26.168156   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper/.minikube/machines/minikube (perms=drwx------)
I0720 10:57:26.168167   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper/.minikube/machines (perms=drwxr-xr-x)
I0720 10:57:26.168173   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper/.minikube (perms=drwxr-xr-x)
I0720 10:57:26.168179   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper/.minikube/machines
I0720 10:57:26.168187   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper (perms=drwx--x--x)
I0720 10:57:26.168202   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper/.minikube
I0720 10:57:26.168209   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper
I0720 10:57:26.168216   17987 main.go:115] libmachine: (minikube) Creating domain...
I0720 10:57:26.168224   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home
I0720 10:57:26.168230   17987 main.go:115] libmachine: (minikube) DBG | Skipping /home - not owner
I0720 10:57:26.217587   17987 main.go:115] libmachine: (minikube) Creating network...
I0720 10:57:26.226986   17987 main.go:115] libmachine: (minikube) Ensuring networks are active...
I0720 10:57:26.236445   17987 main.go:115] libmachine: (minikube) Ensuring network default is active
I0720 10:57:26.332491   17987 main.go:115] libmachine: (minikube) KVM machine creation complete!
I0720 10:57:26.332775   17987 client.go:164] LocalClient.Create took 991.338739ms
I0720 10:57:28.333108   17987 start.go:125] duration metric: createHost completed in 3.005737661s
I0720 10:57:28.333249   17987 start.go:76] releasing machines lock for "minikube", held for 3.005927833s
I0720 10:57:28.334797   17987 main.go:115] libmachine: Found binary path at /home/slinkydeveloper/.minikube/bin/docker-machine-driver-kvm2
I0720 10:57:28.334943   17987 main.go:115] libmachine: Launching plugin server for driver kvm2
I0720 10:57:28.380812   17987 main.go:115] libmachine: Plugin server listening at address 127.0.0.1:39517
I0720 10:57:28.381289   17987 main.go:115] libmachine: () Calling .GetVersion
I0720 10:57:28.381695   17987 main.go:115] libmachine: Using API Version  1
I0720 10:57:28.381713   17987 main.go:115] libmachine: () Calling .SetConfigRaw
I0720 10:57:28.381960   17987 main.go:115] libmachine: () Calling .GetMachineName
I0720 10:57:28.382391   17987 main.go:115] libmachine: Found binary path at /home/slinkydeveloper/.minikube/bin/docker-machine-driver-kvm2
I0720 10:57:28.382429   17987 main.go:115] libmachine: Launching plugin server for driver kvm2
I0720 10:57:28.398746   17987 main.go:115] libmachine: Plugin server listening at address 127.0.0.1:42847
I0720 10:57:28.399081   17987 main.go:115] libmachine: () Calling .GetVersion
I0720 10:57:28.399400   17987 main.go:115] libmachine: Using API Version  1
I0720 10:57:28.399410   17987 main.go:115] libmachine: () Calling .SetConfigRaw
I0720 10:57:28.399654   17987 main.go:115] libmachine: () Calling .GetMachineName
I0720 10:57:28.399751   17987 main.go:115] libmachine: (minikube) Calling .GetState
I0720 10:57:28.407312   17987 main.go:115] libmachine: (minikube) Calling .DriverName
🔥  Deleting "minikube" in kvm2 ...
I0720 10:57:28.407483   17987 main.go:115] libmachine: (minikube) Calling .Remove
I0720 10:57:28.407568   17987 main.go:115] libmachine: (minikube) DBG | Removing machine...
I0720 10:57:28.413400   17987 main.go:115] libmachine: (minikube) DBG | Trying to delete the networks (if possible)
I0720 10:57:28.423105   17987 main.go:115] libmachine: (minikube) DBG | Checking if network minikube-net exists...
I0720 10:57:28.423225   17987 main.go:115] libmachine: (minikube) DBG | Network minikube-net exists
I0720 10:57:28.423243   17987 main.go:115] libmachine: (minikube) DBG | Trying to list all domains...
I0720 10:57:28.423252   17987 main.go:115] libmachine: (minikube) DBG | Listed all domains: total of 1 domains
I0720 10:57:28.423267   17987 main.go:115] libmachine: (minikube) DBG | Trying to get name of domain...
I0720 10:57:28.423275   17987 main.go:115] libmachine: (minikube) DBG | Got domain name: minikube
I0720 10:57:28.423280   17987 main.go:115] libmachine: (minikube) DBG | Skipping domain as it is us...
I0720 10:57:28.423291   17987 main.go:115] libmachine: (minikube) DBG | Trying to destroy network minikube-net...
I0720 10:57:28.423424   17987 main.go:115] libmachine: (minikube) Deleting of networks failed: network destroy: virError(Code=55, Domain=19, Message='Requested operation is not valid: network 'minikube-net' is not active')
I0720 10:57:28.423438   17987 main.go:115] libmachine: (minikube) DBG | Checking if the domain needs to be deleted
I0720 10:57:28.423486   17987 main.go:115] libmachine: (minikube) Domain minikube exists, removing...
I0720 10:57:28.423565   17987 main.go:115] libmachine: (minikube) Domain minikube already destroyed, skipping...
🤦  StartHost failed, but will try again: creating host: create: Error creating machine: Error in driver during machine creation: ensuring active networks: starting network default: virError(Code=89, Domain=47, Message='error from service: changeZoneOfInterface: COMMAND_FAILED: 'python-nftables' failed: 
JSON blob:
{"nftables": [{"metainfo": {"json_schema_version": 1}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 67}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 547}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "tcp", "field": "dport"}}, "op": "==", "right": 53}}, {"match": {"left": {"ct": {"key": "state"}}')
I0720 10:57:33.441506   17987 start.go:241] acquiring machines lock for minikube: {Name:mk0a9c7eb352eb1c53d02d9deee8d33f25d3bf80 Clock:{} Delay:500ms Timeout:15m0s Cancel:<nil>}
I0720 10:57:33.442173   17987 start.go:245] acquired machines lock for "minikube" in 581.636µs
I0720 10:57:33.442273   17987 start.go:85] Provisioning new machine with config: &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.12.0.iso KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.10@sha256:f58e0c4662bac8a9b5dda7984b185bad8502ade5d9fa364bf2755d636ab51438 Memory:6000 CPUs:2 DiskSize:20000 VMDriver: Driver:kvm2 HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio KubernetesConfig:{KubernetesVersion:v1.18.3 ClusterName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.18.3 ControlPlane:true Worker:true}] Addons:map[] VerifyComponents:map[apiserver:true system_pods:true]} &{Name: IP: Port:8443 KubernetesVersion:v1.18.3 ControlPlane:true Worker:true}
I0720 10:57:33.442445   17987 start.go:122] createHost starting for "" (driver="kvm2")
🔥  Creating kvm2 VM (CPUs=2, Memory=6000MB, Disk=20000MB) ...
I0720 10:57:33.443027   17987 main.go:115] libmachine: Found binary path at /home/slinkydeveloper/.minikube/bin/docker-machine-driver-kvm2
I0720 10:57:33.443122   17987 main.go:115] libmachine: Launching plugin server for driver kvm2
I0720 10:57:33.483391   17987 main.go:115] libmachine: Plugin server listening at address 127.0.0.1:45711
I0720 10:57:33.483833   17987 main.go:115] libmachine: () Calling .GetVersion
I0720 10:57:33.484275   17987 main.go:115] libmachine: Using API Version  1
I0720 10:57:33.484297   17987 main.go:115] libmachine: () Calling .SetConfigRaw
I0720 10:57:33.484581   17987 main.go:115] libmachine: () Calling .GetMachineName
I0720 10:57:33.484742   17987 main.go:115] libmachine: (minikube) Calling .GetMachineName
I0720 10:57:33.484849   17987 main.go:115] libmachine: (minikube) Calling .DriverName
I0720 10:57:33.484975   17987 start.go:158] libmachine.API.Create for "minikube" (driver="kvm2")
I0720 10:57:33.485007   17987 client.go:161] LocalClient.Create starting
I0720 10:57:33.485036   17987 main.go:115] libmachine: Reading certificate data from /home/slinkydeveloper/.minikube/certs/ca.pem
I0720 10:57:33.485076   17987 main.go:115] libmachine: Decoding PEM data...
I0720 10:57:33.485096   17987 main.go:115] libmachine: Parsing certificate...
I0720 10:57:33.485237   17987 main.go:115] libmachine: Reading certificate data from /home/slinkydeveloper/.minikube/certs/cert.pem
I0720 10:57:33.485264   17987 main.go:115] libmachine: Decoding PEM data...
I0720 10:57:33.485281   17987 main.go:115] libmachine: Parsing certificate...
I0720 10:57:33.485338   17987 main.go:115] libmachine: Running pre-create checks...
I0720 10:57:33.485348   17987 main.go:115] libmachine: (minikube) Calling .PreCreateCheck
I0720 10:57:33.485485   17987 main.go:115] libmachine: (minikube) Calling .GetConfigRaw
I0720 10:57:33.485833   17987 main.go:115] libmachine: Creating machine...
I0720 10:57:33.485848   17987 main.go:115] libmachine: (minikube) Calling .Create
I0720 10:57:33.485957   17987 main.go:115] libmachine: (minikube) Creating KVM machine...
I0720 10:57:33.497519   17987 main.go:115] libmachine: (minikube) Setting up store path in /home/slinkydeveloper/.minikube/machines/minikube ...
I0720 10:57:33.497539   17987 main.go:115] libmachine: (minikube) Building disk image from file:///home/slinkydeveloper/.minikube/cache/iso/minikube-v1.12.0.iso
I0720 10:57:33.497660   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:33.497497   18305 common.go:99] Making disk image using store path: /home/slinkydeveloper/.minikube
I0720 10:57:33.497691   17987 main.go:115] libmachine: (minikube) Downloading /home/slinkydeveloper/.minikube/cache/boot2docker.iso from file:///home/slinkydeveloper/.minikube/cache/iso/minikube-v1.12.0.iso...
I0720 10:57:33.589988   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:33.589901   18305 common.go:106] Creating ssh key: /home/slinkydeveloper/.minikube/machines/minikube/id_rsa...
I0720 10:57:33.686855   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:33.686778   18305 common.go:112] Creating raw disk image: /home/slinkydeveloper/.minikube/machines/minikube/minikube.rawdisk...
I0720 10:57:33.686870   17987 main.go:115] libmachine: (minikube) DBG | Writing magic tar header
I0720 10:57:33.686889   17987 main.go:115] libmachine: (minikube) DBG | Writing SSH key tar header
I0720 10:57:33.686906   17987 main.go:115] libmachine: (minikube) DBG | ERROR: logging before flag.Parse: I0720 10:57:33.686856   18305 common.go:126] Fixing permissions on /home/slinkydeveloper/.minikube/machines/minikube ...
I0720 10:57:33.686921   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper/.minikube/machines/minikube
I0720 10:57:33.686930   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper/.minikube/machines
I0720 10:57:33.686941   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper/.minikube
I0720 10:57:33.686956   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home/slinkydeveloper
I0720 10:57:33.686967   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper/.minikube/machines/minikube (perms=drwx------)
I0720 10:57:33.686973   17987 main.go:115] libmachine: (minikube) DBG | Checking permissions on dir: /home
I0720 10:57:33.686978   17987 main.go:115] libmachine: (minikube) DBG | Skipping /home - not owner
I0720 10:57:33.686986   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper/.minikube/machines (perms=drwxr-xr-x)
I0720 10:57:33.686995   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper/.minikube (perms=drwxr-xr-x)
I0720 10:57:33.687001   17987 main.go:115] libmachine: (minikube) Setting executable bit set on /home/slinkydeveloper (perms=drwx--x--x)
I0720 10:57:33.687005   17987 main.go:115] libmachine: (minikube) Creating domain...
I0720 10:57:33.775916   17987 main.go:115] libmachine: (minikube) Creating network...
I0720 10:57:33.807476   17987 main.go:115] libmachine: (minikube) Ensuring networks are active...
I0720 10:57:33.835439   17987 main.go:115] libmachine: (minikube) Ensuring network default is active
I0720 10:57:33.924588   17987 main.go:115] libmachine: (minikube) KVM machine creation complete!
I0720 10:57:33.924644   17987 client.go:164] LocalClient.Create took 439.626277ms
I0720 10:57:35.925004   17987 start.go:125] duration metric: createHost completed in 2.482500085s
I0720 10:57:35.925097   17987 start.go:76] releasing machines lock for "minikube", held for 2.482876102s
😿  Failed to start kvm2 VM. "minikube start" may fix it: creating host: create: Error creating machine: Error in driver during machine creation: ensuring active networks: starting network default: virError(Code=89, Domain=47, Message='error from service: changeZoneOfInterface: COMMAND_FAILED: 'python-nftables' failed: 
JSON blob:
{"nftables": [{"metainfo": {"json_schema_version": 1}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 67}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 547}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "tcp", "field": "dport"}}, "op": "==", "right": 53}}, {"match": {"left": {"ct": {"key": "state"}}')
I0720 10:57:35.925687   17987 exit.go:58] WithError(error provisioning host)=Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: ensuring active networks: starting network default: virError(Code=89, Domain=47, Message='error from service: changeZoneOfInterface: COMMAND_FAILED: 'python-nftables' failed: 
JSON blob:
{"nftables": [{"metainfo": {"json_schema_version": 1}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 67}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 547}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "tcp", "field": "dport"}}, "op": "==", "right": 53}}, {"match": {"left": {"ct": {"key": "state"}}') called from:
goroutine 1 [running]:
runtime/debug.Stack(0x1eb8320, 0xc000713800, 0x1eb6e80)
	/usr/local/go/src/runtime/debug/stack.go:24 +0x9d
k8s.io/minikube/pkg/minikube/exit.WithError(0x1ba8136, 0x17, 0x1eb8320, 0xc000713800)
	/app/pkg/minikube/exit/exit.go:58 +0x34
k8s.io/minikube/cmd/minikube/cmd.runStart(0x2cb86a0, 0xc0001112e0, 0x0, 0x2)
	/app/cmd/minikube/cmd/start.go:171 +0xbe7
github.com/spf13/cobra.(*Command).execute(0x2cb86a0, 0xc0001112c0, 0x2, 0x2, 0x2cb86a0, 0xc0001112c0)
	/go/pkg/mod/github.com/spf13/cobra@v1.0.0/command.go:846 +0x29d
github.com/spf13/cobra.(*Command).ExecuteC(0x2cb76e0, 0x0, 0x1, 0xc0003e5080)
	/go/pkg/mod/github.com/spf13/cobra@v1.0.0/command.go:950 +0x349
github.com/spf13/cobra.(*Command).Execute(...)
	/go/pkg/mod/github.com/spf13/cobra@v1.0.0/command.go:887
k8s.io/minikube/cmd/minikube/cmd.Execute()
	/app/cmd/minikube/cmd/root.go:106 +0x72c
main.main()
	/app/cmd/minikube/main.go:71 +0x11f
W0720 10:57:35.927403   17987 out.go:232] error provisioning host: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: ensuring active networks: starting network default: virError(Code=89, Domain=47, Message='error from service: changeZoneOfInterface: COMMAND_FAILED: 'python-nftables' failed: 
JSON blob:
{"nftables": [{"metainfo": {"json_schema_version": 1}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 67}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 547}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "tcp", "field": "dport"}}, "op": "==", "right": 53}}, {"match": {"left": {"ct": {"key": "state"}}')

💣  error provisioning host: Failed to start host: creating host: create: Error creating machine: Error in driver during machine creation: ensuring active networks: starting network default: virError(Code=89, Domain=47, Message='error from service: changeZoneOfInterface: COMMAND_FAILED: 'python-nftables' failed: 
JSON blob:
{"nftables": [{"metainfo": {"json_schema_version": 1}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 67}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "udp", "field": "dport"}}, "op": "==", "right": 547}}, {"match": {"left": {"ct": {"key": "state"}}, "op": "in", "right": {"set": ["new", "untracked"]}}}, {"accept": null}]}}}, {"add": {"rule": {"family": "inet", "table": "firewalld", "chain": "filter_IN_libvirt_allow", "expr": [{"match": {"left": {"payload": {"protocol": "tcp", "field": "dport"}}, "op": "==", "right": 53}}, {"match": {"left": {"ct": {"key": "state"}}')

😿  minikube is exiting due to an error. If the above message is not useful, open an issue:
👉  https://github.com/kubernetes/minikube/issues/new/choose
@medyagh
Copy link
Member

medyagh commented Jul 29, 2020 •
edited
Loading

Thank you for sharing your experience! If you don't mind, could you please provide:

@slinkydeveloper do you happen to be using VPN or a firewall that limits your network connectivit ?
and what version of qemu or libvirt are you using ? (sometimes upgrading the kvm libs fixes kvm issues)

and additionally I am curious is there a reason you are not using the docker driver which is our most preferred driver?

/triage needs-information
/triage support

@k8s-ci-robot k8s-ci-robot added triage/needs-information Indicates an issue needs more information in order to work on it. kind/support Categorizes issue or PR as a support question. labels Jul 29, 2020
@medyagh medyagh added the co/kvm2-driver KVM2 driver related issues label Jul 29, 2020
@slinkydeveloper
Copy link
Author

do you happen to be using VPN or a firewall that limits your network connectivit ?

Nope, I just have the default network configuration of fedora 32 and no vpn running

Name : libvirt
Version : 6.1.0
Rilascio : 4.fc32
Architecture : x86_64
Size : 0.0
Sorgente : libvirt-6.1.0-4.fc32.src.rpm

Name : qemu
Epoca : 2
Version : 4.2.1
Rilascio : 1.fc32
Architecture : x86_64
Size : 12 k
Sorgente : qemu-4.2.1-1.fc32.src.rpm

@medyagh
Copy link
Member

medyagh commented Aug 26, 2020 •
edited
Loading

@slinkydeveloper does switching to docker driver help you solve this problem ?

you could try with latest verison of miniikube
minikube delete
minikube start --driver=docker

for more information on the docker driver checkout:
https://minikube.sigs.k8s.io/docs/drivers/docker/

/triage needs-information
/triage support

@medyagh medyagh closed this as completed Aug 26, 2020
@medyagh medyagh reopened this Aug 26, 2020
@slinkydeveloper
Copy link
Author

I'm trying to install it, but for some reason i get Can not load RPM file: ./minikube-latest.x86-64.rpm. when using dnf...

@medyagh
Copy link
Member

medyagh commented Sep 16, 2020 •
edited
Loading

@slinkydeveloper do you still have this issue ? btw I recommend using our docker driver on linux

@szarnyasg
Copy link

Just an observer here -- I've subscribed to this issue because I had following error on Fedora 32 due to a clash between moby and libvirt:

COMMAND_FAILED: 'python-nftables' failed: 
JSON blob:
{"nftables": [{"metainfo": {"json_schema_version": 1}}, ...

Since subscribing to this issue, I've resolved it as suggested on the Red Hat Bugzilla and, i.e. by removing the incorrect /etc/firewalld/zones/trusted.xml file:

sudo mv /etc/firewalld/zones/trusted.xml /etc/firewalld/zones/trusted.xml.bkp
sudo systemctl restart firewalld
sudo systemctl restart libvirtd

@sharifelgamal sharifelgamal added area/gpu GPU related items kind/bug Categorizes issue or PR as related to a bug. triage/needs-information Indicates an issue needs more information in order to work on it. kind/support Categorizes issue or PR as a support question. and removed triage/needs-information Indicates an issue needs more information in order to work on it. kind/support Categorizes issue or PR as a support question. area/gpu GPU related items kind/bug Categorizes issue or PR as related to a bug. labels Sep 30, 2020
@slinkydeveloper
Copy link
Author

Thanks @szarnyasg, it's the same issue as described here crc-org/crc#1444

@tstromberg tstromberg added needs-solution-message Issues where where offering a solution for an error would be helpful and removed triage/needs-information Indicates an issue needs more information in order to work on it. labels Oct 21, 2020
@tstromberg
Copy link
Contributor

@szarnyasg - thanks for the workaround!

@tstromberg tstromberg mentioned this issue Oct 21, 2020
Closed
@tstromberg
Copy link
Contributor

There is probably nothing we can do about this - so I'm going to leave this.

@tstromberg tstromberg added the long-term-support Long-term support issues that can't be fixed in code label Dec 9, 2020
@tstromberg tstromberg changed the title virError(Code=89, Domain=47, Message='error from service: changeZoneOfInterface: COMMAND_FAILED: 'python-nftables' failed Fedora 32, kvm: COMMAND_FAILED: 'python-nftables' failed Dec 9, 2020
@fejta-bot
Copy link

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-contributor-experience at kubernetes/community.
/lifecycle stale

@k8s-ci-robot k8s-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Mar 9, 2021
@praveenkumar praveenkumar mentioned this issue Apr 7, 2021
Closed
@fejta-bot
Copy link

Stale issues rot after 30d of inactivity.
Mark the issue as fresh with /remove-lifecycle rotten.
Rotten issues close after an additional 30d of inactivity.

If this issue is safe to close now please do so with /close.

Send feedback to sig-contributor-experience at kubernetes/community.
/lifecycle rotten

@k8s-ci-robot k8s-ci-robot added lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. and removed lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. labels Apr 8, 2021
@spowelljr spowelljr added the lifecycle/frozen Indicates that an issue or PR should not be auto-closed due to staleness. label Apr 28, 2021
@medyagh medyagh removed the lifecycle/rotten Denotes an issue or PR that has aged beyond stale and will be auto-closed. label May 19, 2021
@medyagh
Copy link
Member

medyagh commented May 19, 2021

anyone like to add this as a work arround to either minikube Solution messages or our website I would accept a PR
btw @slinkydeveloper seems like our website for RPM URL was missing -

could u try with https://storage.googleapis.com/minikube/releases/latest/minikube-latest.x86_64.rpm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
co/kvm2-driver KVM2 driver related issues kind/support Categorizes issue or PR as a support question. lifecycle/frozen Indicates that an issue or PR should not be auto-closed due to staleness. long-term-support Long-term support issues that can't be fixed in code needs-solution-message Issues where where offering a solution for an error would be helpful
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
8 participants
@tstromberg @szarnyasg @medyagh @slinkydeveloper @k8s-ci-robot @sharifelgamal @fejta-bot @spowelljr