Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Minikube with Podman on Mac: "no such container "minikube" #13261

Closed
tbrodbeck opened this issue Dec 29, 2021 · 21 comments
Closed

Minikube with Podman on Mac: "no such container "minikube" #13261

tbrodbeck opened this issue Dec 29, 2021 · 21 comments
Labels
co/podman-driver podman driver issues kind/bug Categorizes issue or PR as related to a bug. os/macos triage/duplicate Indicates an issue is a duplicate of other open issue.

Comments

@tbrodbeck
Copy link

tbrodbeck commented Dec 29, 2021 •
edited
Loading

What Happened?

I cannot start minikube sucessfully with Podman:

➜  ~ minikube start --driver=podman --container-runtime=cri-o --alsologtostderr
I1229 15:22:04.591580   56508 out.go:297] Setting OutFile to fd 1 ...
I1229 15:22:04.591810   56508 out.go:349] isatty.IsTerminal(1) = true
I1229 15:22:04.591819   56508 out.go:310] Setting ErrFile to fd 2...
I1229 15:22:04.591827   56508 out.go:349] isatty.IsTerminal(2) = true
I1229 15:22:04.591948   56508 root.go:313] Updating PATH: /Users/t/.minikube/bin
I1229 15:22:04.592394   56508 out.go:304] Setting JSON to false
I1229 15:22:04.670973   56508 start.go:112] hostinfo: {"hostname":"apertoBook.fritz.box","uptime":81818,"bootTime":1640705906,"procs":644,"os":"darwin","platform":"darwin","platformFamily":"Standalone Workstation","platformVersion":"12.0.1","kernelVersion":"21.1.0","kernelArch":"x86_64","virtualizationSystem":"","virtualizationRole":"","hostId":"c3ce0e6a-6fdd-5908-8290-c9ee97a32826"}
W1229 15:22:04.671175   56508 start.go:120] gopshost.Virtualization returned error: not implemented yet
I1229 15:22:04.690778   56508 out.go:176] 😄  minikube v1.24.0 on Darwin 12.0.1
😄  minikube v1.24.0 on Darwin 12.0.1
I1229 15:22:04.690966   56508 notify.go:174] Checking for updates...
I1229 15:22:04.693593   56508 config.go:176] Loaded profile config "minikube": Driver=podman, ContainerRuntime=crio, KubernetesVersion=v1.22.3
I1229 15:22:04.694095   56508 driver.go:343] Setting default libvirt URI to qemu:///system
I1229 15:22:05.038631   56508 podman.go:121] podman version: 3.4.2
I1229 15:22:05.059620   56508 out.go:176] ✨  Using the podman (experimental) driver based on existing profile
✨  Using the podman (experimental) driver based on existing profile
I1229 15:22:05.059688   56508 start.go:280] selected driver: podman
I1229 15:22:05.059715   56508 start.go:762] validating driver "podman" against &{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:1965 CPUs:2 DiskSize:20000 VMDriver: Driver:podman HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.22.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host}
I1229 15:22:05.059833   56508 start.go:773] status for podman: {Installed:true Healthy:true Running:false NeedsImprovement:false Error:<nil> Reason: Fix: Doc:}
I1229 15:22:05.059984   56508 cli_runner.go:115] Run: podman system info --format json
I1229 15:22:05.239990   56508 info.go:285] podman info: {Host:{BuildahVersion:1.23.1 CgroupVersion:v2 Conmon:{Package:conmon-2.0.30-2.fc35.x86_64 Path:/usr/bin/conmon Version:conmon version 2.0.30, commit: } Distribution:{Distribution:fedora Version:35} MemFree:307613696 MemTotal:2061135872 OCIRuntime:{Name:crun Package:crun-1.3-1.fc35.x86_64 Path:/usr/bin/crun Version:crun version 1.3
commit: 8e5757a4e68590326dafe8a8b1b4a584b10a1370
spec: 1.0.0
+SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +CRIU +YAJL} SwapFree:0 SwapTotal:0 Arch:amd64 Cpus:2 Eventlogger:journald Hostname:localhost.localdomain Kernel:5.15.7-200.fc35.x86_64 Os:linux Rootless:false Uptime:12m 31.69s} Registries:{Search:[docker.io]} Store:{ConfigFile:/var/home/core/.config/containers/storage.conf ContainerStore:{Number:0} GraphDriverName:overlay GraphOptions:{} GraphRoot:/var/home/core/.local/share/containers/storage GraphStatus:{BackingFilesystem:xfs NativeOverlayDiff:true SupportsDType:true UsingMetacopy:false} ImageStore:{Number:1} RunRoot:/run/user/1000/containers VolumePath:/var/home/core/.local/share/containers/storage/volumes}}
I1229 15:22:05.240351   56508 cni.go:93] Creating CNI manager for ""
I1229 15:22:05.240370   56508 cni.go:160] "podman" driver + crio runtime found, recommending kindnet
I1229 15:22:05.240384   56508 start_flags.go:282] config:
{Name:minikube KeepContext:false EmbedCerts:false MinikubeISO: KicBaseImage:gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c Memory:1965 CPUs:2 DiskSize:20000 VMDriver: Driver:podman HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[] ContainerVolumeMounts:[] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.59.1/24 HypervVirtualSwitch: HypervUseExternalSwitch:false HypervExternalAdapter: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false KVMNUMACount:1 DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true HostOnlyNicType:virtio NatNicType:virtio SSHIPAddress: SSHUser:root SSHKey: SSHPort:22 KubernetesConfig:{KubernetesVersion:v1.22.3 ClusterName:minikube Namespace:default APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:crio CRISocket: NetworkPlugin:cni FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: LoadBalancerStartIP: LoadBalancerEndIP: CustomIngressCert: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false CNI: NodeIP: NodePort:8443 NodeName:} Nodes:[{Name: IP: Port:8443 KubernetesVersion:v1.22.3 ControlPlane:true Worker:true}] Addons:map[] CustomAddonImages:map[] CustomAddonRegistries:map[] VerifyComponents:map[apiserver:true system_pods:true] StartHostTimeout:6m0s ScheduledStop:<nil> ExposedPorts:[] ListenAddress: Network: MultiNodeRequested:false ExtraDisks:0 CertExpiration:26280h0m0s Mount:false MountString:/Users:/minikube-host}
I1229 15:22:05.278954   56508 out.go:176] 👍  Starting control plane node minikube in cluster minikube
👍  Starting control plane node minikube in cluster minikube
I1229 15:22:05.279026   56508 cache.go:118] Beginning downloading kic base image for podman with crio
I1229 15:22:05.297495   56508 out.go:176] 🚜  Pulling base image ...
🚜  Pulling base image ...
I1229 15:22:05.297557   56508 preload.go:132] Checking if preload exists for k8s version v1.22.3 and runtime crio
I1229 15:22:05.297626   56508 preload.go:148] Found local preload: /Users/t/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v13-v1.22.3-cri-o-overlay-amd64.tar.lz4
I1229 15:22:05.297639   56508 cache.go:146] Downloading gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c to local cache
I1229 15:22:05.297642   56508 cache.go:57] Caching tarball of preloaded images
I1229 15:22:05.297839   56508 image.go:59] Checking for gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local cache directory
I1229 15:22:05.297873   56508 image.go:62] Found gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c in local cache directory, skipping pull
I1229 15:22:05.297887   56508 image.go:103] gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c exists in cache, skipping pull
I1229 15:22:05.297919   56508 cache.go:149] successfully saved gcr.io/k8s-minikube/kicbase:v0.0.28@sha256:4780f1897569d2bf77aafb3d133a08d42b4fe61127f06fcfc90c2c5d902d893c as a tarball
I1229 15:22:05.297931   56508 preload.go:174] Found /Users/t/.minikube/cache/preloaded-tarball/preloaded-images-k8s-v13-v1.22.3-cri-o-overlay-amd64.tar.lz4 in cache, skipping download
I1229 15:22:05.297980   56508 cache.go:60] Finished verifying existence of preloaded tar for  v1.22.3 on crio
I1229 15:22:05.298149   56508 profile.go:147] Saving config to /Users/t/.minikube/profiles/minikube/config.json ...
E1229 15:22:05.318388   56508 cache.go:201] Error downloading kic artifacts:  not yet implemented, see issue #8426
I1229 15:22:05.318411   56508 cache.go:206] Successfully downloaded all kic artifacts
I1229 15:22:05.318453   56508 start.go:313] acquiring machines lock for minikube: {Name:mk56da9b1c5cd5dde3f30380840c1bb3b787a0f2 Clock:{} Delay:500ms Timeout:10m0s Cancel:<nil>}
I1229 15:22:05.318576   56508 start.go:317] acquired machines lock for "minikube" in 96.312µs
I1229 15:22:05.318609   56508 start.go:93] Skipping create...Using existing machine configuration
I1229 15:22:05.318622   56508 fix.go:55] fixHost starting:
I1229 15:22:05.319021   56508 cli_runner.go:115] Run: podman container inspect minikube --format={{.State.Status}}
W1229 15:22:05.476922   56508 cli_runner.go:162] podman container inspect minikube --format={{.State.Status}} returned with exit code 125
I1229 15:22:05.476985   56508 fix.go:108] recreateIfNeeded on minikube: state= err=unknown state "minikube": podman container inspect minikube --format={{.State.Status}}: exit status 125
stdout:

stderr:
Error: error inspecting object: no such container "minikube"
I1229 15:22:05.477006   56508 fix.go:113] machineExists: true. err=unknown state "minikube": podman container inspect minikube --format={{.State.Status}}: exit status 125
stdout:

stderr:
Error: error inspecting object: no such container "minikube"
W1229 15:22:05.477024   56508 fix.go:134] unexpected machine state, will restart: unknown state "minikube": podman container inspect minikube --format={{.State.Status}}: exit status 125
stdout:

stderr:
Error: error inspecting object: no such container "minikube"
I1229 15:22:05.495991   56508 out.go:176] 🔄  Restarting existing podman container for "minikube" ...
🔄  Restarting existing podman container for "minikube" ...
I1229 15:22:05.496134   56508 cli_runner.go:115] Run: podman start minikube
W1229 15:22:05.657395   56508 cli_runner.go:162] podman start minikube returned with exit code 125
I1229 15:22:05.657512   56508 cli_runner.go:115] Run: podman inspect minikube
I1229 15:22:05.831407   56508 errors.go:84] Postmortem inspect ("podman inspect minikube"): -- stdout --
[
    {
        "Name": "minikube",
        "Driver": "local",
        "Mountpoint": "/var/home/core/.local/share/containers/storage/volumes/minikube/_data",
        "CreatedAt": "2021-12-29T14:13:54.802916873Z",
        "Labels": {
            "created_by.minikube.sigs.k8s.io": "true",
            "name.minikube.sigs.k8s.io": "minikube"
        },
        "Scope": "local",
        "Options": {}
    }
]

-- /stdout --
I1229 15:22:05.831515   56508 cli_runner.go:115] Run: podman logs --timestamps minikube
W1229 15:22:06.006752   56508 cli_runner.go:162] podman logs --timestamps minikube returned with exit code 125
W1229 15:22:06.006785   56508 errors.go:89] Failed to get postmortem logs. podman logs --timestamps minikube :podman logs --timestamps minikube: exit status 125
stdout:

stderr:
Error: channel "123" found, 0-3 supported: lost synchronization with multiplexed stream
I1229 15:22:06.006869   56508 cli_runner.go:115] Run: podman system info --format json
I1229 15:22:06.182027   56508 info.go:285] podman info: {Host:{BuildahVersion:1.23.1 CgroupVersion:v2 Conmon:{Package:conmon-2.0.30-2.fc35.x86_64 Path:/usr/bin/conmon Version:conmon version 2.0.30, commit: } Distribution:{Distribution:fedora Version:35} MemFree:307613696 MemTotal:2061135872 OCIRuntime:{Name:crun Package:crun-1.3-1.fc35.x86_64 Path:/usr/bin/crun Version:crun version 1.3
commit: 8e5757a4e68590326dafe8a8b1b4a584b10a1370
spec: 1.0.0
+SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +CRIU +YAJL} SwapFree:0 SwapTotal:0 Arch:amd64 Cpus:2 Eventlogger:journald Hostname:localhost.localdomain Kernel:5.15.7-200.fc35.x86_64 Os:linux Rootless:false Uptime:12m 32.63s} Registries:{Search:[docker.io]} Store:{ConfigFile:/var/home/core/.config/containers/storage.conf ContainerStore:{Number:0} GraphDriverName:overlay GraphOptions:{} GraphRoot:/var/home/core/.local/share/containers/storage GraphStatus:{BackingFilesystem:xfs NativeOverlayDiff:true SupportsDType:true UsingMetacopy:false} ImageStore:{Number:1} RunRoot:/run/user/1000/containers VolumePath:/var/home/core/.local/share/containers/storage/volumes}}
I1229 15:22:06.182138   56508 errors.go:106] postmortem podman info: {Host:{BuildahVersion:1.23.1 CgroupVersion:v2 Conmon:{Package:conmon-2.0.30-2.fc35.x86_64 Path:/usr/bin/conmon Version:conmon version 2.0.30, commit: } Distribution:{Distribution:fedora Version:35} MemFree:307613696 MemTotal:2061135872 OCIRuntime:{Name:crun Package:crun-1.3-1.fc35.x86_64 Path:/usr/bin/crun Version:crun version 1.3
commit: 8e5757a4e68590326dafe8a8b1b4a584b10a1370
spec: 1.0.0
+SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +CRIU +YAJL} SwapFree:0 SwapTotal:0 Arch:amd64 Cpus:2 Eventlogger:journald Hostname:localhost.localdomain Kernel:5.15.7-200.fc35.x86_64 Os:linux Rootless:false Uptime:12m 32.63s} Registries:{Search:[docker.io]} Store:{ConfigFile:/var/home/core/.config/containers/storage.conf ContainerStore:{Number:0} GraphDriverName:overlay GraphOptions:{} GraphRoot:/var/home/core/.local/share/containers/storage GraphStatus:{BackingFilesystem:xfs NativeOverlayDiff:true SupportsDType:true UsingMetacopy:false} ImageStore:{Number:1} RunRoot:/run/user/1000/containers VolumePath:/var/home/core/.local/share/containers/storage/volumes}}
I1229 15:22:06.182249   56508 network_create.go:254] running [podman network inspect minikube] to gather additional debugging logs...
I1229 15:22:06.182283   56508 cli_runner.go:115] Run: podman network inspect minikube
I1229 15:22:06.332801   56508 network_create.go:259] output of [podman network inspect minikube]: -- stdout --
[
    {
        "args": {
            "podman_labels": {
                "created_by.minikube.sigs.k8s.io": "true"
            }
        },
        "cniVersion": "0.4.0",
        "name": "minikube",
        "plugins": [
            {
                "bridge": "cni-podman1",
                "hairpinMode": true,
                "ipMasq": true,
                "ipam": {
                    "ranges": [
                        [
                            {
                                "gateway": "192.168.49.1",
                                "subnet": "192.168.49.0/24"
                            }
                        ]
                    ],
                    "routes": [
                        {
                            "dst": "0.0.0.0/0"
                        }
                    ],
                    "type": "host-local"
                },
                "isGateway": true,
                "type": "bridge"
            },
            {
                "capabilities": {
                    "portMappings": true
                },
                "type": "portmap"
            },
            {
                "backend": "",
                "type": "firewall"
            },
            {
                "type": "tuning"
            },
            {
                "capabilities": {
                    "aliases": true
                },
                "domainName": "dns.podman",
                "type": "dnsname"
            },
            {
                "capabilities": {
                    "portMappings": true
                },
                "type": "podman-machine"
            }
        ]
    }
]

-- /stdout --
I1229 15:22:06.333017   56508 cli_runner.go:115] Run: podman system info --format json
I1229 15:22:06.503020   56508 info.go:285] podman info: {Host:{BuildahVersion:1.23.1 CgroupVersion:v2 Conmon:{Package:conmon-2.0.30-2.fc35.x86_64 Path:/usr/bin/conmon Version:conmon version 2.0.30, commit: } Distribution:{Distribution:fedora Version:35} MemFree:307613696 MemTotal:2061135872 OCIRuntime:{Name:crun Package:crun-1.3-1.fc35.x86_64 Path:/usr/bin/crun Version:crun version 1.3
commit: 8e5757a4e68590326dafe8a8b1b4a584b10a1370
spec: 1.0.0
+SYSTEMD +SELINUX +APPARMOR +CAP +SECCOMP +EBPF +CRIU +YAJL} SwapFree:0 SwapTotal:0 Arch:amd64 Cpus:2 Eventlogger:journald Hostname:localhost.localdomain Kernel:5.15.7-200.fc35.x86_64 Os:linux Rootless:false Uptime:12m 32.95s} Registries:{Search:[docker.io]} Store:{ConfigFile:/var/home/core/.config/containers/storage.conf ContainerStore:{Number:0} GraphDriverName:overlay GraphOptions:{} GraphRoot:/var/home/core/.local/share/containers/storage GraphStatus:{BackingFilesystem:xfs NativeOverlayDiff:true SupportsDType:true UsingMetacopy:false} ImageStore:{Number:1} RunRoot:/run/user/1000/containers VolumePath:/var/home/core/.local/share/containers/storage/volumes}}
I1229 15:22:06.504395   56508 cli_runner.go:115] Run: podman container inspect -f {{.NetworkSettings.IPAddress}} minikube
W1229 15:22:06.657895   56508 cli_runner.go:162] podman container inspect -f {{.NetworkSettings.IPAddress}} minikube returned with exit code 125
I1229 15:22:06.658047   56508 ssh_runner.go:152] Run: sh -c "df -h /var | awk 'NR==2{print $5}'"
I1229 15:22:06.658146   56508 cli_runner.go:115] Run: podman version --format {{.Version}}
I1229 15:22:06.858747   56508 cli_runner.go:115] Run: podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
W1229 15:22:07.031023   56508 cli_runner.go:162] podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 125
I1229 15:22:07.031190   56508 retry.go:31] will retry after 276.165072ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 125
stdout:

stderr:
Error: error inspecting object: no such container "minikube"
I1229 15:22:07.307840   56508 cli_runner.go:115] Run: podman version --format {{.Version}}
I1229 15:22:07.505818   56508 cli_runner.go:115] Run: podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
W1229 15:22:07.672659   56508 cli_runner.go:162] podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 125
I1229 15:22:07.672760   56508 retry.go:31] will retry after 540.190908ms: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 125
stdout:

stderr:
Error: error inspecting object: no such container "minikube"
I1229 15:22:08.214446   56508 cli_runner.go:115] Run: podman version --format {{.Version}}
I1229 15:22:08.427724   56508 cli_runner.go:115] Run: podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube
W1229 15:22:08.582195   56508 cli_runner.go:162] podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube returned with exit code 125
W1229 15:22:08.582312   56508 start.go:257] error running df -h /var: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 125
stdout:

stderr:
Error: error inspecting object: no such container "minikube"

W1229 15:22:08.582350   56508 start.go:239] error getting percentage of /var that is free: NewSession: new client: new client: Error creating new ssh host from driver: Error getting ssh port for driver: get ssh host-port: get port 22 for "minikube": podman container inspect -f "'{{(index (index .NetworkSettings.Ports "22/tcp") 0).HostPort}}'" minikube: exit status 125
stdout:

stderr:
Error: error inspecting object: no such container "minikube"
I1229 15:22:08.582367   56508 fix.go:57] fixHost completed within 3.263653726s
I1229 15:22:08.582376   56508 start.go:80] releasing machines lock for "minikube", held for 3.263694231s
W1229 15:22:08.582409   56508 start.go:532] error starting host: podman inspect ip minikube: podman container inspect -f {{.NetworkSettings.IPAddress}} minikube: exit status 125
stdout:

stderr:
Error: error inspecting object: no such container "minikube"
W1229 15:22:08.582595   56508 out.go:241] 🤦  StartHost failed, but will try again: podman inspect ip minikube: podman container inspect -f {{.NetworkSettings.IPAddress}} minikube: exit status 125
stdout:

stderr:
Error: error inspecting object: no such container "minikube"

🤦  StartHost failed, but will try again: podman inspect ip minikube: podman container inspect -f {{.NetworkSettings.IPAddress}} minikube: exit status 125
stdout:

stderr:
Error: error inspecting object: no such container "minikube"

Attach the log file

➜  ~ minikube logs --file=logs.tx

❌  Exiting due to GUEST_STATUS: state: unknown state "minikube": podman container inspect minikube --format=: exit status 125
stdout:

stderr:
Error: error inspecting object: no such container "minikube"


╭───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╮
│                                                                                                                       │
│    😿  If the above advice does not help, please let us know:                                                         │
│    👉  https://github.com/kubernetes/minikube/issues/new/choose                                                       │
│                                                                                                                       │
│    Please run `minikube logs --file=logs.txt` and attach logs.txt to the GitHub issue.                                │
│    Please also attach the following file to the GitHub issue:                                                         │
│    - /var/folders/hv/j2pkf20x1qb1c0sc23yd58y40000gn/T/minikube_logs_b5071b5f0b4713dd674799360d6dd0b30509408b_0.log    │
│                                                                                                                       │
╰────────────────────────────────────────────────────────────────────────────────────────────────
───────────────────────╯

minikube_logs_b5071b5f0b4713dd674799360d6dd0b30509408b_0.log

Operating System

macOS (Default)

Driver

Podman
@tbrodbeck tbrodbeck mentioned this issue Dec 29, 2021
Closed
@afbjorklund afbjorklund added the co/podman-driver podman driver issues label Dec 29, 2021
@afbjorklund
Copy link
Collaborator

The error reporting of that command is truly awful...

Error: error inspecting object: no such container "minikube"

But it looks like the underlying issue is cgroup-related ?

Error: the requested cgroup controller cpu is not available: OCI runtime error

@afbjorklund
Copy link
Collaborator

afbjorklund commented Dec 29, 2021 •
edited
Loading

Unfortunately it is not possible to troubleshoot on the developer machines at the moment, hard-coded on the GOOS.

We might want to enable running podman-remote also on Linux, to troubleshoot these issues with Podman Machine ?

@afbjorklund
Copy link
Collaborator

afbjorklund commented Dec 29, 2021 •
edited
Loading

Same error on Linux:

❌ Exiting due to GUEST_PROVISION: Failed to start host: podman inspect ip minikube: podman-remote container inspect -f minikube: exit status 125

The main issue seems to be that podman machine runs as rootless by default, which minikube doesn't support yet. To fix:

podman system connection default podman-machine-default-root

@afbjorklund
Copy link
Collaborator

There are other things left to fix, before Podman Machine (i.e. running podman without Linux) will work.

@afbjorklund afbjorklund changed the title Minikube with Podman "no such container "minikube" Minikube with Podman on Mac: "no such container "minikube" Dec 29, 2021
@afbjorklund afbjorklund added the kind/bug Categorizes issue or PR as related to a bug. label Dec 29, 2021
@ikaven1024
Copy link

ikaven1024 commented Jan 6, 2022 •
edited
Loading 

podman system connection default podman-machine-default-root

it does not work for me.

➜ ~ podman version
Client:
Version: 3.4.4
API Version: 3.4.4
Go Version: go1.17.3
Built: Thu Dec 9 02:41:11 2021
OS/Arch: darwin/arm64

Server:
Version: 3.4.4
API Version: 3.4.4
Go Version: go1.16.8
Built: Thu Dec 9 05:48:10 2021
OS/Arch: linux/arm64

➜ ~ minikube version
minikube version: v1.24.0
commit: 76b94fb

OS: macOS 11.4 M1

logs.txt

@a-nldisr
Copy link

a-nldisr commented Jan 7, 2022 •
edited
Loading

Same issue, the solution mentioned does not work. It seems that a connection attempt is made to a port (36225 in this case) and whatever is listening there closes the connection:

W0107 13:41:07.219648 91418 sshutil.go:64] dial failure (will retry): dial tcp 127.0.0.1:36225: connect: connection refused

gvproxy 90924 meeps 21u IPv6 0x22736ad02afbc729 0t0 TCP *:36225 (LISTEN) 

Trying ::1...
Connected to localhost.
Escape character is '^]'.
Connection closed by foreign host.

 minikube version
minikube version: v1.24.0
commit: 76b94fb3c4e8ac5062daf70d60cf03ddcc0a741b

podman version
Client:
Version:      3.4.4
API Version:  3.4.4
Go Version:   go1.17.3
Built:        Wed Dec  8 19:41:11 2021
OS/Arch:      darwin/arm64

Server:
Version:      3.4.4
API Version:  3.4.4
Go Version:   go1.16.8
Built:        Wed Dec  8 22:48:10 2021
OS/Arch:      linux/arm64

This is on a M1 Pro macbook.

minikube_logs_5e2f0f0e127cd776a9181abdfefb7fb9b0a78ebb_0.log

Tried to run on the local IP my MacBook uses:
minikube start --driver=podman --listen-address=$LOCAL_IP --alsologtostderr

This opened a new set of errors that I think is a new issue worth.

@klaases
Copy link
Contributor

klaases commented Jan 19, 2022

Hi @tbrodbeck, did you have a chance to review the above comments by @afbjorklund?

@tbrodbeck
Copy link
Author

Sorry, I stopped using podman and switched back to Docker. Therefore, I cannot reproduce it anymore.

@klaases
Copy link
Contributor

klaases commented Jan 19, 2022

Hi @tbrodbeck – thanks for your response, will close out this issue for now. Please feel free to re-open the issue by commenting with /reopen.

Thank you for sharing your experience!

@klaases klaases closed this as completed Jan 19, 2022
@a-nldisr
Copy link

a-nldisr commented Jan 20, 2022 •
edited
Loading

@klaases There are multiple users reporting this issue, why close it?

@weekmo
Copy link

weekmo commented Feb 2, 2022

Same issue 😞

@rakk
Copy link

rakk commented Feb 10, 2022

❌ Exiting due to GUEST_STATUS: state: unknown state "minikube": podman container inspect minikube --format=: exit status 125
stdout:

stderr:
Error: error inspecting object: no such container "minikube"

❯ podman version
Client:
Version: 3.4.1
API Version: 3.4.1
Go Version: go1.17.2
Built: Tue Oct 19 23:14:42 2021
OS/Arch: darwin/amd64

Server:
Version: 3.4.4
API Version: 3.4.4
Go Version: go1.16.8
Built: Wed Dec 8 22:45:07 2021
OS/Arch: linux/amd64

❯ minikube version
minikube version: v1.24.0
commit: 76b94fb

@afbjorklund
Copy link
Collaborator

Podman on Mac is still experimental, but we will continue to look in to it.

@afbjorklund
Copy link
Collaborator

/reopen

@k8s-ci-robot k8s-ci-robot reopened this Feb 10, 2022
@k8s-ci-robot
Copy link
Contributor

@afbjorklund: Reopened this issue.

In response to this:

/reopen

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@afbjorklund
Copy link
Collaborator

Seems to be same root cause as #13618, but there were not enough logs from this restart.

🔄 Restarting existing podman container for "minikube" ...

Follow up in the other issue.

@afbjorklund afbjorklund added the triage/duplicate Indicates an issue is a duplicate of other open issue. label Feb 15, 2022
@ebadfd
Copy link

ebadfd commented Apr 6, 2023 •
edited
Loading

did manage to fix this after trying minikube delete --all --purge and then re-starting again

#10343 (comment)

@ramchandh-narayanasamy
Copy link

minikube start --nodes=4
😄 minikube v1.33.1 on Darwin 14.3 (arm64)
▪ MINIKUBE_ROOTLESS=true
✨ Using the podman (experimental) driver based on existing profile
❗ You cannot change the number of nodes for an existing minikube cluster. Please use 'minikube node add' to add nodes to an existing cluster.
👍 Starting "minikube" primary control-plane node in "minikube" cluster
🚜 Pulling base image v0.0.44 ...
E0830 13:46:25.454194 3401 cache.go:189] Error downloading kic artifacts: not yet implemented, see issue #8426
🔄 Restarting existing podman container for "minikube" ...
🤦 StartHost failed, but will try again: driver start: start: podman start minikube: exit status 125
stdout:

stderr:
Error: no container with name or ID "minikube" found: no such container

🔄 Restarting existing podman container for "minikube" ...
😿 Failed to start podman container. Running "minikube delete" may fix it: driver start: start: podman start minikube: exit status 125
stdout:

stderr:
Error: no container with name or ID "minikube" found: no such container

❌ Exiting due to GUEST_PROVISION: error provisioning guest: Failed to start host: driver start: start: podman start minikube: exit status 125
stdout:

stderr:
Error: no container with name or ID "minikube" found: no such container

╭───────────────────────────────────────────────────────────────────────────────────────────╮
│ │
│ 😿 If the above advice does not help, please let us know: │
│ 👉 https://github.com/kubernetes/minikube/issues/new/choose │
│ │
│ Please run minikube logs --file=logs.txt and attach logs.txt to the GitHub issue. │
│ │
╰───────────────────────────────────────────────────────────────────────────────────────────╯

I am getting this, can anyone help me to sort this out

MacOS
Podman

@alexnelsone
Copy link

For anyone who may be coming here that is experiencing this issue on an M series Mac and podman. Running the following may clear up the issue with Error: no container with name or ID "minikube" found: no such container:

  1. minikube delete
  2. minikube config set rootless true
  3. minikube start --driver=podman --container-runtime=cri-o

@kid1412621
Copy link

3. minikube start --driver=podman --container-runtime=cri-o

not working.

➜ minikube delete
🙄  "minikube" profile does not exist, trying anyways.
💀  Removed all traces of the "minikube" cluster.
~
➜ minikube config set rootless true
~
➜ minikube start --driver=podman --container-runtime=cri-o
😄  minikube v1.34.0 on Microsoft Windows 11 Pro 10.0.22631.4391 Build 22631.4391
    ▪ MINIKUBE_ROOTLESS=true
✨  Using the podman (experimental) driver based on user configuration

❌  Exiting due to MK_USAGE: Using rootless driver was required, but the current driver does not seem rootless

@vigh-m
Copy link

vigh-m commented Nov 7, 2024

For anyone who may be coming here that is experiencing this issue on an M series Mac and podman. Running the following may clear up the issue with Error: no container with name or ID "minikube" found: no such container:

1. `minikube delete`

2. `minikube config set rootless true`

3. `minikube start --driver=podman --container-runtime=cri-o`

FWIW I setup podman with podman machine set --rootful and then ran minikube start --driver=podman --container-runtime=cri-o and was able to get the cluster up and running

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
co/podman-driver podman driver issues kind/bug Categorizes issue or PR as related to a bug. os/macos triage/duplicate Indicates an issue is a duplicate of other open issue.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests