Facing issue while running Minikube start #6282
Comments
afbjorklund
added
co/none-driver
kind/documentation
|
Did you disable SELinux and set up the container runtime, there's some extra requirements for CentOS I'm going to group this issue with #6166, to add more documentation on how to run minikube on centos |
|
We don't have the logs from the initial run (this was a re-start), and lacking some details on the setup. But most likely this is due to one of the known issues, and can be "fixed" by better checks and docs ? |
|
Always interested in learning more about the use case, like how do you develop on the master node ? It should still work, but wonder what next step is and seems to be a lot of extra work - see #4730 |
|
I just resolved this issue by disabling the Selinux. Thanks for your support. |
|
Long term solution is to merge some of our instructions with the information available at: |
The exact command to reproduce the issue:
[root@kubernetes01 ~]# minikube start --vm-driver=none
The full output of the command that failed:
😄 minikube v1.6.2 on Centos 7.6.1810
✨ Selecting 'none' driver from user configuration (alternates: [])
💡 Tip: Use 'minikube start -p ' to create a new cluster, or 'minikube delete' to delete this one.
🏃 Using the running none "minikube" VM ...
⌛ Waiting for the host to be provisioned ...
🐳 Preparing Kubernetes v1.17.0 on Docker '19.03.5' ...
🚀 Launching Kubernetes ...
💣 Error starting cluster: apiserver healthz: apiserver healthz never reported healthy
The output of the
minikube logscommand:==> Docker <==
-- Logs begin at Sun 2020-01-12 02:29:50 EST, end at Sun 2020-01-12 04:18:55 EST. --
Jan 12 04:18:41 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:41.961362596-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:41 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:41.961562939-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:42 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:42.020037152-05:00" level=error msg="bc1363d001c351744b6f3b123dab2d4ad67bfd99f710fd4d2eb4e0ef3abf7b51 cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:43 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:43.275270336-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:43 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:43.277979226-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:43 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:43.367042580-05:00" level=error msg="8ea79c631401b4c6f07c359aff608b5218c11cf6c7c832085599cba6fcd0df13 cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:43 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:43.976906524-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:43 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:43.979940787-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:44 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:44.099648553-05:00" level=error msg="cc14384eb5a7e652ffe2bac81cfd77c7ad69d019a89ec9e0e111d5d865aa35a8 cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:44 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:44.186553016-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:44 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:44.190863973-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:44 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:44.276886527-05:00" level=error msg="3f81dd7a53463bdeb6bcc5978623a7c73e17b776cea0f4a440a2dc536c391bc2 cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:44 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:44.373701099-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:44 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:44.374755081-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:44 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:44.513352506-05:00" level=error msg="120f73b5f413990d14f1d759dffe6d74600c24e42e100c2def816320e46bc8bf cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:45 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:45.359874970-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:45 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:45.360156396-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:45 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:45.532894590-05:00" level=error msg="563a311080d2e520e7f3b4e92cae1038bd2fa4300dec76cc871831ae82e4b5f8 cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:45 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:45.783831329-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:45 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:45.784184298-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:45 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:45.844978860-05:00" level=error msg="9bb1cbe9d8dd83fb421e21943502829ad20eae757e0aaf1cfed8e3f51267098c cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:47 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:47.439183770-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:47 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:47.441533266-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:47 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:47.625558924-05:00" level=error msg="e30224cd800d220f508e769b2d1298be88aebe19ddf33243d42c57f8ae972067 cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:48 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:48.013232616-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:48 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:48.016607009-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:48 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:48.023614104-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:48 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:48.023788395-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:48 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:48.155232397-05:00" level=error msg="bf43d7376cfaa97a14887011396b5b0bca69d9196b6463b0abd3d930a64f247c cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:48 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:48.200333493-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:48 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:48.200466623-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:48 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:48.206789117-05:00" level=error msg="aa8419d5aabee755a10c520ca72771c4fe0aa29a476f756ea69fc99e38dccc78 cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:48 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:48.289628954-05:00" level=error msg="a3477028c71a5c13e0e2b6174f23796206d6ad308749d8ffe525837413e0ed2e cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:50 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:50.516001979-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:50 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:50.516135541-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:50 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:50.609582355-05:00" level=error msg="03574ca87186a0e60d295701c72f892f180bc3a7750314b9ff208a88150b2e34 cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:50 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:50.760017969-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:50 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:50.760194540-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:50 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:50.968159388-05:00" level=error msg="cec275bd8a26588135f4cf8e9b577f571ac5dfad7ec44edc5e8e365ccc27fdce cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:51 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:51.033631396-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:51 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:51.033760070-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:51 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:51.116444182-05:00" level=error msg="882510ef8bf72d3e7159910f4b1c92f3097cbb9d462cf50c86f50a2b68ad4601 cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:51 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:51.199183105-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:51 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:51.199365131-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:51 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:51.328724564-05:00" level=error msg="0a7184f90c9ca39c6f657a73b65abba88028eb0b95b93cf28c7a07ad919ff9c3 cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:52 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:52.147943238-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:52 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:52.148116699-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:52 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:52.259829359-05:00" level=error msg="3bf46bb13a1ebde59fc3ef45ff01904acabca888f1828f7909adafe19d621795 cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:52 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:52.297735529-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:52 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:52.300057393-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:52 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:52.400421823-05:00" level=error msg="9336f46fe995ad1fa439833cc0afdd715eb6415598829146bdcfd4f7d1e0b697 cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:54 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:54.509148796-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:54 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:54.509287547-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:55 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:54.782501827-05:00" level=error msg="4d633d6129edf1580987e37b940310e82780a4410b2f41df5e6082e4d57606e0 cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:55 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:55.074855950-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:55 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:55.076582351-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:55 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:55.276885945-05:00" level=error msg="ade9127b9ce96c1b7dae0d5fdc6a43ea4f65c0b9ce024b20e9937ac6721f39dc cleanup: failed to delete container from containerd: no such container"
Jan 12 04:18:55 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:55.418387431-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:55 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:55.427054601-05:00" level=error msg="stream copy error: reading from a closed fifo"
Jan 12 04:18:55 kubernetes01 dockerd[72443]: time="2020-01-12T04:18:55.522830581-05:00" level=error msg="6053d4f77a05312e7d91388bdaa730e458480fc1f88993e27d9dff522069429f cleanup: failed to delete container from containerd: no such container"
==> container status <==
CONTAINER ID IMAGE CREATED STATE NAME ATTEMPT POD ID
==> dmesg <==
dmesg: invalid option -- '='
Usage:
dmesg [options]
Options:
-C, --clear clear the kernel ring buffer
-c, --read-clear read and clear all messages
-D, --console-off disable printing messages to console
-d, --show-delta show time delta between printed messages
-e, --reltime show local time and time delta in readable format
-E, --console-on enable printing messages to console
-F, --file use the file instead of the kernel log buffer
-f, --facility restrict output to defined facilities
-H, --human human readable output
-k, --kernel display kernel messages
-L, --color colorize messages
-l, --level restrict output to defined levels
-n, --console-level set level of messages printed to console
-P, --nopager do not pipe output into a pager
-r, --raw print the raw message buffer
-S, --syslog force to use syslog(2) rather than /dev/kmsg
-s, --buffer-size buffer size to query the kernel ring buffer
-T, --ctime show human readable timestamp (could be
inaccurate if you have used SUSPEND/RESUME)
-t, --notime don't print messages timestamp
-u, --userspace display userspace messages
-w, --follow wait for new messages
-x, --decode decode facility and level to readable string
-h, --help display this help and exit
-V, --version output version information and exit
Supported log facilities:
kern - kernel messages
user - random user-level messages
mail - mail system
daemon - system daemons
auth - security/authorization messages
syslog - messages generated internally by syslogd
lpr - line printer subsystem
news - network news subsystem
Supported log levels (priorities):
emerg - system is unusable
alert - action must be taken immediately
crit - critical conditions
err - error conditions
warn - warning conditions
notice - normal but significant condition
info - informational
debug - debug-level messages
For more details see dmesg(q).
==> kernel <==
04:18:56 up 1:11, 3 users, load average: 13.23, 10.26, 7.57
Linux kubernetes01 3.10.0-1062.9.1.el7.x86_64 #1 SMP Fri Dec 6 15:49:49 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
PRETTY_NAME="CentOS Linux 7 (Core)"
==> kubelet <==
-- Logs begin at Sun 2020-01-12 02:29:50 EST, end at Sun 2020-01-12 04:18:56 EST. --
Jan 12 04:18:54 kubernetes01 kubelet[66487]: E0112 04:18:54.012489 66487 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp [::1]:8443: connect: connection refused
Jan 12 04:18:54 kubernetes01 kubelet[66487]: E0112 04:18:54.030899 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:54 kubernetes01 kubelet[66487]: E0112 04:18:54.135022 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:54 kubernetes01 kubelet[66487]: E0112 04:18:54.225442 66487 reflector.go:156] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.CSIDriver: Get https://localhost:8443/apis/storage.k8s.io/v1beta1/csidrivers?limit=500&resourceVersion=0: dial tcp [::1]:8443: connect: connection refused
Jan 12 04:18:54 kubernetes01 kubelet[66487]: E0112 04:18:54.237586 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:54 kubernetes01 kubelet[66487]: I0112 04:18:54.311533 66487 kubelet_node_status.go:70] Attempting to register node minikube
Jan 12 04:18:54 kubernetes01 kubelet[66487]: E0112 04:18:54.338048 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:54 kubernetes01 kubelet[66487]: E0112 04:18:54.353463 66487 kubelet_node_status.go:92] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp [::1]:8443: connect: connection refused
Jan 12 04:18:54 kubernetes01 kubelet[66487]: E0112 04:18:54.440194 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:54 kubernetes01 kubelet[66487]: E0112 04:18:54.542343 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:54 kubernetes01 kubelet[66487]: E0112 04:18:54.554017 66487 reflector.go:156] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.RuntimeClass: Get https://localhost:8443/apis/node.k8s.io/v1beta1/runtimeclasses?limit=500&resourceVersion=0: dial tcp [::1]:8443: connect: connection refused
Jan 12 04:18:54 kubernetes01 kubelet[66487]: E0112 04:18:54.644179 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:54.744587 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:54.754445 66487 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/kubelet.go:449: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp [::1]:8443: connect: connection refused
Jan 12 04:18:55 kubernetes01 kubelet[66487]: W0112 04:18:54.784129 66487 container.go:412] Failed to create summary reader for "/kubepods/burstable/pod6e3f1c4f7169584d1ddbab818dc1b256/4d633d6129edf1580987e37b940310e82780a4410b2f41df5e6082e4d57606e0": none of the resources are being tracked.
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:54.784901 66487 remote_runtime.go:105] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "kube-controller-manager-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused "write /proc/self/attr/keycreate: permission denied"": unknown
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:54.784964 66487 kuberuntime_sandbox.go:68] CreatePodSandbox for pod "kube-controller-manager-minikube_kube-system(6e3f1c4f7169584d1ddbab818dc1b256)" failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "kube-controller-manager-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused "write /proc/self/attr/keycreate: permission denied"": unknown
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:54.784992 66487 kuberuntime_manager.go:729] createPodSandbox for pod "kube-controller-manager-minikube_kube-system(6e3f1c4f7169584d1ddbab818dc1b256)" failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "kube-controller-manager-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused "write /proc/self/attr/keycreate: permission denied"": unknown
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:54.785078 66487 pod_workers.go:191] Error syncing pod 6e3f1c4f7169584d1ddbab818dc1b256 ("kube-controller-manager-minikube_kube-system(6e3f1c4f7169584d1ddbab818dc1b256)"), skipping: failed to "CreatePodSandbox" for "kube-controller-manager-minikube_kube-system(6e3f1c4f7169584d1ddbab818dc1b256)" with CreatePodSandboxError: "CreatePodSandbox for pod "kube-controller-manager-minikube_kube-system(6e3f1c4f7169584d1ddbab818dc1b256)" failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "kube-controller-manager-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused \"write /proc/self/attr/keycreate: permission denied\"": unknown"
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:54.845512 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:54.968620 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:54.980047 66487 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/kubelet.go:458: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp [::1]:8443: connect: connection refused
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:54.990527 66487 controller.go:135] failed to ensure node lease exists, will retry in 7s, error: Get https://localhost:8443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/minikube?timeout=10s: dial tcp [::1]:8443: connect: connection refused
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.074603 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.152683 66487 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp [::1]:8443: connect: connection refused
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.175322 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.277609 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:55 kubernetes01 kubelet[66487]: W0112 04:18:55.279738 66487 container.go:412] Failed to create summary reader for "/kubepods/burstable/podb8eefb76d588518b012b387d914f0356/ade9127b9ce96c1b7dae0d5fdc6a43ea4f65c0b9ce024b20e9937ac6721f39dc": none of the resources are being tracked.
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.282155 66487 remote_runtime.go:105] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "kube-apiserver-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused "write /proc/self/attr/keycreate: permission denied"": unknown
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.282220 66487 kuberuntime_sandbox.go:68] CreatePodSandbox for pod "kube-apiserver-minikube_kube-system(b8eefb76d588518b012b387d914f0356)" failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "kube-apiserver-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused "write /proc/self/attr/keycreate: permission denied"": unknown
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.282246 66487 kuberuntime_manager.go:729] createPodSandbox for pod "kube-apiserver-minikube_kube-system(b8eefb76d588518b012b387d914f0356)" failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "kube-apiserver-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused "write /proc/self/attr/keycreate: permission denied"": unknown
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.282336 66487 pod_workers.go:191] Error syncing pod b8eefb76d588518b012b387d914f0356 ("kube-apiserver-minikube_kube-system(b8eefb76d588518b012b387d914f0356)"), skipping: failed to "CreatePodSandbox" for "kube-apiserver-minikube_kube-system(b8eefb76d588518b012b387d914f0356)" with CreatePodSandboxError: "CreatePodSandbox for pod "kube-apiserver-minikube_kube-system(b8eefb76d588518b012b387d914f0356)" failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "kube-apiserver-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused \"write /proc/self/attr/keycreate: permission denied\"": unknown"
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.364689 66487 reflector.go:156] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.CSIDriver: Get https://localhost:8443/apis/storage.k8s.io/v1beta1/csidrivers?limit=500&resourceVersion=0: dial tcp [::1]:8443: connect: connection refused
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.383099 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.484665 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.523793 66487 remote_runtime.go:105] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "kube-scheduler-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused "write /proc/self/attr/keycreate: permission denied"": unknown
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.523906 66487 kuberuntime_sandbox.go:68] CreatePodSandbox for pod "kube-scheduler-minikube_kube-system(ff67867321338ffd885039e188f6b424)" failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "kube-scheduler-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused "write /proc/self/attr/keycreate: permission denied"": unknown
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.523969 66487 kuberuntime_manager.go:729] createPodSandbox for pod "kube-scheduler-minikube_kube-system(ff67867321338ffd885039e188f6b424)" failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "kube-scheduler-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused "write /proc/self/attr/keycreate: permission denied"": unknown
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.524107 66487 pod_workers.go:191] Error syncing pod ff67867321338ffd885039e188f6b424 ("kube-scheduler-minikube_kube-system(ff67867321338ffd885039e188f6b424)"), skipping: failed to "CreatePodSandbox" for "kube-scheduler-minikube_kube-system(ff67867321338ffd885039e188f6b424)" with CreatePodSandboxError: "CreatePodSandbox for pod "kube-scheduler-minikube_kube-system(ff67867321338ffd885039e188f6b424)" failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "kube-scheduler-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused \"write /proc/self/attr/keycreate: permission denied\"": unknown"
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.555761 66487 reflector.go:156] k8s.io/client-go/informers/factory.go:135: Failed to list *v1beta1.RuntimeClass: Get https://localhost:8443/apis/node.k8s.io/v1beta1/runtimeclasses?limit=500&resourceVersion=0: dial tcp [::1]:8443: connect: connection refused
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.597873 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:55 kubernetes01 kubelet[66487]: W0112 04:18:55.685970 66487 container.go:412] Failed to create summary reader for "/kubepods/besteffort/pod52b17743ac9011be3cc09e6978aecb0d/a727720af8ba631734794fc6b0a239cc3e05ed0ed445f97971af4bf6634ea8cd": none of the resources are being tracked.
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.689884 66487 remote_runtime.go:105] RunPodSandbox from runtime service failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "etcd-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused "write /proc/self/attr/keycreate: permission denied"": unknown
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.690013 66487 kuberuntime_sandbox.go:68] CreatePodSandbox for pod "etcd-minikube_kube-system(52b17743ac9011be3cc09e6978aecb0d)" failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "etcd-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused "write /proc/self/attr/keycreate: permission denied"": unknown
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.690049 66487 kuberuntime_manager.go:729] createPodSandbox for pod "etcd-minikube_kube-system(52b17743ac9011be3cc09e6978aecb0d)" failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "etcd-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused "write /proc/self/attr/keycreate: permission denied"": unknown
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.690147 66487 pod_workers.go:191] Error syncing pod 52b17743ac9011be3cc09e6978aecb0d ("etcd-minikube_kube-system(52b17743ac9011be3cc09e6978aecb0d)"), skipping: failed to "CreatePodSandbox" for "etcd-minikube_kube-system(52b17743ac9011be3cc09e6978aecb0d)" with CreatePodSandboxError: "CreatePodSandbox for pod "etcd-minikube_kube-system(52b17743ac9011be3cc09e6978aecb0d)" failed: rpc error: code = Unknown desc = failed to start sandbox container for pod "etcd-minikube": Error response from daemon: OCI runtime create failed: container_linux.go:346: starting container process caused "process_linux.go:449: container init caused \"write /proc/self/attr/keycreate: permission denied\"": unknown"
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.698912 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:55 kubernetes01 kubelet[66487]: W0112 04:18:55.727912 66487 container.go:412] Failed to create summary reader for "/kubepods/burstable/podff67867321338ffd885039e188f6b424/6053d4f77a05312e7d91388bdaa730e458480fc1f88993e27d9dff522069429f": none of the resources are being tracked.
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.756101 66487 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/kubelet.go:449: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp [::1]:8443: connect: connection refused
Jan 12 04:18:55 kubernetes01 kubelet[66487]: I0112 04:18:55.764110 66487 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.800552 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.911869 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:55 kubernetes01 kubelet[66487]: I0112 04:18:55.952041 66487 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach
Jan 12 04:18:55 kubernetes01 kubelet[66487]: E0112 04:18:55.988372 66487 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/kubelet.go:458: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp [::1]:8443: connect: connection refused
Jan 12 04:18:56 kubernetes01 kubelet[66487]: E0112 04:18:56.014582 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:56 kubernetes01 kubelet[66487]: I0112 04:18:56.093395 66487 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach
Jan 12 04:18:56 kubernetes01 kubelet[66487]: E0112 04:18:56.121433 66487 kubelet.go:2263] node "minikube" not found
Jan 12 04:18:56 kubernetes01 kubelet[66487]: E0112 04:18:56.180337 66487 reflector.go:156] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:46: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp [::1]:8443: connect: connection refused
Jan 12 04:18:56 kubernetes01 kubelet[66487]: I0112 04:18:56.189503 66487 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach
Jan 12 04:18:56 kubernetes01 kubelet[66487]: I0112 04:18:56.193619 66487 kubelet_node_status.go:294] Setting node annotation to enable volume controller attach/detach
The operating system version:
[root@kubernetes01 ~]# cat /etc/redhat-release
CentOS Linux release 7.6.1810 (Core)
The text was updated successfully, but these errors were encountered: