Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MacOS/virtualbox w/ VPN: stuck on "Starting cluster components..." #3503

Closed
TheKangaroo opened this issue Jan 4, 2019 · 19 comments
Closed
Labels
area/networking networking issues cause/firewall-or-proxy When firewalls or proxies seem to be interfering cause/poor-internet Failed due to internet access issues help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. priority/backlog Higher priority than priority/awaiting-more-evidence. triage/obsolete Bugs that no longer occur in the latest stable release

Comments

@TheKangaroo
Copy link

Is this a BUG REPORT or FEATURE REQUEST?: Bug report

Please provide the following details:

Environment:

  • Minikube version: v0.32.0
  • OS: macOS 10.14
  • VM Driver: virtualbox
  • ISO version: v0.32.0
  • Install tools: brew cask install virtualbox / brew cask install minikube
  • Others:

What happened:
I try to start minikube on my newly set up MacBook. I installed virtualbox and minikube via brew cask.
When I run minikube startit starts the virtualbox VM and start to configure stuff, but it got stuck at this point:

$ minikube start
Starting local Kubernetes v1.12.4 cluster...
Starting VM...
Getting VM IP address...
Moving files into cluster...
Setting up certs...
Connecting to cluster...
Setting up kubeconfig...
Stopping extra container runtimes...
Starting cluster components...

At this point, it hangs forever.

How to reproduce it:
I just installed virtualbox and minikube via brew cask on a fresh installation of MacOS.
Next I ran minikube start and the issue occured.

Output of minikube logs (if applicable):

-- Logs begin at Fri 2019-01-04 14:27:37 UTC, end at Fri 2019-01-04 14:29:44 UTC. --
Jan 04 14:27:53 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Jan 04 14:27:53 minikube kubelet[2705]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:27:53 minikube kubelet[2705]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:27:53 minikube kubelet[2705]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:27:53 minikube kubelet[2705]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:27:53 minikube kubelet[2705]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:27:53 minikube kubelet[2705]: Flag --allow-privileged has been deprecated, will be removed in a future version
Jan 04 14:27:53 minikube kubelet[2705]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:27:53 minikube kubelet[2705]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:27:54 minikube kubelet[2705]: I0104 14:27:54.185904    2705 server.go:408] Version: v1.12.4
Jan 04 14:27:54 minikube kubelet[2705]: I0104 14:27:54.186097    2705 plugins.go:99] No cloud provider specified.
Jan 04 14:27:54 minikube kubelet[2705]: F0104 14:27:54.186153    2705 server.go:262] failed to run Kubelet: unable to load bootstrap kubeconfig: stat /etc/kubernetes/bootstrap-kubelet.conf: no such file or directory
Jan 04 14:27:54 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Jan 04 14:27:54 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Jan 04 14:28:04 minikube systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Jan 04 14:28:04 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1.
Jan 04 14:28:04 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Jan 04 14:28:04 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Jan 04 14:28:04 minikube kubelet[2891]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:04 minikube kubelet[2891]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:04 minikube kubelet[2891]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:04 minikube kubelet[2891]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:04 minikube kubelet[2891]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:04 minikube kubelet[2891]: Flag --allow-privileged has been deprecated, will be removed in a future version
Jan 04 14:28:04 minikube kubelet[2891]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:04 minikube kubelet[2891]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:04 minikube kubelet[2891]: I0104 14:28:04.562892    2891 server.go:408] Version: v1.12.4
Jan 04 14:28:04 minikube kubelet[2891]: I0104 14:28:04.563298    2891 plugins.go:99] No cloud provider specified.
Jan 04 14:28:04 minikube kubelet[2891]: F0104 14:28:04.563358    2891 server.go:262] failed to run Kubelet: unable to load bootstrap kubeconfig: stat /etc/kubernetes/bootstrap-kubelet.conf: no such file or directory
Jan 04 14:28:04 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Jan 04 14:28:04 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Jan 04 14:28:14 minikube systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Jan 04 14:28:14 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 2.
Jan 04 14:28:14 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Jan 04 14:28:14 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Jan 04 14:28:14 minikube kubelet[3028]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:14 minikube kubelet[3028]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:14 minikube kubelet[3028]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:14 minikube kubelet[3028]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:14 minikube kubelet[3028]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:14 minikube kubelet[3028]: Flag --allow-privileged has been deprecated, will be removed in a future version
Jan 04 14:28:14 minikube kubelet[3028]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:14 minikube kubelet[3028]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:14 minikube kubelet[3028]: I0104 14:28:14.934676    3028 server.go:408] Version: v1.12.4
Jan 04 14:28:14 minikube kubelet[3028]: I0104 14:28:14.934910    3028 plugins.go:99] No cloud provider specified.
Jan 04 14:28:14 minikube kubelet[3028]: F0104 14:28:14.934954    3028 server.go:262] failed to run Kubelet: unable to load bootstrap kubeconfig: stat /etc/kubernetes/bootstrap-kubelet.conf: no such file or directory
Jan 04 14:28:14 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Jan 04 14:28:14 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Jan 04 14:28:22 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Jan 04 14:28:22 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Jan 04 14:28:22 minikube kubelet[3122]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:22 minikube kubelet[3122]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:22 minikube kubelet[3122]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:22 minikube kubelet[3122]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:22 minikube kubelet[3122]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:22 minikube kubelet[3122]: Flag --allow-privileged has been deprecated, will be removed in a future version
Jan 04 14:28:22 minikube kubelet[3122]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:22 minikube kubelet[3122]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:22 minikube kubelet[3122]: I0104 14:28:22.882013    3122 server.go:408] Version: v1.12.4
Jan 04 14:28:22 minikube kubelet[3122]: I0104 14:28:22.882199    3122 plugins.go:99] No cloud provider specified.
Jan 04 14:28:22 minikube kubelet[3122]: F0104 14:28:22.882232    3122 server.go:262] failed to run Kubelet: unable to load bootstrap kubeconfig: stat /etc/kubernetes/bootstrap-kubelet.conf: no such file or directory
Jan 04 14:28:22 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Jan 04 14:28:22 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Jan 04 14:28:32 minikube systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Jan 04 14:28:32 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 3.
Jan 04 14:28:32 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Jan 04 14:28:32 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Jan 04 14:28:33 minikube kubelet[3144]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:33 minikube kubelet[3144]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:33 minikube kubelet[3144]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:33 minikube kubelet[3144]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:33 minikube kubelet[3144]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:33 minikube kubelet[3144]: Flag --allow-privileged has been deprecated, will be removed in a future version
Jan 04 14:28:33 minikube kubelet[3144]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:33 minikube kubelet[3144]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.062663    3144 server.go:408] Version: v1.12.4
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.062936    3144 plugins.go:99] No cloud provider specified.
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.086680    3144 server.go:667] --cgroups-per-qos enabled, but --cgroup-root was not specified.  defaulting to /
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.086979    3144 container_manager_linux.go:247] container manager verified user specified cgroup-root exists: []
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.087002    3144 container_manager_linux.go:252] Creating Container Manager object based on Node Config: {RuntimeCgroupsName: SystemCgroupsName: KubeletCgroupsName: ContainerRuntime:docker CgroupsPerQOS:true CgroupRoot:/ CgroupDriver:cgroupfs KubeletRootDir:/var/lib/kubelet ProtectKernelDefaults:false NodeAllocatableConfig:{KubeReservedCgroupName: SystemReservedCgroupName: EnforceNodeAllocatable:map[pods:{}] KubeReserved:map[] SystemReserved:map[] HardEvictionThresholds:[{Signal:nodefs.inodesFree Operator:LessThan Value:{Quantity:<nil> Percentage:0.05} GracePeriod:0s MinReclaim:<nil>} {Signal:imagefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.15} GracePeriod:0s MinReclaim:<nil>} {Signal:memory.available Operator:LessThan Value:{Quantity:100Mi Percentage:0} GracePeriod:0s MinReclaim:<nil>} {Signal:nodefs.available Operator:LessThan Value:{Quantity:<nil> Percentage:0.1} GracePeriod:0s MinReclaim:<nil>}]} QOSReserved:map[] ExperimentalCPUManagerPolicy:none ExperimentalCPUManagerReconcilePeriod:10s ExperimentalPodPidsLimit:-1 EnforceCPULimits:true CPUCFSQuotaPeriod:100ms}
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.087162    3144 container_manager_linux.go:271] Creating device plugin manager: true
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.087295    3144 state_mem.go:36] [cpumanager] initializing new in-memory state store
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.089911    3144 kubelet.go:279] Adding pod path: /etc/kubernetes/manifests
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.089990    3144 kubelet.go:304] Watching apiserver
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.097271    3144 client.go:75] Connecting to docker on unix:///var/run/docker.sock
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.097362    3144 client.go:104] Start docker client with request timeout=2m0s
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.097662    3144 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.097765    3144 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/kubelet.go:442: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.097843    3144 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:33 minikube kubelet[3144]: W0104 14:28:33.098711    3144 docker_service.go:540] Hairpin mode set to "promiscuous-bridge" but kubenet is not enabled, falling back to "hairpin-veth"
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.098800    3144 docker_service.go:236] Hairpin mode set to "hairpin-veth"
Jan 04 14:28:33 minikube kubelet[3144]: W0104 14:28:33.102106    3144 hostport_manager.go:68] The binary conntrack is not installed, this can cause failures in network connection cleanup.
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.104224    3144 docker_service.go:251] Docker cri networking managed by kubernetes.io/no-op
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.114593    3144 docker_service.go:256] Docker Info: &{ID:PHTK:TUY6:COOL:QHUT:XH6D:ECKB:AT2V:4C2J:AOWQ:XLXA:SQFH:DCT4 Containers:0 ContainersRunning:0 ContainersPaused:0 ContainersStopped:0 Images:7 Driver:overlay2 DriverStatus:[[Backing Filesystem extfs] [Supports d_type true] [Native Overlay Diff true]] SystemStatus:[] Plugins:{Volume:[local] Network:[bridge host macvlan null overlay] Authorization:[] Log:[awslogs fluentd gcplogs gelf journald json-file logentries splunk syslog]} MemoryLimit:true SwapLimit:true KernelMemory:true CPUCfsPeriod:true CPUCfsQuota:true CPUShares:true CPUSet:true IPv4Forwarding:true BridgeNfIptables:true BridgeNfIP6tables:true Debug:false NFd:27 OomKillDisable:true NGoroutines:46 SystemTime:2019-01-04T14:28:33.105120166Z LoggingDriver:json-file CgroupDriver:cgroupfs NEventsListener:0 KernelVersion:4.15.0 OperatingSystem:Buildroot 2018.05 OSType:linux Architecture:x86_64 IndexServerAddress:https://index.docker.io/v1/ RegistryConfig:0xc420bd8e00 NCPU:2 MemTotal:2087550976 GenericResources:[] DockerRootDir:/var/lib/docker HTTPProxy: HTTPSProxy: NoProxy: Name:minikube Labels:[provider=virtualbox] ExperimentalBuild:false ServerVersion:18.06.1-ce ClusterStore: ClusterAdvertise: Runtimes:map[runc:{Path:docker-runc Args:[]}] DefaultRuntime:runc Swarm:{NodeID: NodeAddr: LocalNodeState:inactive ControlAvailable:false Error: RemoteManagers:[] Nodes:0 Managers:0 Cluster:<nil>} LiveRestoreEnabled:false Isolation: InitBinary:docker-init ContainerdCommit:{ID:468a545b9edcd5932818eb9de8e72413e616e86e Expected:468a545b9edcd5932818eb9de8e72413e616e86e} RuncCommit:{ID:69663f0bd4b60df09991c08812a60108003fa340 Expected:69663f0bd4b60df09991c08812a60108003fa340} InitCommit:{ID:N/A Expected:} SecurityOptions:[name=seccomp,profile=default]}
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.114724    3144 docker_service.go:269] Setting cgroupDriver to cgroupfs
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.124146    3144 kuberuntime_manager.go:197] Container runtime docker initialized, version: 18.06.1-ce, apiVersion: 1.38.0
Jan 04 14:28:33 minikube kubelet[3144]: W0104 14:28:33.124491    3144 probe.go:270] Flexvolume plugin directory at /usr/libexec/kubernetes/kubelet-plugins/volume/exec/ does not exist. Recreating.
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.125839    3144 server.go:1013] Started kubelet
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.125956    3144 kubelet.go:1287] Image garbage collection failed once. Stats initialization may not have completed yet: failed to get imageFs info: unable to find data in memory cache
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.126428    3144 fs_resource_analyzer.go:66] Starting FS ResourceAnalyzer
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.126457    3144 status_manager.go:152] Starting to sync pod status with apiserver
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.126464    3144 kubelet.go:1804] Starting kubelet main sync loop.
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.126475    3144 kubelet.go:1821] skipping pod synchronization - [container runtime is down PLEG is not healthy: pleg was last seen active 2562047h47m16.854775807s ago; threshold is 3m0s]
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.126545    3144 server.go:133] Starting to listen on 0.0.0.0:10250
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.126944    3144 server.go:318] Adding debug handlers to kubelet server.
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.128827    3144 volume_manager.go:248] Starting Kubelet Volume Manager
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.131413    3144 desired_state_of_world_populator.go:130] Desired state populator starts to run
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.142915    3144 event.go:212] Unable to write event: 'Post https://localhost:8443/api/v1/namespaces/default/events: dial tcp 127.0.0.1:8443: connect: connection refused' (may retry after sleeping)
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.243657    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.244089    3144 kubelet.go:1821] skipping pod synchronization - [container runtime is down]
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.244298    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.247478    3144 kubelet_node_status.go:70] Attempting to register node minikube
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.247783    3144 kubelet_node_status.go:92] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.249404    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.252573    3144 cpu_manager.go:155] [cpumanager] starting with none policy
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.252599    3144 cpu_manager.go:156] [cpumanager] reconciling every 10s
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.252609    3144 policy_none.go:42] [cpumanager] none policy: Start
Jan 04 14:28:33 minikube kubelet[3144]: W0104 14:28:33.265151    3144 manager.go:527] Failed to retrieve checkpoint for "kubelet_internal_checkpoint": checkpoint is not found
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.265661    3144 eviction_manager.go:243] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.345432    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.445520    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.446038    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.448124    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.450641    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.450831    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.452200    3144 kubelet_node_status.go:70] Attempting to register node minikube
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.452570    3144 kubelet_node_status.go:92] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:33 minikube kubelet[3144]: W0104 14:28:33.457539    3144 status_manager.go:485] Failed to get status for pod "kube-controller-manager-minikube_kube-system(e2ad1c3c6b26b508041ca8968da58d60)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.460407    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.460627    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.464653    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.465328    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:33 minikube kubelet[3144]: W0104 14:28:33.467436    3144 status_manager.go:485] Failed to get status for pod "kube-scheduler-minikube_kube-system(e1b3e16379a55d4c355fa42bc75eb023)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-scheduler-minikube: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:33 minikube kubelet[3144]: W0104 14:28:33.469554    3144 status_manager.go:485] Failed to get status for pod "kube-addon-manager-minikube_kube-system(d682efea6fd7d1c11b13f78e8c81af08)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-addon-manager-minikube: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.470608    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.470657    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:33 minikube kubelet[3144]: W0104 14:28:33.479086    3144 status_manager.go:485] Failed to get status for pod "etcd-minikube_kube-system(400930335566057521570dcbaf3dbb0b)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/etcd-minikube: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.480946    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:33 minikube kubelet[3144]: W0104 14:28:33.484703    3144 status_manager.go:485] Failed to get status for pod "kube-apiserver-minikube_kube-system(29bfd3bf3f1478818331d78a5ae9ebb9)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-minikube: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.540309    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/e1b3e16379a55d4c355fa42bc75eb023-kubeconfig") pod "kube-scheduler-minikube" (UID: "e1b3e16379a55d4c355fa42bc75eb023")
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.540618    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "addons" (UniqueName: "kubernetes.io/host-path/d682efea6fd7d1c11b13f78e8c81af08-addons") pod "kube-addon-manager-minikube" (UID: "d682efea6fd7d1c11b13f78e8c81af08")
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.540847    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "etcd-certs" (UniqueName: "kubernetes.io/host-path/400930335566057521570dcbaf3dbb0b-etcd-certs") pod "etcd-minikube" (UID: "400930335566057521570dcbaf3dbb0b")
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.540900    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "k8s-certs" (UniqueName: "kubernetes.io/host-path/29bfd3bf3f1478818331d78a5ae9ebb9-k8s-certs") pod "kube-apiserver-minikube" (UID: "29bfd3bf3f1478818331d78a5ae9ebb9")
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.540918    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs" (UniqueName: "kubernetes.io/host-path/29bfd3bf3f1478818331d78a5ae9ebb9-ca-certs") pod "kube-apiserver-minikube" (UID: "29bfd3bf3f1478818331d78a5ae9ebb9")
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.540936    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "usr-share-ca-certificates" (UniqueName: "kubernetes.io/host-path/29bfd3bf3f1478818331d78a5ae9ebb9-usr-share-ca-certificates") pod "kube-apiserver-minikube" (UID: "29bfd3bf3f1478818331d78a5ae9ebb9")
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.540958    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "k8s-certs" (UniqueName: "kubernetes.io/host-path/e2ad1c3c6b26b508041ca8968da58d60-k8s-certs") pod "kube-controller-manager-minikube" (UID: "e2ad1c3c6b26b508041ca8968da58d60")
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.540975    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/e2ad1c3c6b26b508041ca8968da58d60-kubeconfig") pod "kube-controller-manager-minikube" (UID: "e2ad1c3c6b26b508041ca8968da58d60")
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.540991    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kubeconfig" (UniqueName: "kubernetes.io/host-path/d682efea6fd7d1c11b13f78e8c81af08-kubeconfig") pod "kube-addon-manager-minikube" (UID: "d682efea6fd7d1c11b13f78e8c81af08")
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.541008    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "etcd-data" (UniqueName: "kubernetes.io/host-path/400930335566057521570dcbaf3dbb0b-etcd-data") pod "etcd-minikube" (UID: "400930335566057521570dcbaf3dbb0b")
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.541027    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "usr-share-ca-certificates" (UniqueName: "kubernetes.io/host-path/e2ad1c3c6b26b508041ca8968da58d60-usr-share-ca-certificates") pod "kube-controller-manager-minikube" (UID: "e2ad1c3c6b26b508041ca8968da58d60")
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.541042    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "ca-certs" (UniqueName: "kubernetes.io/host-path/e2ad1c3c6b26b508041ca8968da58d60-ca-certs") pod "kube-controller-manager-minikube" (UID: "e2ad1c3c6b26b508041ca8968da58d60")
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.546525    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.647332    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.748058    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.848640    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.854332    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:33 minikube kubelet[3144]: I0104 14:28:33.865662    3144 kubelet_node_status.go:70] Attempting to register node minikube
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.866474    3144 kubelet_node_status.go:92] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:33 minikube kubelet[3144]: E0104 14:28:33.949001    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:34 minikube kubelet[3144]: E0104 14:28:34.049297    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:34 minikube kubelet[3144]: E0104 14:28:34.098623    3144 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:34 minikube kubelet[3144]: E0104 14:28:34.101812    3144 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/kubelet.go:442: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:34 minikube kubelet[3144]: E0104 14:28:34.104609    3144 reflector.go:134] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:34 minikube kubelet[3144]: E0104 14:28:34.150160    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:34 minikube kubelet[3144]: I0104 14:28:34.247384    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:34 minikube kubelet[3144]: E0104 14:28:34.251449    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:34 minikube kubelet[3144]: W0104 14:28:34.260026    3144 pod_container_deletor.go:75] Container "fae8150aab221dfbc909798af53ccf48a81fbb9106b0b20773b0634d18bf42ac" not found in pod's containers
Jan 04 14:28:34 minikube kubelet[3144]: I0104 14:28:34.285220    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:34 minikube kubelet[3144]: W0104 14:28:34.288418    3144 pod_container_deletor.go:75] Container "001c4a95a3b5c9dd02dc66d261b9d45a9f16745799bf180317683b932a88a699" not found in pod's containers
Jan 04 14:28:34 minikube kubelet[3144]: I0104 14:28:34.288583    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:34 minikube kubelet[3144]: W0104 14:28:34.290641    3144 pod_container_deletor.go:75] Container "370085474efd4126ff5652fbce540ce7801766619d52c15f66e884cfb12f4b50" not found in pod's containers
Jan 04 14:28:34 minikube kubelet[3144]: E0104 14:28:34.352370    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:34 minikube kubelet[3144]: E0104 14:28:34.452524    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:34 minikube kubelet[3144]: I0104 14:28:34.495269    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:34 minikube kubelet[3144]: W0104 14:28:34.522476    3144 pod_container_deletor.go:75] Container "f144ddd864b63478bd7e1eae57d7f142a6a33daf30a50f06f5e0b929702f9f86" not found in pod's containers
Jan 04 14:28:34 minikube kubelet[3144]: I0104 14:28:34.528848    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:34 minikube kubelet[3144]: W0104 14:28:34.540375    3144 status_manager.go:485] Failed to get status for pod "kube-controller-manager-minikube_kube-system(e2ad1c3c6b26b508041ca8968da58d60)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:34 minikube kubelet[3144]: E0104 14:28:34.553277    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:34 minikube kubelet[3144]: E0104 14:28:34.653460    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:34 minikube kubelet[3144]: I0104 14:28:34.667329    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:34 minikube kubelet[3144]: I0104 14:28:34.669409    3144 kubelet_node_status.go:70] Attempting to register node minikube
Jan 04 14:28:34 minikube kubelet[3144]: E0104 14:28:34.669667    3144 kubelet_node_status.go:92] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: connect: connection refused
Jan 04 14:28:34 minikube kubelet[3144]: E0104 14:28:34.753742    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:34 minikube kubelet[3144]: E0104 14:28:34.854169    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:34 minikube kubelet[3144]: E0104 14:28:34.954357    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:35 minikube kubelet[3144]: E0104 14:28:35.055047    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:35 minikube kubelet[3144]: E0104 14:28:35.155750    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:35 minikube kubelet[3144]: E0104 14:28:35.256284    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:35 minikube kubelet[3144]: E0104 14:28:35.356712    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:35 minikube kubelet[3144]: E0104 14:28:35.461379    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:35 minikube kubelet[3144]: I0104 14:28:35.538405    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:35 minikube kubelet[3144]: I0104 14:28:35.545590    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:35 minikube kubelet[3144]: I0104 14:28:35.555433    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:35 minikube kubelet[3144]: I0104 14:28:35.561333    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:35 minikube kubelet[3144]: E0104 14:28:35.561595    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:35 minikube kubelet[3144]: E0104 14:28:35.664221    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:35 minikube kubelet[3144]: E0104 14:28:35.764545    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:35 minikube kubelet[3144]: E0104 14:28:35.864759    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:35 minikube kubelet[3144]: E0104 14:28:35.965326    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:36 minikube kubelet[3144]: E0104 14:28:36.065690    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:36 minikube kubelet[3144]: E0104 14:28:36.167594    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:36 minikube kubelet[3144]: E0104 14:28:36.269357    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:36 minikube kubelet[3144]: I0104 14:28:36.270787    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:36 minikube kubelet[3144]: I0104 14:28:36.276825    3144 kubelet_node_status.go:70] Attempting to register node minikube
Jan 04 14:28:36 minikube kubelet[3144]: E0104 14:28:36.370547    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:36 minikube kubelet[3144]: E0104 14:28:36.472550    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:36 minikube kubelet[3144]: I0104 14:28:36.580533    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:36 minikube kubelet[3144]: I0104 14:28:36.580853    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:36 minikube kubelet[3144]: I0104 14:28:36.581071    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:36 minikube kubelet[3144]: E0104 14:28:36.612074    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:36 minikube kubelet[3144]: E0104 14:28:36.712733    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:36 minikube kubelet[3144]: E0104 14:28:36.812864    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:36 minikube kubelet[3144]: E0104 14:28:36.913383    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:37 minikube kubelet[3144]: E0104 14:28:37.013711    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:37 minikube kubelet[3144]: E0104 14:28:37.114132    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:37 minikube kubelet[3144]: E0104 14:28:37.214609    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:37 minikube kubelet[3144]: E0104 14:28:37.314694    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:37 minikube kubelet[3144]: E0104 14:28:37.415315    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:37 minikube kubelet[3144]: E0104 14:28:37.515512    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:37 minikube kubelet[3144]: E0104 14:28:37.616276    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:37 minikube kubelet[3144]: E0104 14:28:37.716437    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:37 minikube kubelet[3144]: E0104 14:28:37.816830    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:37 minikube kubelet[3144]: E0104 14:28:37.917325    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:38 minikube kubelet[3144]: E0104 14:28:38.022106    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:38 minikube kubelet[3144]: E0104 14:28:38.122647    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:38 minikube kubelet[3144]: E0104 14:28:38.223092    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:38 minikube kubelet[3144]: E0104 14:28:38.323803    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:38 minikube kubelet[3144]: E0104 14:28:38.424686    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:38 minikube kubelet[3144]: E0104 14:28:38.525001    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:38 minikube kubelet[3144]: I0104 14:28:38.592747    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:38 minikube kubelet[3144]: E0104 14:28:38.625514    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:38 minikube kubelet[3144]: E0104 14:28:38.727650    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:38 minikube kubelet[3144]: E0104 14:28:38.828521    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:38 minikube kubelet[3144]: E0104 14:28:38.928831    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:39 minikube kubelet[3144]: E0104 14:28:39.029279    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:39 minikube kubelet[3144]: E0104 14:28:39.130379    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:39 minikube kubelet[3144]: E0104 14:28:39.231442    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:39 minikube kubelet[3144]: E0104 14:28:39.331978    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:39 minikube kubelet[3144]: E0104 14:28:39.432227    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:39 minikube kubelet[3144]: E0104 14:28:39.532539    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:39 minikube kubelet[3144]: I0104 14:28:39.599255    3144 kubelet_node_status.go:276] Setting node annotation to enable volume controller attach/detach
Jan 04 14:28:39 minikube kubelet[3144]: E0104 14:28:39.633616    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:39 minikube kubelet[3144]: E0104 14:28:39.733888    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:39 minikube kubelet[3144]: E0104 14:28:39.835830    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:39 minikube kubelet[3144]: E0104 14:28:39.937131    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:40 minikube kubelet[3144]: E0104 14:28:40.038164    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:40 minikube kubelet[3144]: E0104 14:28:40.139812    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:40 minikube kubelet[3144]: E0104 14:28:40.241624    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:40 minikube kubelet[3144]: E0104 14:28:40.344357    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:40 minikube kubelet[3144]: E0104 14:28:40.445567    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:40 minikube kubelet[3144]: E0104 14:28:40.546044    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:40 minikube kubelet[3144]: E0104 14:28:40.646724    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:40 minikube kubelet[3144]: E0104 14:28:40.747541    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:40 minikube kubelet[3144]: E0104 14:28:40.848042    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:40 minikube kubelet[3144]: E0104 14:28:40.948399    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:41 minikube kubelet[3144]: E0104 14:28:41.050675    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:41 minikube kubelet[3144]: E0104 14:28:41.151586    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:41 minikube kubelet[3144]: E0104 14:28:41.254208    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:41 minikube kubelet[3144]: E0104 14:28:41.354936    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:41 minikube kubelet[3144]: E0104 14:28:41.455428    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:41 minikube kubelet[3144]: E0104 14:28:41.556078    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:41 minikube kubelet[3144]: E0104 14:28:41.657358    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:41 minikube kubelet[3144]: E0104 14:28:41.758040    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:41 minikube kubelet[3144]: E0104 14:28:41.858254    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:41 minikube kubelet[3144]: E0104 14:28:41.959234    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:42 minikube kubelet[3144]: E0104 14:28:42.059861    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:42 minikube kubelet[3144]: E0104 14:28:42.160552    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:42 minikube kubelet[3144]: E0104 14:28:42.262236    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:42 minikube kubelet[3144]: E0104 14:28:42.363214    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:42 minikube kubelet[3144]: E0104 14:28:42.464284    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:42 minikube kubelet[3144]: E0104 14:28:42.565468    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:42 minikube kubelet[3144]: E0104 14:28:42.666272    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:42 minikube kubelet[3144]: E0104 14:28:42.766874    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:42 minikube kubelet[3144]: E0104 14:28:42.868495    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:42 minikube kubelet[3144]: E0104 14:28:42.968697    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:43 minikube kubelet[3144]: E0104 14:28:43.070164    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:43 minikube kubelet[3144]: E0104 14:28:43.171147    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:43 minikube kubelet[3144]: E0104 14:28:43.266338    3144 eviction_manager.go:243] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found
Jan 04 14:28:43 minikube kubelet[3144]: E0104 14:28:43.271431    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:43 minikube kubelet[3144]: E0104 14:28:43.371803    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:43 minikube kubelet[3144]: E0104 14:28:43.472034    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:43 minikube kubelet[3144]: E0104 14:28:43.574027    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:43 minikube kubelet[3144]: E0104 14:28:43.674395    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:43 minikube kubelet[3144]: E0104 14:28:43.774780    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:43 minikube kubelet[3144]: E0104 14:28:43.875402    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:43 minikube kubelet[3144]: E0104 14:28:43.975630    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.075807    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:44 minikube kubelet[3144]: I0104 14:28:44.161544    3144 reconciler.go:154] Reconciler: start to sync state
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.181533    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.282385    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.343835    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85c82e5277", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"Starting", Message:"Starting kubelet.", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f944477fe877, ext:142217498, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f944477fe877, ext:142217498, loc:(*time.Location)(0x65b5120)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.382594    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.399425    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e538c", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node minikube status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ebfe98c, ext:263852593, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ebfe98c, ext:263852593, loc:(*time.Location)(0x65b5120)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.455522    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e6407", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ebffa07, ext:263856811, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ebffa07, ext:263856811, loc:(*time.Location)(0x65b5120)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.483262    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.511105    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e6e94", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ec00494, ext:263859511, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ec00494, ext:263859511, loc:(*time.Location)(0x65b5120)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.565985    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e761f", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ec00c1f, ext:263861444, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ec00c1f, ext:263861444, loc:(*time.Location)(0x65b5120)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.583740    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.627412    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e6407", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ebffa07, ext:263856811, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444f0d8edb, ext:268941183, loc:(*time.Location)(0x65b5120)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.684132    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.684460    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e538c", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node minikube status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ebfe98c, ext:263852593, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444f0d7b34, ext:268936152, loc:(*time.Location)(0x65b5120)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.739672    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e6e94", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ec00494, ext:263859511, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444f0da591, ext:268946997, loc:(*time.Location)(0x65b5120)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.785156    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.801002    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e761f", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ec00c1f, ext:263861444, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444f0db2a0, ext:268950340, loc:(*time.Location)(0x65b5120)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.885507    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:44 minikube kubelet[3144]: E0104 14:28:44.986817    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:45 minikube kubelet[3144]: E0104 14:28:44.999982    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85d0817bf4", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeAllocatableEnforced", Message:"Updated Node Allocatable limit across pods", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444fd311f4, ext:281885337, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444fd311f4, ext:281885337, loc:(*time.Location)(0x65b5120)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:45 minikube kubelet[3144]: E0104 14:28:45.087735    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:45 minikube kubelet[3144]: E0104 14:28:45.188353    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:45 minikube kubelet[3144]: E0104 14:28:45.288634    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:45 minikube kubelet[3144]: E0104 14:28:45.390131    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:45 minikube kubelet[3144]: E0104 14:28:45.401280    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e761f", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ec00c1f, ext:263861444, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9445ac165d5, ext:465276544, loc:(*time.Location)(0x65b5120)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:45 minikube kubelet[3144]: E0104 14:28:45.490962    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:45 minikube kubelet[3144]: E0104 14:28:45.592425    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:45 minikube kubelet[3144]: E0104 14:28:45.693772    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:45 minikube kubelet[3144]: E0104 14:28:45.794112    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:45 minikube kubelet[3144]: E0104 14:28:45.800144    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e538c", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node minikube status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ebfe98c, ext:263852593, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9445ac13bd2, ext:465265793, loc:(*time.Location)(0x65b5120)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:45 minikube kubelet[3144]: E0104 14:28:45.896569    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:45 minikube kubelet[3144]: E0104 14:28:45.997274    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:46 minikube kubelet[3144]: E0104 14:28:46.097612    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:46 minikube kubelet[3144]: E0104 14:28:46.199758    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:46 minikube kubelet[3144]: E0104 14:28:46.202971    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e6407", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ebffa07, ext:263856811, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9445ac14eed, ext:465270685, loc:(*time.Location)(0x65b5120)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:46 minikube kubelet[3144]: E0104 14:28:46.302841    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:46 minikube kubelet[3144]: E0104 14:28:46.404428    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:46 minikube kubelet[3144]: E0104 14:28:46.507997    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:46 minikube kubelet[3144]: E0104 14:28:46.599982    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e6e94", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ec00494, ext:263859511, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9445ac15aa9, ext:465273685, loc:(*time.Location)(0x65b5120)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:46 minikube kubelet[3144]: E0104 14:28:46.608809    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:46 minikube kubelet[3144]: E0104 14:28:46.709134    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:46 minikube kubelet[3144]: E0104 14:28:46.810247    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:46 minikube kubelet[3144]: E0104 14:28:46.910674    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:47 minikube kubelet[3144]: E0104 14:28:47.002251    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e538c", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node minikube status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ebfe98c, ext:263852593, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9445af3a16a, ext:468568591, loc:(*time.Location)(0x65b5120)}}, Count:4, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:47 minikube kubelet[3144]: E0104 14:28:47.011778    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:47 minikube kubelet[3144]: E0104 14:28:47.114103    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:47 minikube kubelet[3144]: E0104 14:28:47.214305    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:47 minikube kubelet[3144]: E0104 14:28:47.314528    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:47 minikube kubelet[3144]: E0104 14:28:47.401063    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e6407", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ebffa07, ext:263856811, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9445af3b0f7, ext:468572572, loc:(*time.Location)(0x65b5120)}}, Count:4, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:47 minikube kubelet[3144]: E0104 14:28:47.415117    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:47 minikube kubelet[3144]: E0104 14:28:47.515917    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:47 minikube kubelet[3144]: E0104 14:28:47.616344    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:47 minikube kubelet[3144]: E0104 14:28:47.716656    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:47 minikube kubelet[3144]: E0104 14:28:47.802164    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e6e94", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ec00494, ext:263859511, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9445af3ca46, ext:468579050, loc:(*time.Location)(0x65b5120)}}, Count:4, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:47 minikube kubelet[3144]: E0104 14:28:47.817320    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:47 minikube kubelet[3144]: E0104 14:28:47.917612    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:48 minikube kubelet[3144]: E0104 14:28:48.017762    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:48 minikube kubelet[3144]: E0104 14:28:48.118030    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:48 minikube kubelet[3144]: E0104 14:28:48.198854    3144 event.go:203] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1576ab85cf6e761f", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9444ec00c1f, ext:263861444, loc:(*time.Location)(0x65b5120)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbf03f9445af3d31e, ext:468581314, loc:(*time.Location)(0x65b5120)}}, Count:4, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Jan 04 14:28:48 minikube kubelet[3144]: E0104 14:28:48.218636    3144 kubelet.go:2236] node "minikube" not found
Jan 04 14:28:48 minikube kubelet[3144]: I0104 14:28:48.311616    3144 kubelet_node_status.go:73] Successfully registered node minikube
Jan 04 14:29:02 minikube kubelet[3144]: I0104 14:29:02.186749    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "xtables-lock" (UniqueName: "kubernetes.io/host-path/14d1438b-102d-11e9-a654-080027a182b3-xtables-lock") pod "kube-proxy-2hf8p" (UID: "14d1438b-102d-11e9-a654-080027a182b3")
Jan 04 14:29:02 minikube kubelet[3144]: I0104 14:29:02.187167    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "config-volume" (UniqueName: "kubernetes.io/configmap/14d2269f-102d-11e9-a654-080027a182b3-config-volume") pod "coredns-576cbf47c7-zk77v" (UID: "14d2269f-102d-11e9-a654-080027a182b3")
Jan 04 14:29:02 minikube kubelet[3144]: I0104 14:29:02.187239    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "coredns-token-vspsj" (UniqueName: "kubernetes.io/secret/14d2269f-102d-11e9-a654-080027a182b3-coredns-token-vspsj") pod "coredns-576cbf47c7-zk77v" (UID: "14d2269f-102d-11e9-a654-080027a182b3")
Jan 04 14:29:02 minikube kubelet[3144]: I0104 14:29:02.187285    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-proxy" (UniqueName: "kubernetes.io/configmap/14d1438b-102d-11e9-a654-080027a182b3-kube-proxy") pod "kube-proxy-2hf8p" (UID: "14d1438b-102d-11e9-a654-080027a182b3")
Jan 04 14:29:02 minikube kubelet[3144]: I0104 14:29:02.187327    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "lib-modules" (UniqueName: "kubernetes.io/host-path/14d1438b-102d-11e9-a654-080027a182b3-lib-modules") pod "kube-proxy-2hf8p" (UID: "14d1438b-102d-11e9-a654-080027a182b3")
Jan 04 14:29:02 minikube kubelet[3144]: I0104 14:29:02.187369    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "kube-proxy-token-znfjc" (UniqueName: "kubernetes.io/secret/14d1438b-102d-11e9-a654-080027a182b3-kube-proxy-token-znfjc") pod "kube-proxy-2hf8p" (UID: "14d1438b-102d-11e9-a654-080027a182b3")
Jan 04 14:29:02 minikube kubelet[3144]: I0104 14:29:02.187465    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "config-volume" (UniqueName: "kubernetes.io/configmap/14d7dd50-102d-11e9-a654-080027a182b3-config-volume") pod "coredns-576cbf47c7-wj29g" (UID: "14d7dd50-102d-11e9-a654-080027a182b3")
Jan 04 14:29:02 minikube kubelet[3144]: I0104 14:29:02.187592    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "coredns-token-vspsj" (UniqueName: "kubernetes.io/secret/14d7dd50-102d-11e9-a654-080027a182b3-coredns-token-vspsj") pod "coredns-576cbf47c7-wj29g" (UID: "14d7dd50-102d-11e9-a654-080027a182b3")
Jan 04 14:29:02 minikube kubelet[3144]: W0104 14:29:02.817639    3144 pod_container_deletor.go:75] Container "2e07eafecde583b7c981c3caf71167be0a946dd6359f4d503864da6345e88a90" not found in pod's containers
Jan 04 14:29:02 minikube kubelet[3144]: W0104 14:29:02.999597    3144 pod_container_deletor.go:75] Container "550c7624ddfb096b9fd3145d3ebf36c33bed5faff8403922074e100108ba04c7" not found in pod's containers
Jan 04 14:29:03 minikube kubelet[3144]: W0104 14:29:03.172100    3144 pod_container_deletor.go:75] Container "132be6c233bb95a9718b2b76c5366c01ffeb785502338b8df175da9ff3c04968" not found in pod's containers
Jan 04 14:29:03 minikube kubelet[3144]: E0104 14:29:03.512107    3144 reflector.go:134] object-"kube-system"/"default-token-g4bgw": Failed to list *v1.Secret: secrets "default-token-g4bgw" is forbidden: User "system:node:minikube" cannot list resource "secrets" in API group "" in the namespace "kube-system"
Jan 04 14:29:03 minikube kubelet[3144]: I0104 14:29:03.598815    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "default-token-g4bgw" (UniqueName: "kubernetes.io/secret/15ad1015-102d-11e9-a654-080027a182b3-default-token-g4bgw") pod "kubernetes-dashboard-5bff5f8fb8-smqgt" (UID: "15ad1015-102d-11e9-a654-080027a182b3")
Jan 04 14:29:04 minikube kubelet[3144]: E0104 14:29:04.559136    3144 reflector.go:134] object-"kube-system"/"storage-provisioner-token-2fkwg": Failed to list *v1.Secret: secrets "storage-provisioner-token-2fkwg" is forbidden: User "system:node:minikube" cannot list resource "secrets" in API group "" in the namespace "kube-system"
Jan 04 14:29:04 minikube kubelet[3144]: I0104 14:29:04.605627    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "storage-provisioner-token-2fkwg" (UniqueName: "kubernetes.io/secret/16511367-102d-11e9-a654-080027a182b3-storage-provisioner-token-2fkwg") pod "storage-provisioner" (UID: "16511367-102d-11e9-a654-080027a182b3")
Jan 04 14:29:04 minikube kubelet[3144]: I0104 14:29:04.605814    3144 reconciler.go:207] operationExecutor.VerifyControllerAttachedVolume started for volume "tmp" (UniqueName: "kubernetes.io/host-path/16511367-102d-11e9-a654-080027a182b3-tmp") pod "storage-provisioner" (UID: "16511367-102d-11e9-a654-080027a182b3")
Jan 04 14:29:11 minikube kubelet[3144]: E0104 14:29:11.263520    3144 pod_workers.go:186] Error syncing pod 15ad1015-102d-11e9-a654-080027a182b3 ("kubernetes-dashboard-5bff5f8fb8-smqgt_kube-system(15ad1015-102d-11e9-a654-080027a182b3)"), skipping: failed to "StartContainer" for "kubernetes-dashboard" with CrashLoopBackOff: "Back-off 10s restarting failed container=kubernetes-dashboard pod=kubernetes-dashboard-5bff5f8fb8-smqgt_kube-system(15ad1015-102d-11e9-a654-080027a182b3)"
Jan 04 14:29:12 minikube kubelet[3144]: E0104 14:29:12.275685    3144 pod_workers.go:186] Error syncing pod 15ad1015-102d-11e9-a654-080027a182b3 ("kubernetes-dashboard-5bff5f8fb8-smqgt_kube-system(15ad1015-102d-11e9-a654-080027a182b3)"), skipping: failed to "StartContainer" for "kubernetes-dashboard" with CrashLoopBackOff: "Back-off 10s restarting failed container=kubernetes-dashboard pod=kubernetes-dashboard-5bff5f8fb8-smqgt_kube-system(15ad1015-102d-11e9-a654-080027a182b3)"
Jan 04 14:29:19 minikube kubelet[3144]: E0104 14:29:19.900127    3144 pod_workers.go:186] Error syncing pod 15ad1015-102d-11e9-a654-080027a182b3 ("kubernetes-dashboard-5bff5f8fb8-smqgt_kube-system(15ad1015-102d-11e9-a654-080027a182b3)"), skipping: failed to "StartContainer" for "kubernetes-dashboard" with CrashLoopBackOff: "Back-off 10s restarting failed container=kubernetes-dashboard pod=kubernetes-dashboard-5bff5f8fb8-smqgt_kube-system(15ad1015-102d-11e9-a654-080027a182b3)"
Jan 04 14:29:34 minikube kubelet[3144]: E0104 14:29:34.491840    3144 pod_workers.go:186] Error syncing pod 15ad1015-102d-11e9-a654-080027a182b3 ("kubernetes-dashboard-5bff5f8fb8-smqgt_kube-system(15ad1015-102d-11e9-a654-080027a182b3)"), skipping: failed to "StartContainer" for "kubernetes-dashboard" with CrashLoopBackOff: "Back-off 20s restarting failed container=kubernetes-dashboard pod=kubernetes-dashboard-5bff5f8fb8-smqgt_kube-system(15ad1015-102d-11e9-a654-080027a182b3)"
Jan 04 14:29:39 minikube kubelet[3144]: E0104 14:29:39.898967    3144 pod_workers.go:186] Error syncing pod 15ad1015-102d-11e9-a654-080027a182b3 ("kubernetes-dashboard-5bff5f8fb8-smqgt_kube-system(15ad1015-102d-11e9-a654-080027a182b3)"), skipping: failed to "StartContainer" for "kubernetes-dashboard" with CrashLoopBackOff: "Back-off 20s restarting failed container=kubernetes-dashboard pod=kubernetes-dashboard-5bff5f8fb8-smqgt_kube-system(15ad1015-102d-11e9-a654-080027a182b3)"

Anything else do we need to know:
If I can provide more information, let me know.

@viveks4grps
Copy link

I am also facing the same issue.
I have tried minikube stop;minikube delete; and then minikube start
It does not help
I have also uninstalled minikube. Still no help

@TheKangaroo
Copy link
Author

I tried the same steps like @viveks4grps, I even reinstalled virtualbox.. Still no luck.

@pupca
Copy link

pupca commented Jan 5, 2019

+1

@TheKangaroo
Copy link
Author

Any tips on how to debug this?
I have no clue what to try next.
I had a look at the logs of the kubernetes components inside the vm and everything looked fine.
I suspect any issue with the connection from the mac (kubectl) to the apiserver inside the vm.

@wstrange
Copy link

wstrange commented Jan 7, 2019

Not sure If I am seeing the same issue - but dns resolution on the minikube guest fails. The nameserver seems to be incorrect, or perhaps virtualbox 6.x has some kind of dns / host network issue.

@mikesplain
Copy link

I ran into the same issue as above, I went through deleting the VM, removing ~/.minikube and such as well.

The fix was to remove the virtualbox network and have minikube/virtualbox create a new one on boot.

@TheKangaroo
Copy link
Author

Hi @mikesplain, can you tell more detailed what you did?
I run:

# minikube delete
# rm -rf ~/.minikube

then deleted the network vboxnet0 from the virtual box gui, rebooted my mac and run:

# minikube start 
Starting local Kubernetes v1.12.4 cluster...
Starting VM...
Downloading Minikube ISO
 178.88 MB / 178.88 MB [============================================] 100.00% 0s
Getting VM IP address...
Moving files into cluster...
Downloading kubelet v1.12.4
Downloading kubeadm v1.12.4
Finished Downloading kubeadm v1.12.4
Finished Downloading kubelet v1.12.4
Setting up certs...
Connecting to cluster...
Setting up kubeconfig...
Stopping extra container runtimes...
Starting cluster components...

there it still got stuck. The logs show a diffrent error though:

-- Logs begin at Tue 2019-01-15 09:16:36 UTC, end at Tue 2019-01-15 09:23:19 UTC. --
Jan 15 09:22:14 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Jan 15 09:22:14 minikube kubelet[2703]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:14 minikube kubelet[2703]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:14 minikube kubelet[2703]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:14 minikube kubelet[2703]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:14 minikube kubelet[2703]: Flag --allow-privileged has been deprecated, will be removed in a future version
Jan 15 09:22:14 minikube kubelet[2703]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:14 minikube kubelet[2703]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:14 minikube kubelet[2703]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:14 minikube kubelet[2703]: F0115 09:22:14.561033    2703 server.go:245] unable to load client CA file /var/lib/minikube/certs/ca.crt: open /var/lib/minikube/certs/ca.crt: no such file or directory
Jan 15 09:22:14 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Jan 15 09:22:14 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Jan 15 09:22:24 minikube systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Jan 15 09:22:24 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 1.
Jan 15 09:22:24 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Jan 15 09:22:24 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Jan 15 09:22:24 minikube kubelet[2845]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:24 minikube kubelet[2845]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:24 minikube kubelet[2845]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:24 minikube kubelet[2845]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:24 minikube kubelet[2845]: Flag --allow-privileged has been deprecated, will be removed in a future version
Jan 15 09:22:24 minikube kubelet[2845]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:24 minikube kubelet[2845]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:24 minikube kubelet[2845]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:24 minikube kubelet[2845]: I0115 09:22:24.681816    2845 server.go:408] Version: v1.12.4
Jan 15 09:22:24 minikube kubelet[2845]: I0115 09:22:24.682031    2845 plugins.go:99] No cloud provider specified.
Jan 15 09:22:24 minikube kubelet[2845]: F0115 09:22:24.682103    2845 server.go:262] failed to run Kubelet: unable to load bootstrap kubeconfig: stat /etc/kubernetes/bootstrap-kubelet.conf: no such file or directory
Jan 15 09:22:24 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Jan 15 09:22:24 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Jan 15 09:22:34 minikube systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Jan 15 09:22:34 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 2.
Jan 15 09:22:34 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Jan 15 09:22:34 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Jan 15 09:22:34 minikube kubelet[2861]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:34 minikube kubelet[2861]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:34 minikube kubelet[2861]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:34 minikube kubelet[2861]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:34 minikube kubelet[2861]: Flag --allow-privileged has been deprecated, will be removed in a future version
Jan 15 09:22:34 minikube kubelet[2861]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:34 minikube kubelet[2861]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:34 minikube kubelet[2861]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:34 minikube kubelet[2861]: I0115 09:22:34.928110    2861 server.go:408] Version: v1.12.4
Jan 15 09:22:34 minikube kubelet[2861]: I0115 09:22:34.928373    2861 plugins.go:99] No cloud provider specified.
Jan 15 09:22:34 minikube kubelet[2861]: F0115 09:22:34.928447    2861 server.go:262] failed to run Kubelet: unable to load bootstrap kubeconfig: stat /etc/kubernetes/bootstrap-kubelet.conf: no such file or directory
Jan 15 09:22:34 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Jan 15 09:22:34 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Jan 15 09:22:45 minikube systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Jan 15 09:22:45 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 3.
Jan 15 09:22:45 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Jan 15 09:22:45 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Jan 15 09:22:45 minikube kubelet[2883]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:45 minikube kubelet[2883]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:45 minikube kubelet[2883]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:45 minikube kubelet[2883]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:45 minikube kubelet[2883]: Flag --allow-privileged has been deprecated, will be removed in a future version
Jan 15 09:22:45 minikube kubelet[2883]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:45 minikube kubelet[2883]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:45 minikube kubelet[2883]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:45 minikube kubelet[2883]: I0115 09:22:45.174747    2883 server.go:408] Version: v1.12.4
Jan 15 09:22:45 minikube kubelet[2883]: I0115 09:22:45.175121    2883 plugins.go:99] No cloud provider specified.
Jan 15 09:22:45 minikube kubelet[2883]: F0115 09:22:45.175184    2883 server.go:262] failed to run Kubelet: unable to load bootstrap kubeconfig: stat /etc/kubernetes/bootstrap-kubelet.conf: no such file or directory
Jan 15 09:22:45 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Jan 15 09:22:45 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Jan 15 09:22:55 minikube systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Jan 15 09:22:55 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 4.
Jan 15 09:22:55 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Jan 15 09:22:55 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Jan 15 09:22:55 minikube kubelet[2923]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:55 minikube kubelet[2923]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:55 minikube kubelet[2923]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:55 minikube kubelet[2923]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:55 minikube kubelet[2923]: Flag --allow-privileged has been deprecated, will be removed in a future version
Jan 15 09:22:55 minikube kubelet[2923]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:55 minikube kubelet[2923]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:55 minikube kubelet[2923]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:22:55 minikube kubelet[2923]: I0115 09:22:55.416152    2923 server.go:408] Version: v1.12.4
Jan 15 09:22:55 minikube kubelet[2923]: I0115 09:22:55.416326    2923 plugins.go:99] No cloud provider specified.
Jan 15 09:22:55 minikube kubelet[2923]: F0115 09:22:55.416361    2923 server.go:262] failed to run Kubelet: unable to load bootstrap kubeconfig: stat /etc/kubernetes/bootstrap-kubelet.conf: no such file or directory
Jan 15 09:22:55 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Jan 15 09:22:55 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Jan 15 09:23:05 minikube systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Jan 15 09:23:05 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 5.
Jan 15 09:23:05 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Jan 15 09:23:05 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Jan 15 09:23:05 minikube kubelet[2935]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:23:05 minikube kubelet[2935]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:23:05 minikube kubelet[2935]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:23:05 minikube kubelet[2935]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:23:05 minikube kubelet[2935]: Flag --allow-privileged has been deprecated, will be removed in a future version
Jan 15 09:23:05 minikube kubelet[2935]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:23:05 minikube kubelet[2935]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:23:05 minikube kubelet[2935]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:23:05 minikube kubelet[2935]: I0115 09:23:05.679734    2935 server.go:408] Version: v1.12.4
Jan 15 09:23:05 minikube kubelet[2935]: I0115 09:23:05.679950    2935 plugins.go:99] No cloud provider specified.
Jan 15 09:23:05 minikube kubelet[2935]: F0115 09:23:05.679984    2935 server.go:262] failed to run Kubelet: unable to load bootstrap kubeconfig: stat /etc/kubernetes/bootstrap-kubelet.conf: no such file or directory
Jan 15 09:23:05 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Jan 15 09:23:05 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.
Jan 15 09:23:15 minikube systemd[1]: kubelet.service: Service hold-off time over, scheduling restart.
Jan 15 09:23:15 minikube systemd[1]: kubelet.service: Scheduled restart job, restart counter is at 6.
Jan 15 09:23:15 minikube systemd[1]: Stopped kubelet: The Kubernetes Node Agent.
Jan 15 09:23:15 minikube systemd[1]: Started kubelet: The Kubernetes Node Agent.
Jan 15 09:23:15 minikube kubelet[2947]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:23:15 minikube kubelet[2947]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:23:15 minikube kubelet[2947]: Flag --fail-swap-on has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:23:15 minikube kubelet[2947]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:23:15 minikube kubelet[2947]: Flag --allow-privileged has been deprecated, will be removed in a future version
Jan 15 09:23:15 minikube kubelet[2947]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:23:15 minikube kubelet[2947]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:23:15 minikube kubelet[2947]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jan 15 09:23:15 minikube kubelet[2947]: I0115 09:23:15.941447    2947 server.go:408] Version: v1.12.4
Jan 15 09:23:15 minikube kubelet[2947]: I0115 09:23:15.941679    2947 plugins.go:99] No cloud provider specified.
Jan 15 09:23:15 minikube kubelet[2947]: F0115 09:23:15.941814    2947 server.go:262] failed to run Kubelet: unable to load bootstrap kubeconfig: stat /etc/kubernetes/bootstrap-kubelet.conf: no such file or directory
Jan 15 09:23:15 minikube systemd[1]: kubelet.service: Main process exited, code=exited, status=255/n/a
Jan 15 09:23:15 minikube systemd[1]: kubelet.service: Failed with result 'exit-code'.

@douglascamata
Copy link

Personal tip: disconnect to any VPN you might be connected to. Depending on the VPN client, you might even need to completely close it (this was the case with Cisco AnyConnect for me).

@mikesplain
Copy link

@TheKangaroo my solution involved actually deleting the network in virtualbox as well (as seen in this photo).
screen shot 2019-01-15 at 9 27 29 am
Also, as @douglascamata mentioned, dropping from a vpn made a big difference for me too. I did this before deleting the above network and things started working.

@TheKangaroo
Copy link
Author

okay, @mikesplain, I did the same thing but it didn't help.
I already disconnected my AnyConnect client, but actually close AnyConnect did the trick for me @douglascamata. I have no clue why though.
It would be great to make it work with an active AnyConnect VPN connection.

@viveks4grps
Copy link

I think @mikesplain, you are spot on. I rebooted my Mac Book too, and then everything started working.
The problem started when I was on VPN. Thanks a lot.

@TheKangaroo
Copy link
Author

Correct, when I reboot my mac, the following happens:

reboot:                       minikube works as expected
stating AnyConnect:           minikube works as expected
connecting AnyConnect VPN:    minikube stops working
disconnecting AnyConnect VPN: minikube still doesn't work
quitting AnyConnect:          minikube still doesn't work

So I guess AnyConnect configures something when connecting to a VPN, but does not properly reset it after disconnecting. A reboot of the system resets it.

@douglascamata
Copy link

@TheKangaroo that might be the DNS cache. Try running sudo killall -HUP mDNSResponder after closing AnyConnect.

@tstromberg tstromberg changed the title minikube on MacOS/virtualbox got stuck on "Starting cluster components..." MacOS/virtualbox w/ VPN: stuck on "Starting cluster components..." Jan 20, 2019
@tstromberg tstromberg added area/networking networking issues cause/firewall-or-proxy When firewalls or proxies seem to be interfering cause/poor-internet Failed due to internet access issues labels Jan 20, 2019
@TheKangaroo
Copy link
Author

flushing the dns cache after disconnecting from AnyConnect didn't solve the issue for me

@clarkml
Copy link

clarkml commented Jan 22, 2019

I have the same issue but this is on version 1.13.2. I have done everything mentioned in this thread but am curious if anyone has any other suggestions. I have my log below and man it's full of, well, errors.

Thx much

minikub_cluster_no_start.txt

@tstromberg
Copy link
Contributor

Related: #3145

@tstromberg tstromberg added priority/backlog Higher priority than priority/awaiting-more-evidence. help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. labels Jan 24, 2019
@GregSilverman
Copy link

GregSilverman commented Jan 30, 2019

@douglascamata Thanks for suggestion regarding Cisco AnyConnect. I would NEVER have thought having it open without a VPN connection would cause this issue, but alas...

@fejta-bot
Copy link

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

@k8s-ci-robot k8s-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label Apr 30, 2019
@tstromberg tstromberg added the triage/obsolete Bugs that no longer occur in the latest stable release label Apr 30, 2019
@kripashetty
Copy link

@douglascamata Thanks so much ! Killing the Cisco Any Connect App worked for me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/networking networking issues cause/firewall-or-proxy When firewalls or proxies seem to be interfering cause/poor-internet Failed due to internet access issues help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. priority/backlog Higher priority than priority/awaiting-more-evidence. triage/obsolete Bugs that no longer occur in the latest stable release
Projects
None yet
Development

No branches or pull requests