Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v1.4 hyperv: Unable to start VM: start: exit status 1 #5450

Closed
blueelvis opened this issue Sep 24, 2019 · 6 comments
Closed

v1.4 hyperv: Unable to start VM: start: exit status 1 #5450

blueelvis opened this issue Sep 24, 2019 · 6 comments
Labels
co/hyperv HyperV related issues kind/support Categorizes issue or PR as a support question. os/windows triage/duplicate Indicates an issue is a duplicate of other open issue. triage/needs-information Indicates an issue needs more information in order to work on it.

Comments

@blueelvis
Copy link
Contributor

The exact command to reproduce the issue: minikube start --vm-driver=hyperv --hyperv-virtual-switch "Default Switch" --alsologtostderr --v=9

The full output of the command that failed:


W0925 01:03:30.919904 14864 root.go:239] Error reading config file at C:\Users\bluee.minikube\config\config.json: open C:\Users\bluee.minikube\config\config.json: The system cannot find the file specified.
I0925 01:03:30.922908 14864 notify.go:125] Checking for updates...
I0925 01:03:31.304066 14864 start.go:236] hostinfo: {"hostname":"DESKTOP-8TI9P3N","uptime":559976,"bootTime":1568793635,"procs":250,"os":"windows","platform":"Microsoft Windows 10 Pro","platformFamily":"Standalone Workstation","platformVersion":"10.0.18362 Build 18362","kernelVersion":"","virtualizationSystem":"","virtualizationRole":"","hostid":"8883d892-2190-4ee8-a441-ed4ad61874a6"}
W0925 01:03:31.305025 14864 start.go:244] gopshost.Virtualization returned error: not implemented yet

  • minikube v1.4.0 on Microsoft Windows 10 Pro 10.0.18362 Build 18362
    • KUBECONFIG=C:\Users\bluee.kube
      I0925 01:03:31.314022 14864 downloader.go:59] Not caching ISO, using https://storage.googleapis.com/minikube/iso/minikube-v1.4.0.iso
      I0925 01:03:31.315016 14864 profile.go:66] Saving config to C:\Users\bluee.minikube\profiles\minikube\config.json ...
      I0925 01:03:31.315016 14864 cache_images.go:150] windows sanitize: C:\Users\bluee.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner:v1.8.1 -> C:\Users\bluee.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1
      I0925 01:03:31.315016 14864 cache_images.go:150] windows sanitize: C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64:1.14.13 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13
      I0925 01:03:31.322026 14864 cache_images.go:295] CacheImage: k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13
      I0925 01:03:31.315016 14864 cache_images.go:150] windows sanitize: C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64:1.14.13 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13
      I0925 01:03:31.315016 14864 cache_images.go:150] windows sanitize: C:\Users\bluee.minikube\cache\images\k8s.gcr.io\etcd:3.3.15-0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0
      I0925 01:03:31.315016 14864 cache_images.go:150] windows sanitize: C:\Users\bluee.minikube\cache\images\k8s.gcr.io\coredns:1.6.2 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\coredns_1.6.2
      I0925 01:03:31.315016 14864 cache_images.go:150] windows sanitize: C:\Users\bluee.minikube\cache\images\kubernetesui\dashboard:v2.0.0-beta4 -> C:\Users\bluee.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4
      I0925 01:03:31.315016 14864 cache_images.go:150] windows sanitize: C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-addon-manager:v9.0.2 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2
      I0925 01:03:31.315016 14864 cache_images.go:150] windows sanitize: C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-controller-manager:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0
      I0925 01:03:31.315016 14864 cache_images.go:150] windows sanitize: C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-proxy:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0
      I0925 01:03:31.315016 14864 cache_images.go:150] windows sanitize: C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-scheduler:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0
      I0925 01:03:31.315016 14864 cache_images.go:150] windows sanitize: C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-apiserver:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0
      I0925 01:03:31.315016 14864 cache_images.go:150] windows sanitize: C:\Users\bluee.minikube\cache\images\k8s.gcr.io\pause:3.1 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\pause_3.1
      I0925 01:03:31.315016 14864 cache_images.go:150] windows sanitize: C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64:1.14.13 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13
      I0925 01:03:31.316017 14864 lock.go:41] attempting to write to file "C:\Users\bluee\.minikube\profiles\minikube\config.json.tmp250472135" with filemode -rw-------
      I0925 01:03:31.317016 14864 cache_images.go:295] CacheImage: gcr.io/k8s-minikube/storage-provisioner:v1.8.1 -> C:\Users\bluee.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1
      I0925 01:03:31.324040 14864 cache_images.go:295] CacheImage: k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13
      I0925 01:03:31.325011 14864 cache_images.go:295] CacheImage: k8s.gcr.io/etcd:3.3.15-0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0
      I0925 01:03:31.327043 14864 cache_images.go:295] CacheImage: k8s.gcr.io/coredns:1.6.2 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\coredns_1.6.2
      I0925 01:03:31.329011 14864 cache_images.go:295] CacheImage: kubernetesui/dashboard:v2.0.0-beta4 -> C:\Users\bluee.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4
      I0925 01:03:31.333010 14864 cache_images.go:295] CacheImage: k8s.gcr.io/kube-addon-manager:v9.0.2 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2
      I0925 01:03:31.333010 14864 cache_images.go:295] CacheImage: k8s.gcr.io/kube-controller-manager:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0
      I0925 01:03:31.334043 14864 cache_images.go:295] CacheImage: k8s.gcr.io/kube-proxy:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0
      I0925 01:03:31.334043 14864 cache_images.go:295] CacheImage: k8s.gcr.io/kube-scheduler:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0
      I0925 01:03:31.335013 14864 cache_images.go:295] CacheImage: k8s.gcr.io/kube-apiserver:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0
      I0925 01:03:31.335013 14864 cache_images.go:295] CacheImage: k8s.gcr.io/pause:3.1 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\pause_3.1
      I0925 01:03:31.336009 14864 cache_images.go:295] CacheImage: k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13
      I0925 01:03:31.342012 14864 cache_images.go:301] C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13 exists
      I0925 01:03:31.343010 14864 cluster.go:98] Skipping create...Using existing machine configuration
      I0925 01:03:31.346010 14864 cache_images.go:301] C:\Users\bluee.minikube\cache\images\k8s.gcr.io\coredns_1.6.2 exists
      I0925 01:03:31.347010 14864 cache_images.go:301] C:\Users\bluee.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4 exists
      I0925 01:03:31.357010 14864 cache_images.go:301] C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0 exists
      I0925 01:03:31.358011 14864 cache_images.go:301] C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0 exists
      I0925 01:03:31.372010 14864 cache_images.go:301] C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0 exists
      I0925 01:03:31.380012 14864 cache_images.go:301] C:\Users\bluee.minikube\cache\images\k8s.gcr.io\pause_3.1 exists
      I0925 01:03:31.382011 14864 cache_images.go:301] C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13 exists
      I0925 01:03:31.385011 14864 cache_images.go:297] CacheImage: k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13 completed in 60.9717ms
      I0925 01:03:31.396008 14864 cache_images.go:297] CacheImage: k8s.gcr.io/coredns:1.6.2 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\coredns_1.6.2 completed in 68.9658ms
      I0925 01:03:31.402009 14864 cache_images.go:297] CacheImage: kubernetesui/dashboard:v2.0.0-beta4 -> C:\Users\bluee.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4 completed in 72.9981ms
      I0925 01:03:31.404012 14864 cache_images.go:297] CacheImage: k8s.gcr.io/kube-controller-manager:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0 completed in 71.0022ms
      I0925 01:03:31.411011 14864 cache_images.go:297] CacheImage: k8s.gcr.io/kube-proxy:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0 completed in 76.9677ms
      I0925 01:03:31.412012 14864 cache_images.go:297] CacheImage: k8s.gcr.io/kube-scheduler:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0 completed in 77.9692ms
      I0925 01:03:31.414010 14864 cache_images.go:297] CacheImage: k8s.gcr.io/pause:3.1 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\pause_3.1 completed in 78.9971ms
      I0925 01:03:31.420010 14864 cache_images.go:297] CacheImage: k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13 completed in 84.0001ms
      I0925 01:03:31.422012 14864 cache_images.go:82] CacheImage k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13 succeeded
      I0925 01:03:31.423015 14864 cache_images.go:82] CacheImage k8s.gcr.io/coredns:1.6.2 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\coredns_1.6.2 succeeded
      I0925 01:03:31.424010 14864 cache_images.go:82] CacheImage kubernetesui/dashboard:v2.0.0-beta4 -> C:\Users\bluee.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4 succeeded
      I0925 01:03:31.427010 14864 cache_images.go:82] CacheImage k8s.gcr.io/kube-controller-manager:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0 succeeded
      I0925 01:03:31.433011 14864 cache_images.go:82] CacheImage k8s.gcr.io/kube-proxy:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0 succeeded
      I0925 01:03:31.434012 14864 cache_images.go:82] CacheImage k8s.gcr.io/kube-scheduler:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0 succeeded
      I0925 01:03:31.435010 14864 cache_images.go:82] CacheImage k8s.gcr.io/pause:3.1 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\pause_3.1 succeeded
      I0925 01:03:31.438010 14864 cache_images.go:82] CacheImage k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13 succeeded
  • Tip: Use 'minikube start -p ' to create a new cluster, or 'minikube delete' to delete this one.
    I0925 01:03:31.589009 14864 cache_images.go:350] retrieving image: k8s.gcr.io/kube-addon-manager:v9.0.2
    I0925 01:03:31.590009 14864 cache_images.go:350] retrieving image: k8s.gcr.io/kube-apiserver:v1.16.0
    I0925 01:03:31.592009 14864 cache_images.go:350] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v1.8.1
    I0925 01:03:31.602012 14864 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist
    I0925 01:03:31.603011 14864 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist
    I0925 01:03:31.610011 14864 cache_images.go:350] retrieving image: k8s.gcr.io/etcd:3.3.15-0
    I0925 01:03:31.610011 14864 cache_images.go:350] retrieving image: k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13
    I0925 01:03:31.618008 14864 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist
    I0925 01:03:31.625010 14864 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist
    I0925 01:03:31.629008 14864 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist
    W0925 01:03:31.914011 14864 cache_images.go:361] failed authn download for k8s.gcr.io/kube-apiserver:v1.16.0 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Akube-apiserver%3Apull&service=k8s.gcr.io: exit status 1
    W0925 01:03:31.916011 14864 cache_images.go:361] failed authn download for k8s.gcr.io/etcd:3.3.15-0 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Aetcd%3Apull&service=k8s.gcr.io: exit status 1
    W0925 01:03:31.916011 14864 cache_images.go:361] failed authn download for k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Ak8s-dns-dnsmasq-nanny-amd64%3Apull&service=k8s.gcr.io: exit status 1
    W0925 01:03:31.928010 14864 cache_images.go:361] failed authn download for gcr.io/k8s-minikube/storage-provisioner:v1.8.1 (trying anon): Get https://gcr.io/v2/token?scope=repository%3Ak8s-minikube%2Fstorage-provisioner%3Apull&service=gcr.io: exit status 1
    W0925 01:03:31.929010 14864 cache_images.go:361] failed authn download for k8s.gcr.io/kube-addon-manager:v9.0.2 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Akube-addon-manager%3Apull&service=k8s.gcr.io: exit status 1
    I0925 01:03:32.064011 14864 cache_images.go:324] OPENING: \?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0
    I0925 01:03:32.066010 14864 cache_images.go:324] OPENING: \?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13
    I0925 01:03:32.070010 14864 cache_images.go:324] OPENING: \?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0
    I0925 01:03:32.077011 14864 cache_images.go:324] OPENING: \?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1
    I0925 01:03:32.080010 14864 cache_images.go:324] OPENING: \?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2
    I0925 01:03:32.821038 14864 cluster.go:110] Machine state:
  • Starting existing hyperv VM for "minikube" ...
  • Retriable failure: start: exit status 1
    I0925 01:03:33.977045 14864 cluster.go:234] host is in state
  • Deleting "minikube" in hyperv ...
    W0925 01:03:35.141235 14864 start.go:876] DeleteHost: host remove: exit status 1
    I0925 01:03:40.665203 14864 cluster.go:98] Skipping create...Using existing machine configuration
  • Tip: Use 'minikube start -p ' to create a new cluster, or 'minikube delete' to delete this one.
    I0925 01:03:41.258618 14864 cluster.go:110] Machine state:
  • Starting existing hyperv VM for "minikube" ...
    I0925 01:03:41.415621 14864 cache_images.go:345] C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13 exists
    I0925 01:03:41.415621 14864 cache_images.go:297] CacheImage: k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13 completed in 10.0935951s
    I0925 01:03:41.417634 14864 cache_images.go:82] CacheImage k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13 succeeded
  • Retriable failure: start: exit status 1
    I0925 01:03:42.433487 14864 cluster.go:234] host is in state
  • Deleting "minikube" in hyperv ...
    W0925 01:03:43.594604 14864 start.go:876] DeleteHost: host remove: exit status 1
    I0925 01:03:44.054396 14864 cache_images.go:345] C:\Users\bluee.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1 exists
    I0925 01:03:44.054396 14864 cache_images.go:297] CacheImage: gcr.io/k8s-minikube/storage-provisioner:v1.8.1 -> C:\Users\bluee.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1 completed in 12.7373802s
    I0925 01:03:44.057467 14864 cache_images.go:82] CacheImage gcr.io/k8s-minikube/storage-provisioner:v1.8.1 -> C:\Users\bluee.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1 succeeded
    I0925 01:03:54.400363 14864 cluster.go:98] Skipping create...Using existing machine configuration
  • Tip: Use 'minikube start -p ' to create a new cluster, or 'minikube delete' to delete this one.
    I0925 01:03:55.017088 14864 cluster.go:110] Machine state:
  • Starting existing hyperv VM for "minikube" ...
  • Retriable failure: start: exit status 1
    I0925 01:03:56.202092 14864 cluster.go:234] host is in state
  • Deleting "minikube" in hyperv ...
    I0925 01:03:57.000088 14864 cache_images.go:345] C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0 exists
    I0925 01:03:57.000088 14864 cache_images.go:297] CacheImage: k8s.gcr.io/kube-apiserver:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0 completed in 25.6650759s
    I0925 01:03:57.001087 14864 cache_images.go:82] CacheImage k8s.gcr.io/kube-apiserver:v1.16.0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0 succeeded
    W0925 01:03:57.387086 14864 start.go:876] DeleteHost: host remove: exit status 1
    I0925 01:04:06.834268 14864 cache_images.go:345] C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2 exists
    I0925 01:04:06.835235 14864 cache_images.go:297] CacheImage: k8s.gcr.io/kube-addon-manager:v9.0.2 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2 completed in 35.5022258s
    I0925 01:04:06.836241 14864 cache_images.go:82] CacheImage k8s.gcr.io/kube-addon-manager:v9.0.2 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2 succeeded
    I0925 01:04:09.498659 14864 cache_images.go:345] C:\Users\bluee.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0 exists
    I0925 01:04:09.498659 14864 cache_images.go:297] CacheImage: k8s.gcr.io/etcd:3.3.15-0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0 completed in 38.1736482s
    I0925 01:04:09.500658 14864 cache_images.go:82] CacheImage k8s.gcr.io/etcd:3.3.15-0 -> C:\Users\bluee.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0 succeeded
    I0925 01:04:09.502656 14864 cache_images.go:89] Successfully cached all images.
    I0925 01:04:10.489352 14864 cluster.go:98] Skipping create...Using existing machine configuration
  • Tip: Use 'minikube start -p ' to create a new cluster, or 'minikube delete' to delete this one.
    I0925 01:04:11.057288 14864 cluster.go:110] Machine state:
  • Starting existing hyperv VM for "minikube" ...
  • Retriable failure: start: exit status 1
    I0925 01:04:12.189288 14864 cluster.go:234] host is in state
  • Deleting "minikube" in hyperv ...
    W0925 01:04:13.321291 14864 start.go:876] DeleteHost: host remove: exit status 1
    W0925 01:04:13.321291 14864 exit.go:101] Unable to start VM: start: exit status 1

X Unable to start VM: start: exit status 1
*

The output of the minikube logs command:

PS D:\dev\minikube> minikube logs *
X command runner: getting ssh client for bootstrapper: Error creating new ssh host from driver: Error getting ssh host name for driver: Host is not running
*

The operating system version: Windows 10 Pro


While trying to run the integration tests on Windows with @sharifelgamal , we noticed that the release binary is not working on my machine. I also deleted the .minikube folder and started from scratch. From the looks of it, when it is trying to start again, it thinks that the cluster is there even though it is not there.

Any idea what might be happening? Not sure if this is happening with other drivers on Windows.

@blueelvis blueelvis added os/windows co/hyperv HyperV related issues labels Sep 24, 2019
@tstromberg tstromberg changed the title Unable to start minikube on Hyper-V with latest release v1.4: Unable to start VM: start: exit status 1 Sep 24, 2019
@tstromberg
Copy link
Contributor

Related: #5453

Does it start if --hyperv-virtual-switch is omitted? If so, check the output of Get-VMSwitch

@tstromberg tstromberg changed the title v1.4: Unable to start VM: start: exit status 1 v1.4 hyperv: Unable to start VM: start: exit status 1 Sep 24, 2019
@tstromberg
Copy link
Contributor

It's notable and frustrating that there are no libmachine logs here.

@tstromberg tstromberg added triage/needs-information Indicates an issue needs more information in order to work on it. kind/bug Categorizes issue or PR as related to a bug. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. kind/support Categorizes issue or PR as a support question. and removed kind/bug Categorizes issue or PR as related to a bug. priority/important-soon Must be staffed and worked on either currently, or very soon, ideally in time for the next release. labels Sep 24, 2019
@blueelvis
Copy link
Contributor Author

@tstromberg - Nope, still not working :( . This is blocking me from doing development on top of latest release. I think we would need a hotfix release. WDYT?

Meanwhile, trying to debug this.

@blueelvis
Copy link
Contributor Author

blueelvis commented Sep 25, 2019

@tstromberg - You won't believe my foolishness in this... I was running minikube from my D: drive instead of C: drive. I think it is related to #4802 but how come that user got the advice and not me? :(

I have no idea why it went into this loop of deleting, failing image downloads and what not. Following is the complete log when I tried starting from C: drive -

PS C:\> minikube start --vm-driver=hyperv --alsologtostderr --v=9 W0925 23:46:47.058968 12620 root.go:239] Error reading config file at C:\Users\bluee\.minikube\config\config.json: open C:\Users\bluee\.minikube\config\config.json: The system cannot find the file specified. I0925 23:46:47.060970 12620 notify.go:125] Checking for updates... I0925 23:46:47.295882 12620 start.go:236] hostinfo: {"hostname":"DESKTOP-8TI9P3N","uptime":641772,"bootTime":1568793635,"procs":245,"os":"windows","platform":"Microsoft Windows 10 Pro","platformFamily":"Standalone Workstation","platformVersion":"10.0.18362 Build 18362","kernelVersion":"","virtualizationSystem":"","virtualizationRole":"","hostid":"8883d892-2190-4ee8-a441-ed4ad61874a6"} W0925 23:46:47.295882 12620 start.go:244] gopshost.Virtualization returned error: not implemented yet * minikube v1.4.0 on Microsoft Windows 10 Pro 10.0.18362 Build 18362 - KUBECONFIG=C:\Users\bluee\.kube I0925 23:46:47.298913 12620 downloader.go:80] full url: https://storage.googleapis.com/minikube/iso/minikube-v1.4.0.iso?checksum=file:https://storage.googleapis.com/minikube/iso/minikube-v1.4.0.iso.sha256 * Downloading VM boot image ... > minikube-v1.4.0.iso.sha256: 65 B / 65 B [--------------] 100.00% ? p/s 0s > minikube-v1.4.0.iso: 135.73 MiB / 135.73 MiB [-] 100.00% 4.89 MiB p/s 28s I0925 23:47:17.009690 12620 profile.go:66] Saving config to C:\Users\bluee\.minikube\profiles\minikube\config.json ... I0925 23:47:17.009690 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner:v1.8.1 -> C:\Users\bluee\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1 I0925 23:47:17.010690 12620 cache_images.go:295] CacheImage: gcr.io/k8s-minikube/storage-provisioner:v1.8.1 -> C:\Users\bluee\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1 I0925 23:47:17.009690 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-proxy:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0 I0925 23:47:17.009690 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-scheduler:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0 I0925 23:47:17.009690 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-controller-manager:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0 I0925 23:47:17.009690 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-apiserver:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0 I0925 23:47:17.009690 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\pause:3.1 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\pause_3.1 I0925 23:47:17.009690 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13 I0925 23:47:17.009690 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13 I0925 23:47:17.009690 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13 I0925 23:47:17.009690 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\etcd:3.3.15-0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0 I0925 23:47:17.009690 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\coredns:1.6.2 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\coredns_1.6.2 I0925 23:47:17.009690 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\kubernetesui\dashboard:v2.0.0-beta4 -> C:\Users\bluee\.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4 I0925 23:47:17.009690 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-addon-manager:v9.0.2 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2 I0925 23:47:17.010690 12620 lock.go:41] attempting to write to file "C:\\Users\\bluee\\.minikube\\profiles\\minikube\\config.json" with filemode -rw------- I0925 23:47:17.010690 12620 cache_images.go:295] CacheImage: k8s.gcr.io/kube-proxy:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0 I0925 23:47:17.010690 12620 cache_images.go:295] CacheImage: k8s.gcr.io/kube-scheduler:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0 I0925 23:47:17.016690 12620 cluster.go:93] Machine does not exist... provisioning new machine I0925 23:47:17.010690 12620 cache_images.go:295] CacheImage: k8s.gcr.io/kube-controller-manager:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0 I0925 23:47:17.010690 12620 cache_images.go:295] CacheImage: k8s.gcr.io/kube-apiserver:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0 I0925 23:47:17.010690 12620 cache_images.go:295] CacheImage: k8s.gcr.io/pause:3.1 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\pause_3.1 I0925 23:47:17.010690 12620 cache_images.go:295] CacheImage: k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13 I0925 23:47:17.010690 12620 cache_images.go:295] CacheImage: k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13 I0925 23:47:17.010690 12620 cache_images.go:295] CacheImage: k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13 I0925 23:47:17.010690 12620 cache_images.go:295] CacheImage: k8s.gcr.io/etcd:3.3.15-0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0 I0925 23:47:17.010690 12620 cache_images.go:295] CacheImage: k8s.gcr.io/coredns:1.6.2 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\coredns_1.6.2 I0925 23:47:17.011689 12620 cache_images.go:295] CacheImage: kubernetesui/dashboard:v2.0.0-beta4 -> C:\Users\bluee\.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4 I0925 23:47:17.011689 12620 cache_images.go:295] CacheImage: k8s.gcr.io/kube-addon-manager:v9.0.2 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2 I0925 23:47:17.017691 12620 cluster.go:94] Provisioning machine with config: {KeepContext:false EmbedCerts:false MinikubeISO:https://storage.googleapis.com/minikube/iso/minikube-v1.4.0.iso Memory:2000 CPUs:2 DiskSize:20000 VMDriver:hyperv ContainerRuntime:docker HyperkitVpnKitSock: HyperkitVSockPorts:[] DockerEnv:[NO_PROXY=192.168.99.100 NO_PROXY=192.168.99.100] InsecureRegistry:[] RegistryMirror:[] HostOnlyCIDR:192.168.99.1/24 HypervVirtualSwitch: KVMNetwork:default KVMQemuURI:qemu:///system KVMGPU:false KVMHidden:false Downloader:{} DockerOpt:[] DisableDriverMounts:false NFSShare:[] NFSSharesRoot:/nfsshares UUID: NoVTXCheck:false DNSProxy:false HostDNSResolver:true} * Creating hyperv VM (CPUs=2, Memory=2000MB, Disk=20000MB) ... I0925 23:47:17.241691 12620 main.go:104] libmachine: Creating CA: C:\Users\bluee\.minikube\certs\ca.pem I0925 23:47:17.436692 12620 cache_images.go:350] retrieving image: k8s.gcr.io/pause:3.1 I0925 23:47:17.484691 12620 cache_images.go:350] retrieving image: k8s.gcr.io/etcd:3.3.15-0 I0925 23:47:17.487691 12620 cache_images.go:350] retrieving image: k8s.gcr.io/kube-proxy:v1.16.0 I0925 23:47:17.488694 12620 cache_images.go:350] retrieving image: k8s.gcr.io/kube-controller-manager:v1.16.0 I0925 23:47:17.488694 12620 cache_images.go:350] retrieving image: k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13 I0925 23:47:17.489693 12620 cache_images.go:350] retrieving image: k8s.gcr.io/kube-scheduler:v1.16.0 I0925 23:47:17.498690 12620 cache_images.go:350] retrieving image: k8s.gcr.io/kube-apiserver:v1.16.0 I0925 23:47:17.516691 12620 cache_images.go:350] retrieving image: k8s.gcr.io/coredns:1.6.2 I0925 23:47:17.516691 12620 cache_images.go:350] retrieving image: k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13 I0925 23:47:17.520688 12620 cache_images.go:350] retrieving image: gcr.io/k8s-minikube/storage-provisioner:v1.8.1 I0925 23:47:17.524690 12620 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist I0925 23:47:17.524690 12620 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist I0925 23:47:17.529689 12620 cache_images.go:350] retrieving image: k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13 I0925 23:47:17.524690 12620 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist I0925 23:47:17.530689 12620 cache_images.go:350] retrieving image: k8s.gcr.io/kube-addon-manager:v9.0.2 I0925 23:47:17.533689 12620 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist I0925 23:47:17.537692 12620 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist I0925 23:47:17.537692 12620 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist I0925 23:47:17.546690 12620 cache_images.go:350] retrieving image: index.docker.io/kubernetesui/dashboard:v2.0.0-beta4 I0925 23:47:17.549689 12620 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist I0925 23:47:17.559688 12620 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist I0925 23:47:17.576717 12620 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist I0925 23:47:17.577713 12620 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist I0925 23:47:17.581718 12620 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist I0925 23:47:17.584713 12620 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist I0925 23:47:17.591717 12620 cache_images.go:356] daemon image for : Error response from daemon: reference does not exist I0925 23:47:17.664713 12620 main.go:104] libmachine: Creating client certificate: C:\Users\bluee\.minikube\certs\cert.pem W0925 23:47:17.841718 12620 cache_images.go:361] failed authn download for k8s.gcr.io/kube-proxy:v1.16.0 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Akube-proxy%3Apull&service=k8s.gcr.io: exit status 1 W0925 23:47:17.898714 12620 cache_images.go:361] failed authn download for k8s.gcr.io/pause:3.1 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Apause%3Apull&service=k8s.gcr.io: exit status 1 W0925 23:47:17.918715 12620 cache_images.go:361] failed authn download for k8s.gcr.io/coredns:1.6.2 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Acoredns%3Apull&service=k8s.gcr.io: exit status 1 W0925 23:47:17.926717 12620 cache_images.go:361] failed authn download for k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Ak8s-dns-kube-dns-amd64%3Apull&service=k8s.gcr.io: exit status 1 W0925 23:47:17.938715 12620 cache_images.go:361] failed authn download for k8s.gcr.io/etcd:3.3.15-0 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Aetcd%3Apull&service=k8s.gcr.io: exit status 1 W0925 23:47:17.938715 12620 cache_images.go:361] failed authn download for k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Ak8s-dns-sidecar-amd64%3Apull&service=k8s.gcr.io: exit status 1 W0925 23:47:17.947713 12620 cache_images.go:361] failed authn download for k8s.gcr.io/kube-apiserver:v1.16.0 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Akube-apiserver%3Apull&service=k8s.gcr.io: exit status 1 W0925 23:47:17.948716 12620 cache_images.go:361] failed authn download for k8s.gcr.io/kube-controller-manager:v1.16.0 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Akube-controller-manager%3Apull&service=k8s.gcr.io: exit status 1 W0925 23:47:17.954717 12620 cache_images.go:361] failed authn download for k8s.gcr.io/kube-scheduler:v1.16.0 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Akube-scheduler%3Apull&service=k8s.gcr.io: exit status 1 W0925 23:47:17.957714 12620 cache_images.go:361] failed authn download for k8s.gcr.io/kube-addon-manager:v9.0.2 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Akube-addon-manager%3Apull&service=k8s.gcr.io: exit status 1 W0925 23:47:17.962716 12620 cache_images.go:361] failed authn download for k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13 (trying anon): Get https://k8s.gcr.io/v2/token?scope=repository%3Ak8s-dns-dnsmasq-nanny-amd64%3Apull&service=k8s.gcr.io: exit status 1 W0925 23:47:17.977715 12620 cache_images.go:361] failed authn download for gcr.io/k8s-minikube/storage-provisioner:v1.8.1 (trying anon): Get https://gcr.io/v2/token?scope=repository%3Ak8s-minikube%2Fstorage-provisioner%3Apull&service=gcr.io: exit status 1 I0925 23:47:18.005719 12620 cache_images.go:324] OPENING: \\?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0 I0925 23:47:18.057716 12620 cache_images.go:324] OPENING: \\?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee\.minikube\cache\images\k8s.gcr.io\pause_3.1 I0925 23:47:18.073714 12620 cache_images.go:324] OPENING: \\?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee\.minikube\cache\images\k8s.gcr.io\coredns_1.6.2 I0925 23:47:18.077715 12620 cache_images.go:324] OPENING: \\?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13 I0925 23:47:18.086712 12620 cache_images.go:324] OPENING: \\?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee\.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0 I0925 23:47:18.088723 12620 cache_images.go:324] OPENING: \\?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13 I0925 23:47:18.105714 12620 cache_images.go:324] OPENING: \\?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2 I0925 23:47:18.107716 12620 cache_images.go:324] OPENING: \\?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0 I0925 23:47:18.108714 12620 cache_images.go:324] OPENING: \\?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0 I0925 23:47:18.109714 12620 cache_images.go:324] OPENING: \\?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0 I0925 23:47:18.109714 12620 cache_images.go:324] OPENING: \\?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13 I0925 23:47:18.153712 12620 cache_images.go:324] OPENING: \\?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1 I0925 23:47:20.433610 12620 cache_images.go:345] C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\pause_3.1 exists I0925 23:47:20.433610 12620 cache_images.go:297] CacheImage: k8s.gcr.io/pause:3.1 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\pause_3.1 completed in 3.4229192s I0925 23:47:20.435611 12620 cache_images.go:82] CacheImage k8s.gcr.io/pause:3.1 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\pause_3.1 succeeded I0925 23:47:20.533609 12620 main.go:104] libmachine: Downloading C:\Users\bluee\.minikube\cache\boot2docker.iso from file://C:/Users/bluee/.minikube/cache/iso/minikube-v1.4.0.iso... I0925 23:47:20.609615 12620 cache_images.go:324] OPENING: \\?\Volume{432bcd06-0000-0000-0000-602200000000}\Users\bluee\.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4 I0925 23:47:20.679608 12620 main.go:104] libmachine: Creating SSH key... I0925 23:47:20.866611 12620 main.go:104] libmachine: Creating VM... I0925 23:47:22.077607 12620 main.go:104] libmachine: Using switch "Default Switch" I0925 23:47:22.550353 12620 main.go:104] libmachine: Creating VHD I0925 23:47:30.912802 12620 main.go:104] libmachine: Starting VM... I0925 23:47:31.948994 12620 cache_images.go:345] C:\Users\bluee\.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4 exists I0925 23:47:31.950993 12620 cache_images.go:297] CacheImage: kubernetesui/dashboard:v2.0.0-beta4 -> C:\Users\bluee\.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4 completed in 14.9393037s I0925 23:47:31.950993 12620 cache_images.go:82] CacheImage kubernetesui/dashboard:v2.0.0-beta4 -> C:\Users\bluee\.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4 succeeded I0925 23:47:37.002992 12620 main.go:104] libmachine: Waiting for host to start... I0925 23:47:37.492507 12620 cache_images.go:345] C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13 exists I0925 23:47:37.492507 12620 cache_images.go:297] CacheImage: k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13 completed in 20.4818162s I0925 23:47:37.494507 12620 cache_images.go:82] CacheImage k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13 succeeded I0925 23:47:38.718699 12620 cache_images.go:345] C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\coredns_1.6.2 exists I0925 23:47:38.718699 12620 cache_images.go:297] CacheImage: k8s.gcr.io/coredns:1.6.2 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\coredns_1.6.2 completed in 21.7080089s I0925 23:47:38.720693 12620 cache_images.go:82] CacheImage k8s.gcr.io/coredns:1.6.2 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\coredns_1.6.2 succeeded I0925 23:47:40.137395 12620 cache_images.go:345] C:\Users\bluee\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1 exists I0925 23:47:40.138391 12620 cache_images.go:297] CacheImage: gcr.io/k8s-minikube/storage-provisioner:v1.8.1 -> C:\Users\bluee\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1 completed in 23.1277006s I0925 23:47:40.139408 12620 cache_images.go:82] CacheImage gcr.io/k8s-minikube/storage-provisioner:v1.8.1 -> C:\Users\bluee\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1 succeeded I0925 23:47:43.602512 12620 cache_images.go:345] C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13 exists I0925 23:47:43.602512 12620 cache_images.go:297] CacheImage: k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13 completed in 26.5918212s I0925 23:47:43.604512 12620 cache_images.go:82] CacheImage k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13 succeeded I0925 23:47:53.367477 12620 cache_images.go:345] C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0 exists I0925 23:47:53.367477 12620 cache_images.go:297] CacheImage: k8s.gcr.io/kube-scheduler:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0 completed in 36.3567865s I0925 23:47:53.369481 12620 cache_images.go:82] CacheImage k8s.gcr.io/kube-scheduler:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0 succeeded I0925 23:47:55.745475 12620 cache_images.go:345] C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0 exists I0925 23:47:55.745475 12620 cache_images.go:297] CacheImage: k8s.gcr.io/kube-proxy:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0 completed in 38.7347844s I0925 23:47:55.747476 12620 cache_images.go:82] CacheImage k8s.gcr.io/kube-proxy:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0 succeeded I0925 23:48:06.422492 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\certs\ca.pem -> C:\Users\bluee\.minikube/ca.pem I0925 23:48:06.425489 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\certs\cert.pem -> C:\Users\bluee\.minikube/cert.pem I0925 23:48:06.427491 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\certs\key.pem -> C:\Users\bluee\.minikube/key.pem I0925 23:48:08.033495 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\certs\ca.pem -> /etc/docker/ca.pem I0925 23:48:08.076492 12620 ssh_runner.go:170] Transferring 1034 bytes to /etc/docker/ca.pem I0925 23:48:08.079492 12620 ssh_runner.go:189] ca.pem: copied 1034 bytes I0925 23:48:08.088491 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\machines\server.pem -> /etc/docker/server.pem I0925 23:48:08.090493 12620 ssh_runner.go:170] Transferring 1107 bytes to /etc/docker/server.pem I0925 23:48:08.092493 12620 ssh_runner.go:189] server.pem: copied 1107 bytes I0925 23:48:08.100494 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\machines\server-key.pem -> /etc/docker/server-key.pem I0925 23:48:08.102493 12620 ssh_runner.go:170] Transferring 1675 bytes to /etc/docker/server-key.pem I0925 23:48:08.103499 12620 ssh_runner.go:189] server-key.pem: copied 1675 bytes I0925 23:48:09.660526 12620 main.go:104] libmachine: Setting Docker configuration on the remote daemon... I0925 23:48:11.477529 12620 cache_images.go:345] C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0 exists I0925 23:48:11.477529 12620 cache_images.go:297] CacheImage: k8s.gcr.io/kube-controller-manager:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0 completed in 54.4668391s I0925 23:48:11.478534 12620 cache_images.go:82] CacheImage k8s.gcr.io/kube-controller-manager:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0 succeeded I0925 23:48:15.913441 12620 main.go:104] libmachine: Waiting for SSH to be available... I0925 23:48:17.379603 12620 main.go:104] libmachine: Detecting the provisioner... I0925 23:48:18.864604 12620 cluster.go:409] Provisioned with Buildroot 2018.05.3 I0925 23:48:20.300605 12620 cluster.go:202] guest clock: 1569435501.066250528 I0925 23:48:20.300605 12620 cluster.go:215] Guest: 2019-09-25 23:48:21.066250528 +0530 IST Remote: 2019-09-25 23:48:18.864604 +0530 IST m=+92.136632601 (delta=2.201646528s) I0925 23:48:21.730650 12620 cluster.go:222] clock set: Wed Sep 25 18:18:20 UTC 2019 (err=) * Found network options: - NO_PROXY=192.168.99.100 - no_proxy=192.168.99.100 I0925 23:48:23.056954 12620 profile.go:66] Saving config to C:\Users\bluee\.minikube\profiles\minikube\config.json ... I0925 23:48:23.057948 12620 lock.go:41] attempting to write to file "C:\\Users\\bluee\\.minikube\\profiles\\minikube\\config.json.tmp786454291" with filemode -rw------- I0925 23:48:24.419336 12620 ssh_runner.go:102] SSH: systemctl is-active --quiet service containerd I0925 23:48:24.471373 12620 ssh_runner.go:102] SSH: systemctl is-active --quiet service crio I0925 23:48:24.478378 12620 ssh_runner.go:102] SSH: sudo systemctl stop crio I0925 23:48:24.501339 12620 ssh_runner.go:102] SSH: systemctl is-active --quiet service crio I0925 23:48:24.509336 12620 ssh_runner.go:102] SSH: sudo systemctl start docker I0925 23:48:24.849712 12620 ssh_runner.go:138] Run with output: docker version --format '{{.Server.Version}}' I0925 23:48:24.878708 12620 utils.go:167] > 18.09.9 * Preparing Kubernetes v1.16.0 on Docker 18.09.9 ... - env NO_PROXY=192.168.99.100 - env NO_PROXY=192.168.99.100 I0925 23:48:31.424275 12620 cache_images.go:345] C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0 exists I0925 23:48:31.424275 12620 cache_images.go:297] CacheImage: k8s.gcr.io/kube-apiserver:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0 completed in 1m14.4135845s I0925 23:48:31.426273 12620 cache_images.go:82] CacheImage k8s.gcr.io/kube-apiserver:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0 succeeded I0925 23:48:35.036865 12620 cache_images.go:345] C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0 exists I0925 23:48:35.036865 12620 cache_images.go:297] CacheImage: k8s.gcr.io/etcd:3.3.15-0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0 completed in 1m18.026175s I0925 23:48:35.038867 12620 cache_images.go:82] CacheImage k8s.gcr.io/etcd:3.3.15-0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0 succeeded I0925 23:48:36.037521 12620 cache_images.go:345] C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13 exists I0925 23:48:36.037521 12620 cache_images.go:297] CacheImage: k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13 completed in 1m19.0268307s I0925 23:48:36.039469 12620 cache_images.go:82] CacheImage k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13 succeeded I0925 23:48:38.606508 12620 cache_images.go:345] C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2 exists I0925 23:48:38.606508 12620 cache_images.go:297] CacheImage: k8s.gcr.io/kube-addon-manager:v9.0.2 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2 completed in 1m21.5948182s I0925 23:48:38.607513 12620 cache_images.go:82] CacheImage k8s.gcr.io/kube-addon-manager:v9.0.2 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2 succeeded I0925 23:48:38.610509 12620 cache_images.go:89] Successfully cached all images. I0925 23:48:39.924250 12620 settings.go:124] acquiring lock: {Name:kubeconfigUpdate Clock:{} Delay:10s Timeout:0s Cancel:} I0925 23:48:39.924250 12620 settings.go:132] Updating kubeconfig: C:\Users\bluee\.kube I0925 23:48:39.964151 12620 lock.go:41] attempting to write to file "C:\\Users\\bluee\\.kube" with filemode -rw------- I0925 23:48:41.300542 12620 cache_images.go:95] LoadImages start: [k8s.gcr.io/kube-proxy:v1.16.0 k8s.gcr.io/kube-scheduler:v1.16.0 k8s.gcr.io/kube-controller-manager:v1.16.0 k8s.gcr.io/kube-apiserver:v1.16.0 k8s.gcr.io/pause:3.1 k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13 k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13 k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13 k8s.gcr.io/etcd:3.3.15-0 k8s.gcr.io/coredns:1.6.2 kubernetesui/dashboard:v2.0.0-beta4 k8s.gcr.io/kube-addon-manager:v9.0.2 gcr.io/k8s-minikube/storage-provisioner:v1.8.1] I0925 23:48:41.301545 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13 I0925 23:48:41.304540 12620 cache_images.go:210] Loading image from cache: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13 I0925 23:48:41.301545 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner:v1.8.1 -> C:\Users\bluee\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1 I0925 23:48:41.301545 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13 I0925 23:48:41.301545 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64:1.14.13 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13 I0925 23:48:41.301545 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\etcd:3.3.15-0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0 I0925 23:48:41.301545 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\coredns:1.6.2 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\coredns_1.6.2 I0925 23:48:41.301545 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\kubernetesui\dashboard:v2.0.0-beta4 -> C:\Users\bluee\.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4 I0925 23:48:41.301545 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-addon-manager:v9.0.2 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2 I0925 23:48:41.301545 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-controller-manager:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0 I0925 23:48:41.301545 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-proxy:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0 I0925 23:48:41.301545 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-scheduler:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0 I0925 23:48:41.301545 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-apiserver:v1.16.0 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0 I0925 23:48:41.301545 12620 cache_images.go:150] windows sanitize: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\pause:3.1 -> C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\pause_3.1 I0925 23:48:41.305510 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13 -> /var/lib/minikube/images/k8s-dns-kube-dns-amd64_1.14.13 I0925 23:48:41.305510 12620 cache_images.go:210] Loading image from cache: C:\Users\bluee\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1 I0925 23:48:41.306510 12620 cache_images.go:210] Loading image from cache: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13 I0925 23:48:41.306510 12620 cache_images.go:210] Loading image from cache: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13 I0925 23:48:41.307510 12620 cache_images.go:210] Loading image from cache: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0 I0925 23:48:41.307510 12620 cache_images.go:210] Loading image from cache: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\coredns_1.6.2 I0925 23:48:41.308551 12620 cache_images.go:210] Loading image from cache: C:\Users\bluee\.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4 I0925 23:48:41.308551 12620 cache_images.go:210] Loading image from cache: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2 I0925 23:48:41.309519 12620 cache_images.go:210] Loading image from cache: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0 I0925 23:48:41.310514 12620 cache_images.go:210] Loading image from cache: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0 I0925 23:48:41.310514 12620 cache_images.go:210] Loading image from cache: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0 I0925 23:48:41.310514 12620 cache_images.go:210] Loading image from cache: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0 I0925 23:48:41.311510 12620 cache_images.go:210] Loading image from cache: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\pause_3.1 I0925 23:48:41.320520 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1 -> /var/lib/minikube/images/storage-provisioner_v1.8.1 I0925 23:48:41.321511 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13 -> /var/lib/minikube/images/k8s-dns-dnsmasq-nanny-amd64_1.14.13 I0925 23:48:41.322519 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13 -> /var/lib/minikube/images/k8s-dns-sidecar-amd64_1.14.13 I0925 23:48:41.322519 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0 -> /var/lib/minikube/images/etcd_3.3.15-0 I0925 23:48:41.323561 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\coredns_1.6.2 -> /var/lib/minikube/images/coredns_1.6.2 I0925 23:48:41.324511 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4 -> /var/lib/minikube/images/dashboard_v2.0.0-beta4 I0925 23:48:41.327512 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2 -> /var/lib/minikube/images/kube-addon-manager_v9.0.2 I0925 23:48:41.328510 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0 -> /var/lib/minikube/images/kube-controller-manager_v1.16.0 I0925 23:48:41.328510 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0 -> /var/lib/minikube/images/kube-proxy_v1.16.0 I0925 23:48:41.329521 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0 -> /var/lib/minikube/images/kube-scheduler_v1.16.0 I0925 23:48:41.330510 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0 -> /var/lib/minikube/images/kube-apiserver_v1.16.0 I0925 23:48:41.331513 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\pause_3.1 -> /var/lib/minikube/images/pause_3.1 I0925 23:48:41.335512 12620 ssh_runner.go:170] Transferring 14267904 bytes to /var/lib/minikube/images/k8s-dns-kube-dns-amd64_1.14.13 I0925 23:48:41.337511 12620 ssh_runner.go:170] Transferring 20683776 bytes to /var/lib/minikube/images/storage-provisioner_v1.8.1 I0925 23:48:41.338527 12620 ssh_runner.go:170] Transferring 11769344 bytes to /var/lib/minikube/images/k8s-dns-dnsmasq-nanny-amd64_1.14.13 I0925 23:48:41.338527 12620 ssh_runner.go:170] Transferring 12207616 bytes to /var/lib/minikube/images/k8s-dns-sidecar-amd64_1.14.13 I0925 23:48:41.339519 12620 ssh_runner.go:170] Transferring 85501440 bytes to /var/lib/minikube/images/etcd_3.3.15-0 I0925 23:48:41.340511 12620 ssh_runner.go:170] Transferring 14125568 bytes to /var/lib/minikube/images/coredns_1.6.2 I0925 23:48:41.340511 12620 ssh_runner.go:170] Transferring 35855360 bytes to /var/lib/minikube/images/dashboard_v2.0.0-beta4 I0925 23:48:41.341511 12620 ssh_runner.go:170] Transferring 30519808 bytes to /var/lib/minikube/images/kube-addon-manager_v9.0.2 I0925 23:48:41.342511 12620 ssh_runner.go:170] Transferring 48862720 bytes to /var/lib/minikube/images/kube-controller-manager_v1.16.0 I0925 23:48:41.342511 12620 ssh_runner.go:170] Transferring 30888448 bytes to /var/lib/minikube/images/kube-proxy_v1.16.0 I0925 23:48:41.343511 12620 ssh_runner.go:170] Transferring 31408640 bytes to /var/lib/minikube/images/kube-scheduler_v1.16.0 I0925 23:48:41.344520 12620 ssh_runner.go:170] Transferring 50498560 bytes to /var/lib/minikube/images/kube-apiserver_v1.16.0 I0925 23:48:41.352511 12620 ssh_runner.go:170] Transferring 318976 bytes to /var/lib/minikube/images/pause_3.1 I0925 23:48:41.401773 12620 ssh_runner.go:189] pause_3.1: copied 318976 bytes I0925 23:48:41.492778 12620 docker.go:97] Loading image: /var/lib/minikube/images/pause_3.1 I0925 23:48:41.492778 12620 ssh_runner.go:102] SSH: docker load -i /var/lib/minikube/images/pause_3.1 I0925 23:48:41.915306 12620 utils.go:167] > Loaded image: k8s.gcr.io/pause:3.1 I0925 23:48:41.918307 12620 cache_images.go:236] Successfully loaded image C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\pause_3.1 from cache I0925 23:48:41.929303 12620 ssh_runner.go:189] k8s-dns-dnsmasq-nanny-amd64_1.14.13: copied 11769344 bytes I0925 23:48:41.944306 12620 docker.go:97] Loading image: /var/lib/minikube/images/k8s-dns-dnsmasq-nanny-amd64_1.14.13 I0925 23:48:41.944306 12620 ssh_runner.go:102] SSH: docker load -i /var/lib/minikube/images/k8s-dns-dnsmasq-nanny-amd64_1.14.13 I0925 23:48:41.974302 12620 ssh_runner.go:189] k8s-dns-sidecar-amd64_1.14.13: copied 12207616 bytes I0925 23:48:42.004306 12620 ssh_runner.go:189] k8s-dns-kube-dns-amd64_1.14.13: copied 14267904 bytes I0925 23:48:42.016303 12620 ssh_runner.go:189] coredns_1.6.2: copied 14125568 bytes I0925 23:48:42.198341 12620 ssh_runner.go:189] storage-provisioner_v1.8.1: copied 20683776 bytes I0925 23:48:42.447440 12620 ssh_runner.go:189] kube-addon-manager_v9.0.2: copied 30519808 bytes I0925 23:48:42.487968 12620 ssh_runner.go:189] kube-proxy_v1.16.0: copied 30888448 bytes I0925 23:48:42.489964 12620 ssh_runner.go:189] kube-scheduler_v1.16.0: copied 31408640 bytes I0925 23:48:42.546477 12620 ssh_runner.go:189] dashboard_v2.0.0-beta4: copied 35855360 bytes I0925 23:48:42.665513 12620 ssh_runner.go:189] kube-apiserver_v1.16.0: copied 50498560 bytes I0925 23:48:42.668516 12620 ssh_runner.go:189] kube-controller-manager_v1.16.0: copied 48862720 bytes I0925 23:48:43.029619 12620 ssh_runner.go:189] etcd_3.3.15-0: copied 85501440 bytes I0925 23:48:46.518414 12620 utils.go:167] > Loaded image: k8s.gcr.io/k8s-dns-dnsmasq-nanny-amd64:1.14.13 I0925 23:48:46.520461 12620 cache_images.go:236] Successfully loaded image C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-dnsmasq-nanny-amd64_1.14.13 from cache I0925 23:48:46.520461 12620 docker.go:97] Loading image: /var/lib/minikube/images/k8s-dns-sidecar-amd64_1.14.13 I0925 23:48:46.520461 12620 ssh_runner.go:102] SSH: docker load -i /var/lib/minikube/images/k8s-dns-sidecar-amd64_1.14.13 I0925 23:48:47.240660 12620 utils.go:167] > Loaded image: k8s.gcr.io/k8s-dns-sidecar-amd64:1.14.13 I0925 23:48:47.242662 12620 cache_images.go:236] Successfully loaded image C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-sidecar-amd64_1.14.13 from cache I0925 23:48:47.242662 12620 docker.go:97] Loading image: /var/lib/minikube/images/k8s-dns-kube-dns-amd64_1.14.13 I0925 23:48:47.243664 12620 ssh_runner.go:102] SSH: docker load -i /var/lib/minikube/images/k8s-dns-kube-dns-amd64_1.14.13 I0925 23:48:49.219479 12620 utils.go:167] > Loaded image: k8s.gcr.io/k8s-dns-kube-dns-amd64:1.14.13 I0925 23:48:49.222475 12620 cache_images.go:236] Successfully loaded image C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\k8s-dns-kube-dns-amd64_1.14.13 from cache I0925 23:48:49.222475 12620 docker.go:97] Loading image: /var/lib/minikube/images/coredns_1.6.2 I0925 23:48:49.223474 12620 ssh_runner.go:102] SSH: docker load -i /var/lib/minikube/images/coredns_1.6.2 I0925 23:48:50.001518 12620 utils.go:167] > Loaded image: k8s.gcr.io/coredns:1.6.2 I0925 23:48:50.004532 12620 cache_images.go:236] Successfully loaded image C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\coredns_1.6.2 from cache I0925 23:48:50.004532 12620 docker.go:97] Loading image: /var/lib/minikube/images/storage-provisioner_v1.8.1 I0925 23:48:50.004532 12620 ssh_runner.go:102] SSH: docker load -i /var/lib/minikube/images/storage-provisioner_v1.8.1 I0925 23:48:51.590040 12620 utils.go:167] > Loaded image: gcr.io/k8s-minikube/storage-provisioner:v1.8.1 I0925 23:48:51.593040 12620 cache_images.go:236] Successfully loaded image C:\Users\bluee\.minikube\cache\images\gcr.io\k8s-minikube\storage-provisioner_v1.8.1 from cache I0925 23:48:51.594040 12620 docker.go:97] Loading image: /var/lib/minikube/images/kube-addon-manager_v9.0.2 I0925 23:48:51.595053 12620 ssh_runner.go:102] SSH: docker load -i /var/lib/minikube/images/kube-addon-manager_v9.0.2 I0925 23:48:53.654442 12620 utils.go:167] > Loaded image: k8s.gcr.io/kube-addon-manager:v9.0.2 I0925 23:48:53.658715 12620 cache_images.go:236] Successfully loaded image C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-addon-manager_v9.0.2 from cache I0925 23:48:53.658715 12620 docker.go:97] Loading image: /var/lib/minikube/images/kube-proxy_v1.16.0 I0925 23:48:53.659493 12620 ssh_runner.go:102] SSH: docker load -i /var/lib/minikube/images/kube-proxy_v1.16.0 I0925 23:48:54.475244 12620 utils.go:167] > Loaded image: k8s.gcr.io/kube-proxy:v1.16.0 I0925 23:48:54.479244 12620 cache_images.go:236] Successfully loaded image C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-proxy_v1.16.0 from cache I0925 23:48:54.479244 12620 docker.go:97] Loading image: /var/lib/minikube/images/kube-scheduler_v1.16.0 I0925 23:48:54.480239 12620 ssh_runner.go:102] SSH: docker load -i /var/lib/minikube/images/kube-scheduler_v1.16.0 I0925 23:48:55.211545 12620 utils.go:167] > Loaded image: k8s.gcr.io/kube-scheduler:v1.16.0 I0925 23:48:55.215545 12620 cache_images.go:236] Successfully loaded image C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-scheduler_v1.16.0 from cache I0925 23:48:55.215545 12620 docker.go:97] Loading image: /var/lib/minikube/images/dashboard_v2.0.0-beta4 I0925 23:48:55.216545 12620 ssh_runner.go:102] SSH: docker load -i /var/lib/minikube/images/dashboard_v2.0.0-beta4 I0925 23:48:56.652618 12620 utils.go:167] > Loaded image: kubernetesui/dashboard:v2.0.0-beta4 I0925 23:48:56.659621 12620 cache_images.go:236] Successfully loaded image C:\Users\bluee\.minikube\cache\images\kubernetesui\dashboard_v2.0.0-beta4 from cache I0925 23:48:56.659621 12620 docker.go:97] Loading image: /var/lib/minikube/images/kube-apiserver_v1.16.0 I0925 23:48:56.661620 12620 ssh_runner.go:102] SSH: docker load -i /var/lib/minikube/images/kube-apiserver_v1.16.0 I0925 23:48:58.639587 12620 utils.go:167] > Loaded image: k8s.gcr.io/kube-apiserver:v1.16.0 I0925 23:48:58.643586 12620 cache_images.go:236] Successfully loaded image C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-apiserver_v1.16.0 from cache I0925 23:48:58.644591 12620 docker.go:97] Loading image: /var/lib/minikube/images/kube-controller-manager_v1.16.0 I0925 23:48:58.645587 12620 ssh_runner.go:102] SSH: docker load -i /var/lib/minikube/images/kube-controller-manager_v1.16.0 I0925 23:49:00.991956 12620 utils.go:167] > Loaded image: k8s.gcr.io/kube-controller-manager:v1.16.0 I0925 23:49:00.996939 12620 cache_images.go:236] Successfully loaded image C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\kube-controller-manager_v1.16.0 from cache I0925 23:49:00.996939 12620 docker.go:97] Loading image: /var/lib/minikube/images/etcd_3.3.15-0 I0925 23:49:00.997938 12620 ssh_runner.go:102] SSH: docker load -i /var/lib/minikube/images/etcd_3.3.15-0 I0925 23:49:04.027882 12620 utils.go:167] > Loaded image: k8s.gcr.io/etcd:3.3.15-0 I0925 23:49:04.034880 12620 cache_images.go:236] Successfully loaded image C:\Users\bluee\.minikube\cache\images\k8s.gcr.io\etcd_3.3.15-0 from cache I0925 23:49:04.034880 12620 cache_images.go:119] Successfully loaded all cached images. I0925 23:49:04.035880 12620 cache_images.go:120] LoadImages end I0925 23:49:04.037413 12620 kubeadm.go:610] kubelet v1.16.0 config: [Unit] Wants=docker.socket

[Service]
ExecStart=
ExecStart=/var/lib/minikube/binaries/v1.16.0/kubelet --authorization-mode=Webhook --bootstrap-kubeconfig=/etc/kubernetes/bootstrap-kubelet.conf --cgroup-driver=cgroupfs --client-ca-file=/var/lib/minikube/certs/ca.crt --cluster-dns=10.96.0.10 --cluster-domain=cluster.local --container-runtime=docker --fail-swap-on=false --hostname-override=minikube --kubeconfig=/etc/kubernetes/kubelet.conf --pod-manifest-path=/etc/kubernetes/manifests

[Install]
I0925 23:49:04.038406 12620 ssh_runner.go:102] SSH: pgrep kubelet && sudo systemctl stop kubelet
W0925 23:49:04.046407 12620 kubeadm.go:615] unable to stop kubelet: command failed: pgrep kubelet && sudo systemctl stop kubelet
stdout:
stderr: : Process exited with status 1

  • Downloading kubelet v1.16.0

  • Downloading kubeadm v1.16.0
    I0925 23:49:21.481986 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee.minikube\cache\v1.16.0/kubeadm -> /var/lib/minikube/binaries/v1.16.0/kubeadm
    I0925 23:49:21.483983 12620 ssh_runner.go:170] Transferring 44244800 bytes to /var/lib/minikube/binaries/v1.16.0/kubeadm
    I0925 23:49:21.655562 12620 ssh_runner.go:189] kubeadm: copied 44244800 bytes
    I0925 23:49:36.168036 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee.minikube\cache\v1.16.0/kubelet -> /var/lib/minikube/binaries/v1.16.0/kubelet
    I0925 23:49:36.169039 12620 ssh_runner.go:170] Transferring 123120976 bytes to /var/lib/minikube/binaries/v1.16.0/kubelet
    I0925 23:49:36.622155 12620 ssh_runner.go:189] kubelet: copied 123120976 bytes
    I0925 23:49:36.671154 12620 ssh_runner.go:170] Transferring 1147 bytes to /var/tmp/minikube/kubeadm.yaml
    I0925 23:49:36.672154 12620 ssh_runner.go:189] kubeadm.yaml: copied 1147 bytes
    I0925 23:49:36.680157 12620 ssh_runner.go:170] Transferring 498 bytes to /etc/systemd/system/kubelet.service.d/10-kubeadm.conf
    I0925 23:49:36.681154 12620 ssh_runner.go:189] 10-kubeadm.conf: copied 498 bytes
    I0925 23:49:36.691154 12620 ssh_runner.go:170] Transferring 349 bytes to /lib/systemd/system/kubelet.service
    I0925 23:49:36.692156 12620 ssh_runner.go:189] kubelet.service: copied 349 bytes
    I0925 23:49:36.700157 12620 ssh_runner.go:170] Transferring 1532 bytes to /etc/kubernetes/manifests/addon-manager.yaml.tmpl
    I0925 23:49:36.702156 12620 ssh_runner.go:189] addon-manager.yaml.tmpl: copied 1532 bytes
    I0925 23:49:36.709184 12620 ssh_runner.go:170] Transferring 271 bytes to /etc/kubernetes/addons/storageclass.yaml
    I0925 23:49:36.710157 12620 ssh_runner.go:189] storageclass.yaml: copied 271 bytes
    I0925 23:49:36.720154 12620 ssh_runner.go:170] Transferring 1709 bytes to /etc/kubernetes/addons/storage-provisioner.yaml
    I0925 23:49:36.722159 12620 ssh_runner.go:189] storage-provisioner.yaml: copied 1709 bytes
    I0925 23:49:36.730161 12620 ssh_runner.go:102] SSH: sudo systemctl daemon-reload && sudo systemctl start kubelet
    I0925 23:49:36.806182 12620 certs.go:71] acquiring lock: {Name:setupCerts Clock:{} Delay:15s Timeout:0s Cancel:}
    I0925 23:49:36.806182 12620 certs.go:79] Setting up C:\Users\bluee.minikube for IP: 192.168.215.108
    I0925 23:49:36.989666 12620 crypto.go:157] Writing cert to C:\Users\bluee.minikube\ca.crt ...
    I0925 23:49:36.989666 12620 lock.go:41] attempting to write to file "C:\Users\bluee\.minikube\ca.crt" with filemode -rw-r--r--
    I0925 23:49:36.996666 12620 crypto.go:165] Writing key to C:\Users\bluee.minikube\ca.key ...
    I0925 23:49:36.996666 12620 lock.go:41] attempting to write to file "C:\Users\bluee\.minikube\ca.key" with filemode -rw-------
    I0925 23:49:37.106666 12620 crypto.go:157] Writing cert to C:\Users\bluee.minikube\proxy-client-ca.crt ...
    I0925 23:49:37.106666 12620 lock.go:41] attempting to write to file "C:\Users\bluee\.minikube\proxy-client-ca.crt" with filemode -rw-r--r--
    I0925 23:49:37.113670 12620 crypto.go:165] Writing key to C:\Users\bluee.minikube\proxy-client-ca.key ...
    I0925 23:49:37.113670 12620 lock.go:41] attempting to write to file "C:\Users\bluee\.minikube\proxy-client-ca.key" with filemode -rw-------
    I0925 23:49:37.120671 12620 crypto.go:69] Generating cert C:\Users\bluee.minikube\client.crt with IP's: []
    I0925 23:49:37.372666 12620 crypto.go:157] Writing cert to C:\Users\bluee.minikube\client.crt ...
    I0925 23:49:37.373668 12620 lock.go:41] attempting to write to file "C:\Users\bluee\.minikube\client.crt" with filemode -rw-r--r--
    I0925 23:49:37.379681 12620 crypto.go:165] Writing key to C:\Users\bluee.minikube\client.key ...
    I0925 23:49:37.379681 12620 lock.go:41] attempting to write to file "C:\Users\bluee\.minikube\client.key" with filemode -rw-------
    I0925 23:49:37.384668 12620 crypto.go:69] Generating cert C:\Users\bluee.minikube\apiserver.crt with IP's: [192.168.215.108 10.96.0.1 10.0.0.1]
    I0925 23:49:37.583666 12620 crypto.go:157] Writing cert to C:\Users\bluee.minikube\apiserver.crt ...
    I0925 23:49:37.583666 12620 lock.go:41] attempting to write to file "C:\Users\bluee\.minikube\apiserver.crt" with filemode -rw-r--r--
    I0925 23:49:37.590668 12620 crypto.go:165] Writing key to C:\Users\bluee.minikube\apiserver.key ...
    I0925 23:49:37.590668 12620 lock.go:41] attempting to write to file "C:\Users\bluee\.minikube\apiserver.key" with filemode -rw-------
    I0925 23:49:37.596681 12620 crypto.go:69] Generating cert C:\Users\bluee.minikube\proxy-client.crt with IP's: []
    I0925 23:49:37.881696 12620 crypto.go:157] Writing cert to C:\Users\bluee.minikube\proxy-client.crt ...
    I0925 23:49:37.881696 12620 lock.go:41] attempting to write to file "C:\Users\bluee\.minikube\proxy-client.crt" with filemode -rw-r--r--
    I0925 23:49:37.888680 12620 crypto.go:165] Writing key to C:\Users\bluee.minikube\proxy-client.key ...
    I0925 23:49:37.888680 12620 lock.go:41] attempting to write to file "C:\Users\bluee\.minikube\proxy-client.key" with filemode -rw-------
    I0925 23:49:37.894666 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee.minikube\ca.crt -> /var/lib/minikube/certs/ca.crt
    I0925 23:49:37.894666 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee.minikube\ca.key -> /var/lib/minikube/certs/ca.key
    I0925 23:49:37.895667 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee.minikube\apiserver.crt -> /var/lib/minikube/certs/apiserver.crt
    I0925 23:49:37.897675 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee.minikube\apiserver.key -> /var/lib/minikube/certs/apiserver.key
    I0925 23:49:37.898668 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee.minikube\proxy-client-ca.crt -> /var/lib/minikube/certs/proxy-client-ca.crt
    I0925 23:49:37.898668 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee.minikube\proxy-client-ca.key -> /var/lib/minikube/certs/proxy-client-ca.key
    I0925 23:49:37.899666 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee.minikube\proxy-client.crt -> /var/lib/minikube/certs/proxy-client.crt
    I0925 23:49:37.900749 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee.minikube\proxy-client.key -> /var/lib/minikube/certs/proxy-client.key
    I0925 23:49:37.903677 12620 vm_assets.go:82] NewFileAsset: C:\Users\bluee.minikube\ca.crt -> /usr/share/ca-certificates/minikubeCA.pem
    I0925 23:49:37.905685 12620 ssh_runner.go:170] Transferring 1066 bytes to /var/lib/minikube/certs/ca.crt
    I0925 23:49:37.906667 12620 ssh_runner.go:189] ca.crt: copied 1066 bytes
    I0925 23:49:37.914666 12620 ssh_runner.go:170] Transferring 1679 bytes to /var/lib/minikube/certs/ca.key
    I0925 23:49:37.915671 12620 ssh_runner.go:189] ca.key: copied 1679 bytes
    I0925 23:49:37.924669 12620 ssh_runner.go:170] Transferring 1298 bytes to /var/lib/minikube/certs/apiserver.crt
    I0925 23:49:37.925342 12620 ssh_runner.go:189] apiserver.crt: copied 1298 bytes
    I0925 23:49:37.933339 12620 ssh_runner.go:170] Transferring 1675 bytes to /var/lib/minikube/certs/apiserver.key
    I0925 23:49:37.934337 12620 ssh_runner.go:189] apiserver.key: copied 1675 bytes
    I0925 23:49:37.942342 12620 ssh_runner.go:170] Transferring 1074 bytes to /var/lib/minikube/certs/proxy-client-ca.crt
    I0925 23:49:37.944372 12620 ssh_runner.go:189] proxy-client-ca.crt: copied 1074 bytes
    I0925 23:49:37.952339 12620 ssh_runner.go:170] Transferring 1679 bytes to /var/lib/minikube/certs/proxy-client-ca.key
    I0925 23:49:37.953343 12620 ssh_runner.go:189] proxy-client-ca.key: copied 1679 bytes
    I0925 23:49:37.961339 12620 ssh_runner.go:170] Transferring 1103 bytes to /var/lib/minikube/certs/proxy-client.crt
    I0925 23:49:37.962338 12620 ssh_runner.go:189] proxy-client.crt: copied 1103 bytes
    I0925 23:49:37.970341 12620 ssh_runner.go:170] Transferring 1679 bytes to /var/lib/minikube/certs/proxy-client.key
    I0925 23:49:37.971345 12620 ssh_runner.go:189] proxy-client.key: copied 1679 bytes
    I0925 23:49:37.980353 12620 ssh_runner.go:170] Transferring 1066 bytes to /usr/share/ca-certificates/minikubeCA.pem
    I0925 23:49:37.981341 12620 ssh_runner.go:189] minikubeCA.pem: copied 1066 bytes
    I0925 23:49:37.989357 12620 ssh_runner.go:170] Transferring 428 bytes to /var/lib/minikube/kubeconfig
    I0925 23:49:37.990346 12620 ssh_runner.go:189] kubeconfig: copied 428 bytes
    I0925 23:49:37.999340 12620 ssh_runner.go:102] SSH: which openssl
    I0925 23:49:38.002339 12620 utils.go:167] > /usr/bin/openssl
    I0925 23:49:38.002339 12620 ssh_runner.go:102] SSH: sudo test -f '/etc/ssl/certs/minikubeCA.pem'
    I0925 23:49:38.013341 12620 ssh_runner.go:102] SSH: sudo ln -s '/usr/share/ca-certificates/minikubeCA.pem' '/etc/ssl/certs/minikubeCA.pem'
    I0925 23:49:38.019336 12620 ssh_runner.go:138] Run with output: openssl x509 -hash -noout -in '/usr/share/ca-certificates/minikubeCA.pem'
    I0925 23:49:38.033338 12620 utils.go:167] > b5213941
    I0925 23:49:38.033338 12620 ssh_runner.go:102] SSH: sudo test -f '/etc/ssl/certs/b5213941.0'
    I0925 23:49:38.041339 12620 ssh_runner.go:102] SSH: sudo ln -s '/etc/ssl/certs/minikubeCA.pem' '/etc/ssl/certs/b5213941.0'

  • Pulling images ...
    I0925 23:49:38.048343 12620 ssh_runner.go:102] SSH: sudo env PATH=/var/lib/minikube/binaries/v1.16.0:$PATH kubeadm config images pull --config /var/tmp/minikube/kubeadm.yaml
    I0925 23:49:40.218737 12620 utils.go:167] > [config/images] Pulled k8s.gcr.io/kube-apiserver:v1.16.0
    I0925 23:49:41.929938 12620 utils.go:167] > [config/images] Pulled k8s.gcr.io/kube-controller-manager:v1.16.0
    I0925 23:49:43.536224 12620 utils.go:167] > [config/images] Pulled k8s.gcr.io/kube-scheduler:v1.16.0
    I0925 23:49:45.142170 12620 utils.go:167] > [config/images] Pulled k8s.gcr.io/kube-proxy:v1.16.0
    I0925 23:49:46.812902 12620 utils.go:167] > [config/images] Pulled k8s.gcr.io/pause:3.1
    I0925 23:49:48.479979 12620 utils.go:167] > [config/images] Pulled k8s.gcr.io/etcd:3.3.15-0
    I0925 23:49:50.124194 12620 utils.go:167] > [config/images] Pulled k8s.gcr.io/coredns:1.6.2

  • Launching Kubernetes ...
    I0925 23:49:50.127146 12620 kubeadm.go:232] StartCluster: {KubernetesVersion:v1.16.0 NodeIP:192.168.215.108 NodePort:8443 NodeName:minikube APIServerName:minikubeCA APIServerNames:[] APIServerIPs:[] DNSDomain:cluster.local ContainerRuntime:docker CRISocket: NetworkPlugin: FeatureGates: ServiceCIDR:10.96.0.0/12 ImageRepository: ExtraOptions:[] ShouldLoadCachedImages:true EnableDefaultCNI:false}
    I0925 23:49:50.127146 12620 ssh_runner.go:138] Run with output: sudo env PATH=/var/lib/minikube/binaries/v1.16.0:$PATH kubeadm init --config /var/tmp/minikube/kubeadm.yaml --ignore-preflight-errors=DirAvailable--etc-kubernetes-manifests,DirAvailable--var-lib-minikube,FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml,FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml,FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml,FileAvailable--etc-kubernetes-manifests-etcd.yaml,Port-10250,Swap
    I0925 23:49:50.198034 12620 utils.go:167] > [init] Using Kubernetes version: v1.16.0
    I0925 23:49:50.198034 12620 utils.go:167] > [preflight] Running pre-flight checks
    I0925 23:49:50.260033 12620 utils.go:167] ! [WARNING Service-Docker]: docker service is not enabled, please run 'systemctl enable docker.service'
    I0925 23:49:50.290034 12620 utils.go:167] ! [WARNING IsDockerSystemdCheck]: detected "cgroupfs" as the Docker cgroup driver. The recommended driver is "systemd". Please follow the guide at https://kubernetes.io/docs/setup/cri/
    I0925 23:49:50.402291 12620 utils.go:167] ! [WARNING Service-Kubelet]: kubelet service is not enabled, please run 'systemctl enable kubelet.service'
    I0925 23:49:50.402291 12620 utils.go:167] > [preflight] Pulling images required for setting up a Kubernetes cluster
    I0925 23:49:50.404260 12620 utils.go:167] > [preflight] This might take a minute or two, depending on the speed of your internet connection
    I0925 23:49:50.405981 12620 utils.go:167] > [preflight] You can also perform this action in beforehand using 'kubeadm config images pull'
    I0925 23:49:50.620524 12620 utils.go:167] > [kubelet-start] Writing kubelet environment file with flags to file "/var/lib/kubelet/kubeadm-flags.env"
    I0925 23:49:50.621525 12620 utils.go:167] > [kubelet-start] Writing kubelet configuration to file "/var/lib/kubelet/config.yaml"
    I0925 23:49:50.629537 12620 utils.go:167] > [kubelet-start] Activating the kubelet service
    I0925 23:49:50.703529 12620 utils.go:167] > [certs] Using certificateDir folder "/var/lib/minikube/certs"
    I0925 23:49:50.704527 12620 utils.go:167] > [certs] Using existing ca certificate authority
    I0925 23:49:50.707526 12620 utils.go:167] > [certs] Using existing apiserver certificate and key on disk
    I0925 23:49:50.969044 12620 utils.go:167] > [certs] Generating "apiserver-kubelet-client" certificate and key
    I0925 23:49:51.276583 12620 utils.go:167] > [certs] Generating "front-proxy-ca" certificate and key
    I0925 23:49:51.439075 12620 utils.go:167] > [certs] Generating "front-proxy-client" certificate and key
    I0925 23:49:51.614587 12620 utils.go:167] > [certs] Generating "etcd/ca" certificate and key
    I0925 23:49:51.706593 12620 utils.go:167] > [certs] Generating "etcd/server" certificate and key
    I0925 23:49:51.707584 12620 utils.go:167] > [certs] etcd/server serving cert is signed for DNS names [minikube localhost] and IPs [192.168.215.108 127.0.0.1 ::1]
    I0925 23:49:51.840827 12620 utils.go:167] > [certs] Generating "etcd/peer" certificate and key
    I0925 23:49:51.840827 12620 utils.go:167] > [certs] etcd/peer serving cert is signed for DNS names [minikube localhost] and IPs [192.168.215.108 127.0.0.1 ::1]
    I0925 23:49:52.028528 12620 utils.go:167] > [certs] Generating "etcd/healthcheck-client" certificate and key
    I0925 23:49:52.130521 12620 utils.go:167] > [certs] Generating "apiserver-etcd-client" certificate and key
    I0925 23:49:52.339105 12620 utils.go:167] > [certs] Generating "sa" key and public key
    I0925 23:49:52.339105 12620 utils.go:167] > [kubeconfig] Using kubeconfig folder "/etc/kubernetes"
    I0925 23:49:52.522617 12620 utils.go:167] > [kubeconfig] Writing "admin.conf" kubeconfig file
    I0925 23:49:52.656614 12620 utils.go:167] > [kubeconfig] Writing "kubelet.conf" kubeconfig file
    I0925 23:49:52.817641 12620 utils.go:167] > [kubeconfig] Writing "controller-manager.conf" kubeconfig file
    I0925 23:49:52.943639 12620 utils.go:167] > [kubeconfig] Writing "scheduler.conf" kubeconfig file
    I0925 23:49:52.943639 12620 utils.go:167] > [control-plane] Using manifest folder "/etc/kubernetes/manifests"
    I0925 23:49:52.943639 12620 utils.go:167] > [control-plane] Creating static Pod manifest for "kube-apiserver"
    I0925 23:49:52.950640 12620 utils.go:167] > [control-plane] Creating static Pod manifest for "kube-controller-manager"
    I0925 23:49:52.950640 12620 utils.go:167] > [control-plane] Creating static Pod manifest for "kube-scheduler"
    I0925 23:49:52.953641 12620 utils.go:167] > [etcd] Creating static Pod manifest for local etcd in "/etc/kubernetes/manifests"
    I0925 23:49:52.956642 12620 utils.go:167] > [wait-control-plane] Waiting for the kubelet to boot up the control plane as static Pods from directory "/etc/kubernetes/manifests". This can take up to 4m0s
    I0925 23:50:21.960011 12620 utils.go:167] > [apiclient] All control plane components are healthy after 29.004044 seconds
    I0925 23:50:21.961008 12620 utils.go:167] > [upload-config] Storing the configuration used in ConfigMap "kubeadm-config" in the "kube-system" Namespace
    I0925 23:50:21.976846 12620 utils.go:167] > [kubelet] Creating a ConfigMap "kubelet-config-1.16" in namespace kube-system with the configuration for the kubelets in the cluster
    I0925 23:50:22.511775 12620 utils.go:167] > [upload-certs] Skipping phase. Please see --upload-certs
    I0925 23:50:22.511775 12620 utils.go:167] > [mark-control-plane] Marking the node minikube as control-plane by adding the label "node-role.kubernetes.io/master=''"
    I0925 23:50:23.019513 12620 utils.go:167] > [bootstrap-token] Using token: v1nxsq.92da8nmajje2x9f2
    I0925 23:50:23.020507 12620 utils.go:167] > [bootstrap-token] Configuring bootstrap tokens, cluster-info ConfigMap, RBAC Roles
    I0925 23:50:23.026509 12620 utils.go:167] > [bootstrap-token] configured RBAC rules to allow Node Bootstrap tokens to post CSRs in order for nodes to get long term certificate credentials
    I0925 23:50:23.031512 12620 utils.go:167] > [bootstrap-token] configured RBAC rules to allow the csrapprover controller automatically approve CSRs from a Node Bootstrap Token
    I0925 23:50:23.034509 12620 utils.go:167] > [bootstrap-token] configured RBAC rules to allow certificate rotation for all node client certificates in the cluster
    I0925 23:50:23.038508 12620 utils.go:167] > [bootstrap-token] Creating the "cluster-info" ConfigMap in the "kube-public" namespace
    I0925 23:50:23.095510 12620 utils.go:167] > [addons] Applied essential addon: CoreDNS
    I0925 23:50:23.443369 12620 utils.go:167] > [addons] Applied essential addon: kube-proxy
    I0925 23:50:23.445369 12620 utils.go:167] > Your Kubernetes control-plane has initialized successfully!
    I0925 23:50:23.445369 12620 utils.go:167] > To start using your cluster, you need to run the following as a regular user:
    I0925 23:50:23.446367 12620 utils.go:167] > mkdir -p $HOME/.kube
    I0925 23:50:23.446367 12620 utils.go:167] > sudo cp -i /etc/kubernetes/admin.conf $HOME/.kube/config
    I0925 23:50:23.446367 12620 utils.go:167] > sudo chown $(id -u):$(id -g) $HOME/.kube/config
    I0925 23:50:23.447374 12620 utils.go:167] > You should now deploy a pod network to the cluster.
    I0925 23:50:23.447374 12620 utils.go:167] > Run "kubectl apply -f [podnetwork].yaml" with one of the options listed at:
    I0925 23:50:23.447374 12620 utils.go:167] > https://kubernetes.io/docs/concepts/cluster-administration/addons/
    I0925 23:50:23.447374 12620 utils.go:167] > You can now join any number of control-plane nodes by copying certificate authorities
    I0925 23:50:23.448367 12620 utils.go:167] > and service account keys on each node and then running the following as root:
    I0925 23:50:23.448367 12620 utils.go:167] > kubeadm join localhost:8443 --token v1nxsq.92da8nmajje2x9f2
    I0925 23:50:23.448367 12620 utils.go:167] > --discovery-token-ca-cert-hash sha256:21a9142e8241c987e1afa480a70f2f8b4d4231368cf453f4625352085aab9718
    I0925 23:50:23.448367 12620 utils.go:167] > --control-plane
    I0925 23:50:23.451369 12620 utils.go:167] > Then you can join any number of worker nodes by running the following on each as root:
    I0925 23:50:23.451369 12620 utils.go:167] > kubeadm join localhost:8443 --token v1nxsq.92da8nmajje2x9f2
    I0925 23:50:23.452369 12620 utils.go:167] > --discovery-token-ca-cert-hash sha256:21a9142e8241c987e1afa480a70f2f8b4d4231368cf453f4625352085aab9718
    I0925 23:50:23.454372 12620 kubeadm.go:273] Configuring cluster permissions ...
    I0925 23:50:23.459370 12620 kapi.go:58] client config for minikube: &rest.Config{Host:"https://192.168.215.108:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\Users\bluee\.minikube\client.crt", KeyFile:"C:\Users\bluee\.minikube\client.key", CAFile:"C:\Users\bluee\.minikube\ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil)}, UserAgent:"", Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x15ec950), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil)}
    I0925 23:50:23.533369 12620 util.go:67] duration metric: took 58.9978ms to wait for elevateKubeSystemPrivileges.
    I0925 23:50:23.533369 12620 ssh_runner.go:138] Run with output: cat /proc/$(pgrep kube-apiserver)/oom_adj
    I0925 23:50:23.542366 12620 utils.go:167] > -16
    I0925 23:50:23.542366 12620 kubeadm.go:299] apiserver oom_adj: -16
    I0925 23:50:23.542366 12620 kubeadm.go:234] StartCluster complete in 33.41522s

  • Waiting for: apiserverI0925 23:50:23.543365 12620 kubeadm.go:454] Waiting for apiserver process ...
    I0925 23:50:23.543365 12620 ssh_runner.go:102] SSH: sudo pgrep kube-apiserver
    I0925 23:50:23.551375 12620 utils.go:167] > 4097
    I0925 23:50:23.551375 12620 kubeadm.go:469] Waiting for apiserver to port healthy status ...
    I0925 23:50:23.557495 12620 kubeadm.go:156] https://192.168.215.108:8443/healthz response: &{Status:200 OK StatusCode:200 Proto:HTTP/1.1 ProtoMajor:1 ProtoMinor:1 Header:map[Cache-Control:[no-cache, private] Content-Length:[2] Content-Type:[text/plain; charset=utf-8] Date:[Wed, 25 Sep 2019 18:20:24 GMT] X-Content-Type-Options:[nosniff]] Body:0xc0003f5e80 ContentLength:2 TransferEncoding:[] Close:false Uncompressed:false Trailer:map[] Request:0xc000543500 TLS:0xc00031ce70}
    I0925 23:50:23.558371 12620 kubeadm.go:472] apiserver status: Running, err:
    I0925 23:50:23.558371 12620 kubeadm.go:451] duration metric: took 15.0059ms to wait for apiserver status ...
    I0925 23:50:23.559365 12620 kapi.go:58] client config for minikube: &rest.Config{Host:"https://192.168.215.108:8443", APIPath:"", ContentConfig:rest.ContentConfig{AcceptContentTypes:"", ContentType:"", GroupVersion:(*schema.GroupVersion)(nil), NegotiatedSerializer:runtime.NegotiatedSerializer(nil)}, Username:"", Password:"", BearerToken:"", BearerTokenFile:"", Impersonate:rest.ImpersonationConfig{UserName:"", Groups:[]string(nil), Extra:map[string][]string(nil)}, AuthProvider:, AuthConfigPersister:rest.AuthProviderConfigPersister(nil), ExecProvider:, TLSClientConfig:rest.sanitizedTLSClientConfig{Insecure:false, ServerName:"", CertFile:"C:\Users\bluee\.minikube\client.crt", KeyFile:"C:\Users\bluee\.minikube\client.key", CAFile:"C:\Users\bluee\.minikube\ca.crt", CertData:[]uint8(nil), KeyData:[]uint8(nil), CAData:[]uint8(nil)}, UserAgent:"", Transport:http.RoundTripper(nil), WrapTransport:(transport.WrapperFunc)(0x15ec950), QPS:0, Burst:0, RateLimiter:flowcontrol.RateLimiter(nil), Timeout:0, Dial:(func(context.Context, string, string) (net.Conn, error))(nil)}
    proxyI0925 23:50:23.568365 12620 kapi.go:74] Waiting for pod with label "kube-system" in ns "k8s-app=kube-proxy" ...
    I0925 23:50:23.576367 12620 kapi.go:85] Found 0 Pods for label selector k8s-app=kube-proxy
    I0925 23:50:30.081663 12620 kapi.go:85] Found 1 Pods for label selector k8s-app=kube-proxy
    I0925 23:50:30.082659 12620 kapi.go:95] waiting for pod "k8s-app=kube-proxy", current state: Pending: []
    I0925 23:50:30.582337 12620 kapi.go:95] waiting for pod "k8s-app=kube-proxy", current state: Pending: []
    I0925 23:50:31.088916 12620 kapi.go:107] duration metric: took 7.520551s to wait for k8s-app=kube-proxy ...
    etcdI0925 23:50:31.090914 12620 kapi.go:74] Waiting for pod with label "kube-system" in ns "component=etcd" ...
    I0925 23:50:31.129433 12620 kapi.go:85] Found 0 Pods for label selector component=etcd
    I0925 23:51:47.636875 12620 kapi.go:85] Found 1 Pods for label selector component=etcd
    I0925 23:51:47.636875 12620 kapi.go:95] waiting for pod "component=etcd", current state: Pending: []
    I0925 23:51:48.133495 12620 kapi.go:95] waiting for pod "component=etcd", current state: Pending: []
    I0925 23:51:48.635243 12620 kapi.go:95] waiting for pod "component=etcd", current state: Pending: []
    I0925 23:51:49.132550 12620 kapi.go:95] waiting for pod "component=etcd", current state: Pending: []
    I0925 23:51:49.635100 12620 kapi.go:95] waiting for pod "component=etcd", current state: Pending: []
    I0925 23:51:50.134380 12620 kapi.go:95] waiting for pod "component=etcd", current state: Pending: []
    I0925 23:51:50.641967 12620 kapi.go:95] waiting for pod "component=etcd", current state: Pending: []
    I0925 23:51:51.140370 12620 kapi.go:95] waiting for pod "component=etcd", current state: Pending: []
    I0925 23:51:51.642210 12620 kapi.go:95] waiting for pod "component=etcd", current state: Pending: []
    I0925 23:51:52.136292 12620 kapi.go:95] waiting for pod "component=etcd", current state: Pending: []
    I0925 23:51:52.636872 12620 kapi.go:95] waiting for pod "component=etcd", current state: Pending: []
    I0925 23:51:53.139394 12620 kapi.go:95] waiting for pod "component=etcd", current state: Pending: []
    I0925 23:51:53.636322 12620 kapi.go:107] duration metric: took 1m22.5454088s to wait for component=etcd ...
    schedulerI0925 23:51:53.637324 12620 kapi.go:74] Waiting for pod with label "kube-system" in ns "component=kube-scheduler" ...
    I0925 23:51:53.645339 12620 kapi.go:85] Found 1 Pods for label selector component=kube-scheduler
    I0925 23:51:53.645339 12620 kapi.go:107] duration metric: took 8.0151ms to wait for component=kube-scheduler ...
    controllerI0925 23:51:53.647359 12620 kapi.go:74] Waiting for pod with label "kube-system" in ns "component=kube-controller-manager" ...
    I0925 23:51:53.652329 12620 kapi.go:85] Found 1 Pods for label selector component=kube-controller-manager
    I0925 23:51:53.652329 12620 kapi.go:107] duration metric: took 4.9703ms to wait for component=kube-controller-manager ...
    dnsI0925 23:51:53.654328 12620 kapi.go:74] Waiting for pod with label "kube-system" in ns "k8s-app=kube-dns" ...
    I0925 23:51:53.658331 12620 kapi.go:85] Found 2 Pods for label selector k8s-app=kube-dns
    I0925 23:51:53.658331 12620 kapi.go:107] duration metric: took 4.0032ms to wait for k8s-app=kube-dns ...

  • Done! kubectl is now configured to use "minikube"
    PS C:>

FYI, I can reproduce the above issue as well. Also, not sure why the authenticated downloads during caching of images is failing but anonymous download is passing in the above log?

@medyagh
Copy link
Member

medyagh commented Sep 26, 2019

hm... so running it from C works just fine ? I wonder if we could detect earlier and tell the user to run from C ?

@sharifelgamal
Copy link
Collaborator

This is a known issue with Windows, marking as a dupe of #4802.

@sharifelgamal sharifelgamal added the triage/duplicate Indicates an issue is a duplicate of other open issue. label Oct 23, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
co/hyperv HyperV related issues kind/support Categorizes issue or PR as a support question. os/windows triage/duplicate Indicates an issue is a duplicate of other open issue. triage/needs-information Indicates an issue needs more information in order to work on it.
Projects
None yet
Development

No branches or pull requests

4 participants