shadowsock proxy: kube-proxy configmap update: timed out: Unable to register node connection refused #3031

efengx · 2018-07-31T10:35:11Z

Is this a BUG REPORT or FEATURE REQUEST? (choose one):
BUG REPORT

Please provide the following details:

Environment:
macOS High Sierra(MacBook Pro (Retina, 15-inch, Mid 2015))
Docker version 18.06.0-ce, build 0ffa825
kubectl version:v1.10.2

Minikube version (use minikube version): v0.28.2

OS (e.g. from /etc/os-release): macOS High Sierra(MacBook Pro (Retina, 15-inch, Mid 2015))
cat: /etc/os-release: No such file or directory
VM Driver (e.g. cat ~/.minikube/machines/minikube/config.json | grep DriverName): "DriverName": "virtualbox",
ISO version (e.g. cat ~/.minikube/machines/minikube/config.json | grep -i ISO or minikube ssh cat /etc/VERSION):"Boot2DockerURL": "file:///Users/ofengx/.minikube/cache/iso/minikube-v0.28.1.iso"
Install tools: Homebrew 1.7.1 (Homebrew/homebrew-core (git revision 299fc; last commit 2018-07-30))
Others:
The above can be generated in one go with the following commands (can be copied and pasted directly into your terminal):

minikube version
echo "";
echo "OS:";
cat /etc/os-release
echo "";
echo "VM driver": 
grep DriverName ~/.minikube/machines/minikube/config.json
echo "";
echo "ISO version";
grep -i ISO ~/.minikube/machines/minikube/config.json

What happened:

bogon% minikube start
Starting local Kubernetes v1.10.0 cluster...
Starting VM...
Getting VM IP address...
Moving files into cluster...
Setting up certs...
Connecting to cluster...
Setting up kubeconfig...
Starting cluster components...
E0731 18:16:39.216933   18636 start.go:305] Error restarting cluster:  restarting kube-proxy: waiting for kube-proxy to be up for configmap update: timed out waiting for the condition
E0731 18:16:39.327064   18636 util.go:151] Error uploading error message: : Post https://clouderrorreporting.googleapis.com/v1beta1/projects/k8s-minikube/events:report?key=AIzaSyACUwzG0dEPcl-eOgpDKnyKoUFgHdfoFuA: read tcp 192.168.1.102:56815->172.217.24.42:443: read: connection reset by peer

What you expected to happen: Can start correctly

How to reproduce it (as minimally and precisely as possible): minikube start

Output of minikube logs (if applicable):

Jul 31 10:32:11 minikube kubelet[3121]: I0731 10:32:11.516325    3121 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Jul 31 10:32:11 minikube kubelet[3121]: I0731 10:32:11.519107    3121 kubelet_node_status.go:82] Attempting to register node minikube
Jul 31 10:32:11 minikube kubelet[3121]: E0731 10:32:11.519447    3121 kubelet_node_status.go:106] Unable to register node "minikube" with API server: Post https://localhost:8443/api/v1/nodes: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:11 minikube kubelet[3121]: E0731 10:32:11.891049    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:11 minikube kubelet[3121]: E0731 10:32:11.892339    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:11 minikube kubelet[3121]: E0731 10:32:11.893691    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: E0731 10:32:12.183082    3121 event.go:209] Unable to write event: 'Patch https://localhost:8443/api/v1/namespaces/default/events/minikube.15466b9eb0ebe955: dial tcp 127.0.0.1:8443: getsockopt: connection refused' (may retry after sleeping)
Jul 31 10:32:12 minikube kubelet[3121]: W0731 10:32:12.381350    3121 status_manager.go:461] Failed to get status for pod "kube-apiserver-minikube_kube-system(8992e871ee1a351e263f594547a078f7)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: W0731 10:32:12.381864    3121 status_manager.go:461] Failed to get status for pod "kube-apiserver-minikube_kube-system(dba6863aab51a307a859d780f9ae1044)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-apiserver-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: W0731 10:32:12.382410    3121 status_manager.go:461] Failed to get status for pod "kube-controller-manager-minikube_kube-system(e46ad27d50ade97ba19ee3c2bbf58276)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: W0731 10:32:12.382693    3121 status_manager.go:461] Failed to get status for pod "etcd-minikube_kube-system(e5e1f61a35d019a62e13bbcf10bd25c4)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/etcd-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: W0731 10:32:12.382875    3121 status_manager.go:461] Failed to get status for pod "etcd-minikube_kube-system(1721ddabe174a549a90501ff84c8b807)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/etcd-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: W0731 10:32:12.383052    3121 status_manager.go:461] Failed to get status for pod "kube-controller-manager-minikube_kube-system(375ab1764ef440b06253b7d8f5aa513f)": Get https://localhost:8443/api/v1/namespaces/kube-system/pods/kube-controller-manager-minikube: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: E0731 10:32:12.892489    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: E0731 10:32:12.892865    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:12 minikube kubelet[3121]: E0731 10:32:12.894134    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:13 minikube kubelet[3121]: E0731 10:32:13.893413    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:13 minikube kubelet[3121]: E0731 10:32:13.895094    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:13 minikube kubelet[3121]: E0731 10:32:13.895782    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:14 minikube kubelet[3121]: E0731 10:32:14.767104    3121 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found
Jul 31 10:32:14 minikube kubelet[3121]: E0731 10:32:14.895824    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:14 minikube kubelet[3121]: E0731 10:32:14.895824    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:14 minikube kubelet[3121]: E0731 10:32:14.897166    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:15 minikube kubelet[3121]: E0731 10:32:15.898092    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:15 minikube kubelet[3121]: E0731 10:32:15.898826    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:15 minikube kubelet[3121]: E0731 10:32:15.900280    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:16 minikube kubelet[3121]: E0731 10:32:16.900171    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/config/apiserver.go:47: Failed to list *v1.Pod: Get https://localhost:8443/api/v1/pods?fieldSelector=spec.nodeName%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:16 minikube kubelet[3121]: E0731 10:32:16.901161    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:460: Failed to list *v1.Node: Get https://localhost:8443/api/v1/nodes?fieldSelector=metadata.name%3Dminikube&limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:16 minikube kubelet[3121]: E0731 10:32:16.901786    3121 reflector.go:205] k8s.io/kubernetes/pkg/kubelet/kubelet.go:451: Failed to list *v1.Service: Get https://localhost:8443/api/v1/services?limit=500&resourceVersion=0: dial tcp 127.0.0.1:8443: getsockopt: connection refused
Jul 31 10:32:17 minikube kubelet[3121]: I0731 10:32:17.380585    3121 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach

Anything else do we need to know:
Using the Chinese network
Shadowsock + ss + global Mode

The text was updated successfully, but these errors were encountered:

akellehe · 2018-08-03T14:56:34Z

I consistently get the reported behavior.

I also see the following in the minikube logs

Aug 03 15:10:36 minikube kubelet[2803]: E0803 15:10:36.783080    2803 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found
Aug 03 15:10:44 minikube kubelet[2803]: I0803 15:10:44.495677    2803 kubelet_node_status.go:271] Setting node annotation to enable volume controller attach/detach
Aug 03 15:10:45 minikube kubelet[2803]: I0803 15:10:45.090958    2803 reconciler.go:154] Reconciler: start to sync state
Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.118588    2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d24f46", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node minikube status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df53f46, ext:277649639, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df53f46, ext:277649639, loc:(*time.Location)(0x5b98020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.173921    2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d25e84", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df54e84, ext:277653540, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df54e84, ext:277653540, loc:(*time.Location)(0x5b98020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.229168    2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d2676c", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df5576c, ext:277655820, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df5576c, ext:277655820, loc:(*time.Location)(0x5b98020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.282958    2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d26faf", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df55faf, ext:277657936, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df55faf, ext:277657936, loc:(*time.Location)(0x5b98020)}}, Count:1, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.340582    2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d25e84", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df54e84, ext:277653540, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da3a27dde7, ext:482293642, loc:(*time.Location)(0x5b98020)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.397558    2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d24f46", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node minikube status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df53f46, ext:277649639, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da3a27937e, ext:482274593, loc:(*time.Location)(0x5b98020)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.456008    2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d2676c", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df5576c, ext:277655820, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da3a27ea91, ext:482296885, loc:(*time.Location)(0x5b98020)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.512618    2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d26faf", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df55faf, ext:277657936, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da3a27f32c, ext:482299091, loc:(*time.Location)(0x5b98020)}}, Count:2, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Aug 03 15:10:45 minikube kubelet[2803]: E0803 15:10:45.775745    2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d25e84", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientMemory", Message:"Node minikube status is now: NodeHasSufficientMemory", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df54e84, ext:277653540, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da56a6578f, ext:886602546, loc:(*time.Location)(0x5b98020)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Aug 03 15:10:46 minikube kubelet[2803]: E0803 15:10:46.173696    2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d24f46", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientDisk", Message:"Node minikube status is now: NodeHasSufficientDisk", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df53f46, ext:277649639, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da56a5225f, ext:886523395, loc:(*time.Location)(0x5b98020)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Aug 03 15:10:46 minikube kubelet[2803]: E0803 15:10:46.573875    2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d2676c", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasNoDiskPressure", Message:"Node minikube status is now: NodeHasNoDiskPressure", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df5576c, ext:277655820, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da56a6696c, ext:886607119, loc:(*time.Location)(0x5b98020)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)
Aug 03 15:10:46 minikube kubelet[2803]: E0803 15:10:46.783538    2803 eviction_manager.go:246] eviction manager: failed to get get summary stats: failed to get node info: node "minikube" not found
Aug 03 15:10:46 minikube kubelet[2803]: E0803 15:10:46.975036    2803 event.go:200] Server rejected event '&v1.Event{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"minikube.1547685337d26faf", GenerateName:"", Namespace:"default", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Initializers:(*v1.Initializers)(nil), Finalizers:[]string(nil), ClusterName:""}, InvolvedObject:v1.ObjectReference{Kind:"Node", Namespace:"", Name:"minikube", UID:"minikube", APIVersion:"", ResourceVersion:"", FieldPath:""}, Reason:"NodeHasSufficientPID", Message:"Node minikube status is now: NodeHasSufficientPID", Source:v1.EventSource{Component:"kubelet", Host:"minikube"}, FirstTimestamp:v1.Time{Time:time.Time{wall:0xbed139da2df55faf, ext:277657936, loc:(*time.Location)(0x5b98020)}}, LastTimestamp:v1.Time{Time:time.Time{wall:0xbed139da56a689ea, ext:886615436, loc:(*time.Location)(0x5b98020)}}, Count:3, Type:"Normal", EventTime:v1.MicroTime{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, Series:(*v1.EventSeries)(nil), Action:"", Related:(*v1.ObjectReference)(nil), ReportingController:"", ReportingInstance:""}': 'namespaces "default" not found' (will not retry!)

I can also add that if I try again repeatedly it eventually works.

Environment:
macOS High Sierra(MacBook Pro (Retina, 15-inch, Mid 2017))
Docker version 18.06.0-ce, build 0ffa825
kubectl version:v1.10.4

Minikube version (use minikube version): v0.28.2

OS (e.g. from /etc/os-release): macOS High Sierra(MacBook Pro (Retina, 13-inch, Mid 2017)) cat: /etc/os-release: No such file or directory
VM Driver (e.g. cat ~/.minikube/machines/minikube/config.json | grep DriverName): "DriverName": "virtualbox",
ISO version (e.g. cat ~/.minikube/machines/minikube/config.json | grep -i ISO")
Install tools: Homebrew 1.7.1 (Homebrew/homebrew-core (git revision 92d5; last commit 2018-08-01))

ianseyer · 2018-08-07T04:58:28Z

Also getting this behavior when attempting to start minikube with the kvm2 driver.

JTG2020 · 2018-08-22T10:38:02Z

I am having same problem...I tried on ubuntu 16.04, LUbuntu 16.04 and 18. Tired of setting up minikube on Ubuntu. Could anyone guide on how to resolve this ?

minikube version: v0.28.2
OS - Ubuntu 16.04
VBox- 5.1.38_Ubuntur122592
Laptop - HP Notebook 15
Memory - 4GB, 2 cpus

output -
Below are exact output -
minikube start
Starting local Kubernetes v1.10.0 cluster...
Starting VM...
Getting VM IP address...
Moving files into cluster...
Setting up certs...
Connecting to cluster...
Setting up kubeconfig...
Starting cluster components...
E0822 06:27:21.931685 11383 start.go:305] Error restarting cluster: restarting kube-proxy: waiting for kube-proxy to be up for configmap update: timed out waiting for the condition

rhogannginx · 2018-08-22T19:18:26Z

I am seeing this problem as well on MacOS High Sierra and the VMware Fusion Driver.

systemlevel · 2018-08-23T23:18:35Z

Running to the same issue here using same config as @efengx with the exception that I am using vmwarefusion

mirgee · 2018-08-29T06:58:42Z

Same issue here with the same configuration as @JTG2020

sinamiandashti · 2018-09-02T09:34:52Z

same here Ubuntu 18

cantino · 2018-09-05T22:06:54Z

I am also having this issue.

Lots of log entries like

Sep 05 22:05:31 minikube kubelet[27422]: E0905 22:05:31.818666   27422 pod_workers.go:186] Error syncing pod fedfcb7b-b14f-11e8-afc9-080027c07615 ("kubernetes-dashboard-5498ccf677-l7kk2_kube-system(fedfcb7b-b14f-11e8-afc9-080027c07615)"), skipping: failed to "StartContainer" for "kubernetes-dashboard" with CrashLoopBackOff: "Back-off 1m20s restarting failed container=kubernetes-dashboard pod=kubernetes-dashboard-5498ccf677-l7kk2_kube-system(fedfcb7b-b14f-11e8-afc9-080027c07615)"

geo-az · 2018-09-11T23:05:54Z

Hello this is my first post so don't mind missing precision,
Im on a Windows 10 Home, I7, 16Gb use Virtualbox,
installed using choco
I had the same error as in the first Question and solved it by:
Giving Virtualbox permanent Admin privileges through
Start-> VirtualBox ->properties ->Compatibility -> start as Administrator
Then Allowing VirtualBox permanentely to communicate through the Windows Defender Firewall (in Adding VirtualBox to the allowed Apps List)
finally restart system
and

minikube delete && minikube start

in a regular non admin cmd shell
made it work

Just let me know if it works for you as well and if you think the privileges are too risky (on a private W-lan)

tstromberg · 2018-09-18T23:03:53Z

FWIW, this sounds like either a firewall or routing issue, where the host is not configured to be able to contact the VM it installs.

JTG2020 · 2018-09-19T02:35:25Z

The issue is happening on laptop. Is there anything that needs to be checked? Because I can start and stop VM with sudo.

…

Sent from my iPad

On Sep 18, 2018, at 7:04 PM, Thomas Strömberg ***@***.***> wrote: FWIW, this sounds like either a firewall or routing issue, where the host is not configured to be able to contact the VM it installs. — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

xunpan · 2018-10-29T02:14:19Z

My environment has similar issue.
It is fine last Friday to start a k8s cluster. I use version 0.28. Today it failed with message:
" Error starting cluster: kubeadm init error"

I upgrade minikube to 0.30. It failed with below message for command " minikube start -p cluster1 --kubernetes-version v1.11.0"

"E1028 21:47:30.342880 23752 start.go:302] Error restarting cluster: restarting kube-proxy: waiting for kube-proxy to be up for configmap update: timed out waiting for the condition"

syntheticproduct · 2018-10-31T23:42:21Z

We are having the same issue
MacOs Mojave 10.14
minikube v0.30
kubectl version 1.12

minikube start gives us "restarting kube-proxy: waiting for kube-proxy to be up for configmap update: timed out waiting for the condition"

update: minikube delete solved our issue.

abdelhegazi · 2018-11-11T17:41:25Z

MacOs Mojave 10.14
minikube v0.30
kubectl version 1.12

I got the same exact issue and minikube delete didn't really fix it

JTG2020 · 2018-11-13T02:44:58Z

Somehow I could resolve the issue by running ubuntu in unsecured mode and minikube started successfully. My issue #3031 (comment) is resolved now but i don't think this is correct resolution.
After enabling secure boot again, minikube hangs up again. So i think the issue is something with communication between host and vm and modules such as dkmg that is causing communication.

abdelhegazi · 2018-11-15T20:19:01Z

I managed to resolve the issue by starting minikube in this way explicitly mentioning the K8S version

minikube start --kubernetes-version v1.11.0

minikube delete only didn't fix the issue for me as many commented mentioned but mentioning the cluster version did

marlovil · 2018-11-29T08:47:47Z

I managed to resolve the issue by starting minikube in this way explicitly mentioning the K8S version
minikube start --kubernetes-version v1.11.0
minikube delete only didn't fix the issue for me as many commented mentioned but mentioning the cluster version did

This worked for me as well! :)

Pezhvak · 2018-12-18T10:35:43Z

I managed to resolve the issue by starting minikube in this way explicitly mentioning the K8S version
minikube start --kubernetes-version v1.11.0
minikube delete only didn't fix the issue for me as many commented mentioned but mentioning the cluster version did

this actually helped me as well, but not just that, it didn't work as i expected, here's what i did:
open virtual box and remove all vms, then follow @n1t1nv3rma hint:
$ minikube delete
$ rm -rf ~/.minikube

now restart your computer (this did the trick for me, i did all these steps without restarting with no luck)

$ brew cask reinstall minikube

but when you want to start minikube provide kubernetes version to it
first get current kubernetes version by running:
$ kubectl version
(mine is 1.13.1 right now)

now use it like so:
$ minikube start --kubernetes-version v1.13.1

Note: you have to prefix 'v' to the version otherwise it won't work.
Note2: being connected to a vpn will cause timeout issues

all these steps has been posted by others, i just ran them in this order and it worked.

tstromberg · 2019-01-24T19:23:14Z

Related: #3145

scrossan-crown · 2019-02-13T07:39:40Z

Hello this is my first post so don't mind missing precision,
Im on a Windows 10 Home, I7, 16Gb use Virtualbox,
installed using choco
I had the same error as in the first Question and solved it by:
Giving Virtualbox permanent Admin privileges through
Start-> VirtualBox ->properties ->Compatibility -> start as Administrator
Then Allowing VirtualBox permanentely to communicate through the Windows Defender Firewall (in Adding VirtualBox to the allowed Apps List)
finally restart system
and

minikube delete && minikube start

in a regular non admin cmd shell
made it work

Just let me know if it works for you as well and if you think the privileges are too risky (on a private W-lan)

This worked perfectly for me. Thanks

fejta-bot · 2019-05-14T08:29:59Z

Issues go stale after 90d of inactivity.
Mark the issue as fresh with /remove-lifecycle stale.
Stale issues rot after an additional 30d of inactivity and eventually close.

If this issue is safe to close now please do so with /close.

Send feedback to sig-testing, kubernetes/test-infra and/or fejta.
/lifecycle stale

tstromberg · 2019-05-22T21:29:35Z

I believe this issue was resolved in the v1.1.0 release. Please try upgrading to the latest release of minikube, and if the same issue occurs, please re-open this bug. Thank you opening this bug report, and for your patience!

tstromberg added the area/networking networking issues label Sep 18, 2018

tstromberg added cause/firewall-or-proxy When firewalls or proxies seem to be interfering failed-start failed/local-networking startup failures due to networking issues and removed failed/local-networking startup failures due to networking issues failed-start labels Sep 18, 2018

tstromberg changed the title ~~kube-proxy to be up for configmap update: timed out waiting for the condition~~ kube-proxy configmap update: timed out (Unable to register node "minikube" connection refused) Sep 19, 2018

tstromberg mentioned this issue Sep 19, 2018

kube-proxy configmap update: timed out (unknown root cause) #2755

Closed

tstromberg added the ev/apiserver-refused failures due to the master on 8443 returning "Connection Refused" label Sep 19, 2018

tstromberg mentioned this issue Sep 19, 2018

waiting for kube-proxy to be up for configmap update + i/o timeout during log upload #2787

Closed

tstromberg added kind/bug Categorizes issue or PR as related to a bug. co/kube-proxy issues relating to kube-proxy in some way top5 os/macos co/virtualbox cause/poor-internet Failed due to internet access issues labels Sep 19, 2018

tstromberg mentioned this issue Sep 25, 2018

Mystery hang during /usr/bin/kubeadm init (with no --extra-config options) #2939

Closed

tstromberg mentioned this issue Oct 8, 2018

minikube start failure #3234

Closed

tstromberg mentioned this issue Oct 29, 2018

hyperv: Cluster not starting up / connection to port 8443 refused #3272

Closed

tstromberg removed top5 cause/poor-internet Failed due to internet access issues co/kube-proxy issues relating to kube-proxy in some way co/virtualbox failed/local-networking startup failures due to networking issues labels Jan 22, 2019

tstromberg changed the title ~~kube-proxy configmap update: timed out (Unable to register node "minikube" connection refused)~~ shadowsock proxy: kube-proxy configmap update: timed out: Unable to register node connection refused Jan 24, 2019

tstromberg added priority/backlog Higher priority than priority/awaiting-more-evidence. help wanted Denotes an issue that needs help from a contributor. Must meet "help wanted" guidelines. labels Jan 24, 2019

tstromberg mentioned this issue Mar 1, 2019

Improve reliability of kube-proxy configmap updates (retry, block until pods are up) #3774

Merged

k8s-ci-robot added the lifecycle/stale Denotes an issue or PR has remained open with no activity and has become stale. label May 14, 2019

tstromberg closed this as completed May 22, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

shadowsock proxy: kube-proxy configmap update: timed out: Unable to register node connection refused #3031

shadowsock proxy: kube-proxy configmap update: timed out: Unable to register node connection refused #3031

efengx commented Jul 31, 2018 •

edited

Loading

akellehe commented Aug 3, 2018 •

edited

Loading

ianseyer commented Aug 7, 2018

JTG2020 commented Aug 22, 2018

rhogannginx commented Aug 22, 2018

systemlevel commented Aug 23, 2018

mirgee commented Aug 29, 2018

sinamiandashti commented Sep 2, 2018

cantino commented Sep 5, 2018 •

edited

Loading

geo-az commented Sep 11, 2018 •

edited

Loading

tstromberg commented Sep 18, 2018

JTG2020 commented Sep 19, 2018 via email

xunpan commented Oct 29, 2018

syntheticproduct commented Oct 31, 2018 •

edited

Loading

abdelhegazi commented Nov 11, 2018

JTG2020 commented Nov 13, 2018

abdelhegazi commented Nov 15, 2018 •

edited

Loading

marlovil commented Nov 29, 2018

Pezhvak commented Dec 18, 2018

tstromberg commented Jan 24, 2019

scrossan-crown commented Feb 13, 2019

fejta-bot commented May 14, 2019

tstromberg commented May 22, 2019

shadowsock proxy: kube-proxy configmap update: timed out: Unable to register node connection refused #3031

shadowsock proxy: kube-proxy configmap update: timed out: Unable to register node connection refused #3031

Comments

efengx commented Jul 31, 2018 • edited Loading

akellehe commented Aug 3, 2018 • edited Loading

ianseyer commented Aug 7, 2018

JTG2020 commented Aug 22, 2018

rhogannginx commented Aug 22, 2018

systemlevel commented Aug 23, 2018

mirgee commented Aug 29, 2018

sinamiandashti commented Sep 2, 2018

cantino commented Sep 5, 2018 • edited Loading

geo-az commented Sep 11, 2018 • edited Loading

tstromberg commented Sep 18, 2018

JTG2020 commented Sep 19, 2018 via email

xunpan commented Oct 29, 2018

syntheticproduct commented Oct 31, 2018 • edited Loading

abdelhegazi commented Nov 11, 2018

JTG2020 commented Nov 13, 2018

abdelhegazi commented Nov 15, 2018 • edited Loading

marlovil commented Nov 29, 2018

Pezhvak commented Dec 18, 2018

tstromberg commented Jan 24, 2019

scrossan-crown commented Feb 13, 2019

fejta-bot commented May 14, 2019

tstromberg commented May 22, 2019

efengx commented Jul 31, 2018 •

edited

Loading

akellehe commented Aug 3, 2018 •

edited

Loading

cantino commented Sep 5, 2018 •

edited

Loading

geo-az commented Sep 11, 2018 •

edited

Loading

syntheticproduct commented Oct 31, 2018 •

edited

Loading

abdelhegazi commented Nov 15, 2018 •

edited

Loading