Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Multi node network problem with driver kvm2 #10044

Closed
lingsamuel opened this issue Dec 24, 2020 · 2 comments · Fixed by #10985
Closed

Multi node network problem with driver kvm2 #10044

lingsamuel opened this issue Dec 24, 2020 · 2 comments · Fixed by #10985
Labels
kind/bug Categorizes issue or PR as related to a bug.

Comments

@lingsamuel
Copy link
Contributor

Start minikube:

❯ cat .minikube/config/config.json
{
    "WantUpdateNotification": false,
    "cache": {
        "kindest/kindnetd:0.5.4": null,
        "nginx": null,
        "praqma/network-multitool": null
    },
    "driver": "kvm2",
    "kubernetes-version": "v1.19.3"
}

❯ minikube-v1.16.0 version
minikube version: v1.16.0
commit: 9f1e482427589ff8451c4723b6ba53bb9742fbb1

❯ minikube-v1.16.0 start -n 2

Test yaml comes from #9838

❯ kgp -o wide
NAME                        READY   STATUS    RESTARTS   AGE   IP           NODE           NOMINATED NODE   READINESS GATES
my-nginx-5b56ccd65f-mqsjt   1/1     Running   0          45s   10.244.0.4   minikube       <none>           <none>
my-nginx-5b56ccd65f-p6zwd   1/1     Running   0          45s   10.244.1.2   minikube-m02   <none>           <none>
my-nginx-5b56ccd65f-t6bpn   1/1     Running   0          45s   10.244.1.3   minikube-m02   <none>           <none>
my-nginx-5b56ccd65f-tnbcq   1/1     Running   0          45s   10.244.0.2   minikube       <none>           <none>
net-test-c4f9cfdd4-9dp2r    1/1     Running   0          45s   10.244.0.3   minikube       <none>           <none>
net-test-c4f9cfdd4-cx87r    1/1     Running   0          45s   10.244.1.5   minikube-m02   <none>           <none>
net-test-c4f9cfdd4-qd5mv    1/1     Running   0          45s   10.244.1.4   minikube-m02   <none>           <none>
net-test-c4f9cfdd4-zgmz7    1/1     Running   0          45s   10.244.0.5   minikube       <none>           <none>

Then test inside pod:

❯ kx net-test-c4f9cfdd4-9dp2r -- bash # pod in node minikube
bash-5.0# curl baidu.com
<html>
<meta http-equiv="refresh" content="0;url=http://www.baidu.com/">
</html>
bash-5.0# curl my-nginx --connect-timeout 10
<!DOCTYPE html>
<html>
.....
</html>
bash-5.0# curl my-nginx --connect-timeout 10
curl: (28) Connection timed out after 10001 milliseconds

bash-5.0# curl 10.244.1.2 --connect-timeout 10 # try ip
curl: (28) Connection timed out after 10001 milliseconds
bash-5.0# curl 10.244.0.2
<!DOCTYPE html>
<html>
...
</html>
❯ kx net-test-c4f9cfdd4-cx87r -- bash # pod in node minikube-m02
bash-5.0# curl baidu.com --connect-timeout 10
curl: (6) Could not resolve host: baidu.com
bash-5.0# curl my-nginx --connect-timeout 10
curl: (6) Could not resolve host: my-nginx
bash-5.0# curl ^C
bash-5.0# curl 10.244.1.2 --connect-timeout 10
<!DOCTYPE html>
<html>
...
</html>
bash-5.0# curl 10.244.0.2 --connect-timeout 10
curl: (7) Failed to connect to 10.244.0.2 port 80: Host is unreachable

Test in host machine:

❯ minikube-v1.16.0 ssh -n m02 # host m02
$ curl 10.244.0.4 # cannot connect to m01, includes coredns
curl: (7) Failed to connect to 10.244.0.4 port 80: No route to host
❯ minikube-v1.16.0 ssh
$ curl 10.244.1.2 # but m01 can access m02
<!DOCTYPE html>
<html>
...
</html>
@lingsamuel lingsamuel mentioned this issue Dec 24, 2020
Closed
@lingsamuel
Copy link
Contributor Author

/kind bug
Cluster with calico CNI works well. (minikube-v1.16.0 start -n 2 --cni='calico').

@k8s-ci-robot k8s-ci-robot added the kind/bug Categorizes issue or PR as related to a bug. label Dec 24, 2020
@lingsamuel
Copy link
Contributor Author

😂 because #10045 the CNI plugin not running
/close

@prezha prezha mentioned this issue Apr 5, 2021
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
kind/bug Categorizes issue or PR as related to a bug.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix CNI issue related to picking up wrong CNI prezha/minikube
2 participants
@lingsamuel @k8s-ci-robot