W0216

[joekohut]

cadvisor v0.27.4 fails to connect to docker daemon on start of docker services with --restart=unless-stopped when entire RedHat Atromic Host box is rebooted. Container log shows:

I0216 19:19:01.150340 1 manager.go:222] Version: {KernelVersion:3.10.0-327.18.2.el7.x86_64 ContainerOsVersion:Alpine Linux v3.4 DockerVersion:Unknown DockerAPIVersion:Unknown CadvisorVersion:v0.27.4 CadvisorRevision:492322b}
W0216 19:19:01.150783 1 manager.go:260] Docker container factory registration failed: failed to validate Docker info: failed to detect Docker info: Cannot connect to the Docker daemon. Is the docker daemon running on this host?.
W0216 19:19:01.150791 1 manager.go:265] Registration of the rkt container factory failed: unable to communicate with Rkt api service: rkt: cannot tcp Dial rkt api service: dial tcp [::1]:15441: getsockopt: connection refused
W0216 19:19:01.150863 1 manager.go:276] Registration of the crio container factory failed: Get http://%2Fvar%2Frun%2Fcrio.sock/info: dial unix /var/run/crio.sock: connect: no such file or directory

Cadvsior runs normally after the container is stopped and then started:
I0220 14:37:18.223709 1 manager.go:222] Version: {KernelVersion:3.10.0-327.18.2.el7.x86_64 ContainerOsVersion:Alpine Linux v3.4 DockerVersion:1.9.1 DockerAPIVersion:1.21 CadvisorVersion:v0.27.4 CadvisorRevision:492322b}
E0220 14:37:18.490204 1 factory.go:340] devicemapper filesystem stats will not be reported: RHEL/Centos 7.x kernel version 3.10.0-366 or later is required to use thin_ls - you have "3.10.0-327.18.2.el7.x86_64"
I0220 14:37:18.550727 1 factory.go:356] Registering Docker factory
W0220 14:37:18.550755 1 manager.go:265] Registration of the rkt container factory failed: unable to communicate with Rkt api service: rkt: cannot tcp Dial rkt api service: dial tcp [::1]:15441: getsockopt: connection refused
W0220 14:37:18.550970 1 manager.go:276] Registration of the crio container factory failed: Get http://%2Fvar%2Frun%2Fcrio.sock/info: dial unix /var/run/crio.sock: connect: no such file or directory
I0220 14:37:18.550986 1 factory.go:54] Registering systemd factory
I0220 14:37:18.554297 1 factory.go:86] Registering Raw factory
I0220 14:37:18.557236 1 manager.go:1140] Started watching for new ooms in manager
I0220 14:37:18.557947 1 manager.go:311] Starting recovery of all containers
I0220 14:37:18.856343 1 manager.go:316] Recovery completed
I0220 14:37:19.010707 1 cadvisor.go:159] Starting cAdvisor version: v0.27.4-492322b on port 8080

v0.28.x does not load on Atomic due to a different issue regarding cpuacct,cpu issue.
Is regression moby/moby#9365 back again?

[dashpole]

I think this could be related to #1866. We recently introduced a timeout for the connection to the docker daemon, but if it times out initially, it will never reconnect.