health_check extension: liveliness is failing, not sure.

[Ishmeet]

Component(s)

extension/healthcheck

What happened?

Description

Getting this error

Liveness probe failed: Get "http://10.85.3.47:13133/": dial tcp 10.85.3.47:13133: connect: connection refused 

But when I exec into the pod and do curl localhost:13133 it gives 200 ok. I am not sure, If I am missing something.

Otel config:

    extensions:
      health_check:
        check_collector_pipeline:
          enabled: true
          exporter_failure_threshold: 5
          interval: 5m
        endpoint: localhost:13133 // tried with 0.0.0.0:13133 -> same error   

I am using open telemetry-operator to create a statefulset pod of collector config.

curl from other pod to port 13133 is not working

# curl test-collector.default:13133
curl: (7) Failed to connect to test-collector.default port 13133 after 1 ms: Couldn't connect to server 

But I have pprof also configured at port 1777. That is working

# curl test-collector.default:1777
404 page not found

Steps to Reproduce

Use health check extension

Expected Result

Healthcheck should have worked.

Actual Result

Liveness probe failed: Get "http://10.85.3.47:13133/": dial tcp 10.85.3.47:13133: connect: connection refused 

Collector version

v0.79.0

Environment information

Environment

OS: (e.g., "Ubuntu 20.04")
Compiler(if manually compiled): (e.g., "go 14.2")

OpenTelemetry Collector configuration

extensions:
      health_check:
        check_collector_pipeline:
          enabled: true
          exporter_failure_threshold: 5
          interval: 5m
        endpoint: localhost:13133 // tried with 0.0.0.0:13133 -> same error

Log output

No response

Additional context

No response

[github-actions]

Pinging code owners:

• extension/healthcheck: @jpkrohling

See Adding Labels via Comments if you do not have permissions to add labels yourself.

[jpkrohling]

Can you share the entire collector logs? Using 0.0.0.0:13133 in the endpoint should have made it work.

[DewaldDeJager]

Did you enable the health check extension in the services section of the collector config?

service:
  extensions: [pprof, health_check]

[crobert-1]

/label waiting-for-author

[atoulme]

This bug has been waiting for author for a little while. Closing. Please reopen if more discussion is needed.