Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Collector exports partial list of internal telemetry metrics #34020

Closed
exemory opened this issue Jul 10, 2024 · 1 comment
Closed

Collector exports partial list of internal telemetry metrics #34020

exemory opened this issue Jul 10, 2024 · 1 comment
Labels
bug Something isn't working collector-telemetry needs triage New item requiring triage

Comments

@exemory
Copy link

exemory commented Jul 10, 2024 •
edited
Loading

Component(s)

No response

What happened?

Description

Only 21 metrics are exported instead of the full list, as stated in the docs

Steps to Reproduce

Expected Result

Complete list of metrics exported

Actual Result

Only 21 metrics are exported

# HELP otelcol_exporter_queue_capacity Fixed capacity of the retry queue (in batches)
# TYPE otelcol_exporter_queue_capacity gauge
otelcol_exporter_queue_capacity{exporter="otlphttp",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 1000
# HELP otelcol_exporter_queue_size Current size of the retry queue (in batches)
# TYPE otelcol_exporter_queue_size gauge
otelcol_exporter_queue_size{exporter="otlphttp",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 0
# HELP otelcol_exporter_send_failed_metric_points Number of metric points in failed attempts to send to destination.
# TYPE otelcol_exporter_send_failed_metric_points counter
otelcol_exporter_send_failed_metric_points{exporter="debug",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 0
otelcol_exporter_send_failed_metric_points{exporter="otlphttp",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 0
# HELP otelcol_exporter_sent_metric_points Number of metric points successfully sent to destination.
# TYPE otelcol_exporter_sent_metric_points counter
otelcol_exporter_sent_metric_points{exporter="debug",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 474
otelcol_exporter_sent_metric_points{exporter="otlphttp",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 474
# HELP otelcol_http_client_duration Measures the duration of outbound HTTP requests.
# TYPE otelcol_http_client_duration histogram
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="0"} 8
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="5"} 9
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="10"} 14
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="25"} 20
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="50"} 21
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="75"} 21
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="100"} 21
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="250"} 21
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="500"} 21
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="750"} 21
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="1000"} 21
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="2500"} 21
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="5000"} 21
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="7500"} 21
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="10000"} 21
otelcol_http_client_duration_bucket{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",le="+Inf"} 21
otelcol_http_client_duration_sum{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 152.56509999999997
otelcol_http_client_duration_count{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 21
# HELP otelcol_http_client_request_size Measures the size of HTTP request messages.
# TYPE otelcol_http_client_request_size counter
otelcol_http_client_request_size{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 137572
# HELP otelcol_http_client_response_size Measures the size of HTTP response messages.
# TYPE otelcol_http_client_response_size counter
otelcol_http_client_response_size{http_method="POST",http_status_code="200",net_peer_name="otlp-gateway-prod-eu-west-2.grafana.net",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 0
# HELP otelcol_process_cpu_seconds Total CPU user and system time in seconds
# TYPE otelcol_process_cpu_seconds counter
otelcol_process_cpu_seconds{service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 0.359375
# HELP otelcol_process_memory_rss Total physical memory (resident set size)
# TYPE otelcol_process_memory_rss gauge
otelcol_process_memory_rss{service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 1.21942016e+08
# HELP otelcol_process_runtime_heap_alloc_bytes Bytes of allocated heap objects (see 'go doc runtime.MemStats.HeapAlloc')
# TYPE otelcol_process_runtime_heap_alloc_bytes gauge
otelcol_process_runtime_heap_alloc_bytes{service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 4.1788968e+07
# HELP otelcol_process_runtime_total_alloc_bytes Cumulative bytes allocated for heap objects (see 'go doc runtime.MemStats.TotalAlloc')
# TYPE otelcol_process_runtime_total_alloc_bytes counter
otelcol_process_runtime_total_alloc_bytes{service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 5.7912e+07
# HELP otelcol_process_runtime_total_sys_memory_bytes Total bytes of memory obtained from the OS (see 'go doc runtime.MemStats.Sys')
# TYPE otelcol_process_runtime_total_sys_memory_bytes gauge
otelcol_process_runtime_total_sys_memory_bytes{service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 6.0836088e+07
# HELP otelcol_process_uptime Uptime of the process
# TYPE otelcol_process_uptime counter
otelcol_process_uptime{service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 212.085786
# HELP otelcol_processor_batch_metadata_cardinality Number of distinct metadata value combinations being processed
# TYPE otelcol_processor_batch_metadata_cardinality gauge
otelcol_processor_batch_metadata_cardinality{processor="batch",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 1
# HELP otelcol_receiver_accepted_metric_points Number of metric points successfully pushed into the pipeline.
# TYPE otelcol_receiver_accepted_metric_points counter
otelcol_receiver_accepted_metric_points{receiver="prometheus/otel-collector",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",transport="http"} 474
# HELP otelcol_receiver_refused_metric_points Number of metric points that could not be pushed into the pipeline.
# TYPE otelcol_receiver_refused_metric_points counter
otelcol_receiver_refused_metric_points{receiver="prometheus/otel-collector",service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0",transport="http"} 0
# HELP target_info Target metadata
# TYPE target_info gauge
target_info{service_instance_id="d7653d70-d78a-4586-9e89-e370814a57f6",service_name="otelcol-contrib",service_version="0.104.0"} 1

Collector version

0.104.0

Environment information

Environment

OS: Windows Server 2022 Datacenter Azure Edition

OpenTelemetry Collector configuration

receivers:
  otlp:
    protocols:
      grpc:
        endpoint: 0.0.0.0:4317
  prometheus/otel-collector:
    config:
      scrape_configs:
        - job_name: "otel-collector"
          scrape_interval: 10s
          static_configs:
            - targets: ["localhost:8888"]

connectors:
  spanmetrics:
  servicegraph:

processors:
  batch:

exporters:
  otlphttp:
    auth:
      authenticator: basicauth/otlp
    endpoint:
  debug:

extensions:
  health_check:
  basicauth/otlp:
    client_auth:
      username:
      password:

service:
  extensions: [health_check, basicauth/otlp]
  telemetry:
    metrics:
      address: localhost:8888
      level: detailed
  pipelines:
    traces:
      receivers: [otlp]
      processors: [batch]
      exporters: [spanmetrics, servicegraph, otlphttp]
    metrics:
      receivers: [otlp, spanmetrics, servicegraph]
      processors: [batch]
      exporters: [otlphttp]
    metrics/otel-collector:
      receivers: [prometheus/otel-collector]
      exporters: [otlphttp, debug]
    logs:
      receivers: [otlp]
      processors: [batch]
      exporters: [otlphttp]

Log output

1.7206190398069162e+09	info	MetricsExporter	{"kind": "exporter", "data_type": "metrics", "name": "debug", "resource metrics": 1, "metrics": 21, "data points": 23}

Additional context

Collector installed using msi package distribution
@exemory exemory added bug Something isn't working needs triage New item requiring triage labels Jul 10, 2024
@exemory
Copy link
Author

exemory commented Jul 11, 2024

It turns out I didn't send any data to OTLP receiver, so I didn't get other metrics

@exemory exemory closed this as completed Jul 11, 2024
@github-actions github-actions bot mentioned this issue Jul 16, 2024
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working collector-telemetry needs triage New item requiring triage
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@crobert-1 @exemory