Skip to content

[Metricbeat] Add missing snapshot metrics to pubsub metricset in gcp #17154

Closed

Description

Right now, pubsub metricset is only collecting metrics from API endpoints below:

- "pubsub.googleapis.com/subscription/ack_message_count"
- "pubsub.googleapis.com/subscription/backlog_bytes"
- "pubsub.googleapis.com/subscription/num_outstanding_messages"
- "pubsub.googleapis.com/subscription/num_undelivered_messages"
- "pubsub.googleapis.com/subscription/oldest_unacked_message_age"
- "pubsub.googleapis.com/subscription/pull_ack_message_operation_count"
- "pubsub.googleapis.com/subscription/pull_ack_request_count"
- "pubsub.googleapis.com/subscription/pull_message_operation_count"
- "pubsub.googleapis.com/subscription/pull_request_count"
- "pubsub.googleapis.com/subscription/push_request_count"
- "pubsub.googleapis.com/subscription/push_request_latencies"
- "pubsub.googleapis.com/subscription/sent_message_count"
- "pubsub.googleapis.com/subscription/streaming_pull_ack_message_operation_count"
- "pubsub.googleapis.com/subscription/streaming_pull_ack_request_count"
- "pubsub.googleapis.com/subscription/streaming_pull_message_operation_count"
- "pubsub.googleapis.com/subscription/streaming_pull_response_count"
- "pubsub.googleapis.com/topic/message_sizes"
- "pubsub.googleapis.com/topic/send_message_operation_count"
- "pubsub.googleapis.com/topic/send_request_count"

We are missing all snapshot related metrics for pubsub monitoring as well as part of the topic related. This list needs to be revisited and enriched later as well as https://www.elastic.co/guide/en/beats/metricbeat/master/metricbeat-metricset-googlecloud-pubsub.html.

Dashboard needs to be improved as well after more metrics are added.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Assignees

Labels

MetricbeatMetricbeatTeam:PlatformsLabel for the Integrations - Platforms team

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions