Skip to content

Conversation

@eyazici90
Copy link
Contributor

@eyazici90 eyazici90 commented Apr 17, 2025

Context

This is to manage timeout for the context that is passed to pagerduty calls. Group level context is set to wider intervals on the dispatcher such as 5mins default, whereas we would like to set lower level thresholds for pagerduty integrations to have limit on retries and intermediate blockers in the network.

Relates to #4348

Case

In our setup with HA usage of AM, we use proxy for egress comm from alertmanagers to PD(pagerduty) that sits in between. Our proxy may lead to block such calls taking way longer than expected leading to no retries and hanging connections at alertmanager side as the parent context is set at dispatcher that is group interval.

We should be able to set smaller duration timeout for outgoing calls to pagerduty, consequently having more controls for robust communication.

This is to manager timeout for the context that is passed to pagerduty calls. Group level context is set to wider intervals such as 5mins, whereas we would like to set lower level threasholds for pagerduty integrations to have limit on retries and intermediate blockers in the network.

Signed-off-by: emreya <e.yazici1990@gmail.com>
Signed-off-by: emreya <e.yazici1990@gmail.com>
To see if timeout option is obeyed.

Signed-off-by: emreya <e.yazici1990@gmail.com>
@eyazici90 eyazici90 marked this pull request as ready for review April 18, 2025 09:08
To improve readability of the test.

Signed-off-by: emreya <e.yazici1990@gmail.com>
Copy link
Contributor

@rajagopalanand rajagopalanand left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@eyazici90
Copy link
Contributor Author

@grobinson-grafana Could u help me with the review? 🙏

@eyazici90
Copy link
Contributor Author

Could u help me with review @SuperQ ?

@SuperQ SuperQ merged commit ca9ed08 into prometheus:main Oct 19, 2025
5 checks passed
@SoloJacobs SoloJacobs mentioned this pull request Nov 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants