Skip to content

Conversation

@codyrioux
Copy link
Contributor

@codyrioux codyrioux commented Mar 9, 2022

Context

We have detected an issue internally that occurs with low probability. Connectors retrying an IP:PORT combination may connect to an unrelated job if that same IP:PORT combination is reused in a time frame less than the the client's expiration period. To address this we'll be making connection intentions explicit by passing a sourceJobName parameter when making a connection.

Checklist

  • ./gradlew build compiles code correctly
  • Added new tests where applicable
  • ./gradlew test passes all tests
  • Extended README or added javadocs where applicable
  • Added copyright headers for new files from CONTRIBUTING.md

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this can be logged at INFO to avoid triggering a downstream alert from our RADAR logging infra.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can add a metric to track rejections due to this

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

naming nit: sourceJobName -> targetJobCluster as the SSE sink could be on any job

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The first commit actually uses targetJob but we had a bit of a debate in a Slack thread because Raven currently uses sourceJobName.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No strong feeling either way. Just pointing out sourceJobName is what's used in raven's TargetInfo json.

@codyrioux codyrioux force-pushed the 2167-source-job-has-incorrect-subscriptions branch from 1a309a4 to 1f24186 Compare March 10, 2022 00:07
@codyrioux codyrioux marked this pull request as ready for review March 10, 2022 00:20
@codyrioux codyrioux merged commit de88e88 into master Mar 10, 2022
@codyrioux codyrioux deleted the 2167-source-job-has-incorrect-subscriptions branch March 11, 2022 19:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants