Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

integration-tests/deployment/ccip: fix assertion fns #14482

Merged
merged 5 commits into from
Sep 18, 2024

Conversation

makramkd
Copy link
Contributor

Requires

Resolves

Comment on lines +200 to +201
t.Logf("Waiting for ExecutionStateChanged on chain %d (offramp %s) from chain %d with expected sequence number %d, current onchain minSeqNr: %d, execution state: %s",
dest.Selector, offRamp.Address().String(), source.Selector, expectedSeqNr, scc.MinSeqNr, executionStateToString(executionState))
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adding these logs to aid in test debugging - in case the log fetching is (for whatever reason) not working.

@makramkd makramkd marked this pull request as ready for review September 18, 2024 16:19
@makramkd makramkd requested a review from a team as a code owner September 18, 2024 16:19
@makramkd makramkd requested review from connorwstein, AnieeG and a team September 18, 2024 16:19
Comment on lines +202 to +206
if executionState == EXECUTION_STATE_SUCCESS {
t.Logf("Observed SUCCESS execution state on chain %d (offramp %s) from chain %d with expected sequence number %d",
dest.Selector, offRamp.Address().String(), source.Selector, expectedSeqNr)
return nil
}
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adding this because in the flakes I observed the following phenomenon:

2024-09-18T16:35:18.1257108Z     Waiting for ExecutionStateChanged on chain 5548718428018410741 (offramp 0x5E6f8839581AfeE68f899bF33B8F284FFf92ef0E) from chain 909606746561742123 with expected sequence number 1, current onchain minSeqNr: 2, execution state: UNTOUCHED
2024-09-18T16:35:18.1258349Z     Waiting for ExecutionStateChanged on chain 909606746561742123 (offramp 0xBAa5D0009A5a445ab05F190923dBFd0624BC9dd7) from chain 5548718428018410741 with expected sequence number 1, current onchain minSeqNr: 2, execution state: UNTOUCHED
2024-09-18T16:35:18.1259586Z     Waiting for ExecutionStateChanged on chain 5548718428018410741 (offramp 0x5E6f8839581AfeE68f899bF33B8F284FFf92ef0E) from chain 789068866484373046 with expected sequence number 1, current onchain minSeqNr: 2, execution state: SUCCESS
2024-09-18T16:35:18.1260817Z     Waiting for ExecutionStateChanged on chain 909606746561742123 (offramp 0xBAa5D0009A5a445ab05F190923dBFd0624BC9dd7) from chain 789068866484373046 with expected sequence number 1, current onchain minSeqNr: 2, execution state: SUCCESS
2024-09-18T16:35:18.1262055Z     Waiting for ExecutionStateChanged on chain 789068866484373046 (offramp 0xAF84A0E10C914dD6d91c2e1674031f4668Ada3FB) from chain 909606746561742123 with expected sequence number 1, current onchain minSeqNr: 2, execution state: UNTOUCHED
2024-09-18T16:35:18.1263291Z     Waiting for ExecutionStateChanged on chain 789068866484373046 (offramp 0xAF84A0E10C914dD6d91c2e1674031f4668Ada3FB) from chain 5548718428018410741 with expected sequence number 1, current onchain minSeqNr: 2, execution state: UNTOUCHED

i.e even before subscribing it seems that we successfully executed some messages. The subscription never ended up picking up these logs and relaying them to the channel. So this is hopefully going to aid in those cases.

Comment on lines +51 to +52
ccipocr3.SeqNum(expectedSeqNums[dstChain.Selector]),
ccipocr3.SeqNum(expectedSeqNums[dstChain.Selector]),
Copy link
Contributor

@winder winder Sep 18, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Input should probably be expectedSeqNums map[uint64]SeqNumRange since we'll need that eventually.

@makramkd makramkd enabled auto-merge September 18, 2024 17:22
@makramkd makramkd added this pull request to the merge queue Sep 18, 2024
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to no response for status checks Sep 18, 2024
@makramkd makramkd added this pull request to the merge queue Sep 18, 2024
@makramkd makramkd removed this pull request from the merge queue due to a manual request Sep 18, 2024
@makramkd makramkd enabled auto-merge September 18, 2024 18:35
@cl-sonarqube-production
Copy link

@makramkd makramkd added this pull request to the merge queue Sep 18, 2024
@github-merge-queue github-merge-queue bot removed this pull request from the merge queue due to no response for status checks Sep 18, 2024
@makramkd makramkd added this pull request to the merge queue Sep 18, 2024
Merged via the queue into develop with commit d64834a Sep 18, 2024
156 checks passed
@makramkd makramkd deleted the mk/fix-flakey-ccip-test branch September 18, 2024 21:15
momentmaker added a commit that referenced this pull request Sep 19, 2024
* develop: (79 commits)
  core/config/toml: include value in InsecureConnection error message (#14495)
  vrf: add soneium config for integration tests (#14443)
  Add default test config for Grafana (#14475)
  Update to 1.5 RMN contract address (#14485)
  fix lint issues (#14450)
  [BCFR-203] Improve CR value comparator querying (topics and data words) by doing encoding in the relayer (#14207)
  integration-tests/deployment/ccip: fix assertion fns (#14482)
  chore: remove gha workflow validation (#14487)
  devsvcs-244: update token transfer (#14481)
  DF-20481: Add new OCR3DataFeeds telemetry type for Mercury jobs (#14470)
  Merc 6304 view function ea telem support (#14467)
  [DEVSVCS-545] cleanup (#14478)
  Mantle use vanilla l1 oracle (#14471)
  Fix E2E_TESTS_ON_GITHUB_CI.md (#14473)
  Upgrade chainlink ccip dependency (#14474)
  [DEVSVCS-545] automation benchmark test remove support for keepers v1 (#14472)
  Enables OOO Execution for E2E Tests (#14392)
  Delegate workflow spec creation (#14365)
  CCIP-3407: Add release testing configs (#1436) (#14463)
  Implement v0.3-compatible telemetry for LLO (#14440)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants