Skip to content

OCPBUGS-36859: Support NODEIP_HINT in IPI deployments too #4973

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

cybertron
Copy link
Member

Originally this was only enabled for UPI deployments because in IPI we expected the node IP to match the VIP subnet. However, since then two scenarios have come up where that may not be true:

  • VSphere clusters are often deployed with VIPs that are not on the Machine Network
  • User-namaged loadbalancers may be on any subnet In either of these cases we currently fall back to the remote worker behavior of selecting based on the default route. This is a problem if there are two interfaces, both with default routes. The order of activation can cause nondeterministic behavior.

This deliberately does not support the old KUBELET_NODEIP_HINT name that the UPI service does because it was never a thing in IPI and we don't need the backward compatibility with it.

- What I did

- How to verify it

- Description for the changelog

Originally this was only enabled for UPI deployments because in IPI
we expected the node IP to match the VIP subnet. However, since then
two scenarios have come up where that may not be true:
- VSphere clusters are often deployed with VIPs that are not on the
  Machine Network
- User-namaged loadbalancers may be on any subnet
In either of these cases we currently fall back to the remote worker
behavior of selecting based on the default route. This is a problem
if there are two interfaces, both with default routes. The order of
activation can cause nondeterministic behavior.

This deliberately does not support the old KUBELET_NODEIP_HINT name
that the UPI service does because it was never a thing in IPI and
we don't need the backward compatibility with it.
@openshift-ci-robot openshift-ci-robot added jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. labels Apr 4, 2025
@openshift-ci-robot
Copy link
Contributor

@cybertron: This pull request references Jira Issue OCPBUGS-36859, which is invalid:

  • expected the bug to target the "4.19.0" version, but no target version was set

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

Originally this was only enabled for UPI deployments because in IPI we expected the node IP to match the VIP subnet. However, since then two scenarios have come up where that may not be true:

  • VSphere clusters are often deployed with VIPs that are not on the Machine Network
  • User-namaged loadbalancers may be on any subnet In either of these cases we currently fall back to the remote worker behavior of selecting based on the default route. This is a problem if there are two interfaces, both with default routes. The order of activation can cause nondeterministic behavior.

This deliberately does not support the old KUBELET_NODEIP_HINT name that the UPI service does because it was never a thing in IPI and we don't need the backward compatibility with it.

- What I did

- How to verify it

- Description for the changelog

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci openshift-ci bot requested review from EmilienM and engelmi April 4, 2025 19:27
@cybertron
Copy link
Member Author

/cc @mkowalski

@openshift-ci openshift-ci bot requested a review from mkowalski April 4, 2025 19:30
@cybertron
Copy link
Member Author

/jira refresh

@openshift-ci-robot openshift-ci-robot added the jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. label Apr 4, 2025
@openshift-ci-robot
Copy link
Contributor

@cybertron: This pull request references Jira Issue OCPBUGS-36859, which is valid. The bug has been moved to the POST state.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (4.19.0) matches configured target version for branch (4.19.0)
  • bug is in the state ASSIGNED, which is one of the valid states (NEW, ASSIGNED, POST)

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the openshift-eng/jira-lifecycle-plugin repository.

@openshift-ci-robot openshift-ci-robot removed the jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. label Apr 4, 2025
Copy link
Contributor

openshift-ci bot commented Apr 4, 2025

@cybertron: The following tests failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
ci/prow/bootstrap-unit 9ce5aa2 link false /test bootstrap-unit
ci/prow/e2e-azure-ovn-upgrade-out-of-change 9ce5aa2 link false /test e2e-azure-ovn-upgrade-out-of-change
ci/prow/okd-scos-e2e-aws-ovn 9ce5aa2 link false /test okd-scos-e2e-aws-ovn

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here.

@@ -35,6 +35,7 @@ contents: |
--prefer-ipv6 \
{{end -}}
--retry-on-failure \
${NODEIP_HINT:-} \
Copy link
Contributor

@mkowalski mkowalski Apr 15, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Grepping the repo I see we do ${NODEIP_HINT:-${KUBELET_NODEIP_HINT:-}}; \. Which one do you want here, yours or the one that repo already has?

(lgtm anyway because I read it's only about compatibility or lack; no opinion from my side, your call)

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I noted that in the PR description: "This deliberately does not support the old KUBELET_NODEIP_HINT name that the UPI service does because it was never a thing in IPI and we don't need the backward compatibility with it."

@mkowalski
Copy link
Contributor

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Apr 15, 2025
Copy link
Contributor

openshift-ci bot commented Apr 15, 2025

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: cybertron, mkowalski
Once this PR has been reviewed and has the lgtm label, please assign lorbuschris for approval. For more information see the Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants