Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ignore nodes where drain is not possible #22

Open
phillebaba opened this issue Jan 25, 2023 · 3 comments
Open

Ignore nodes where drain is not possible #22

phillebaba opened this issue Jan 25, 2023 · 3 comments
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@phillebaba
Copy link
Contributor

A node may be blocked from being drained when a PDB stops a Pod from being moved. This should be avoided in most cases but mistakes can happen. Currently Node TTL will just get stuck with that node. A better solution would be to ignore the nodes which will never be drained.

@phillebaba phillebaba added enhancement New feature or request good first issue Good for newcomers labels Jan 25, 2023
@brovoca
Copy link

brovoca commented Feb 10, 2023

Hi! Note that the Rook operator handles PDBs dynamically, so that OSD pods (disks) aren't evicted faster than the storage cluster can handle.

@phillebaba
Copy link
Contributor Author

Ah thats an interesting point did not know about this. So my understanding then is that it has PDB which prohibits any eviction and then modifies the PDB when it feels like it can handle the eviction? So would all nodes with OSD pods be stuck until Rook jumps in and modifies the PDB?

My plan was to implement a dry run on the drain which evaluates is a node would get stuck in the first place. Do you think this would work with Rook?

@brovoca
Copy link

brovoca commented Feb 10, 2023

So would all nodes with OSD pods be stuck until Rook jumps in and modifies the PDB?

Yes, that's right!

My plan was to implement a dry run on the drain which evaluates is a node would get stuck in the first place. Do you think this would work with Rook?

I don't know about this actually, and I am unable to test it since I no longer use Rook

I would suggest implementing a labelSelector for this feature so that Rook nodes still can be drained (effectively ignoring this feature), while respecting others.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

2 participants