Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Config: Implement deferred clusters on worker. #28702

Merged
merged 12 commits into from
Aug 8, 2023

Conversation

KBaichoo
Copy link
Contributor

Commit Message: Config: Implement deferred clusters on worker.
Additional Description: We initialize certain cluster types on workers inline when there's traffic for that cluster. This is a memory optimization for large envoy deployments with many clusters and workers. This will be followed up with an "eviction PR" so that the deferral benefits don't go away the longer the envoy process runs.
Risk Level: med / high
Testing: unit, integration
Docs Changes: included
Release Notes: included
Platform Specific Features: na
Runtime guard: Config guarded
[Optional Fixes #Issue]
[Optional Fixes commit #PR or SHA]
[Optional Deprecated:]
[Optional API Considerations:]

workers inline when there's traffic for that cluster.

Signed-off-by: Kevin Baichoo <kbaichoo@google.com>
@KBaichoo
Copy link
Contributor Author

/assign @adisuissa

@repokitteh-read-only
Copy link

CC @envoyproxy/api-shepherds: Your approval is needed for changes made to (api/envoy/|docs/root/api-docs/).
envoyproxy/api-shepherds assignee is @mattklein123
CC @envoyproxy/api-watchers: FYI only for changes made to (api/envoy/|docs/root/api-docs/).

🐱

Caused by: #28702 was opened by KBaichoo.

see: more, trace.

@KBaichoo
Copy link
Contributor Author

might make sense for adip to do api shepparding as well since he'll do the review.

/unassign @mattklein123

Signed-off-by: Kevin Baichoo <kbaichoo@google.com>
Signed-off-by: Kevin Baichoo <kbaichoo@google.com>
Signed-off-by: Kevin Baichoo <kbaichoo@google.com>
Signed-off-by: Kevin Baichoo <kbaichoo@google.com>
Copy link
Contributor

@adisuissa adisuissa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for working on this!
Overall this LGTM. Left a few comments, mostly minor.

source/common/upstream/cluster_manager_impl.h Outdated Show resolved Hide resolved
test/integration/eds_integration_test.cc Show resolved Hide resolved
test/integration/eds_integration_test.cc Show resolved Hide resolved
source/common/upstream/cluster_discovery_manager.cc Outdated Show resolved Hide resolved
source/common/upstream/cluster_manager_impl.cc Outdated Show resolved Hide resolved
source/common/upstream/cluster_manager_impl.h Outdated Show resolved Hide resolved
Signed-off-by: Kevin Baichoo <kbaichoo@google.com>
Signed-off-by: Kevin Baichoo <kbaichoo@google.com>
Signed-off-by: Kevin Baichoo <kbaichoo@google.com>
Signed-off-by: Kevin Baichoo <kbaichoo@google.com>
Copy link
Contributor

@adisuissa adisuissa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Overall looks good.
I suggest adding some more comments explaining why some invariants hold.

test/integration/cds_integration_test.cc Show resolved Hide resolved
envoy/upstream/cluster_manager.h Outdated Show resolved Hide resolved
source/common/upstream/cluster_manager_impl.cc Outdated Show resolved Hide resolved
Signed-off-by: Kevin Baichoo <kbaichoo@google.com>
Signed-off-by: Kevin Baichoo <kbaichoo@google.com>
Signed-off-by: Kevin Baichoo <kbaichoo@google.com>
Copy link
Contributor Author

@KBaichoo KBaichoo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the reviews @adisuissa !

envoy/upstream/cluster_manager.h Outdated Show resolved Hide resolved
source/common/upstream/cluster_manager_impl.cc Outdated Show resolved Hide resolved
Copy link
Contributor

@adisuissa adisuissa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, LGTM!
/lgtm api

/assign-from @envoyproxy/senior-maintainers

@repokitteh-read-only
Copy link

@envoyproxy/senior-maintainers assignee is @mattklein123

🐱

Caused by: a #28702 (review) was submitted by @adisuissa.

see: more, trace.

Copy link
Member

@mattklein123 mattklein123 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice!

@KBaichoo KBaichoo merged commit 4aaf17d into envoyproxy:main Aug 8, 2023
114 of 115 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants