Skip to content

Conversation

elevran
Copy link
Contributor

@elevran elevran commented Jun 28, 2025

Reduce boilerplate in Plugins by embedding a TypedName into each, implementing the Plugin methods.

@k8s-ci-robot k8s-ci-robot added the cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. label Jun 28, 2025
@k8s-ci-robot k8s-ci-robot requested review from ahg-g and liu-cong June 28, 2025 16:28
@k8s-ci-robot k8s-ci-robot added the needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. label Jun 28, 2025
@k8s-ci-robot
Copy link
Contributor

Hi @elevran. Thanks for your PR.

I'm waiting for a kubernetes-sigs member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository.

@k8s-ci-robot k8s-ci-robot added the size/L Denotes a PR that changes 100-499 lines, ignoring generated files. label Jun 28, 2025
Copy link

netlify bot commented Jun 28, 2025

Deploy Preview for gateway-api-inference-extension ready!

Name Link
🔨 Latest commit 3766b51
🔍 Latest deploy log https://app.netlify.com/projects/gateway-api-inference-extension/deploys/68652446b0427f000859b18f
😎 Deploy Preview https://deploy-preview-1086--gateway-api-inference-extension.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

@nirrozenbaum
Copy link
Contributor

/ok-to-test

@k8s-ci-robot k8s-ci-robot added ok-to-test Indicates a non-member PR verified by an org member that is safe to test. and removed needs-ok-to-test Indicates a PR that requires an org member to verify it is safe to test. labels Jun 28, 2025
@ahg-g
Copy link
Contributor

ahg-g commented Jun 29, 2025

Not suggesting to change anything now, but the explicit Plugin "Type" parameter is duplicating the builtin type name that we can get via the reflect pkg; what if we add a common function in the plugin interface that uses reflect.TypeOf to get the type instead of having the plugins to define a constant?

@elevran elevran marked this pull request as draft June 29, 2025 15:57
@k8s-ci-robot k8s-ci-robot added do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. labels Jun 29, 2025
@elevran
Copy link
Contributor Author

elevran commented Jun 30, 2025

Not suggesting to change anything now, but the explicit Plugin "Type" parameter is duplicating the builtin type name that we can get via the reflect pkg; what if we add a common function in the plugin interface that uses reflect.TypeOf to get the type instead of having the plugins to define a constant?

Can see Pros and Cons to this (and these depend on implementation):

  • using the full package path guarantees uniqueness (whereas strings could collide).
  • could potentially save some boilerplate (but would be hard to delegate to an embedded struct and reuse implementation)
  • users would need to know the internal Go type (e.g., do we use full package path)?
  • types should make sense and be more descriptive (e.g., currently the cache prefix is just called Plugin...)

Overall, would need more careful consideration but I can see some good outcomes.

@k8s-ci-robot k8s-ci-robot removed the needs-rebase Indicates a PR cannot be merged because it has merge conflicts with HEAD. label Jun 30, 2025
@elevran elevran marked this pull request as ready for review June 30, 2025 13:21
@k8s-ci-robot k8s-ci-robot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jun 30, 2025
return tn.Type + Separator + tn.Name
}

func (tn *TypedName) GetTypedName() TypedName {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I understand the motivation behind this, but this function looks not natural.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I’d argue it’s better to put back a one liner TypedName() function in each plugin..
yes, it adds “boilerplate” code (hard to say this on one line), but more aligned with how things are usually written in go.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think your point is that a Plugin HAS-A TypedName and not IS-A TypedName (which is what embedding models).
We could add a BasePlugin struct that implements GetTypedName() generically and then embed that into Plugin, but I would prefer to delay that until there's more "behavior" in the base plugin.

elevran added 4 commits July 2, 2025 15:17
Signed-off-by: Etai Lev Ran <elevran@gmail.com>
Signed-off-by: Etai Lev Ran <elevran@gmail.com>
Signed-off-by: Etai Lev Ran <elevran@gmail.com>
Signed-off-by: Etai Lev Ran <elevran@gmail.com>
@elevran
Copy link
Contributor Author

elevran commented Jul 2, 2025

@nirrozenbaum hopefully last iteration: made TypedName a private field and not an embedded struct

@nirrozenbaum
Copy link
Contributor

/lgtm
/approve

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Jul 3, 2025
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: elevran, nirrozenbaum

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jul 3, 2025
@k8s-ci-robot k8s-ci-robot merged commit e9e4558 into kubernetes-sigs:main Jul 3, 2025
9 checks passed
@elevran elevran deleted the typed_name branch July 3, 2025 08:31
EyalPazz pushed a commit to EyalPazz/gateway-api-inference-extension that referenced this pull request Jul 9, 2025
…kubernetes-sigs#1086)

* introduce TypedName to reduce boilerplate, modify plugins

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* implement GetTypedName()

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* Remove Type() and Name() from Plugin interface

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* use TypedName as private field, not embedded

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

---------

Signed-off-by: Etai Lev Ran <elevran@gmail.com>
BenjaminBraunDev pushed a commit to BenjaminBraunDev/gateway-api-inference-extension that referenced this pull request Aug 12, 2025
…kubernetes-sigs#1086)

* introduce TypedName to reduce boilerplate, modify plugins

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* implement GetTypedName()

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* Remove Type() and Name() from Plugin interface

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* use TypedName as private field, not embedded

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

---------

Signed-off-by: Etai Lev Ran <elevran@gmail.com>
BenjaminBraunDev pushed a commit to BenjaminBraunDev/gateway-api-inference-extension that referenced this pull request Aug 14, 2025
Add APIs for the instantiated plugins to the EPP Handle (kubernetes-sigs#1039)

* Added plugin instance APIs to plugins.Handle

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* An implementation of the new plugins.Handle APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Moved all configuration loading code to new package

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Updates due to new and moved APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Cleanup of old configuration loading code

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

---------

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

chore(deps): bump the kubernetes group with 6 updates (kubernetes-sigs#1050)

Bumps the kubernetes group with 6 updates:

| Package | From | To |
| --- | --- | --- |
| [k8s.io/api](https://github.com/kubernetes/api) | `0.33.1` | `0.33.2` |
| [k8s.io/apiextensions-apiserver](https://github.com/kubernetes/apiextensions-apiserver) | `0.33.1` | `0.33.2` |
| [k8s.io/apimachinery](https://github.com/kubernetes/apimachinery) | `0.33.1` | `0.33.2` |
| [k8s.io/client-go](https://github.com/kubernetes/client-go) | `0.33.1` | `0.33.2` |
| [k8s.io/code-generator](https://github.com/kubernetes/code-generator) | `0.33.1` | `0.33.2` |
| [k8s.io/component-base](https://github.com/kubernetes/component-base) | `0.33.1` | `0.33.2` |

Updates `k8s.io/api` from 0.33.1 to 0.33.2
- [Commits](kubernetes/api@v0.33.1...v0.33.2)

Updates `k8s.io/apiextensions-apiserver` from 0.33.1 to 0.33.2
- [Release notes](https://github.com/kubernetes/apiextensions-apiserver/releases)
- [Commits](kubernetes/apiextensions-apiserver@v0.33.1...v0.33.2)

Updates `k8s.io/apimachinery` from 0.33.1 to 0.33.2
- [Commits](kubernetes/apimachinery@v0.33.1...v0.33.2)

Updates `k8s.io/client-go` from 0.33.1 to 0.33.2
- [Changelog](https://github.com/kubernetes/client-go/blob/master/CHANGELOG.md)
- [Commits](kubernetes/client-go@v0.33.1...v0.33.2)

Updates `k8s.io/code-generator` from 0.33.1 to 0.33.2
- [Commits](kubernetes/code-generator@v0.33.1...v0.33.2)

Updates `k8s.io/component-base` from 0.33.1 to 0.33.2
- [Commits](kubernetes/component-base@v0.33.1...v0.33.2)

---
updated-dependencies:
- dependency-name: k8s.io/api
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/apiextensions-apiserver
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/apimachinery
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/client-go
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/code-generator
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/component-base
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

remove datastore dependency from the scheduler (kubernetes-sigs#1049)

* remove datastore dependency from the scheduler

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* added back comments on snapshotting pods from datastore before calling schedule

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* removed fake datastore from conformance scheduler test

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

Add subsetting logic for epp (kubernetes-sigs#981)

feat: Added a factory function for the DecisionTree filter (kubernetes-sigs#1053)

* Added a factory function for the DecisionTreeFilter

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Added tests of the factory function of the DecisionTreeFilter

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Registered the factory function of the DecisionTreeFilter

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Refactored the configuration loading

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

---------

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

Adding pprof endpoints to metrics port (kubernetes-sigs#1069)

feat: Add a context.Context to the plugins.HAndle interface (kubernetes-sigs#1076)

* Added a context.Context to the plugins.Handle interface

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Changes due to changes in internal APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Changes to tests due to changes in internal APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

---------

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

convert subset filter from a plugin to logic in director (kubernetes-sigs#1088)

* convert subset filter from a plugin to logic in director

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* replace interface{} with any

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* make linter happy

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* address code review comments

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

chore(deps): bump golang.org/x/sync from 0.14.0 to 0.15.0 (kubernetes-sigs#1096)

Bumps [golang.org/x/sync](https://github.com/golang/sync) from 0.14.0 to 0.15.0.
- [Commits](golang/sync@v0.14.0...v0.15.0)

---
updated-dependencies:
- dependency-name: golang.org/x/sync
  dependency-version: 0.15.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Introduce plugins.TypedName to be used for Plugin base implementation (kubernetes-sigs#1086)

* introduce TypedName to reduce boilerplate, modify plugins

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* implement GetTypedName()

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* Remove Type() and Name() from Plugin interface

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* use TypedName as private field, not embedded

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

---------

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

move the conversion from pod metrics to scheduler pod representation one level up (kubernetes-sigs#1104)

* move the converstion from pod metrics to scheduler pod representation one level up

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* minor change in helper func

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

handle picking multiple destinations in scheduling layer (kubernetes-sigs#1059)

* implement multiple destination as the output of the scheduler

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* updated max score picker unit tests to cover multiple pods

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* imports

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* unit-test fix

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

refactor: 🔨 use the more explicit singular form (kubernetes-sigs#1129)
BenjaminBraunDev pushed a commit to BenjaminBraunDev/gateway-api-inference-extension that referenced this pull request Aug 22, 2025
Add APIs for the instantiated plugins to the EPP Handle (kubernetes-sigs#1039)

* Added plugin instance APIs to plugins.Handle

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* An implementation of the new plugins.Handle APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Moved all configuration loading code to new package

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Updates due to new and moved APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Cleanup of old configuration loading code

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

---------

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

chore(deps): bump the kubernetes group with 6 updates (kubernetes-sigs#1050)

Bumps the kubernetes group with 6 updates:

| Package | From | To |
| --- | --- | --- |
| [k8s.io/api](https://github.com/kubernetes/api) | `0.33.1` | `0.33.2` |
| [k8s.io/apiextensions-apiserver](https://github.com/kubernetes/apiextensions-apiserver) | `0.33.1` | `0.33.2` |
| [k8s.io/apimachinery](https://github.com/kubernetes/apimachinery) | `0.33.1` | `0.33.2` |
| [k8s.io/client-go](https://github.com/kubernetes/client-go) | `0.33.1` | `0.33.2` |
| [k8s.io/code-generator](https://github.com/kubernetes/code-generator) | `0.33.1` | `0.33.2` |
| [k8s.io/component-base](https://github.com/kubernetes/component-base) | `0.33.1` | `0.33.2` |

Updates `k8s.io/api` from 0.33.1 to 0.33.2
- [Commits](kubernetes/api@v0.33.1...v0.33.2)

Updates `k8s.io/apiextensions-apiserver` from 0.33.1 to 0.33.2
- [Release notes](https://github.com/kubernetes/apiextensions-apiserver/releases)
- [Commits](kubernetes/apiextensions-apiserver@v0.33.1...v0.33.2)

Updates `k8s.io/apimachinery` from 0.33.1 to 0.33.2
- [Commits](kubernetes/apimachinery@v0.33.1...v0.33.2)

Updates `k8s.io/client-go` from 0.33.1 to 0.33.2
- [Changelog](https://github.com/kubernetes/client-go/blob/master/CHANGELOG.md)
- [Commits](kubernetes/client-go@v0.33.1...v0.33.2)

Updates `k8s.io/code-generator` from 0.33.1 to 0.33.2
- [Commits](kubernetes/code-generator@v0.33.1...v0.33.2)

Updates `k8s.io/component-base` from 0.33.1 to 0.33.2
- [Commits](kubernetes/component-base@v0.33.1...v0.33.2)

---
updated-dependencies:
- dependency-name: k8s.io/api
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/apiextensions-apiserver
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/apimachinery
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/client-go
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/code-generator
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/component-base
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

remove datastore dependency from the scheduler (kubernetes-sigs#1049)

* remove datastore dependency from the scheduler

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* added back comments on snapshotting pods from datastore before calling schedule

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* removed fake datastore from conformance scheduler test

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

Add subsetting logic for epp (kubernetes-sigs#981)

feat: Added a factory function for the DecisionTree filter (kubernetes-sigs#1053)

* Added a factory function for the DecisionTreeFilter

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Added tests of the factory function of the DecisionTreeFilter

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Registered the factory function of the DecisionTreeFilter

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Refactored the configuration loading

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

---------

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

Adding pprof endpoints to metrics port (kubernetes-sigs#1069)

feat: Add a context.Context to the plugins.HAndle interface (kubernetes-sigs#1076)

* Added a context.Context to the plugins.Handle interface

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Changes due to changes in internal APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Changes to tests due to changes in internal APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

---------

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

convert subset filter from a plugin to logic in director (kubernetes-sigs#1088)

* convert subset filter from a plugin to logic in director

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* replace interface{} with any

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* make linter happy

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* address code review comments

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

chore(deps): bump golang.org/x/sync from 0.14.0 to 0.15.0 (kubernetes-sigs#1096)

Bumps [golang.org/x/sync](https://github.com/golang/sync) from 0.14.0 to 0.15.0.
- [Commits](golang/sync@v0.14.0...v0.15.0)

---
updated-dependencies:
- dependency-name: golang.org/x/sync
  dependency-version: 0.15.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Introduce plugins.TypedName to be used for Plugin base implementation (kubernetes-sigs#1086)

* introduce TypedName to reduce boilerplate, modify plugins

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* implement GetTypedName()

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* Remove Type() and Name() from Plugin interface

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* use TypedName as private field, not embedded

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

---------

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

move the conversion from pod metrics to scheduler pod representation one level up (kubernetes-sigs#1104)

* move the converstion from pod metrics to scheduler pod representation one level up

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* minor change in helper func

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

handle picking multiple destinations in scheduling layer (kubernetes-sigs#1059)

* implement multiple destination as the output of the scheduler

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* updated max score picker unit tests to cover multiple pods

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* imports

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* unit-test fix

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

refactor: 🔨 use the more explicit singular form (kubernetes-sigs#1129)
BenjaminBraunDev pushed a commit to BenjaminBraunDev/gateway-api-inference-extension that referenced this pull request Aug 29, 2025
Add APIs for the instantiated plugins to the EPP Handle (kubernetes-sigs#1039)

* Added plugin instance APIs to plugins.Handle

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* An implementation of the new plugins.Handle APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Moved all configuration loading code to new package

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Updates due to new and moved APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Cleanup of old configuration loading code

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

---------

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

chore(deps): bump the kubernetes group with 6 updates (kubernetes-sigs#1050)

Bumps the kubernetes group with 6 updates:

| Package | From | To |
| --- | --- | --- |
| [k8s.io/api](https://github.com/kubernetes/api) | `0.33.1` | `0.33.2` |
| [k8s.io/apiextensions-apiserver](https://github.com/kubernetes/apiextensions-apiserver) | `0.33.1` | `0.33.2` |
| [k8s.io/apimachinery](https://github.com/kubernetes/apimachinery) | `0.33.1` | `0.33.2` |
| [k8s.io/client-go](https://github.com/kubernetes/client-go) | `0.33.1` | `0.33.2` |
| [k8s.io/code-generator](https://github.com/kubernetes/code-generator) | `0.33.1` | `0.33.2` |
| [k8s.io/component-base](https://github.com/kubernetes/component-base) | `0.33.1` | `0.33.2` |

Updates `k8s.io/api` from 0.33.1 to 0.33.2
- [Commits](kubernetes/api@v0.33.1...v0.33.2)

Updates `k8s.io/apiextensions-apiserver` from 0.33.1 to 0.33.2
- [Release notes](https://github.com/kubernetes/apiextensions-apiserver/releases)
- [Commits](kubernetes/apiextensions-apiserver@v0.33.1...v0.33.2)

Updates `k8s.io/apimachinery` from 0.33.1 to 0.33.2
- [Commits](kubernetes/apimachinery@v0.33.1...v0.33.2)

Updates `k8s.io/client-go` from 0.33.1 to 0.33.2
- [Changelog](https://github.com/kubernetes/client-go/blob/master/CHANGELOG.md)
- [Commits](kubernetes/client-go@v0.33.1...v0.33.2)

Updates `k8s.io/code-generator` from 0.33.1 to 0.33.2
- [Commits](kubernetes/code-generator@v0.33.1...v0.33.2)

Updates `k8s.io/component-base` from 0.33.1 to 0.33.2
- [Commits](kubernetes/component-base@v0.33.1...v0.33.2)

---
updated-dependencies:
- dependency-name: k8s.io/api
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/apiextensions-apiserver
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/apimachinery
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/client-go
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/code-generator
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/component-base
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

remove datastore dependency from the scheduler (kubernetes-sigs#1049)

* remove datastore dependency from the scheduler

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* added back comments on snapshotting pods from datastore before calling schedule

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* removed fake datastore from conformance scheduler test

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

Add subsetting logic for epp (kubernetes-sigs#981)

feat: Added a factory function for the DecisionTree filter (kubernetes-sigs#1053)

* Added a factory function for the DecisionTreeFilter

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Added tests of the factory function of the DecisionTreeFilter

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Registered the factory function of the DecisionTreeFilter

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Refactored the configuration loading

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

---------

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

Adding pprof endpoints to metrics port (kubernetes-sigs#1069)

feat: Add a context.Context to the plugins.HAndle interface (kubernetes-sigs#1076)

* Added a context.Context to the plugins.Handle interface

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Changes due to changes in internal APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Changes to tests due to changes in internal APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

---------

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

convert subset filter from a plugin to logic in director (kubernetes-sigs#1088)

* convert subset filter from a plugin to logic in director

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* replace interface{} with any

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* make linter happy

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* address code review comments

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

chore(deps): bump golang.org/x/sync from 0.14.0 to 0.15.0 (kubernetes-sigs#1096)

Bumps [golang.org/x/sync](https://github.com/golang/sync) from 0.14.0 to 0.15.0.
- [Commits](golang/sync@v0.14.0...v0.15.0)

---
updated-dependencies:
- dependency-name: golang.org/x/sync
  dependency-version: 0.15.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Introduce plugins.TypedName to be used for Plugin base implementation (kubernetes-sigs#1086)

* introduce TypedName to reduce boilerplate, modify plugins

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* implement GetTypedName()

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* Remove Type() and Name() from Plugin interface

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* use TypedName as private field, not embedded

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

---------

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

move the conversion from pod metrics to scheduler pod representation one level up (kubernetes-sigs#1104)

* move the converstion from pod metrics to scheduler pod representation one level up

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* minor change in helper func

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

handle picking multiple destinations in scheduling layer (kubernetes-sigs#1059)

* implement multiple destination as the output of the scheduler

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* updated max score picker unit tests to cover multiple pods

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* imports

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* unit-test fix

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

refactor: 🔨 use the more explicit singular form (kubernetes-sigs#1129)
BenjaminBraunDev pushed a commit to BenjaminBraunDev/gateway-api-inference-extension that referenced this pull request Sep 9, 2025
Add APIs for the instantiated plugins to the EPP Handle (kubernetes-sigs#1039)

* Added plugin instance APIs to plugins.Handle

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* An implementation of the new plugins.Handle APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Moved all configuration loading code to new package

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Updates due to new and moved APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Cleanup of old configuration loading code

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

---------

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

chore(deps): bump the kubernetes group with 6 updates (kubernetes-sigs#1050)

Bumps the kubernetes group with 6 updates:

| Package | From | To |
| --- | --- | --- |
| [k8s.io/api](https://github.com/kubernetes/api) | `0.33.1` | `0.33.2` |
| [k8s.io/apiextensions-apiserver](https://github.com/kubernetes/apiextensions-apiserver) | `0.33.1` | `0.33.2` |
| [k8s.io/apimachinery](https://github.com/kubernetes/apimachinery) | `0.33.1` | `0.33.2` |
| [k8s.io/client-go](https://github.com/kubernetes/client-go) | `0.33.1` | `0.33.2` |
| [k8s.io/code-generator](https://github.com/kubernetes/code-generator) | `0.33.1` | `0.33.2` |
| [k8s.io/component-base](https://github.com/kubernetes/component-base) | `0.33.1` | `0.33.2` |

Updates `k8s.io/api` from 0.33.1 to 0.33.2
- [Commits](kubernetes/api@v0.33.1...v0.33.2)

Updates `k8s.io/apiextensions-apiserver` from 0.33.1 to 0.33.2
- [Release notes](https://github.com/kubernetes/apiextensions-apiserver/releases)
- [Commits](kubernetes/apiextensions-apiserver@v0.33.1...v0.33.2)

Updates `k8s.io/apimachinery` from 0.33.1 to 0.33.2
- [Commits](kubernetes/apimachinery@v0.33.1...v0.33.2)

Updates `k8s.io/client-go` from 0.33.1 to 0.33.2
- [Changelog](https://github.com/kubernetes/client-go/blob/master/CHANGELOG.md)
- [Commits](kubernetes/client-go@v0.33.1...v0.33.2)

Updates `k8s.io/code-generator` from 0.33.1 to 0.33.2
- [Commits](kubernetes/code-generator@v0.33.1...v0.33.2)

Updates `k8s.io/component-base` from 0.33.1 to 0.33.2
- [Commits](kubernetes/component-base@v0.33.1...v0.33.2)

---
updated-dependencies:
- dependency-name: k8s.io/api
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/apiextensions-apiserver
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/apimachinery
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/client-go
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/code-generator
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
- dependency-name: k8s.io/component-base
  dependency-version: 0.33.2
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: kubernetes
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

remove datastore dependency from the scheduler (kubernetes-sigs#1049)

* remove datastore dependency from the scheduler

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* added back comments on snapshotting pods from datastore before calling schedule

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* removed fake datastore from conformance scheduler test

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

Add subsetting logic for epp (kubernetes-sigs#981)

feat: Added a factory function for the DecisionTree filter (kubernetes-sigs#1053)

* Added a factory function for the DecisionTreeFilter

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Added tests of the factory function of the DecisionTreeFilter

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Registered the factory function of the DecisionTreeFilter

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Refactored the configuration loading

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

---------

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

Adding pprof endpoints to metrics port (kubernetes-sigs#1069)

feat: Add a context.Context to the plugins.HAndle interface (kubernetes-sigs#1076)

* Added a context.Context to the plugins.Handle interface

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Changes due to changes in internal APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

* Changes to tests due to changes in internal APIs

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

---------

Signed-off-by: Shmuel Kallner <kallner@il.ibm.com>

convert subset filter from a plugin to logic in director (kubernetes-sigs#1088)

* convert subset filter from a plugin to logic in director

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* replace interface{} with any

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* make linter happy

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* address code review comments

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

chore(deps): bump golang.org/x/sync from 0.14.0 to 0.15.0 (kubernetes-sigs#1096)

Bumps [golang.org/x/sync](https://github.com/golang/sync) from 0.14.0 to 0.15.0.
- [Commits](golang/sync@v0.14.0...v0.15.0)

---
updated-dependencies:
- dependency-name: golang.org/x/sync
  dependency-version: 0.15.0
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Introduce plugins.TypedName to be used for Plugin base implementation (kubernetes-sigs#1086)

* introduce TypedName to reduce boilerplate, modify plugins

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* implement GetTypedName()

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* Remove Type() and Name() from Plugin interface

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

* use TypedName as private field, not embedded

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

---------

Signed-off-by: Etai Lev Ran <elevran@gmail.com>

move the conversion from pod metrics to scheduler pod representation one level up (kubernetes-sigs#1104)

* move the converstion from pod metrics to scheduler pod representation one level up

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* minor change in helper func

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

handle picking multiple destinations in scheduling layer (kubernetes-sigs#1059)

* implement multiple destination as the output of the scheduler

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* updated max score picker unit tests to cover multiple pods

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* imports

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

* unit-test fix

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

---------

Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>

refactor: 🔨 use the more explicit singular form (kubernetes-sigs#1129)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. ok-to-test Indicates a non-member PR verified by an org member that is safe to test. size/L Denotes a PR that changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants