Skip to content

kubeai/readme: fix mistake in nri policy config#1115

Merged
poussa merged 1 commit intoopea-project:mainfrom
marquiz:devel/kubeai-nri
Jun 12, 2025
Merged

kubeai/readme: fix mistake in nri policy config#1115
poussa merged 1 commit intoopea-project:mainfrom
marquiz:devel/kubeai-nri

Conversation

@marquiz
Copy link
Collaborator

@marquiz marquiz commented Jun 11, 2025

Fix a mistake in the balloons policy config snippet. We want to match pod labels not container labels.

Copy link
Collaborator

@eero-t eero-t left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@marquiz rebase on main / remove conflicting changes, and add the missing sign-off to the fix commit.

Copy link
Collaborator

@mkbhanda mkbhanda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

minor edits and a question

## Overview

[NRI plugins][nri-plugins] provide a way to
optimize the resource placement of applications in a Kubernetes cluster. They
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
optimize the resource placement of applications in a Kubernetes cluster. They
optimize the resources allocated to an application in a Kubernetes cluster. They

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thx. See #1119. I used wording "node-level resource assignment" there

## Installation of Balloons Policy Plugin

> **NOTE:** To avoid disturbing already running workloads it is recommended to
> install the NRI plugin to an empty node (do it right after node bootstrap, or
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> install the NRI plugin to an empty node (do it right after node bootstrap, or
> install the NRI plugin on an empty node, that is, before launching workloads on the same (do it right after node bootstrap, or


> **NOTE:** To avoid disturbing already running workloads it is recommended to
> install the NRI plugin to an empty node (do it right after node bootstrap, or
> drain the node before installation).
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> drain the node before installation).
> drain the node of work before installation).

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"draining a node" (kubectl drain <node>) is a well-established term in Kubernetes so I didn't change this


> **NOTE**: With containerd version earlier than v2.0 you need to enable
> the NRI support in the containerd configuration file. Instead of manual
> configuration you can provide `--set nri.runtime.patchConfig=true` to the Helm
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
> configuration you can provide `--set nri.runtime.patchConfig=true` to the Helm
> configuring/editing the file, you can pass in `--set nri.runtime.patchConfig=true` to the Helm

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thx. See #1119. I used slightly different wording

## Configuration of Balloons Policy Plugin

The aim of the balloons policy configuration is to isolate the model (inference
engine) containers to minimize the impact of containers on each other.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
engine) containers to minimize the impact of containers on each other.
engine containers, to minimize noisy neighbor effects, interfering with each other.

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thx. See #1119. I used slightly different wording


# Observability

With [Prometheus](../helm-charts/monitoring.md) running, install script can enable monitoring of the vLLM inference engine instances.
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

which install script? Are you asking the user to install a script for observability?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this refers to kubeai/install.sh

Fix a mistake in the balloons policy config snippet. We want to match
pod labels not container labels.

Signed-off-by: Markus Lehtonen <markus.lehtonen@intel.com>
@marquiz marquiz force-pushed the devel/kubeai-nri branch from 3a11dec to 2867399 Compare June 12, 2025 09:54
@marquiz
Copy link
Collaborator Author

marquiz commented Jun 12, 2025

rebase on main / remove conflicting changes, and add the missing sign-off to the fix commit.

Done.

Submitted a separate PR based on @mkbhanda's comments in #1119

@poussa poussa merged commit 79ed357 into opea-project:main Jun 12, 2025
5 checks passed
@marquiz marquiz deleted the devel/kubeai-nri branch June 23, 2025 11:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants