Skip to content

Commit 6266624

Browse files
committed
allow setting custom plugins file through helm
Signed-off-by: Nir Rozenbaum <nirro@il.ibm.com>
1 parent 2220efc commit 6266624

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

config/charts/inferencepool/templates/epp-deployment.yaml

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -30,9 +30,10 @@ spec:
3030
- --zap-encoder
3131
- "json"
3232
- --config-file
33-
- "/config/default-plugins.yaml"
33+
- "config/{{ .Values.inferenceExtension.pluginsConfigFile }}"
3434
{{- range .Values.inferenceExtension.flags }}
35-
- "--{{ .name }}={{ .value }}"
35+
- "--{{ .name }}"
36+
- "{{ .value }}"
3637
{{- end }}
3738
{{- if eq (.Values.inferencePool.modelServerType | default "vllm") "triton-tensorrt-llm" }}
3839
- --total-queued-requests-metric

0 commit comments

Comments
 (0)