Skip to content

Commit e326cde

Browse files
committed
/pooling endpoint support all pooling tasks
1 parent d98bf46 commit e326cde

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/entrypoints/openai/protocol.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1721,6 +1721,7 @@ class IOProcessorRequest(OpenAIBaseModel, Generic[T]):
17211721
"""
17221722
data: T
17231723

1724+
task: PoolingTask = "plugin"
17241725
encoding_format: EncodingFormat = "float"
17251726
embed_dtype: EmbedDType = Field(
17261727
default="float32",

0 commit comments

Comments
 (0)