File tree Expand file tree Collapse file tree 1 file changed +1
-8
lines changed Expand file tree Collapse file tree 1 file changed +1
-8
lines changed Original file line number Diff line number Diff line change @@ -54,7 +54,7 @@ This living user guide outlines a few known **important changes and limitations*
54
54
| ** FP8 KV Cache** | <nobr >🟢 Functional on Hopper devices ([ PR #15191 ] ( https://github.com/vllm-project/vllm/pull/15191 ) )</nobr >|
55
55
| ** Spec Decode** | <nobr >🚧 WIP ([ PR #13933 ] ( https://github.com/vllm-project/vllm/pull/13933 ) )</nobr >|
56
56
| ** Prompt Logprobs with Prefix Caching** | <nobr >🟡 Planned ([ RFC #13414 ] ( https://github.com/vllm-project/vllm/issues/13414 ) )</nobr >|
57
- | ** Structured Output Alternative Backends** | <nobr >🟡 Planned </nobr > |
57
+ | ** Structured Output Alternative Backends** | <nobr >🟢 Functional </nobr > |
58
58
| ** Embedding Models** | <nobr >🚧 WIP ([ PR #16188 ] ( https://github.com/vllm-project/vllm/pull/16188 ) )</nobr > |
59
59
| ** Mamba Models** | <nobr >🟡 Planned</nobr > |
60
60
| ** Encoder-Decoder Models** | <nobr >🟠 Delayed</nobr > |
@@ -132,13 +132,6 @@ in progress.
132
132
- ** Multimodal Models** : V1 is almost fully compatible with V0 except that interleaved modality input is not supported yet.
133
133
See [ here] ( https://github.com/orgs/vllm-project/projects/8 ) for the status of upcoming features and optimizations.
134
134
135
- #### Features to Be Supported
136
-
137
- - ** Structured Output Alternative Backends** : Structured output alternative backends (outlines, guidance) support is planned. V1 currently
138
- supports only the ` xgrammar:no_fallback ` mode, meaning that it will error out if the output schema is unsupported by xgrammar.
139
- Details about the structured outputs can be found
140
- [ here] ( https://docs.vllm.ai/en/latest/features/structured_outputs.html ) .
141
-
142
135
#### Models to Be Supported
143
136
144
137
vLLM V1 currently excludes model architectures with the ` SupportsV0Only ` protocol,
You can’t perform that action at this time.
0 commit comments