Skip to content

Provide example chat template usage #36

Open
@tstescoTT

Description

using vLLM endpoint API: v1/chat/completions

Client will respond:

 RESPONSE:
"As of transformers v4.44, default chat template is no longer allowed, so you must provide a chat template if the tokenizer does not define one."

Metadata

Assignees

Labels

documentationImprovements or additions to documentationenhancementNew feature or request

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions