How to write a chat template for llama.cpp server?

[AFKler]

Which variables do i have to use in jina? How to define user-name and system-name?

#5766 (comment)

[ngxson]

Currently it's not possible, you can only use these templates: https://github.com/ggerganov/llama.cpp/wiki/Templates-supported-by-llama_chat_apply_template

The ability to have custom prefix for user - system - assistant maybe added in the future

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.