Skip to content

Chat template for 13B/70B-chat #13

@vera-bernhard

Description

@vera-bernhard

Hi there

I was wondering which chat template did you employ for fine-tuning? I noticed in your How to use-Section in the README, you don't mention any chat template.

Looking at the ME-LLaMA-70B-chat model repositories, there is a chat template defined in the tokenizer_config.json, namely the same template as for its backbone Llama-2-70b-chat. However, there is no chat template defined in the tokenizer_config.jsonfor the ME-LLaMA-13B-chat model.

Could you clarify whether ME-LLaMA-13B/70B-chat requires a chat template for proper interaction, and if so, which one? Without this information, it’s difficult to use the model effectively.

Thanks

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions