Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Track and format chat history #9

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from

Commits on Sep 27, 2024

  1. Add special tokens for models

    We should download the relevant files from HF. I don't think we can
    avoid implementing the Jinja2 templates for each model family though.
    Would need to use regular expressions instead of full names (might be slow).
    rlouf committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    e91d0b4 View commit details
    Browse the repository at this point in the history
  2. Track and format chat history

    Given the multiplicity of formats, formatting the prompt for chat
    workflows with open models can be a real hassle and is error-prone. In
    this PR we introduce a `Chat` class that allows users to track the
    conversation and easily print the corresponding prompt.
    rlouf committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    65546fe View commit details
    Browse the repository at this point in the history