Skip to content

Conversation

philschmid
Copy link
Contributor

This is a PR for #52. I am not sure if there are other implications but with that change it works for Gemma 2 9b IT.

Copy link
Collaborator

@markurtz markurtz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, thanks for the contribution @philschmid!

@markurtz markurtz merged commit 1409245 into vllm-project:main Sep 10, 2024
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants