Skip to content

v1.1.0

Compare
Choose a tag to compare
@pandyamarut pandyamarut released this 02 Aug 23:54
· 58 commits to main since this release
37d140a
  • Major update from vllm v0.4.2 -> v0.5.3.
  • supports Llama 3.1 version models.
  • Various improvements and bug fixes.
    [Known Issue]: OpenAI Completion Requests error.