Skip to content

langport 0.3.3

Compare
Choose a tag to compare
@jstzwj jstzwj released this 06 Aug 16:11
· 66 commits to main since this release
63a2a34

What's Changed

  • Support model Qwen
  • Inference speedup
  • Dynamic Batch Inference
  • Gateway logging