Added extra endpoints to enable Open Webui / LibreChat
You can select the initial model but due to tabby/Exllama switching models won't free up the memory.
forked from theroyallab/tabbyAPI
-
Notifications
You must be signed in to change notification settings - Fork 0
An OAI compatible exllamav2 API that's both lightweight and fast
License
JohnZolton/tabbyAPI-ollama
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
An OAI compatible exllamav2 API that's both lightweight and fast
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published
Languages
- Python 92.3%
- Jupyter Notebook 4.0%
- Jinja 1.4%
- Other 2.3%