Highlights
- Pro
Pinned Loading
-
turboderp-org/exllamav2
turboderp-org/exllamav2 PublicA fast inference library for running LLMs locally on modern consumer-class GPUs
-
theroyallab/tabbyAPI
theroyallab/tabbyAPI PublicAn OAI compatible exllamav2 API that's both lightweight and fast
-
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.