βΈοΈ Easy, advanced inference platform for large language models on Kubernetes. π Star to support our work!
kubernetes inference huggingface llm modelscope llamacpp vllm text-generation-inference ollama sglang inference-platform
-
Updated
Aug 27, 2026 - Go