Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 58.8k 10.3k

2. oobabooga/text-generation-webui oobabooga/text-generation-webui Public

   The definitive Web UI for local AI, with powerful features and easy setup.

   Python 45k 5.8k

3. OpenBMB/MiniCPM-V OpenBMB/MiniCPM-V Public

   MiniCPM-V 4.5: A GPT-4o Level MLLM for Single Image, Multi Image and High-FPS Video Understanding on Your Phone

   Python 21.9k 1.6k

4. huggingface/llm-vscode huggingface/llm-vscode Public

   LLM powered development for VSCode

   TypeScript 1.3k 142

5. mlc-ai/llm-perf-bench mlc-ai/llm-perf-bench Public

   Python 120 13

6. llm-vscode-inference-server llm-vscode-inference-server Public

   An endpoint server for efficiently serving quantized open-source LLMs for code.

   Python 56 10