Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
-
Updated
Feb 20, 2026 - TypeScript
Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
The Privacy Firewall for LLMs
Multi-model LLM serving for NVIDIA DGX Spark with vLLM, web UI, and tool calling
Verify claims using AI agents that debate using scraped evidence and local language models.
AI tool to help users research using local LLMs and automated web search.
Create a Small LLM using EleutherAI/gpt-neo-2.7B - Fine Tune It for a Specalized Purpouse and Leverage as a Co-Pilot
Bot for IRC and Discord with LocalLLM and LLM support
Sovereign AI Infrastructure: A Hardened-by-Design approach to private LLM deployment. Engineered for Fiscal Efficiency and zero-trust security.
Add a description, image, and links to the private-llm topic page so that developers can more easily learn about it.
To associate your repository with the private-llm topic, visit your repo's landing page and select "manage topics."