#

inference-server

Here is 1 public repository matching this topic...

rhea-impact / rhearouter

Production-grade self-hosted inference gateway with OpenAI-compatible API

python self-hosted inference-server fastapi ai-agent local-llm ollama openai-compatible

Updated Feb 5, 2026
HTML

Improve this page

Add a description, image, and links to the inference-server topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the inference-server topic, visit your repo's landing page and select "manage topics."