A fancy, easy-to-use and reactive self-hosted docker compose.yaml stack-oriented manager

A high-throughput and memory-efficient inference and serving engine for LLMs

A full-stack Webui implementation of Large Language model, such as ChatGPT or LLaMA.