Template for building microservice-based apps with a frontend, backend, LLM serving engine (e.g., vllm), and nginx.
nginx machine-learning microservices frontend docker-compose docker-compose-template model-serving frontend-backend nginx-reverse-proxy fastapi template-repository ai-applications openai-api large-language-models llm ai-template large-language-model vllm llm-inference ollama
-
Updated
Oct 4, 2024 - HTML