vllm-production-stack

Here are 6 public repositories matching this topic...

KhaiTrang1995 / llm-internal

MLOps — vLLM + LiteLLM + Portainer CE + Netdata. Case study song ngữ: kiến trúc, metrics, bài học vận hành. · Self-hosted LLM inference done the MLOps way, a bilingual case study

docker gpu selfhosted self-hosted portainer observability case-study netdata llm case-study-project vllm vllm-production-stack vllm-server

Updated Aug 16, 2026
HTML

0xnyn / periscope

Sponsor

Star

LLM Performance Testing | K6 + Grafana + InfluxDB | A tiny toolkit for load testing and benchmarking OpenAI-like inference endpoints using K6 + Grafana + InfluxDB

influxdb grafana performance-testing k6 vllm llm-testing vllm-production-stack

Updated Apr 11, 2025
JavaScript

CloudThrill / vllm-production-stack-terraform

Star

Multi-cloud Terraform deployment framework for the vLLM Production Stack — with implementations for AWS (EKS), Azure (AKS), GCP (GKE), Nebius, and Oracle OKE.