abdulvahapmutlu / edge-serve-ab Star 0 Code Issues Pull requests This project is a FastAPI + ONNX Runtime microservice that serves image inference with A/B routing, optional shadow traffic, token-bucket rate limiting, payload size guards, and end-to-end observability (Prometheus metrics, Grafana dashboards, structured logs, request tracing). python docker kubernetes computer-vision docker-compose grafana prometheus ci-cd ab-testing canary-deployment k6 model-serving blue-green-deployment mlops fastapi edge-ai onnxruntime shadow-traffic Updated Sep 16, 2025 Python