Se7en的架构笔记

A high-throughput and memory-efficient inference and serving engine for LLMs

A Datacenter Scale Distributed Inference Serving Framework

🤖 AI Gateway | AI Native API Gateway

Higress Official Website

A go sdk for coding Higress wasm plugins.

Cloud-native high-performance edge/middle/service proxy

OpenSearch Kubernetes Operator

Connect, secure, control, and observe services.

higress console

🎯 An unified python client to communicate with various kinds of object-store providers.

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

SGLang is a fast serving framework for large language models and vision language models.

🎉 An awesome & curated list of best LLMOps tools.

Production-Grade Container Scheduling and Management

An LLM Mock Server that supports simulating the protocols of all LLM providers.

Autonomous coding agent right in your IDE, capable of creating/editing files, executing commands, using the browser, and more with your permission every step of the way.

This repository contains examples for Elastic Observability

OpenTelemetry Community Demo Application

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorR…

Context7 MCP Server -- Up-to-date documentation for LLMs and AI code editors