sglang

Star

Here are 6 public repositories matching this topic...

InftyAI / llmaz

Star

☸️ Easy, advanced inference platform for large language models on Kubernetes

kubernetes helm huggingface llm modelscope llamacpp vllm llm-inference text-generation-inference sglang

Updated Nov 12, 2024
Go

AidanCooper / constrained-decoding

Star

A guide to structured generation using constrained decoding

nlp generative-model constrained-decoding large-language-models structured-generation sglang

Updated Jun 9, 2024
Jupyter Notebook

lucasavila00 / LmScript

Star

Controllable Language Model Interactions in TypeScript

typescript ai guidance outlines llm sglang

Updated May 17, 2024
TypeScript

NEOS-AI / Neosearch

Star

AI-based search engine done right

information-retrieval rag llm cloudnativepg ray-serve vllm retrieval-augmented-generation paradedb llm-search sglang flashrank-reranking postgres-search

Updated Nov 16, 2024
HTML

wtlow003 / modal-llm-serving

Star

Examples of serving LLM on Modal.

modal openai model-serving openai-api llm vllm sglang lmdeploy

Updated Jun 13, 2024
Python

Yijia-Z / aide

Star

chat-application ai-applications openai-api llm-interface sglang

Updated Nov 15, 2024
TypeScript

Improve this page

Add a description, image, and links to the sglang topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the sglang topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

sglang

Here are 6 public repositories matching this topic...

InftyAI / llmaz

AidanCooper / constrained-decoding

lucasavila00 / LmScript

NEOS-AI / Neosearch

wtlow003 / modal-llm-serving

Yijia-Z / aide

Improve this page

Add this topic to your repo