LMOS is modular, scalable AI system for deploying full-featured language models, transcription, embeddings, and reranking, with support for Docker and Kubernetes orchestration.
Coming Soon to Apache 2.0
LMOS - Language Model Orchestration System
A modular, scalable AI system for deploying full-featured language models, transcription, embeddings, and reranking, with support for Docker and Kubernetes.
Pinned Loading
Repositories
Showing 10 of 22 repositories
- LMOS-openai-types Public
Contains Pydantic and MsgSpec models derived from OpenAI's OpenAPI spec. Used across the organization.
LMOS-IO/LMOS-openai-types’s past year of commit activity - vllm Public Forked from vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
LMOS-IO/vllm’s past year of commit activity - litellm Public Forked from BerriAI/litellm
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]
LMOS-IO/litellm’s past year of commit activity - LMOS-config Public
The LMOS-Config repo contains a shared config provider for the entire LMOS system.
LMOS-IO/LMOS-config’s past year of commit activity - exllamav2 Public Forked from turboderp-org/exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
LMOS-IO/exllamav2’s past year of commit activity - LMOS-database Public
This contains a relational database schema for the LMOS system. It is stored in this repo so that it can be included as a dependency inside other systems to eliminate ambiguity and diverging specifications.
LMOS-IO/LMOS-database’s past year of commit activity
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Top languages
Loading…
Most used topics
Loading…