Skip to content
#

constrained-decoding

Star

Here is 1 public repository matching this topic...

Language: C
Filter by language
All 79 Python 52 Rust 5 TypeScript 5 JavaScript 3 Jupyter Notebook 3 HTML 2 C 1 C++ 1 Clojure 1 Go 1
xyntetik-runner

Joakimpalm-Zen / xyntetik-runner

Star 11

Single-binary GGUF model runtime in C — CPU/CUDA/Metal, OpenAI-compatible. Serves, scores, and trains LoRA directly through the quantized weights it deploys, with byte-reproducible adapters. Tool calls survive the token limit; sparse MoE and schema-constrained decoding included.

c metal json-schema cuda inference moe llama granite ai-agents mixture-of-experts edge-ai openai-api constrained-decoding llm local-llm function-calling qwen gguf tool-calling structured-outputs
  • Updated Sep 1, 2026
  • C

Add this topic to your repo

To associate your repository with the constrained-decoding topic, visit your repo's landing page and select "manage topics."

Learn more