On-device AI across mobile, embedded and edge for PyTorch

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

utilities for batched llm calls with retries

A powerful GUI app and Toolkit for Claude Code - Create custom agents, manage interactive Claude Code sessions, run secure background agents, and more.

Nano vLLM

Claude Code Emacs integration

Automatic evals for LLMs

Simplifying how you write Lisp

Reproduction Package for the paper "Type-Constrained Code Generation with Language Models" [PLDI 2025]

A collection of LogitsProcessors to customize and enhance LLM behavior for specific tasks.

Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.

A simple tool that let's you explore different possible paths that an LLM might sample.

The place for SLOP

Grammars suitable for lark parser and Hypothesis

AI Pair Programming in Emacs with Aider

🔯 Modern, batteries-included Hugo theme for creating beautiful doc, blog and static websites

A collection of MCP servers.

Any model. Any hardware. Zero compromise. Built with @ziglang / @openxla / MLIR / @bazelbuild

Transpiler of Python to many other languages

Automatically rerun your tests on file modifications

Structured Outputs

Use `outlines` generators with Haystack.

Infers JSON Schemas and Type Definitions from example JSON

The pytest framework makes it easy to write small tests, yet scales to support complex functional testing

A Unified Library for Parameter-Efficient and Modular Transfer Learning

AI Observability & Evaluation

A playbook for effectively prompting post-trained LLMs

🦀 A curated list of Rust tools, libraries, and frameworks for working with LLMs, GPT, AI