LLM training in simple, raw C/CUDA

2-2000x faster ML algos, 50% less memory usage, works on all hardware - new and old.

Official release of InternLM series (InternLM, InternLM2, InternLM2.5, InternLM3).

✨ AI agents that spark joy

Digger is an open source IaC orchestration tool. Digger allows you to run IaC in your existing CI pipeline ⚡️

Python bindings for llama.cpp

A cog implementation of MosaicML's MPT-7B-StoryWriter-65k+ Large Language Model

Numbers every LLM developer should know

A guidance language for controlling large language models.

Self-hosted Supabase on AWS

Python source code auditing and static analysis on a large scale

Locally run an Instruction-Tuned Chat-Style LLM

LLM inference in C/C++

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

Code and documentation to train Stanford's Alpaca models, and generate the data.

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

Serve, optimize and scale PyTorch models in production

High-speed download of LLaMA, Facebook's 65B parameter GPT model

AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data…

React components to build charts and dashboards

A comprehensive Flask boilerplate to build SaaS applications that includes Stripe billing, emails, login, and OAuth.

Terminal Watch Face for Apple Watch

A curated collection of marketing articles & tools to grow your product.

📖 Heuristics for effective management

API Guide for Local Heroes partners

TensorFlow code and pre-trained models for BERT

Code samples used on cloud.google.com