Interact with your documents using the power of GPT, 100% privately, no data leaks

Virtual whiteboard for sketching hand-drawn like diagrams

1.58 Bit LLM on Apple Silicon using MLX

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚

AirLLM 70B inference with single 4GB GPU

OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training

Independent technology for modern publishing, memberships, subscriptions and newsletters.

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

A high-throughput and memory-efficient inference and serving engine for LLMs

🔥🕷️ Crawl4AI: Open-source LLM Friendly Web Crawler & Scrapper

Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.

🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transf…

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

Get up and running with Llama 3.2, Mistral, Gemma 2, and other large language models.

LLM training in simple, raw C/CUDA

Interactive roadmaps, guides and other educational content to help developers grow in their careers.

Infinite Bookshelf: Generate entire books in seconds using Groq and Llama3

Port of OpenAI's Whisper model in C/C++

You like pytorch? You like micrograd? You love tinygrad! ❤️

the only cheat sheet you need

📚 Collaborative cheatsheets for console commands

Python logic and recipes for automatic cooking

The Mojo Programming Language

The open source Firebase alternative. Supabase gives you a dedicated Postgres database to build your web, mobile, and AI applications.

DeDRM tools for ebooks

Ghidra is a software reverse engineering (SRE) framework

🚀✨ Help beginners to contribute to open source projects

A collection of simple python mini projects to enhance your python skills

A list of Free Software network services and web applications which can be hosted on your own servers