Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

Finetune Llama 3.3, DeepSeek-R1, Gemma 3 & Reasoning LLMs 2x faster with 70% less memory! 🦥

A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp.

Kolosal AI is an OpenSource and Lightweight alternative to LM Studio to run LLMs 100% offline on your device.

Whisper STT + Orpheus TTS + Gemma 3 using LM Studio to create a virtual assistant.

A user-friendly Command-line/SDK tool that makes it quickly and easier to deploy open-source LLMs on AWS

Lightroom plugin for generating title, caption and keywords with ChatGPT, Gemini or various Ollama models

An open-source implementaion for Gemma3 series by Google.

Chat with a character via reference images!

Gemma 3 [ Image-text-text ] [ video inference ] [ multi image chat ]

Get started with the new Gemma 3 model for on-device inference. Giving you the simplest steps to get started with AI on Android.

modify a language model's behavior by abliterating its weights.

AI-Powered PDF Summarizer is a tool that extracts and summarizes research papers from ArXiv PDFs using Ollama (Gemma 3 LLM). The system provides structured, downloadable summaries to help researchers and professionals quickly grasp key findings.

multimodal chatbot

This project demonstrates how to run Large Language Model \(LLM\) inference locally on Android devices using MediaPipe. It provides a foundation for building applications that leverage the power of LLMs without relying on cloud-based APIs, ensuring privacy and enabling offline functionality.

Leverage Gemma 3's capabilities using LitServe.

A Gradio interface that automatically transcribes YouTube videos using faster-whisper (small) and refines the transcription with ChatOllama (gemma3:12b).

Gemma3 Rag with ChromaDB RAG Nomic Embed Text embeddings

Grida bot running locally doing chors with LLM

A Streamlit web application that leverages the Gemma-3 Vision model to extract and structure text from images