A generalized information-seeking agent system with Large Language Models (LLMs).
-
Updated
Jun 19, 2024 - Python
#
localllm
Here are 38 public repositories matching this topic...
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
natural-language-processing text-generation transformer llama quantization model-compression efficient-inference post-training-quantization large-language-models llm small-models localllm
-
Updated
Aug 13, 2024 - Python
[NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
natural-language-processing compression text-generation transformer llama quantization mistral model-compression efficient-inference efficient-model large-language-models llm small-models localllm localllama
-
Updated
Aug 13, 2024 - Python
The PyVisionAI Official Repo
python open-source ocr computer vision openai llama vlm vision-models localllm ollama claude-3-5-sonnet
-
Updated
Mar 6, 2025 - Python
MVP of an idea using multiple local LLM models to simulate and play D&D
dnd local multiagent streamlit llm localllm local-ai ollama multi-llm llm-generator ollama-python multi-ai llm-game ai-dnd
-
Updated
Apr 23, 2025 - Python
A local chatbot for managing docs
-
Updated
Feb 23, 2025 - Python
LocalLab allows you to easily run Hugging Face AI models locally or on Google Colab, featuring automatic API setup, model management, performance optimization, and system monitoring.
nodejs python ai model python3 client-server ngrok-server google-colab fastapi google-colab-notebook huggingface-transformers generative-ai localllm
-
Updated
May 4, 2025 - Python
Demo project showcasing Gemma3 function calling capabilities using Ollama. Enables automatic web searches via Serper.dev for up-to-date information and features an interactive Gradio chat interface.
machine-learning googleapi artificial-intelligence llm genai localllm function-calling ollama gemma3
-
Updated
Mar 30, 2025 - Python
Read your local files and answer your queries
rag llm largelanguagemodel localllm retrieval-augmented-generation open-source-llm llmprojects runing-llm-locally
-
Updated
Sep 3, 2024 - Python
Local AI Open Orca For Dummies is a user-friendly guide to running Large Language Models locally. Simplify your AI journey with easy-to-follow instructions and minimal setup. Perfect for developers tired of complex processes!
ai easy-to-use for-dummies large-language-models llm llms large-language-model localai local-llm localllm local-ai openorca open-orca
-
Updated
Mar 5, 2024 - Python
A minimal CLI tool to locally summarize any text using LLM!
-
Updated
Jan 15, 2025 - Python
Improve this page
Add a description, image, and links to the localllm topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the localllm topic, visit your repo's landing page and select "manage topics."