Here are
7 public repositories
matching this topic...
TinyML & Edge AI: On-device inference, model quantization, embedded ML, ultra-low-power AI for microcontrollers and IoT devices.
Updated
Nov 10, 2025
Python
iOS + Android app that runs local LLMs on-device + routstr cloud LLMs for anonymous inference
Updated
Sep 18, 2025
TypeScript
Mobile AI: iOS CoreML, Android TFLite, on-device inference, ONNX, TensorRT, and ML deployment for smartphones.
Updated
Nov 10, 2025
Python
Production Android AI with ExecuTorch 1.0 - Deploy PyTorch models to mobile with NPU acceleration and 50KB footprint
Updated
Nov 14, 2025
Python
Real-time SAM2 segmentation on edge devices - 40x faster C++ inference with ONNX Runtime for iOS/Android deployment
Run small LLMs directly on your device, no cloud computing needed.
Updated
Feb 14, 2026
JavaScript
A free, 100% on-device ChatGPT Application. Your data never leaves your hardware. Private. Local. Limitless.
Updated
Jan 23, 2026
Python
Improve this page
Add a description, image, and links to the
on-device-inference
topic page so that developers can more easily learn about it.
Curate this topic
Add this topic to your repo
To associate your repository with the
on-device-inference
topic, visit your repo's landing page and select "manage topics."
Learn more
You can’t perform that action at this time.