Run frontier LLMs and VLMs with day-0 model support across GPU, NPU, and CPU, with comprehensive runtime coverage for PC (Python/C++), mobile (Android & iOS), and Linux/IoT (Arm64 & x86 Docker). Supporting OpenAI GPT-OSS, IBM Granite-4, Qwen-3-VL, Gemma-3n, Ministral-3, and more.
go sdk llama vlm on-device-ai llm stable-diffusion llama3 phi3 gemma3 qwen3 gpt-oss granite4 qwen3vl
-
Updated
Dec 26, 2025 - Go