Machine Learning Systems
On device streaming voice activity detection (Silero VAD v5) for Android. ~424 KB native binary, NEON-accelerated arm64-v8a, RTF ~3% on Snapdragon 662.
Always-on wake-phrase detection for Android on the VoxRT custom on-device inference runtime — Kotlin library, 16 kHz mono PCM in, threshold-crossing events out. Custom phrases at voxrt.com.
Production Android AI with ExecuTorch 1.0 - Deploy PyTorch models to mobile with NPU acceleration and 50KB footprint
On-device 14-way keyword spotter for iOS — Swift Package on the VoxRT custom Rust runtime. 16 kHz mono PCM in, per-class detections out. Streaming Conformer with NEON kernels, same runtime as voxrt-kws-{linux,android,browser}. Upcoming.
On-device 14-way keyword spotter for Android — Kotlin library on the VoxRT custom Rust runtime. 16 kHz mono PCM in, per-class detections out. Streaming Conformer, RTF 16 % on Snapdragon 662 A73. Same runtime as voxrt-kws-{linux,browser}.
LLM inference on mobile via Capacitor — run quantized GGUF models on-device
ONNX model execution on iOS and Android via Capacitor
Qualcomm® AI Hub Models is our collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm® devices.
Description: On-device Android AI assistant for face recognition, object detection, speech I/O, and memory-aware assistance using ExecuTorch, TFLite, Whisper, and Piper.
📱 Optimized ML for edge devices. Showcasing efficient model deployment, GPU-CPU memory transfer optimization, and real-world edge AI applications. 🤖
Claude Code skill for Google LiteRT - on-device AI/ML deployment framework
Model download and serving orchestration for Dust — Capacitor bridge
On-device text embedding generation for iOS and Android via Capacitor
Android ONNX runtime session management and preprocessing for Dust
LLM inference optimization for low-end Android devices - INT8 quantization, on-device processing, Gemma 2 2B
Android ML model server — download management, session caching, accelerator probing
Add a description, image, and links to the mobile-ml topic page so that developers can more easily learn about it.
To associate your repository with the mobile-ml topic, visit your repo's landing page and select "manage topics."