Tutorials, demos, and guides for building on-device AI apps
DEVELOPERSMarch 9, 2026
MetalRT becomes the first inference engine to handle LLMs, Speech-to-Text, and Text-to-Speech on Apple Silicon. 101ms to transcribe 70 seconds of audio. 178ms to synthesize speech. 4.6x faster than Apple MLX.
DEVELOPERSMarch 3, 2026
MetalRT delivers 658 tok/s decode and 6.6ms time-to-first-token, winning decode on 3 of 4 models we tested on a single M4 Max.
DEVELOPERSFebruary 24, 2026
We added hybrid retrieval (BM25 + vector search) to our on-device voice pipeline. Retrieval adds less than 4ms. The real cost is LLM prefill — but word-level flushing absorbs it. Sub-200ms first-audio on 5,016 chunks with zero cloud dependencies.
DEVELOPERSFebruary 22, 2026
FastVoice achieves 63ms first-audio latency — well under the 200ms perceptual threshold — by composing STT, LLM, and TTS into a single C++ pipeline on Apple Silicon. No cloud. No network. Just speed.
DEVELOPERSFebruary 21, 2026
·No server. No API key. No internet. Just a phone doing things on its own.
DEVELOPERSFebruary 19, 2026
·And the rabbit hole that taught me more about Android internals than 3 years of app development.
DEVELOPERSFebruary 18, 2026
Offline AI guide for developers: run models privately on-device with zero cloud dependency. Compare RunAnywhere, Core ML, LiteRT, and more, plus production controls for shipping at scale.
DEVELOPERSFebruary 17, 2026
Compare the best on-device AI infrastructure platforms for edge deployment in 2026. Explore RunAnywhere, Cactus, Liquid AI, and more; covering SDKs, OTA updates, hybrid routing, voice support, and fleet-scale operations.
DEVELOPERSFebruary 15, 2026
Compare the best edge AI management platforms in 2026 for deploying, monitoring, and optimizing on-device models. See how RunAnywhere unified SDK + control plane supports iOS and Android fleets, OTA updates, hybrid routing, and observability.
RunAnywhere
Connect with developers, share ideas, get support, and stay updated on the latest features. Our Discord community is the heart of everything we build.
Product
Company
Legal
