Running Gemma 4 Models Offline on an iPhone
Melvin Vivas · X video post · 2026-09-20 · Open on X
Topics: LLM Fundamentals, AI Dev Tools & Productivity · Level: intermediate
Summary
A demo of Google's Gemma 4 models chatting fully on-device on an iPhone with no internet. The creator notes the models are also trainable, and he built the app using Devin's Mac environment.
Key points
- Gemma 4 models can run locally on an iPhone, so chat works without internet
- On-device inference keeps data local and works offline
- Gemma models are open and trainable, so you can fine-tune them for on-device use
- The app was built using Devin's (AI coding agent) Mac environment
Resources mentioned
- Google Gemma (@googlegemma) on X · person · x.com · free
The official Google Gemma account on X, which posts news about Gemma model releases.
Also in: EmbeddingGemma 2: One On-Device Model for Multimodal Embeddings (Melvin Vivas on X · notes), Running Gemma4-E2B tool calling locally on an iPhone (Melvin Vivas on X · notes) - Gemma 4 · tool · ai.google.dev · free
Google's family of open-weight models in several sizes, built to run on devices and offline, with multimodal and agentic abilities, and open to fine-tuning.
Also in: Meetily: Open-Source Local AI Meeting Notes App (Melvin Vivas on X · notes), New Gemma Developer Documentation Site (Melvin Vivas on X · notes), A100 80GB GPUs in Google Colab via Google AI Pro plans (Melvin Vivas on X · notes), A day of work done from a phone with Grok Bot agents (Melvin Vivas on X · notes) and 32 more - Devin · tool · x.com · paid
A desktop app from the makers of the Devin coding agent for planning, delegating, reviewing and shipping work across fleets of local and cloud coding agents.
Also in: Devin's open-source vulnerability-fixes agent plugin (Melvin Vivas on X · notes), Gemini 4 Argon now available in Devin (Melvin Vivas on X · notes), Devin Defaults to Opus 5.5 in Normal and Fusion Modes (Cloud) (Melvin Vivas on X · notes), Devin: Preview Websites in Its Built-in Cloud Browser (Melvin Vivas on X · notes) and 57 more
Try this
- Build an offline chat app on iPhone running Gemma 4 locally
More in LLM Fundamentals
- GPT-6 Sol vs Opus 5.5 in a Livestream Comparison
- Opus 5.5 vs GPT-6 Sol for Writing: Latent Space AINews Test
- Grok 4.7 Launch: Official xAI Announcement
- Possible Open-Weights Version of Jev on Hugging Face
- Ternary Bonsai 2 27B: 9x smaller model keeping 98.2% of benchmark scores
- Jev model from TypeSafe AI for cheap support-ticket triage