Running Gemma 4 Models Offline on an iPhone

Melvin Vivas · X video post · 2026-09-20 · Open on X

Topics: LLM Fundamentals, AI Dev Tools & Productivity · Level: intermediate

Summary

A demo of Google's Gemma 4 models chatting fully on-device on an iPhone with no internet. The creator notes the models are also trainable, and he built the app using Devin's Mac environment.

Key points

• Gemma 4 models can run locally on an iPhone, so chat works without internet
• On-device inference keeps data local and works offline
• Gemma models are open and trainable, so you can fine-tune them for on-device use
• The app was built using Devin's (AI coding agent) Mac environment

Resources mentioned

• Google Gemma (@googlegemma) · person · x.com · free
  Official X account for Google's Gemma open models, with release news and examples.
  Also in: Running Gemma4-E2B tool calling locally on an iPhone (Melvin Vivas on X · notes)
• Gemma 4 · tool · ai.google.dev · free
  Google's family of open-weight models in several sizes, built to run on devices and offline, with multimodal and agentic abilities, and open to fine-tuning.
  Also in: Gemma 4 Runs Locally On-Device in the Antigravity SDK (Melvin Vivas on X · notes), On-Device AI: Running Gemma 4 E2B Offline on an iPhone with LiteRT (Melvin Vivas on X · notes), Fine-tuning Gemma4-E2B on your own tweet style with Unsloth (Melvin Vivas on X · notes), Running Gemma4-E2B tool calling locally on an iPhone (Melvin Vivas on X · notes) and 25 more
• Devin · tool · x.com · paid
  A desktop app from the makers of the Devin coding agent for planning, delegating, reviewing and shipping work across fleets of local and cloud coding agents.
  Also in: Using the Devin iOS App to Build iOS Apps (Quick Demo) (Melvin Vivas on X · notes), Use Your ChatGPT Plus/Pro Subscription to Run Devin (Melvin Vivas on X · notes), OpenAI DevDay recap: Dots, GPT-6.1 Sol, Codex Cloud, Agents API (Melvin Vivas on X · notes), Devin price cuts and top score on FrontierCode 1.1 Extended (Melvin Vivas on X · notes) and 44 more

Try this

• Build an offline chat app on iPhone running Gemma 4 locally