Gemma 4 as a Strong Small Model for Local and On-Device Use
Melvin Vivas · X post · 2026-09-11 · Open on X
Topics: LLM Fundamentals · Level: beginner
Summary
A short post saying that Google's Gemma 4 is still one of the strongest small models you can run locally and on-device.
Key points
- Gemma 4 is recommended as a strong small model for running locally or on-device.
- Consider small open models when you need local inference.
Resources mentioned
- Gemma 4 · tool · ai.google.dev · free
Google's family of open-weight models in several sizes, built to run on devices and offline, with multimodal and agentic abilities, and open to fine-tuning.
Also in: Meetily: Open-Source Local AI Meeting Notes App (Melvin Vivas on X · notes), New Gemma Developer Documentation Site (Melvin Vivas on X · notes), A100 80GB GPUs in Google Colab via Google AI Pro plans (Melvin Vivas on X · notes), A day of work done from a phone with Grok Bot agents (Melvin Vivas on X · notes) and 32 more
More in LLM Fundamentals
- DeepSeek 4.1 Flash speed on the official API: about 325 tokens/s
- Read the GPT-6 Astra launch article to learn what the model can do
- When a higher reasoning level is worth the extra cost
- Running Qwen3.8 27B Locally with llama.cpp for Writing
- Three Local GGUF Models That Fit on an RTX 3090 (24GB)
- Comparing GPT Models in Codex by Intelligence and Cost per Task