Running a 28.9M-Parameter LLM on an $8 ESP32 Microcontroller
Melvin Vivas · X post · 2026-08-02 · Open on X
Topics: LLM Fundamentals, Industry Trends & Job Market · Level: intermediate
Summary
A developer used a trick borrowed from Google's Gemma models to fit a 28.9M-parameter language model on an $8 ESP32 microcontroller. It shows that very small LLMs can run on very cheap hardware at the edge. The linked Hackster.io article has the details.
Key points
- A 28.9M-parameter LLM was made to run on an ESP32 chip that costs about $8.
- The approach borrows a technique from Google's Gemma model family.
- Tiny LLMs can run on microcontrollers, without a GPU or the cloud.
- Read the Hackster.io write-up for how it was done.
Resources mentioned
- Running a 28.9M Parameter LLM on an $8 Microcontroller (Hackster.io) · article · hackster.io · free
Hackster.io news article about fitting a 28.9M-parameter LLM onto an ESP32 using a trick from Gemma. - ESP32 · tool · espressif.com · paid
A low-cost microcontroller from Espressif, used here to run a tiny LLM. - Gemma 4 · tool · ai.google.dev · free
Google's family of open-weight models in several sizes, built to run on devices and offline, with multimodal and agentic abilities, and open to fine-tuning.
Also in: Meetily: Open-Source Local AI Meeting Notes App (Melvin Vivas on X · notes), New Gemma Developer Documentation Site (Melvin Vivas on X · notes), A100 80GB GPUs in Google Colab via Google AI Pro plans (Melvin Vivas on X · notes), A day of work done from a phone with Grok Bot agents (Melvin Vivas on X · notes) and 32 more
Try this
- Read the Hackster.io article to learn the technique used.
- Run a tiny language model on a cheap microcontroller such as an ESP32.