Fine-tuning Gemma 3 270M with Unsloth for Work Tasks

Melvin Vivas · X post · 2026-04-04 · Open on X

Topics: Fine-tuning & Model Customization · Level: intermediate

Summary

The creator says he is fine-tuning Google's tiny Gemma 3 270M model for a work use case with Unsloth, and is thinking about fine-tuning Gemma 4 next. Very small models like this are cheap to customize for narrow tasks.

Key points

• Gemma 3 270M is a very small open model that suits fine-tuning for narrow tasks.
• Unsloth is a library that makes fine-tuning faster and lighter on memory.
• Fine-tuning a tiny model for one work task is fast and cheap.
• Gemma 4 can also be fine-tuned.

Resources mentioned

• Unsloth · tool · unsloth.ai · free
  Open-source library for fast, memory-efficient fine-tuning of open LLMs (LoRA/QLoRA) on a single GPU or in Colab.
  Also in: Run Laya Decision models locally with Unsloth on 4GB RAM (Melvin Vivas on X · notes), Unsloth passes 500M model downloads on Hugging Face (Melvin Vivas on X · notes), Run Qwen-Image-2.1 locally on 12GB VRAM with Unsloth GGUFs (Melvin Vivas on X · notes), Base vs fine-tuned Gemma 4 E2B as a model router (Melvin Vivas on X · notes) and 29 more
• Gemma 3 270M · tool · huggingface.co · free
  Google's 270M-parameter open model, designed to be fine-tuned for specific tasks.

Try this

• Try fine-tuning Gemma 3 270M on a narrow task using Unsloth.
• Fine-tune a small Gemma model with Unsloth for a specific work task.