Running Qwen3.8 27B Locally with llama.cpp for Writing

Melvin Vivas · X post · 2026-09-09 · Open on X

Topics: LLM Fundamentals, LLMOps, Deployment & Monitoring · Level: beginner

Summary

The creator says he likes how Qwen3.8 27B writes and that he runs it locally with llama.cpp. It is a short endorsement that points to a local, open-weight model for writing tasks.

Key points

• The creator likes the writing quality of Qwen3.8 27B.
• He runs the model locally with llama.cpp.
• A 27B open-weight model can be a practical local option for writing.

Resources mentioned

• Qwen3.8-27B · tool · huggingface.co · free
  A 27B-parameter open-weight model from Alibaba's Qwen family that you can run locally or call through hosted APIs.
  Also in: Deploying Qwen3.8 27B on Hugging Face Inference Endpoints (Melvin Vivas on X · notes), Using Hugging Face credits: Jobs, Inference Endpoints and Open Models (Melvin Vivas on X · notes), Running Qwen3.8-27B Locally on an M5 Max MacBook with Inco Splash (Melvin Vivas on X · notes), Ternary Bonsai 2 27B: 9x smaller model keeping 98.2% of benchmark scores (Melvin Vivas on X · notes) and 24 more
• llama.cpp · repo · github.com · free
  An open-source C/C++ engine for running GGUF models locally. Its llama-server command provides an OpenAI-compatible HTTP server.
  Also in: Running LLMs Locally Without an Expensive Rig (Melvin Vivas on X · notes), llama.cpp / Llama-macOS v0.5.0 release (Melvin Vivas on X · notes), Run llama.cpp GGUF Checkpoints in Hugging Face Transformers (Melvin Vivas on X · notes), llama.cpp v0.4.1 release announcement (Melvin Vivas on X · notes) and 28 more