Run Hermes Agent locally with Qwen 3.6 35B MTP in LM Studio

Melvin Vivas · X post · 2026-07-20 · Open on X

Topics: AI Agents, Tool Use & MCP, LLMOps, Deployment & Monitoring, AI Dev Tools & Productivity · Level: intermediate

Summary

The creator runs Hermes Agent on a local Qwen 3.6 35B model (MTP variant) served through LM Studio. The point is that you can run a capable agent fully locally, for free.

Key points

• Stack: Hermes Agent + Qwen 3.6 35B (MTP) + LM Studio
• LM Studio serves the local model that the agent uses
• Fully local: no API costs and your data stays on your machine
• MTP (multi-token prediction) variants can speed up generation

Resources mentioned

• Hermes Agent · tool · github.com · free
  Nous Research's open-source AI agent with CLI, TUI and desktop interfaces. It now supports hands-free activation with a wake word.
  Also in: Inspecting Coding-Agent Traces Live with JSONL Viewer (Codex, Claude Code) (Melvin Vivas on X · notes), Hermes Agent: each bot is its own profile (Melvin Vivas on X · notes), An X research bot built with Hermes (Melvin Vivas on X · notes), Run Your Hermes Agent on Free LFM2.5-2.6B via OpenRouter (Melvin Vivas on X · notes) and 55 more
• Qwen 3.6 35B (MTP) · tool · huggingface.co · free
  Qwen 3.6 mixture-of-experts model (35B total, about 3B active parameters) with multi-token prediction for local inference.
  Also in: Use a Local Model for Confidential Data with Your Agent (Melvin Vivas on X · notes), Running Qwen 3.6 35B locally on an RTX 3090 for agent tool calling (Melvin Vivas on X · notes), Models That Work With the Hermes Agent for Personal Productivity (Melvin Vivas on X · notes), Local Personal AI Agent to Explain Your Investment Portfolio (Melvin Vivas on X · notes) and 4 more
• LM Studio · tool · x.com · free
  Desktop app for downloading and running LLMs locally, with a developer mode that serves models through an API.
  Also in: Running LLMs Locally Without an Expensive Rig (Melvin Vivas on X · notes), Adding Vercel AI Gateway as a provider in AIBackends with Devin (Melvin Vivas on X · notes), LoRA Fine-Tune Qwen3.5-2B on Your Tweets with Unsloth Studio (Melvin Vivas on X · notes), AIBackends: An API Layer Between Your App and AI Models (Now with Jev) (Melvin Vivas on X · notes) and 31 more

Try this

• Serve Qwen 3.6 35B MTP in LM Studio and connect Hermes Agent to it
• Build a fully local, free personal AI agent with Hermes Agent and LM Studio