Running Qwen 3.6 35B locally on an RTX 3090 for agent tool calling

Melvin Vivas · X post · 2026-08-03 · Open on X

Topics: AI Agents, Tool Use & MCP, LLMOps, Deployment & Monitoring · Level: intermediate

Summary

The creator runs Qwen 3.6 35B (MTP variant) locally on one RTX 3090 GPU. He calls Qwen the most affordable local AI. He says it is great at tool calling and good enough to power Hermes Agent for personal-assistant tasks.

Key points

• Qwen 3.6 35B MTP runs on a single 24GB RTX 3090.
• He reports strong tool-calling ability, which agents depend on.
• He says it is good enough to run Hermes Agent for personal AI tasks.
• A local open-weight model avoids paying per-token API fees for personal agents.

Resources mentioned

• Qwen 3.6 35B (MTP) · tool · huggingface.co · free
  Qwen 3.6 mixture-of-experts model (35B total, about 3B active parameters) with multi-token prediction for local inference.
  Also in: Use a Local Model for Confidential Data with Your Agent (Melvin Vivas on X · notes), Models That Work With the Hermes Agent for Personal Productivity (Melvin Vivas on X · notes), Run Hermes Agent locally with Qwen 3.6 35B MTP in LM Studio (Melvin Vivas on X · notes), Local Personal AI Agent to Explain Your Investment Portfolio (Melvin Vivas on X · notes) and 4 more
• Hermes Agent · tool · github.com · free
  Nous Research's open-source AI agent with CLI, TUI and desktop interfaces. It now supports hands-free activation with a wake word.
  Also in: Inspecting Coding-Agent Traces Live with JSONL Viewer (Codex, Claude Code) (Melvin Vivas on X · notes), Hermes Agent: each bot is its own profile (Melvin Vivas on X · notes), An X research bot built with Hermes (Melvin Vivas on X · notes), Run Your Hermes Agent on Free LFM2.5-2.6B via OpenRouter (Melvin Vivas on X · notes) and 55 more

Try this

• Try running Qwen 3.6 35B locally on a 24GB GPU to power your agent.
• Build a personal AI agent backed by a local Qwen model on a consumer GPU.