Running Codex Inside a Runpod GPU Instance

Melvin Vivas · X post · 2026-09-03 · Open on X

Topics: AI Dev Tools & Productivity, LLMOps, Deployment & Monitoring · Level: intermediate

Summary

The creator runs the Codex coding agent directly inside a Runpod GPU instance. He says this makes it easier to set up Python and run local models. He also recommends herdr.

Key points

• Run a coding agent (Codex) on the GPU box itself to handle Python environment setup.
• This makes running local models on cloud GPUs easier.
• herdr is recommended as a useful tool ("herdr rocks!").

Resources mentioned

• OpenAI Codex · tool · openai.com · paid
  OpenAI's coding agent. In the diagram it writes code, fixes review findings and drives the build loop. The creator also used it to make this video.
  Also in: An agent bot that installs and drives Codex on its own (Melvin Vivas on X · notes), Asking a Coder bot to install Codex (Melvin Vivas on X · notes), Sign in with ChatGPT: Setting Usage Limits for Each App (Melvin Vivas on X · notes), Codex Cloud Environments Must Be Saved & Published Before Use (Melvin Vivas on X · notes) and 240 more
• Runpod · tool · x.com · paid
  GPU cloud platform for running, training and serving AI models; Flash deploys workloads to it.
  Also in: AI DevBox v1.3.0: a GPU-ready Docker image with coding-agent CLIs (Melvin Vivas on X · notes), Why LLM data agents need solid data foundations (Runpod) (Melvin Vivas on X · notes), Docker image with coding agents pre-installed on a CUDA + PyTorch base (Melvin Vivas on X · notes), GPU devbox Docker image with coding agents on Runpod (Melvin Vivas on X · notes) and 5 more
• herdr · tool · x.com · check price
  A runtime that keeps real terminals open for coding agents on a local or rented machine, so agent sessions keep running when you disconnect.
  Also in: Terminal Tool Recommendation: herdr (Melvin Vivas on X · notes), herdr 0.9.0: Control Agents Across Multiple Machines (Melvin Vivas on X · notes), GPU devbox Docker image with coding agents on Runpod (Melvin Vivas on X · notes), GPU-Ready AI Devbox Docker Image on Runpod (PyTorch 2.8 + CUDA 12.8) (Melvin Vivas on X · notes) and 7 more

Try this

• Try running a coding agent like Codex inside your cloud GPU instance to set up Python and local models.