Use Codex to Prepare Fine-Tuning Datasets
Melvin Vivas · X post · 2026-09-15 · Open on X
Topics: Fine-tuning & Model Customization, AI Dev Tools & Productivity · Level: intermediate
Summary
Tip: when you train a model, ask Codex to help prepare the dataset. It can research the data format your base model needs.
Key points
- Ask a coding agent to prepare your training dataset.
- Codex can look up the chat or template format that your chosen base model requires.
- This saves you from checking format details by hand before fine-tuning.
Resources mentioned
- OpenAI Codex · tool · openai.com · paid · recommended by both Bashiri Smith & Melvin Vivas
OpenAI's coding agent. In the diagram it writes code, fixes review findings and drives the build loop. The creator also used it to make this video.
Also in: Developers moving from ChatGPT/Codex to Claude (Melvin Vivas on X · notes), Creator Opinion: Codex Is Still the Best at Computer Use (Melvin Vivas on X · notes), OpenAI Codex Ambassador applications are open (Melvin Vivas on X · notes), GPT-Live-1.1: Multilingual Voice Update for ChatGPT and Codex (Melvin Vivas on X · notes) and 264 more
Try this
- When fine-tuning, ask Codex to prepare your dataset in the format your base model requires.
More in Fine-tuning & Model Customization
- Fine-tuning ModernBERT-base to route tasks between two models
- Train models locally with the Unsloth Docker image
- Post-training Qwen3.5-2B on your own X posts with Unsloth Studio
- Melvin Vivas's Hugging Face Profile
- GPT-6 Astra Medium in Codex as a Low-Cost Fine-Tuning Assistant
- Push Fine-Tuned Models to Hugging Face from Unsloth Studio