AI Engineer Study Library

OpenAI Retires Its Evals Platform and Recommends promptfoo

Melvin Vivas · X post · 2026-10-06 · Open on X

Topics: Evaluation (Evals) & Testing, AI Safety, Security & Guardrails, LLMOps, Deployment & Monitoring · Level: intermediate

Summary

The post says OpenAI is retiring its evals platform and recommends promptfoo as the replacement. promptfoo is an open-source tool for testing prompts, agents and RAG pipelines. It also covers red teaming and vulnerability scanning, and it can compare models such as GPT, Claude, Gemini and DeepSeek.

Key points

Resources mentioned

Try this

More in Evaluation (Evals) & Testing

All of Evaluation (Evals) & Testing