Jev by TypeSafe AI as an alternative to LLM-as-judge
Melvin Vivas · X post · 2026-09-18 · Open on X
Topics: Evaluation (Evals) & Testing, Industry Trends & Job Market · Level: intermediate
Summary
The creator claims that TypeSafe AI's Jev model 'just killed LLM as judge', meaning it could replace the usual approach of grading outputs with an LLM. This is a short opinion with no details. See the TypeSafe AI launch article for the full explanation.
Key points
- TypeSafe AI's Jev is presented as a possible replacement for LLM-as-judge evaluation.
- This is only the creator's opinion; check the official blog post before relying on it.
- If you use LLM-as-judge in your evals, Jev is worth comparing against it.
Resources mentioned
- TypeSafe AI (@typesafeai) on X · person · x.com · free
Company that built Jev and the RLCD training method, focused on reliable models for automation.
Also in: Decision Model Rankings by Spend and Token Share (Melvin Vivas on X · notes), JevDev v0.1.3: Free UI Environment for Experimenting with Jev Models (Melvin Vivas on X · notes), Using Jev (TypeSafe AI) as a Decision Model for Email Classification (Melvin Vivas on X · notes), Building a Jev Session-History Tool with Codex and Astra (Melvin Vivas on X · notes) and 9 more
Try this
- Look into Jev as a possible alternative to LLM-as-judge in your eval pipeline.
More in Evaluation (Evals) & Testing
- Benchmarks matter less than how a model does on your own task
- 5 Things AI Engineers Must Evaluate: RAG, Agents, Models, Data, Guardrails
- Test models on your own workflow, not public benchmarks
- Models Cheating on Terminal-Bench-2.1
- How to Evaluate a RAG System Before Production (Interview Answer)
- Evaluating Claude Code Plugins with `claude plugin eval`