AI Engineer Study Library

MLflow 3.17.0: Jev models as LLM judges in GenAI evaluate

Melvin Vivas · X post · 2026-10-12 · Open on X

Topics: Evaluation (Evals) & Testing, LLMOps, Deployment & Monitoring · Level: intermediate

Summary

MLflow 3.17.0 adds 'Jev Decisions'. You can now use TypeSafe's Jev models as judges in mlflow.genai.evaluate() for yes/no and fixed-category checks. These judge calls work with MLflow Tracing and AI Gateway, so you can inspect and govern them in one place.

Key points

Resources mentioned

Try this

More in Evaluation (Evals) & Testing

All of Evaluation (Evals) & Testing