Tag: evaluation
All the articles with the tag "evaluation".
95% Agreement, Zero Failures Caught: Testing Your LLM Judge
Published: at 06:00 AMAn executable confusion-matrix example shows why agreement can hide a useless judge. Evaluate failure detection and actual task outcomes separately.