Evals - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Shipwright

Nov 15

LLM-as-judge evals: writing the rubric, and the failure modes that lie to you

#evals #llmjudge #claude #testing

3 min read

Nov 14

Run your own bake-off before you pick a production model

#ai #llm #evals #performance

4 min read

Sankar

Nov 14

"Trust Me Bro" Benchmarks — How AI Labs Grade Their Own Homework

#ai #llm #benchmarks #evals

29 min read

Sayam Jain

Nov 11

Evals before vibes

#ai #llm #testing #evals

9 min read

Jeremy Longshore

Nov 14

MCP structuredContent: Claude Code Drops Your Text Blocks

#mcp #claudecode #evals #aiagents

9 min read

InApp

Nov 8

Why an 88.64 leaderboard score needed the catch in the same sentence

#benchmarks #evals #video #ai

1 min read

Konstantin Gredeskoul

Nov 5

Home-made Evals Just Taste Better

#evals #ai #ruby #opensource

8 min read

Royal Simpson Pinto

Nov 10

The Eval Scorers You Actually Need for LLM Apps (and When to Use Each)

#ai #testing #llm #evals

5 min read

Shipwright

Nov 9

Catch prompt regressions in CI before your users do

#evals #prompts #ci #claude

3 min read

deavgprime

Nov 7

Can an AI model hide how capable it really is?

#ai #evals #agents #testing

10 min read

Nov 1

LLM Evals Start as Thirty Test Cases, Not a Platform

#ai #llm #evals #typescript

4 min read

Oct 29

"🚫 Your Agent Demo Is Not a Release Gate"

#agents #evals #devops #ci

2 min read

Oct 29

"⛔ Stop Merging Agents Without a Required Check"

#agents #evals #github #devops

2 min read

Oct 29

"🧪 RAG Without CI Metrics Is Just a Chatbot"

#rag #evals #llm #python

2 min read

Oct 30

Testing multi-agent crews: forcing split-brain, goal drift, and context drift to happen in CI

#multiagent #testing #evals #coordination

9 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.