Evaluation - DEV Community

Skip to content

DEV Community

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Jason Lau

Sep 24

Your Agent Has Observability. It Doesn't Have Evals.

#agents #observability #evaluation #llm

10 min read

Modusensus

Sep 25

Cosine Gating Won't Save You From Sycophancy: A Self-Refutation Observed by Three Judges

#ai #oss #evaluation #llm

5 min read

Sep 17

My local 7B thinks "kill a Python process" is a violent crime — and my regex beat it

#ai #security #evaluation #llm

4 min read

saaro

Sep 17

RAG Evaluation 2026: The Four Core Metrics and How to Read Them Diagnostically

#rag #ai #evaluation #metrics

4 min read

Sep 17

Using Execution Traces to Evaluate AI Agent Behavior

#ai #opensource #evaluation

5 min read

Sep 28

Green Scores Without a Pinned Harness Are Screenshots

#evaluation #rag #ai #llm

4 min read

RESK

Sep 28

AI Agent Evaluation End to End: How the LFORLA Drone Build Benchmark Scores Planning, Sourcing, and Assembly

#ai #benchmark #agents #evaluation

4 min read

Debashish Ghosal

Sep 24

7 Agent Eval Mistakes That Cost Me Weeks (And the One-Line Fixes That Ended Them)

#ai #evaluation #llm #programming

5 min read

Cristian Gormaz

Sep 7

El modelo encontró evidencia relevante y aun así falló: por qué “alucinación” se me quedó corta

#ai #testing #llm #evaluation

4 min read

Sep 10

The benchmark that disproved its own result

#localmodels #llm #evaluation #buildinpublic

6 min read

Sep 4

How to Evaluate AI Agents

#ai #agentskills #agents #evaluation

7 min read

Ama Senevirathne

Sep 5

JuryTrace: make agent-judge failures inspectable

#ai #llm #evaluation #python

4 min read

Erik Hill

Aug 31

My board never scored an outage as a regression. My evidence couldn't prove it.

#evaluation #testing #llm #opensource

5 min read

Aug 30

We spent two days bisecting a prompt change. The regression was noise.

#mlops #regression #evaluation #agents

1 min read

Sep 11

Nineteen of twenty patched the symptom

#ai #agents #evaluation #research

9 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.