Posts

Showing 1 - 12 of 16 Posts
Passing Evals Aren't a Quality Signal
Passing Evals Aren't a Quality Signal
Observability & Evals

Passing Evals Aren't a Quality Signal

A high eval pass rate tells you your test set is easy, not that your system is working. A practitioner argument for adversarial evaluation, done right

S
Siv Souvam
1 Min ReadApril, 22 2026