AISeptember 202612 min read
Prompt Regression Testing in CI: Assert a Rate, Not an Answer
A prompt has no type system and no compiler, so a suite of tests is the only thing standing between a reworded instruction and a changed product. Here is how I build that suite: cases lifted from real incidents, deterministic assertions before any judge, a judge calibrated against my own labels, a pinned model, and the three things a red run can mean.
Read More
