A regression test checks that a change (prompt, model, parameter) does not degrade results that were already good. You replay the reference test set before and after the change and compare the scores; a drop on previously passing cases blocks the release to production.
Example
score before: 92%, after: 87% -> change rejected