A judge model is a language model tasked with scoring or comparing answers according to written criteria. It lets you evaluate free-text outputs at scale, but its biases (a preference for long answers, for example) require calibrating it against human judgments.
Example
Rate the clarity of this answer from 1 to 5 using the provided rubric and justify it in one sentence.