Verifier
Beginner
A checker that says whether an answer is right, like an answer key or a set of tests.
Novice
Anything that scores an answer: a program that checks a math answer or runs unit tests, or a trained model that estimates whether a solution is correct.
Expert
A rule-based checker (answer matcher, compiler plus tests) or a learned model (outcome or process reward model). Rule-based verifiers are hard to game but cover only checkable tasks.