Glossary

Verifier

Beginner

A checker that says whether an answer is right, like an answer key or a set of tests.

Novice

Anything that scores an answer: a program that checks a math answer or runs unit tests, or a trained model that estimates whether a solution is correct.

Expert

A rule-based checker (answer matcher, compiler plus tests) or a learned model (outcome or process reward model). Rule-based verifiers are hard to game but cover only checkable tasks.