Best-of-N
Beginner
Make many answers and let a checker pick the best one.
Novice
Generate N candidate answers and keep the one a verifier or reward model scores highest.
Expert
Selection by a scorer over N samples. With a perfect verifier, accuracy approaches 1 − (1 − p)^N; with a learned scorer, the gain is capped by the scorer’s errors and can fall at large N as the scorer is over-optimized.
See also: Verifier, Reward model.