Glossary

Logits

Beginner

The raw scores a model gives each possible next word, before they become chances.

Novice

The raw, unnormalized scores the model outputs, one per vocabulary entry. Softmax turns them into probabilities.

Expert

The output-layer values z=hWz = hW: log-probabilities up to a shared constant. Temperature divides them before softmax.