Tensor
Beginner
A big block of numbers arranged in rows and columns (or more dimensions), the way a neural network stores its data.
Novice
A multi-dimensional array of numbers: a vector is 1-D, a matrix 2-D. Weights, activations and gradients in a neural network are all tensors, and a number format is chosen per tensor.
Expert
An -dimensional array with a shape and element type. Quantization granularity is described along tensor axes: per-tensor, per-channel (one axis), per-block ( contiguous elements, usually along the reduction dimension of the matrix multiplication).
Explained in Number formats (Architectures).