Convolution
Beginner
Sliding a small pattern detector across an image, checking each spot for that pattern.
Novice
A layer that applies the same small filter at every position of an image (or other grid). Image networks are built mostly from convolutions, and libraries turn each one into a matrix multiplication.
Expert
filters of size over an input of channels; lowering (im2col) turns it into a by GEMM at the cost of duplicating inputs, or it is computed directly with the same reuse.
Explained in What the workload needs (Architectures).
See also: Matrix multiplication (GEMM).