Glossary

Convolution

Beginner

Sliding a small pattern detector across an image, checking each spot for that pattern.

Novice

A layer that applies the same small filter at every position of an image (or other grid). Image networks are built mostly from convolutions, and libraries turn each one into a matrix multiplication.

Expert

KK filters of size C×R×SC \times R \times S over an input of CC channels; lowering (im2col) turns it into a K×CRSK \times CRS by CRS×NPQCRS \times NPQ GEMM at the cost of duplicating inputs, or it is computed directly with the same reuse.