FLOP and FLOP/s
Beginner
One math step on a number with a decimal point, like one multiplication. Chips are rated by how many they can do each second.
Novice
A floating-point operation: one add or one multiply. FLOP/s (FLOPS) counts them per second; AI chips are rated in teraFLOP/s ( per second) or more.
Expert
A multiply-accumulate counts as 2 FLOPs. Vendor peaks are usually dense matrix rates at a stated precision, sometimes doubled for structured sparsity, so always check which. Integer rates are quoted as OPS or TOPS.
Explained in What the workload needs (Architectures).
See also: MAC (multiply-accumulate).