Glossary

Utilization (of compute)

Beginner

How much of its top speed a chip actually uses on a real job. A chip at 30% utilization is busy only about a third of the time it could be.

Novice

Delivered throughput divided by peak throughput, as a percentage. It depends on the workload, the software and the system as much as on the chip.

Expert

Report what was counted: useful model FLOPs (MFU) or all FLOPs the hardware executed (HFU), over what interval, and against which peak (dense or sparse, which precision). Not the same as placement density, which is also called utilization.