MLPerf
Beginner
A shared set of AI speed tests, run under the same rules by many companies, so their results can be compared fairly.
Novice
Benchmark suites from MLCommons, an industry and academic consortium, that time complete AI tasks (training a model to a target accuracy, or answering queries under latency limits). Submissions are reviewed by the other submitters before publication.
Expert
Separate suites for training, datacenter and edge inference, mobile, tiny devices and more, each released in numbered versions. Each result is tied to a division, an availability category and a scenario; only results with the same benchmark and scenario from compatible versions should be compared.
Explained in Comparing chips (Architectures).
See also: Closed and Open divisions, Inference scenario.