Layer pipelining (streaming dataflow)
Beginner
Running a model like an assembly line: each group of cores does one step and passes its result to the next group, so all steps work at once on different inputs.
Novice
Giving each layer of a model its own group of cores and streaming data from group to group. Every layer works at the same time on a different piece of data, and the slowest group sets the pace.
Expert
Spatial execution of a dataflow graph as a coarse-grained pipeline with stage buffers between operators. Throughput is set by the slowest stage or link; latency by the sum of stage delays. Requires the whole pipeline’s weights and buffers to fit on chip at once.