What is Operator fusion?
An optimization that combines several operations into one kernel, avoiding writing intermediate results to memory and reading them back.
Field: AI Hardware & Software Stack
Operator fusion in the explanations
Reusing data through blocking or operator fusion increases operations per byte (arithmetic intensity), moving the workload rightward and raising its ceiling.
When the Roofline model shows a workload in the memory-band…
Questions that mention Operator fusion (2)
Related terms
Roofline model Arithmetic intensity AI compiler AI inference All-reduce Attention mechanism Backpropagation Batch size Computational graph Data parallelism