What is Model FLOPs utilization (MFU)?
The percentage of hardware peak performance achieved, computed from the operations a model actually requires.
Field: AI Hardware & Software Stack
Model FLOPs utilization (MFU) in the explanations
MFU derives the rate of useful computation from tokens processed per second and the operations the model requires, then divides it by the GPUs' peak performance.
Which describes MFU (Model FLOPs Utilization), a metric of …
Questions that mention Model FLOPs utilization (MFU) (1)
Related terms
AI compiler AI inference All-reduce Arithmetic intensity Attention mechanism Backpropagation Batch size Computational graph Data parallelism FlashAttention