What is Structured sparsity?

Sparsity in which zero weights follow a fixed pattern; 2:4 sparsity, with two zeros in every four weights, lets matrix units compute about twice as fast.

Field: AI Hardware & Software Stack

Questions that mention Structured sparsity (1)

  1. Which describes the 2:4 structured sparsity supported by GPU matrix units?

Related terms

GPU AI compiler AI inference All-reduce Arithmetic intensity Attention mechanism Backpropagation Batch size Computational graph Data parallelism

Back to the glossary