What is AI compiler?
Software that analyzes a model's computational graph, optimizes fusion, data layout and tiling, and generates code for the target hardware, such as XLA and TVM.
Field: AI Hardware & Software Stack
AI compiler in the explanations
An AI compiler takes the model as a computational graph of operations and data flows, fuses operations where possible, removes unnecessary computation, chooses memory layouts and tunes tile sizes, then generates kernels suited to the target, such as a GPU or NPU.
What do AI compilers such as XLA, TVM or PyTorch's compile …The framework or an AI compiler or runtime optimizes the computational graph, and operations such as matrix products and convolutions call kernels from highly optimized libraries.
Which orders the AI software stack from the layer closest t…
Questions that mention AI compiler (2)
Related terms
Computational graph GPU NPU (neural processing unit) AI inference All-reduce Arithmetic intensity Attention mechanism Backpropagation Batch size Data parallelism