What is Computational graph?

Computational graph in the explanations

• A computational graph is a blueprint of a model's computation, with operations such as matrix products, additions and activations as nodes and the tensors flowing between them as edges.

  Which describes the computational graph used by AI framewor…

• An AI compiler takes the model as a computational graph of operations and data flows, fuses operations where possible, removes unnecessary computation, chooses memory layouts and tunes tile sizes, then generates kernels suited to the target, such as a GPU or NPU.

  What do AI compilers such as XLA, TVM or PyTorch's compile …

• ONNX (Open Neural Network Exchange) is a standard for representing a model's computational graph and weights in a common format.

  Which describes ONNX?

Questions that mention Computational graph (4)

1. Which describes the computational graph used by AI frameworks and compilers?
2. What do AI compilers such as XLA, TVM or PyTorch's compile feature mainly do?
3. Which describes ONNX?
4. Which orders the AI software stack from the layer closest to users down to the layer closest to hardware?

Related terms

AI compiler GPU NPU (neural processing unit) Backpropagation ONNX AI inference All-reduce Arithmetic intensity Attention mechanism Batch size