What is Post-training quantization?

Post-training quantization in the explanations

• Post-training quantization converts a trained model's weights (and activations) to lower precision after examining value ranges with a small representative dataset.

  What is the difference between post-training quantization (…

Questions that mention Post-training quantization (2)

1. What is the difference between post-training quantization (PTQ) and quantization-aware training (QAT)?
2. In post-training quantization of activations to INT8, what is the purpose of calibration?

Related terms

Quantization-aware training INT8 AI compiler AI inference All-reduce Arithmetic intensity Attention mechanism Backpropagation Batch size Computational graph