CPUs and architecture
What is the main reason GPUs are well suited to matrix operations and AI training and inference?
- ATheir clock frequency is over 100 times that of CPUs
- BThey have many simple arithmetic units and can process large amounts of data in parallel
- CThey have no memory
Show answer and explanation
Answer: B. They have many simple arithmetic units and can process large amounts of data in parallel
GPUs were originally designed to process many image pixels at once, with thousands of simple arithmetic units arranged in parallel. For workloads that repeat the same calculation on large amounts of data, such as matrix operations, they deliver high performance by exploiting this parallelism.