Advanced packaging (3D and chiplets)
What is the problem called in which the speed of supplying data from memory cannot keep up with improvements in processor compute performance, limiting overall performance?
- AThe thermal wall
- BThe memory wall
- CMoore's law
Show answer and explanation
Answer: B. The memory wall
Processor compute performance has improved rapidly, but data transfer speed (bandwidth) to and from memory has grown more slowly, so compute units spend more time waiting for data. This is called the memory wall. It is especially severe in AI, which handles huge amounts of data, and advanced packaging that places HBM close to the processor is one countermeasure.
- A. Limits from heat are a different problem, called the power wall and the like.
- B. Correct. It is the problem of memory bandwidth limiting performance.
- C. Moore's law is an empirical rule about the growth in transistor count.