AI Hardware & Software Stack

What is the main reason neuromorphic computing hardware can aim for low power consumption?

  1. AAll neurons always run simultaneously at a high clock frequency
  2. BAll calculations are performed in 64-bit floating point
  3. CIt is event-driven, so only the parts that receive spikes are active, and memory holding the weights sits close to computation to reduce data movement
Show answer and explanation

Answer: C. It is event-driven, so only the parts that receive spikes are active, and memory holding the weights sits close to computation to reduce data movement

Neuromorphic computing takes the brain's neural circuits as a model and conveys information as pulses called spikes. Only the parts that receive spikes when input changes are active, so in sparse workloads idle circuits use almost no power. Synaptic weights are held in memory inside each core, reducing long data movement to and from arithmetic units. These features distinguish it from GPUs, which perform dense matrix operations in lockstep.

  • A. Running everything in lockstep all the time would increase power.
  • B. High-precision number formats push power up, not down.
  • C. Correct. Event-driven operation and memory close to computation are the reasons.
Practice this topic Back to topic

Related calculators

Books on AI Hardware & Software Stack Ad

As an Amazon Associate I earn from qualifying purchases.

More AI Hardware & Software Stack questions

  1. Why is it hard to train spiking neural networks (SNNs), the models run in neuromorphic computing, directly with the backpropagation used for ordinary neural networks?
  2. What is the difference between training and inference for a neural network?
  3. Which is NOT a reason training needs much more memory than inference for the same model?
  4. A 7-billion-parameter (7B) model is trained with weights, gradients and Adam's two states all held in FP32 (4 bytes). Excluding activations, roughly how much memory is needed?
  5. If a 7-billion-parameter (7B) model's weights are held in FP16 (2 bytes), roughly how much memory do the weights take?

Comparisons in this topic