Performance Analysis

Which describes a standard benchmark such as SPEC CPU?

  1. AMany programs derived from real applications are run under fixed rules, and performance is reported as an aggregate of ratios against a reference machine
  2. BIt measures only how many additions can be performed
  3. CManufacturers may set benchmark results freely
Show answer and explanation

Answer: A. Many programs derived from real applications are run under fixed rules, and performance is reported as an aggregate of ratios against a reference machine

SPEC CPU is a benchmark suite of many programs based on real applications such as compilers, compression and physics simulation. Each program's execution time is compared with a reference machine's to obtain a ratio, and the ratios are combined into a single value with a geometric mean. There are also rules for compiler settings and run methods, and results are published with detailed conditions.

  • A. Correct. Fixed rules enable fair comparison.
  • B. Many realistic programs are used.
  • C. Results are measured and reported under fixed rules.
Practice this topic Back to topic

More Performance Analysis questions

  1. When combining ratios of speed against a reference machine across several benchmarks, why is the geometric mean often used?
  2. Two programs with equal instruction counts run back to back, one at 1000 million instructions per second and the other at 500 million. What is the overall average rate?
  3. Timing a small loop like the one above gave nearly zero time even for large N. What is the most likely cause?
  4. When timing a program, why are measurements often repeated with the first few runs discarded?
  5. What is the problem with timing a very short operation once, and what is the fix?