Performance Analysis

Which correctly describes throughput and latency as server performance measures?

  1. AThroughput and latency are the same thing
  2. BThroughput is the number of requests processed per unit time; latency is the time from receiving one request to responding
  3. CHigher latency means better performance
Show answer and explanation

Answer: B. Throughput is the number of requests processed per unit time; latency is the time from receiving one request to responding

Throughput measures how much work can be done; latency measures how quickly a single piece of work completes. Batching many requests raises throughput but can lengthen latency by the time spent waiting to batch. Overnight batch processing values throughput, while web responses that users wait for at the screen value latency.

  • A. They are different quantities.
  • B. Correct. Which matters more depends on the goal.
  • C. Lower latency is better.
Practice this topic Back to topic

More Performance Analysis questions

  1. When evaluating web service response times, why is the 99th percentile (the boundary of the slowest 1%) often examined in addition to the mean?
  2. A server receives 100 requests per second, each taking 0.2 seconds on average (steady state). How many requests are in progress at once on average (Little's law)?
  3. What happens to request waiting time as server utilization (fraction of busy time) approaches 100%?
  4. What is the purpose of using a profiler when improving program performance?
  5. What characterizes a sampling profiler?