Performance Analysis
When analyzing the performance of a GPU program, what is the most appropriate thing to check first?
- AThe GPU fan speed
- BThe color of the GPU memory
- CHow total time divides among kernel execution, CPU-GPU data transfers and CPU-side processing
Show answer and explanation
Answer: C. How total time divides among kernel execution, CPU-GPU data transfers and CPU-side processing
In GPU programs, even when kernels are fast, data transfers or CPU-side preparation often keep the whole from speeding up. A GPU profiler's timeline shows how much each part takes and whether transfers overlap computation. If kernels dominate, investigate their memory access patterns and occupancy; if transfers dominate, reduce or overlap them.
- A. Cooling status is not the first clue in performance analysis.
- B. Color is irrelevant.
- C. Correct. It shows what to improve.