Power Aware Computing on GPUs

• Main Authors: Kasichayanula, K., Terpstra, D., Luszczek, P., Tomov, S., Moore, S., Peterson, G. D.
• Format: Conference Proceeding
• Language: English
• Subjects: AMG; GPUs; Graphics processing unit; Instruction sets; Kernel; MAGMA power analysis; Memory management; Nonvolatile memory; NVIDIA C2075; NVML; Power demand; Power measurement; power-aware; temperature-aware
• ISSN: 2166-5133; 2166-515X
• DOI: 10.1109/SAAHPC.2012.26

Energy and power density concerns in modern processors have led to significant computer architecture research efforts in power-aware and temperature-aware computing. With power dissipation becoming an increasingly vexing problem, power analysis of Graphical Processing Unit (GPU) and its components has become crucial for hardware and software system design. Here, we describe our technique for a coordinated measurement approach that combines real total power measurement and per-component power estimation. To identify power consumption accurately, we introduce the Activity-based Model for GPUs (AMG), from which we identify activity factors and power for micro architectures on GPUs that will help in analyzing power tradeoffs of one component versus another using micro benchmarks. The key challenge addressed in this work is real-time power consumption, which can be accurately estimated using NVIDIA's Management Library (NVML). We validated our model using Kill-A-Watt power meter and the results are accurate within 10%. This work also analyses energy consumption of MAGMA (Matrix Algebra on GPU and Multicore Architectures) BLAS2, BLAS3 kernels, and Hessenberg kernels.