Online GPU Energy Optimization with Switching-Aware Bandits

Understand

Energy consumption has become a bottleneck for future computing architectures, from wearable devices to leadership-class supercomputers.

• Existing energy management techniques largely target CPUs, even though GPUs now dominate power draw in heterogeneous high performance computing (HPC) systems.
• Moreover, many prior methods rely on either purely offline or hybrid offline and online training, which is impractical and results in energy inefficiencies during data collection.
• In this paper, we introduce a practical online GPU energy optimization problem in a HPC scenarios.