Energy and Power Efficiency for Applications on the Latest NVIDIA Technology
, Principal Developer Technology Engineer, NVIDIA
With increasing energy costs and environmental impact, it's increasingly important to consider not just performance but also energy usage. Learn how user and developer choices can impact power, energy, and performance for applications running on NVIDIA technology. Through experiments on a wide range of applications, we'll demonstrate the technique of varying GPU clock frequency to tune the application's energy use, without needing to change any source code. The analysis will account not just for GPU power but for all other power overheads associated with running in a data center. We'll then go more in-depth at the application level to show how runtime scheduling and algorithmic choices affect energy and performance. As part of this analysis, we'll showcase the unique properties of the new Grace Hopper Superchips.