NCA-AIIO - AI Operations - Section 3.3

Articulate key measures and criteria for monitoring GPUs.

Articulate the key GPU health and performance metrics to monitor, including GPU utilisation, memory utilisation, temperature, power draw, and SM activity, typically exposed via NVIDIA Management Library (NVML) and tools such as nvidia-smi or DCGM. Recognise how these metrics reveal underutilised hardware, thermal throttling, or impending hardware failures in production.

Examworthy is not affiliated with or endorsed by NVIDIA. Original, blueprint-aligned practice material only.