NCA-AIIO - AI Operations - Section 3.1

Describe AI data centre management and monitoring essentials.

Describe the tools and practices used to manage and monitor AI data centre infrastructure, including out-of-band management via BMC/IPMI, health monitoring dashboards, and alerting on hardware faults. Recognise the role of NVIDIA Base Command Manager and similar platforms in providing unified visibility across nodes, GPUs, and network fabric.

Practice question for this objective

Free sampleAI Operationsmedium

A data centre team needs to monitor GPU server health even when a node's operating system has hung or the host driver is unresponsive, so that they can detect thermal and power faults and power-cycle the node remotely. Which monitoring path lets them collect this information independently of the host software state?

  • AQuerying DCGM through its host engine on each node, which reads live GPU counters directly from the resident driver across the cluster
  • BScraping the dcgm-exporter endpoint on each node so a Prometheus server pulls GPU metrics over the cluster network for dashboards and alerts
  • CReading the operating system's hardware sensor interface on each host to gather temperature and power readings through standard kernel drivers
  • DOut-of-band management via the baseboard management controller using a protocol such as Redfish or IPMI, which operates independently of the host CPU and OS Correct
Out-of-band BMC management via Redfish or IPMI monitors and power-cycles nodes independently of host OS and driver state. In-band tools like DCGM and dcgm-exporter run inside the host and stop when the OS or driver fails. The baseboard management controller is a separate processor with its own network and power-control hooks, so out-of-band protocols such as Redfish or IPMI keep delivering sensor data and remote power-cycle capability when the host itself is down.

Why A is wrong: DCGM is the right tool for rich GPU telemetry, but it runs in the host operating system and depends on the driver, so it goes blind exactly when the host has hung.

Why B is wrong: The dcgm-exporter is a standard Prometheus integration and tempting because it centralises alerting, but it is a host-resident process feeding from the driver, so it stops responding when the OS hangs.

Why C is wrong: Kernel sensor interfaces do expose temperature and power, but they live inside the very host software that has stopped responding, so they cannot deliver telemetry during an OS hang.

Why D is correct: The baseboard management controller runs on dedicated management hardware with its own network path, so a Redfish or IPMI query reaches sensor data and power controls even when the host OS and GPU driver are down, which is exactly what remote fault detection and power-cycling require.

See more NCA-AIIO practice questions, answers explained.

More in this domain

Back to all AI Operations objectives, or the NCA-AIIO cert hub.

Examworthy is not affiliated with or endorsed by NVIDIA. Original, blueprint-aligned practice material only.