NCA-AIIO domain - 22% of the exam

AI Operations

AI Operations is 22% of the NVIDIA-Certified Associate: AI Infrastructure and Operations (NCA-AIIO) exam. These are the objectives it covers, each with practice questions and worked explanations.

Objectives in this domain

Sample question from this domain

Free sampleAI Operationsmedium

A research team submits a distributed training job that requires 16 GPUs spread across 4 nodes. The job fails to start because the scheduler allocates only 3 of the 4 nodes before a competing job claims the fourth. Which scheduling strategy is specifically designed to prevent this outcome?

  • AGang scheduling, which holds all required nodes in reserve and starts all processes simultaneously Correct
  • BFair-share scheduling, which divides available GPU resources proportionally among all active users
  • CPreemptive scheduling, which evicts lower-priority jobs to free resources for higher-priority requests
  • DBackfill scheduling, which slots smaller jobs into idle windows left by reserved future allocations
Explain how gang scheduling prevents partial-allocation failures in multi-node distributed GPU training jobs. Gang scheduling (also called co-scheduling) treats all processes of a distributed job as a single indivisible unit. The scheduler withholds the job from running until every required slot on every required node is available at the same instant, then launches all ranks together. This is essential for tight-coupling frameworks such as MPI or PyTorch distributed training where all ranks must communicate from the first iteration. Without gang scheduling, partial allocations stall indefinitely, wasting the already-allocated GPUs and blocking other work.

Why A is correct: Gang scheduling ensures every process in a distributed job is launched at the same time across all required nodes. This atomic allocation eliminates the partial-allocation deadlock where some nodes are claimed by competing jobs before the full gang is assembled.

Why B is wrong: Fair-share scheduling governs resource equity across users over time, but it does not guarantee that all nodes for a single job are reserved simultaneously, so the same partial-allocation race can still occur.

Why C is wrong: Preemptive scheduling can reclaim resources from lower-priority jobs, but it does not inherently co-allocate all nodes at once. A preempted node may become available only after the remaining nodes are already taken by other jobs.

Why D is wrong: Backfill scheduling improves cluster utilisation by filling gaps around reserved slots, but it is not the mechanism that guarantees simultaneous allocation of all nodes for a single multi-node job.

Other domains in this exam

See also the NCA-AIIO cert hub, the study guide, and the cheat sheet.

Examworthy is not affiliated with or endorsed by NVIDIA. Original, blueprint-aligned practice material only.