NCA-AIIO - Essential AI Knowledge (38% of the exam) - Section 1.4
Explain factors contributing to the recent rapid improvement and adoption of AI.
Explain how the convergence of larger datasets, increased GPU compute, and advances in neural-network architectures such as transformers has accelerated AI progress. Recognise that reduced cloud infrastructure costs and the availability of open-source frameworks have lowered the barrier to enterprise AI adoption.
Practice question for this objective
lock_openFree sampleEssential AI Knowledgeeasy
A data science team wants to train a large language model but lacks on-premises GPU infrastructure. Which development has most directly lowered the barrier for teams in this position?
AThe introduction of DPUs that offload networking and storage processing from CPUs
BThe release of open-source model weights and cloud-based GPU compute servicescheck_circle Correct
CWider adoption of NVLink interconnects inside GPU servers
DStandardisation of InfiniBand networking for distributed training clusters
Explain how cloud GPU access and open model releases have lowered the barrier to AI adoption for resource-constrained teams. Cloud providers offering on-demand GPU instances (including NVIDIA A100 and H100 nodes) allow teams to pay per use rather than buy hardware. Simultaneously, the release of pre-trained open model weights means teams can fine-tune existing large models rather than training from scratch, dramatically reducing both compute cost and time-to-value. These two developments together are primary drivers of broader AI adoption beyond well-resourced organisations.
Why A is wrong: DPUs (data processing units) improve data-centre efficiency by offloading networking and security tasks, but they do not give a team without GPUs access to training-scale parallel compute.
Why B is correct: Open model releases (such as Llama and Mistral) combined with cloud GPU services (on-demand A100 or H100 instances) let teams fine-tune or build on existing models without capital investment in hardware.
Why C is wrong: NVLink is a high-bandwidth GPU-to-GPU interconnect that improves multi-GPU training throughput within a node. It is a hardware feature inside a server, not something that reduces entry barriers for teams without infrastructure.
Why D is wrong: InfiniBand reduces latency in large GPU clusters and benefits teams that already have infrastructure. It does not help a team that has no on-premises GPUs at all.
Answers that look right on this material and are not. Each one is a distractor from a different question in the NCA-AIIO bank for this domain.
A regulatory mandate requiring that all machine learning frameworks be released under open licences, which forced the tools into the public domain.
errorWhy it is wrong: Tempting because open availability is the theme, but no such regulatory mandate exists, and popular frameworks are released openly by their maintainers as a community and commercial choice, not by legal compulsion.
Larger datasets allow a model to be trained in far fewer epochs, which shortens wall-clock training time and is the main reason accuracy improved.
errorWhy it is wrong: Tempting because more data can change how many passes are useful, but larger datasets generally increase the compute per training run, and faster training does not by itself raise accuracy.
Federated learning, which lets the startup train across many distributed edge devices without ever centralising any of the underlying data.
errorWhy it is wrong: Tempting because it is a modern technique that reduces data burden, but federated learning concerns distributed training across decentralised data, not reusing a pre-trained model, so it does not describe this workflow.