NCA-GENM domain - 5% of the exam

Trustworthy AI

Trustworthy AI is 5% of the NCA-GENM exam. These are the objectives it covers, each with practice questions, with every answer explained.

The domain in numbers

26
Practice questions
2
Objectives
26
Medium

Where people go wrong

  • Swapping watermarks and C2PA manifests

    The wrong answers reverse where each authenticity signal lives. A C2PA manifest is signed metadata attached to the file, so a pipeline that discards metadata removes it, and a signature cannot protect a manifest that is gone. An invisible watermark sits in the pixels or audio samples and is built to tolerate mild recompression, but it carries a payload rather than a signed edit history. Each signal answers a different need, and the surviving one depends on what the pipeline strips.

    See it in a sample question
  • Trusting a detector's old benchmark

    The wrong answers blame resolution, EXIF, overfitting, label noise or a corrupted model when a detector starts missing newer synthetic images. A detector learns the artefact patterns of the generators in its training data. Newer generators leave different artefacts, so false negatives rise while accuracy on the original test set stays unchanged. The cause is a shift in generators, and a fixed detector cannot follow it without retraining.

    See it in a sample question
  • Keeping policy in weights or prompts

    The wrong answers place usage policy in the model weights, in a prompt template, in a keyword denylist or in guidance scale. Weights need a costly retrain on every rule change, prompt instructions are advisory and easy to bypass, and guidance scale only controls how closely generation follows the prompt. A separate guardrail layer, such as NeMo Guardrails, screens inputs and outputs against a configurable policy that is edited independently of the frozen model.

    See it in a sample question
  • Fixing training-data bias after training

    The wrong answers treat a skew in the training corpus with RLHF, output filters, guidance, weight decay or a bigger model. Each of these acts during or after training, or at inference, so the biased association stays in the learned representation, and a larger model reproduces the skew. A data-level mitigation rebalances, resamples or curates the examples so the distribution is more even before any training begins.

    See it in a sample question
  • Curing hallucination with decoding or fine-tuning

    The wrong answers reach for temperature, a longer output budget, a different model family or more fine-tuning. Raising temperature makes fabrication more varied, and lowering it makes unsupported claims more consistent, because the model still draws on parametric memory. Fine-tuning stores facts in weights that drift and does not bind an answer to a given document. Retrieval-augmented generation places retrieved passages in context, so each claim is conditioned on source text.

    See it in a sample question

Objectives in this domain

Sample questions from this domain

Free sampleTrustworthy AImedium

A media organisation must distinguish between two content-authenticity technologies for its AI image pipeline: one embeds a cryptographically signed record of an asset's origin and edit history as metadata travelling alongside the file, while the other embeds an imperceptible signal directly into the pixels so it survives recompression and resharing. Which statement most accurately characterises the conceptual difference between these two approaches?

  • ABoth invisible watermarking and provenance metadata cryptographically sign the asset, so either one alone proves the editing history and neither can be removed without invalidating the file.
  • BProvenance metadata is embedded in the pixels and survives recompression, whereas invisible watermarking is external metadata that is removed the moment the file is re-exported.
  • CProvenance metadata standards such as C2PA carry rich signed assertions but can be stripped when a file is re-exported, whereas invisible watermarking embeds a signal into the content itself that tends to survive transformations like compression. Correct
  • DBoth technologies are visible overlays applied to the rendered image, differing only in whether the overlay is a logo or a QR code that viewers can scan.
Distinguish signed provenance metadata, which is strippable, from invisible watermarking, which embeds a persistent signal in the content itself. A C2PA manifest binds cryptographically signed assertions about origin and edits as metadata, which a re-export can discard; an invisible watermark perturbs the signal so the mark persists through compression and resampling, making the two layers complementary in a provenance strategy.

Why A is wrong: Tempting because both relate to authenticity, but watermarking encodes a bit-pattern rather than a signed edit history, and metadata can be stripped without corrupting the visible content, so this overstates both.

Why B is wrong: Tempting as a plausible labelling, but it reverses the two: it is the watermark that lives in the signal and the manifest metadata that is strippable, so the roles are swapped.

Why C is correct: Correct: a C2PA manifest is signed metadata bound to the file and is lost if the metadata is removed, while an invisible watermark lives in the signal and persists through many transformations, so the two are complementary rather than equivalent.

Why D is wrong: Tempting because visible credential badges exist, but the question describes imperceptible and metadata-borne mechanisms, neither of which is a visible overlay, so this mischaracterises both.

Free sampleTrustworthy AImedium

A trust-and-safety team relies solely on a binary AI-image detector trained in 2023 to flag synthetic photographs. Which limitation should the team be most aware of when assessing its ongoing reliability?

  • AThe detector cannot run on GPU hardware without recompilation, limiting throughput
  • BBinary detectors always misclassify JPEG-compressed images as synthetic
  • CDetection accuracy degrades on images produced by generators released after the detector's training cutoff Correct
  • DPerceptual hashing prevents the detector from reading image pixels correctly
Explain how training-data recency limits the reliability of AI-generated image detectors against novel generation models. Synthetic-media detectors are trained to recognise artefact patterns produced by specific generative models available at training time. As new architectures and training techniques emerge, the artefact profile of generated content shifts. A detector trained in 2023 has never seen images from models released in 2024 or later, so it cannot reliably identify them - a fundamental generalisation gap. This is the primary reliability limitation the team must understand, and it motivates the complementary use of provenance standards such as C2PA rather than relying on detection alone.

Why A is wrong: Hardware compatibility is an infrastructure concern unrelated to the fundamental accuracy challenge; it does not explain why a well-deployed detector would fail to catch new synthetic images.

Why B is wrong: This overstates a known sensitivity issue; compression artefacts can affect detector confidence but modern classifiers are calibrated against them, and the claim that compression always causes misclassification is inaccurate.

Why C is correct: Synthetic-media detectors learn statistical patterns from the specific generators included in their training data. When newer generators - especially those with improved architectures or fine-tuning pipelines - produce images with different artefact profiles, the detector's generalisation fails, leading to increased false-negative rates.

Why D is wrong: Perceptual hashing is a separate content-matching technique; it does not interact with or obstruct a pixel-based neural classifier and has no bearing on detection accuracy for synthetic media.

Free sampleTrustworthy AImedium

An engineering team deploying a customer-facing image generation service wants to prevent the model from producing content that violates usage policies, while preserving the ability to update policy rules without retraining the model. Which safety architecture best satisfies both constraints?

  • AEncode all policy rules directly into the model's system prompt and rely on the model's instruction-following capability to self-enforce them at inference time.
  • BDeploy a modular, rule-based safety layer such as NeMo Guardrails between the model and end users, with policies defined in a separately maintained configuration that can be updated without model retraining. Correct
  • CRetrain the model periodically on datasets that omit policy-violating content so that the generation distribution no longer includes prohibited outputs.
  • DUse CLIP-based post-generation filtering to score every generated image against a set of concept embeddings and discard outputs above a threshold similarity to prohibited concepts.
Describe how a modular safety layer architecture enables policy enforcement in generative AI services without requiring model retraining. NeMo Guardrails and similar modular safety frameworks decouple policy logic from model weights by implementing guardrails as a separate, configurable component that intercepts requests and responses. Because the rules live in an external configuration rather than in the model parameters, teams can update, add, or remove policies immediately and without a training run. This architectural separation supports human oversight, audit trails, and rapid policy iteration - core requirements for trustworthy deployment of generative models.

Why A is wrong: Prompt-only enforcement is brittle; adversarial inputs or prompt injection attacks can bypass system-prompt instructions, and updating a rule requires prompt engineering rather than a governed policy change.

Why B is correct: A modular safety layer such as NeMo Guardrails externalises policy logic from model weights into a maintainable configuration, allowing teams to add, remove, or modify rules at any time without a new training run, which directly meets the update-without-retraining requirement.

Why C is wrong: Periodic retraining can shift the generation distribution away from prohibited content but is expensive, slow to update, and cannot react to policy changes that arise between training cycles.

Why D is wrong: CLIP-based post-generation filtering can catch many prohibited images but operates solely on the output rather than controlling the generation process; updating policies requires rebuilding concept embeddings and the scoring pipeline, and latency increases due to the additional inference pass.

Free sampleTrustworthy AImedium

A multimodal generative model is trained on a large image-caption dataset scraped from the web. Audits reveal that captions describing people in professional roles skew heavily toward one demographic group. Which mitigation strategy most directly targets this bias at the data level before model training begins?

  • AApply RLHF with human annotators who rate outputs for demographic balance after the model has been trained on the original dataset.
  • BAdd a NeMo Guardrails safety layer at inference time that blocks outputs containing demographic references in professional contexts.
  • CIncrease the model parameter count so the larger capacity can learn to represent minority demographics more accurately from the same corpus.
  • DResample and rebalance the training corpus so that professional-role captions are distributed equitably across demographic groups before any training run. Correct
Identify data-level mitigation strategies for demographic bias in multimodal generative model training pipelines. Bias in generative models originates primarily in the training data distribution. Resampling and rebalancing the corpus before training is the most direct intervention because it alters the statistical prior the model learns from. Post-training techniques such as RLHF or inference guardrails treat symptoms rather than causes, and increasing model scale without changing the data amplifies existing biases.

Why A is wrong: RLHF can nudge model behaviour after training but does not correct the skewed distribution already baked into the pre-training corpus; the underlying representations remain biased.

Why B is wrong: Inference-time blocking suppresses outputs but leaves the biased representation in the model weights intact; it also risks over-blocking legitimate content.

Why C is wrong: Scaling model size amplifies patterns in the training data; a larger model trained on a skewed corpus typically reproduces and reinforces that skew rather than correcting it.

Why D is correct: Resampling the corpus to achieve demographic balance removes the skewed prior from the training distribution itself, addressing the root cause rather than downstream symptoms.

Free sampleTrustworthy AImedium

A text-to-audio generation system is observed to produce confident-sounding narration that includes factual details not present in the grounding document provided at inference time. Which architectural or pipeline mechanism most directly reduces this hallucination behaviour?

  • AImplement retrieval-augmented generation so that every factual claim in the narration is traceable to a retrieved passage from the grounding document. Correct
  • BSwitch the underlying language model backbone to a diffusion-based architecture so that outputs are sampled from a learned distribution rather than generated autoregressively.
  • CIncrease the temperature sampling parameter during decoding to encourage more diverse output, which reduces the model's overconfidence in specific factual claims.
  • DFine-tune the model on a curated dataset of factually accurate audio samples to shift the prior distribution toward truthful outputs.
Explain how retrieval-augmented generation reduces hallucination by grounding multimodal generative outputs in verifiable source documents. Hallucination in generative models occurs when the model produces content that is plausible given its parametric knowledge but not faithful to provided context. Retrieval-augmented generation addresses this by conditioning generation on retrieved evidence, making each claim traceable back to a source passage. This grounding mechanism is more reliable than temperature tuning or fine-tuning alone because it introduces an explicit, inspectable link between output and source at each inference step.

Why A is correct: Retrieval-augmented generation (RAG) anchors generation to explicit source passages, providing a verifiable grounding chain that constrains the model from producing facts outside the provided context.

Why B is wrong: Diffusion-based models for audio generation address signal quality and style, but they do not inherently constrain factual content to a grounding document; hallucination is a knowledge-grounding problem, not an architecture-family problem.

Why C is wrong: Raising temperature increases output diversity and randomness but makes hallucination worse, not better; the model is more likely to fabricate varied content rather than staying faithful to the source.

Why D is wrong: Fine-tuning on accurate samples improves baseline factuality but does not bind the model to a specific grounding document at inference time; the model can still hallucinate beyond the provided context.

Other domains in this exam

See also the NCA-GENM cert hub, the study guide, and the cheat sheet.

Examworthy is not affiliated with or endorsed by NVIDIA. Original, blueprint-aligned practice material only.