CCAO-F - Output Evaluation and Validation (21% of the exam) - Section 2.3

Apply fact-checking and validation techniques.

Verifying claims against an authoritative source rather than asking Claude to rate its own confidence. Candidates should know which claims need checking first: names, numbers, dates, citations and anything going to an external or compliance audience.

authoritative sourcesself-rated confidence is unreliableprioritising high-stakes claims

Practice question for this objective

Free sampleOutput Evaluation and Validationmedium

A project manager at an engineering consultancy asked Claude to turn her notes and a pasted finance tracker extract into a monthly status report for the client's steering group, which meets tomorrow. The executive summary says the project is on budget, but the cost table later in the same report shows spending 12 percent over the approved budget. The steering group will decide on extra funding from this report. What should she do before sending it?

  • AAsk Claude which of the two statements is correct and keep whichever version it confirms
  • BDelete the on-budget sentence from the summary, since tables are usually more reliable than prose
  • CCheck both figures against the finance tracker, correct the wrong one, and recheck related claims Correct
  • DRegenerate the whole report with the same prompt until the summary and the table agree
When a Claude output contradicts itself, resolve the conflict against the source data rather than asking Claude or simply picking one version. An internal contradiction is a reliable signal that at least one statement in an output is wrong, but it does not reveal which one. Only the source the report was built from can settle it. Because other statements, such as a forecast or a risk rating, may rest on the wrong figure, the correction should extend to claims derived from it, not just the one sentence.

Why A is wrong: Tempting because Claude produced both statements and seems best placed to reconcile them, but its answer is just another generated claim, not evidence, and it may confidently pick the wrong figure.

Why B is wrong: Tempting because the table looks more precise, but precision is not accuracy. Either part could be the error, and removing the sentence without checking the source could leave a wrong table in front of a funding decision.

Why C is correct: The contradiction shows that at least one statement is wrong, and only the finance tracker can say which. Correcting against the source and rechecking claims built on that figure, such as forecasts or risk ratings, makes the report safe for a funding decision.

Why D is wrong: Tempting as a quick fix, but rerunning an unchanged prompt can produce agreement on the wrong figure. Consistency between two generated statements does not prove that either matches the tracker.

See more CCAO-F practice questions, answers explained.

Exam traps in Output Evaluation and Validation

Answers that look right on this material and are not. Each one is a distractor from a different question in the CCAO-F bank for this domain.

  • The opening paragraph's general claim that food waste is a large share of what households throw away

    Why it is wrong: It is tempting because it is a factual statement, but it is general background that carries little consequence if loosely worded, so it ranks below the specific dates, figures and quotations.

  • Use the figures, as the specific amounts suggest Claude drew on the competitor's real price list.

    Why it is wrong: Precise figures feel as though they must come from a real source. Specificity is not evidence: Claude can state exact prices that are outdated or invented with the same confidence as correct ones.

  • The news article Claude cited, since it is the most recent public source and comes from an established outlet.

    Why it is wrong: Tempting because recency and a reputable outlet suggest reliability. It is wrong because a news report is a secondary account; it does not set the trust's deadline and may be out of date or misreported.

Examworthy is not affiliated with or endorsed by Anthropic. Original, blueprint-aligned practice material only.