startthat.work home

CK-19 Atomic claim decomposition and scoring (FActScore; atomic fact checking)

Split generated text into atomic facts and score the share that a reliable knowledge source supports, and produce a supported proportion and a list of unsupported facts.

Check extracted resultsEvidence: TestedVerification technique, runs in step 6Strongest statement: describe

What it does

Splits generated text into atomic facts and scores the share that a reliable knowledge source supports. Artefact: the proportion of supported facts and a list of unsupported facts. Read the unsupported list.

When to use it

Use when a long model output contains many separate factual claims and you want a figure for how many are supported.

When it does not fit

Fits long outputs with many separable claims. Misfit: claims that are inferences and not facts stated in the source. The estimator uses a strong model, so the checker can share the generator's errors (inference).

Result format

The result lists the atomic facts split out of the generated text, each marked as supported or unsupported by the knowledge source. It gives the proportion of supported facts and ends with the list of unsupported facts.

Requirements on the material

PropertyRequirement typeRequirement
Content typeAlways appliesrequires=text
Unit of analysisAlways appliesrequires=claim
Appraises source credibilityApplies in some casesno

Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materiala reliable knowledge source or the source documents, and outputs with several separable claims
Additional sources needednone
Not for (rules)none
Not for (text)Wrong choice for claims that are inferences and not facts stated in the source. The reported error rate came from one biography task and must not be transferred to other tasks.

Choosing and ordering

Kind of techniqueVerification technique, runs in step 6
Phase tagvalidate
Other phase tagsreport
Kind of findingcontradiction; gap
Question answeredwhat
Strongest statement it supportsdescribe
Needs as input
Makes as output
Must exist firstNone
Loop targetproceed with limit stated

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.

StakesCheckPerson involvedCounts as a different method
exploratoryspot checkoptionalno
decision-informingspot checkoptionalno
decision-informinghuman review sampleneeded; left out below high stakesno
decision-informingsource-span citationnoneno
high-stakesspot checkoptionalno
high-stakeshuman review sampleneededno
high-stakessource-span citationnoneno
high-stakesgold standard agreementconditionalno
high-stakesindependent reviewneededno

Failure modes and limits

Model suitabilitymodel plus code
Typical model failureAccepts a plausible claim that the source does not state.
Error sourcesinput data; language model
Certainty limitsCertainty drops when the checker model shares the generator's errors (risk of bias) and when the knowledge source is incomplete (indirectness).

Evidence and tag basis

Tested. The automated estimator had an error rate below 2 per cent against human scoring on the authors' biography task (2023, abstract). Do not transfer the figure to other tasks. (Min et al. 2023, arXiv 2305.14251)

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.