startthat.work home

CK-24 Review sampling design (random audit sample; stratified sample; risk-based sampling; acceptance sampling; rule of three)

Choose which outputs to inspect and how many so that the observed error rate has a stated bound, and produce an error-rate estimate with an upper bound.

Check extracted resultsEvidence: DocumentedVerification technique, runs in step 6Strongest statement: describe

What it does

Chooses which outputs to inspect and how many, so that the observed error rate has a stated bound. Artefact: an error-rate estimate with an upper bound. With zero errors in n independent random items, the 95 per cent upper bound is about 3 divided by n.

When to use it

Use when you need to audit model output by hand and must decide how many items to review and which.

When it does not fit

Fits rare errors and independent items. Misfit: clustered items, or errors concentrated in a subgroup, which need stratification. No source sets a sample size for LLM output.

Result format

The result states how the items to inspect were chosen, the sample size and the number of errors found. It gives an error-rate estimate with an upper bound, and notes the strata used if any.

Requirements on the material

PropertyRequirement typeRequirement
Unit of analysisAlways appliesrequires=claim; requires=record; requires=document
Level of detail availableAlways appliesrequires=record-level
Appraises source credibilityApplies in some casesno

Not restricted on: Structure, Content type, Variable types, Time structure, How the sample was chosen, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materialindependent items and a stated error rate that would be unacceptable, with at least 59 error-free items for a 5 per cent upper bound
Additional sources needednone
Not for (rules)none
Not for (text)Wrong choice when items are clustered or errors concentrate in a subgroup, unless sampling is stratified. No source sets a sample size for language model output.

Choosing and ordering

Kind of techniqueVerification technique, runs in step 6
Phase tagvalidate
Other phase tagsnone
Kind of findingrisk
Question answeredhow much
Strongest statement it supportsdescribe
Needs as input
Makes as output
Must exist firstNone
Loop targetproceed with limit stated

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: repeatable with fixed settings.

StakesCheckPerson involvedCounts as a different method
exploratoryinput validationnoneno
decision-informinginput validationnoneno
decision-informingcode execution for arithmeticnoneno
high-stakesinput validationnoneno
high-stakescode execution for arithmeticnoneno
high-stakesindependent reviewneededno
high-stakesassumption and limitation statementnoneno

Failure modes and limits

Model suitabilitymodel plus code
Typical model failurePicks "representative" examples to check, which gives a biased sample.
Error sourcesinput data; source selection; statistical assumptions
Certainty limitsCertainty drops when sampled items are not independent (risk of bias) and when errors are rare so the bound is wide (imprecision).

Evidence and tag basis

Documented. The rule of three is read from an encyclopaedia page and is valid roughly for n above 30. The note author's arithmetic gives an upper bound near 5 per cent for 59 error-free items and near 1 per cent for 299. (Wikipedia: Rule of three (statistics); Grimmer and Stewart 2013, Political Analysis; Artstein and Poesio 2008, Inter-coder agreement for computational linguistics)

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.