CK-26 Independent human review of model output (expert review; adjudication; human oversight)
Specify who reviews which outputs, with what rubric and with authority to overrule, and produce a review log with decisions.
What it does
Specifies who reviews which outputs, with what rubric and with authority to overrule. Artefact: a review log with decisions. Read the overruled items and the reasons.
When to use it
Use when an output will inform a decision and a person who did not build it must check and be able to overrule it.
When it does not fit
Fits any output used in a decision. Misfit: reviewers see only items the model approved (automation bias, inference). Neither source gives sample sizes or reviewer numbers.
Result format
The result is a review log with one row per output reviewed, giving the reviewer, the rubric applied, the decision and the reason. It states who reviews which outputs and lists the overruled items with the reasons.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Unit of analysis | Always applies | requires=claim; requires=document; requires=record |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Content type, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | at least one reviewer who did not develop the model, and a written rubric |
|---|---|
| Additional sources needed | reference structure |
| Not for (rules) | none |
| Not for (text) | Wrong choice when reviewers see only the items the model approved, which invites automation bias. Neither source gives sample sizes or reviewer numbers. |
Choosing and ordering
| Kind of technique | Verification technique, runs in step 6 |
|---|---|
| Phase tag | validate |
| Other phase tags | conclude |
| Kind of finding | risk |
| Question answered | what next |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to analyse |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | spot check | optional | no |
| decision-informing | spot check | optional | no |
| decision-informing | human review sample | needed; left out below high stakes | no |
| decision-informing | provenance log | none | no |
| high-stakes | spot check | optional | no |
| high-stakes | human review sample | needed | no |
| high-stakes | provenance log | none | no |
| high-stakes | independent review | needed | no |
| high-stakes | expert review | needed | no |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Reports "reviewed" when no reviewer saw the output. |
| Error sources | input data; coder or rater judgement; expert opinion |
| Certainty limits | Certainty drops when reviewers see only approved items (risk of bias), when review is rushed (imprecision) and when reviewers lack subject knowledge (indirectness). |
Related techniques
- should follow CK-24 Review sampling design (random audit sample; stratified sample; risk-based sampling; acceptance sampling; rule of three): the sample design says which items reviewers see
- pairs with CK-25 Error taxonomy and error analysis (failure mode analysis; confusion analysis): reviewed failures are classified; should follow :: family:Prepare and extract :: the extracted outputs are what reviewers check
Evidence and tag basis
Documented. NIST says reviewers should not be directly involved in developing the same model and that review should be prioritised by risk. The Australian standard asks for a competent person with authority to intervene. (NIST AI 600-1; Voluntary AI Safety Standard, 10 guardrails)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.