CH-01 Key assumptions check (assumptions check)
Lists the stated and unstated premises of the current line, challenges each, and produces a refined assumptions register with the conditions that would invalidate each assumption.
What it does
Lists the stated and unstated premises of the current line, challenges each, and keeps those that must be true with the conditions that would invalidate them. Artefact: a refined assumption list; assumptions with no stated invalidating condition are the likely points of error.
When to use it
Use when a judgement or plan is written down and you want to know which premises must be true and what would show them false.
When it does not fit
The list contains only facts, or no assumption is marked vulnerable.
Result format
The result is a refined assumption list in which each assumption is marked as stated or unstated and as challenged, kept or dropped. Each kept assumption has the conditions that would invalidate it, and the assumptions with no stated invalidating condition are named as the likely points of error.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Unit of analysis | Always applies | requires=claim; requires=topic |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Content type, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | The current judgement or plan written down. |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | The list contains only facts, or no assumption is marked vulnerable. |
Choosing and ordering
| Kind of technique | Challenge technique, runs in step 6 |
|---|---|
| Phase tag | validate |
| Other phase tags | frame; conclude |
| Kind of finding | risk; gap |
| Question answered | what; why |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to analyse |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | assumption and limitation statement | none | no |
| decision-informing | assumption and limitation statement | none | no |
| decision-informing | independent review | needed; left out below high stakes | no |
| high-stakes | assumption and limitation statement | none | no |
| high-stakes | independent review | needed | no |
| high-stakes | expert review | needed | no |
| high-stakes | second technique with different assumptions | none | conditional |
Failure modes and limits
| Model suitability | model alone |
|---|---|
| Typical model failure | Lists generic assumptions or facts, and agrees with its own earlier output, so that no assumption is marked vulnerable. |
| Error sources | input data; coder or rater judgement; language model |
| Certainty limits | A model checking its own output may share its biases with the original; assumptions with no stated invalidating condition remain the likely points of error. No controlled evidence found. |
Related techniques
- pairs with CH-03 Devil's advocacy: Devil advocacy attacks the most vulnerable assumptions found here
- pairs with CH-09 Structured self-critique: Structured self-critique overlaps with this check plus alternative hypotheses
Evidence and tag basis
Documented. Described in both the CIA primer and the UK handbook; no controlled evidence found. (CIA Tradecraft Primer (2009); UK Red Teaming Handbook)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.