startthat.work home

CH-01 Key assumptions check (assumptions check)

Lists the stated and unstated premises of the current line, challenges each, and produces a refined assumptions register with the conditions that would invalidate each assumption.

ChallengeEvidence: DocumentedChallenge technique, runs in step 6Strongest statement: describe

What it does

Lists the stated and unstated premises of the current line, challenges each, and keeps those that must be true with the conditions that would invalidate them. Artefact: a refined assumption list; assumptions with no stated invalidating condition are the likely points of error.

When to use it

Use when a judgement or plan is written down and you want to know which premises must be true and what would show them false.

When it does not fit

The list contains only facts, or no assumption is marked vulnerable.

Result format

The result is a refined assumption list in which each assumption is marked as stated or unstated and as challenged, kept or dropped. Each kept assumption has the conditions that would invalidate it, and the assumptions with no stated invalidating condition are named as the likely points of error.

Requirements on the material

PropertyRequirement typeRequirement
Unit of analysisAlways appliesrequires=claim; requires=topic
Appraises source credibilityApplies in some casesno

Not restricted on: Structure, Content type, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materialThe current judgement or plan written down.
Additional sources needednone
Not for (rules)none
Not for (text)The list contains only facts, or no assumption is marked vulnerable.

Choosing and ordering

Kind of techniqueChallenge technique, runs in step 6
Phase tagvalidate
Other phase tagsframe; conclude
Kind of findingrisk; gap
Question answeredwhat; why
Strongest statement it supportsdescribe
Needs as input
Makes as output
Must exist firstNone
Loop targetreturn to analyse

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.

StakesCheckPerson involvedCounts as a different method
exploratoryassumption and limitation statementnoneno
decision-informingassumption and limitation statementnoneno
decision-informingindependent reviewneeded; left out below high stakesno
high-stakesassumption and limitation statementnoneno
high-stakesindependent reviewneededno
high-stakesexpert reviewneededno
high-stakessecond technique with different assumptionsnoneconditional

Failure modes and limits

Model suitabilitymodel alone
Typical model failureLists generic assumptions or facts, and agrees with its own earlier output, so that no assumption is marked vulnerable.
Error sourcesinput data; coder or rater judgement; language model
Certainty limitsA model checking its own output may share its biases with the original; assumptions with no stated invalidating condition remain the likely points of error. No controlled evidence found.

Evidence and tag basis

Documented. Described in both the CIA primer and the UK handbook; no controlled evidence found. (CIA Tradecraft Primer (2009); UK Red Teaming Handbook)

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.