CH-06 High-impact and low-probability analysis Also serves: Project forward.
Works out plausible pathways to an unlikely but consequential event, with triggers and indicators, and produces pathways and an indicator list.
What it does
Works out plausible pathways to an unlikely but consequential event, with triggers and indicators. Artefact: pathways and indicators; read indicators that can be watched cheaply.
When to use it
Use when an unlikely event would be severe and you want to know how it could happen and what to watch for.
When it does not fit
The event is not high impact, or pathways are too vague to produce indicators.
Result format
The result is a set of plausible pathways to the unlikely but consequential event, each with its triggers and its indicators. It names the indicators that can be watched cheaply.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Unit of analysis | Always applies | requires=topic |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Content type, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | A clearly defined outcome and analysts with varied experience. |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | The event is not high impact, or pathways are too vague to produce indicators. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | validate |
| Kind of finding | risk; gap |
| Question answered | what next; what |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to analyse |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | assumption and limitation statement | none | no |
| decision-informing | assumption and limitation statement | none | no |
| decision-informing | independent review | needed; left out below high stakes | no |
| high-stakes | assumption and limitation statement | none | no |
| high-stakes | independent review | needed | no |
| high-stakes | expert review | needed | no |
| high-stakes | second technique with different assumptions | none | conditional |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Lists generic catastrophes and indicators that cannot be watched, instead of pathways specific to the topic. |
| Error sources | input data; coder or rater judgement; language model |
| Certainty limits | Pathways are judgements with no frequency data, so likelihood is not estimated; no effectiveness evidence found. |
Related techniques
- pairs with PJ-25 Leading indicators and signposts (indicators of change, trigger points): Leading indicators turn the pathway indicators into thresholds that can be monitored
- pairs with AO-15 Risk matrix (likelihood and consequence matrix, risk heat map): A risk matrix rates low-probability events low, which this technique corrects
Evidence and tag basis
Documented. Appears under the same name in both sources; no effectiveness evidence found. (CIA Tradecraft Primer (2009); UK Red Teaming Handbook)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.