CM1-01 Historical analogy and parallel analysis (likenesses and differences, analogical explanation)
Places the present topic beside a past case and rates each likeness and difference, producing a likenesses and differences table that shows where a lesson from the past case may and may not be applied.
What it does
Places the present topic beside one or more past cases and lists where they resemble and differ. Artefact: a likenesses and differences table with each element rated (strong, moderate, weak, not analogous); correspondence supports applying a lesson to the present case and divergence marks where it must not be applied.
When to use it
Use when a user asks whether a past episode is a fair guide to the present one, or what a similar earlier case suggests will happen.
When it does not fit
The listed differences are never checked against the mechanism that produced the earlier outcome, only one analogy is tested, or a vivid case is chosen because it is memorable.
Result format
The result is a table of likenesses and differences between the present topic and each past case, with each element rated strong, moderate, weak or not analogous. It names the elements where the cases correspond, which support applying a lesson to the present case, and the elements where they diverge, where the lesson must not be applied.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Content type | Always applies | requires=text |
| Unit of analysis | Always applies | requires=topic |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | At least one past case with established facts, timeline and outcome, and a statement of what is known, unclear and presumed about the present case. |
|---|---|
| Additional sources needed | comparator |
| Not for (rules) | none |
| Not for (text) | Wrong choice when only one analogy is tested, when the case was picked because it is memorable, or when the listed differences are never checked against the mechanism that produced the earlier outcome. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | none |
| Kind of finding | difference; pattern |
| Question answered | why; what next; what |
| Strongest statement it supports | show a link between things |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to analyse |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | assumption and limitation statement | none | no |
| decision-informing | assumption and limitation statement | none | no |
| decision-informing | alternative explanations check | none | no |
| decision-informing | source-span citation | none | no |
| high-stakes | assumption and limitation statement | none | no |
| high-stakes | alternative explanations check | none | no |
| high-stakes | source-span citation | none | no |
| high-stakes | second technique with different assumptions | none | conditional |
| high-stakes | expert review | needed | no |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Picks the most famous past case, lists likenesses at length and leaves out differences in the mechanism that produced the earlier outcome. |
| Error sources | input data; source selection; coder or rater judgement |
| Certainty limits | Certainty drops when only one analogy is used, when the case was chosen for vividness (risk of bias), or when the earlier mechanism is not shown to apply now (indirectness). |
Related techniques
- should follow CM1-06 Case selection techniques (extreme, deviant, diverse, index, most similar): choosing the past case by a stated rule reduces the pull of a vivid case
- pairs with PJ-02 Reference class forecasting (outside view, base-rate forecasting) Also serves: Compare.: a base rate from many similar cases corrects reliance on a single analogy
- pairs with TC1-04 Process tracing (diagnostic tests: straw in the wind, hoop, smoking gun, doubly decisive): process tracing tests whether the earlier mechanism operated in the present case
Evidence and tag basis
Documented. Described in method texts and in studies of misuse (vividness bias; Bundy's use of Dien Bien Phu for Vietnam in 1965 fitted poorly). No study comparing analogy with other techniques on accuracy was found. (Neustadt and May, Thinking in Time (summary); CIA, Analogical Reasoning in Intelligence Analysis; Khong, Analogies at War (Project MUSE record))
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.