startthat.work home

CM1-01 Historical analogy and parallel analysis (likenesses and differences, analogical explanation)

Places the present topic beside a past case and rates each likeness and difference, producing a likenesses and differences table that shows where a lesson from the past case may and may not be applied.

CompareEvidence: DocumentedPrimary technique, runs in step 5.3Strongest statement: show a link between things

What it does

Places the present topic beside one or more past cases and lists where they resemble and differ. Artefact: a likenesses and differences table with each element rated (strong, moderate, weak, not analogous); correspondence supports applying a lesson to the present case and divergence marks where it must not be applied.

When to use it

Use when a user asks whether a past episode is a fair guide to the present one, or what a similar earlier case suggests will happen.

When it does not fit

The listed differences are never checked against the mechanism that produced the earlier outcome, only one analogy is tested, or a vivid case is chosen because it is memorable.

Result format

The result is a table of likenesses and differences between the present topic and each past case, with each element rated strong, moderate, weak or not analogous. It names the elements where the cases correspond, which support applying a lesson to the present case, and the elements where they diverge, where the lesson must not be applied.

Requirements on the material

PropertyRequirement typeRequirement
Content typeAlways appliesrequires=text
Unit of analysisAlways appliesrequires=topic
Appraises source credibilityApplies in some casesno

Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materialAt least one past case with established facts, timeline and outcome, and a statement of what is known, unclear and presumed about the present case.
Additional sources neededcomparator
Not for (rules)none
Not for (text)Wrong choice when only one analogy is tested, when the case was picked because it is memorable, or when the listed differences are never checked against the mechanism that produced the earlier outcome.

Choosing and ordering

Kind of techniquePrimary technique, runs in step 5.3
Phase taganalyse
Other phase tagsnone
Kind of findingdifference; pattern
Question answeredwhy; what next; what
Strongest statement it supportsshow a link between things
Needs as input
Makes as output
Must exist firstNone
Loop targetreturn to analyse

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.

StakesCheckPerson involvedCounts as a different method
exploratoryassumption and limitation statementnoneno
decision-informingassumption and limitation statementnoneno
decision-informingalternative explanations checknoneno
decision-informingsource-span citationnoneno
high-stakesassumption and limitation statementnoneno
high-stakesalternative explanations checknoneno
high-stakessource-span citationnoneno
high-stakessecond technique with different assumptionsnoneconditional
high-stakesexpert reviewneededno

Failure modes and limits

Model suitabilityhuman judgement required
Typical model failurePicks the most famous past case, lists likenesses at length and leaves out differences in the mechanism that produced the earlier outcome.
Error sourcesinput data; source selection; coder or rater judgement
Certainty limitsCertainty drops when only one analogy is used, when the case was chosen for vividness (risk of bias), or when the earlier mechanism is not shown to apply now (indirectness).

Evidence and tag basis

Documented. Described in method texts and in studies of misuse (vividness bias; Bundy's use of Dien Bien Phu for Vietnam in 1965 fitted poorly). No study comparing analogy with other techniques on accuracy was found. (Neustadt and May, Thinking in Time (summary); CIA, Analogical Reasoning in Intelligence Analysis; Khong, Analogies at War (Project MUSE record))

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.