startthat.work home

FQ-05 Multiple mental models (applying explicit models from several fields to one topic)

Reads one topic through several explicit models from different fields and produces one reading per model.

Frame the questionEvidence: PracticeQuestion technique, runs in step 5.1Strongest statement: describe

What it does

Reads the same topic through several explicit models. Artefact: one reading per model; divergences mark areas of uncertainty.

When to use it

Use when you suspect that a single view of the topic hides alternative explanations and want to see where models disagree.

When it does not fit

A model is applied outside its domain, or models are chosen after the answer is known.

Result format

The result has one reading of the topic for each explicit model applied, with the model named at the head of each reading. It ends with a list of the points where the readings diverge, marked as areas of uncertainty.

Requirements on the material

PropertyRequirement typeRequirement
Unit of analysisAlways appliesrequires=topic
Appraises source credibilityApplies in some casesno

Not restricted on: Structure, Content type, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materialAt least three models whose assumptions are stated.
Additional sources neededreference structure
Not for (rules)none
Not for (text)A model is applied outside its domain, or models are chosen after the answer is known.

Choosing and ordering

Kind of techniqueQuestion technique, runs in step 5.1
Phase tagframe
Other phase tagsanalyse
Kind of findingdifference; contradiction
Question answeredwhat; why
Strongest statement it supportsdescribe
Needs as input
Makes as output
Must exist firstNone
Loop targetreturn to frame

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.

StakesCheckPerson involvedCounts as a different method
exploratoryspot checkoptionalno
decision-informingspot checkoptionalno
decision-informingassumption and limitation statementnoneno
high-stakesspot checkoptionalno
high-stakesassumption and limitation statementnoneno
high-stakesindependent reviewneededno
high-stakessecond technique with different assumptionsnoneconditional

Failure modes and limits

Model suitabilityhuman judgement required
Typical model failureApplies a model by name only, repeating one common reading under several labels.
Error sourcesinput data; coder or rater judgement; language model
Certainty limitsIndirectness when a model is used outside its domain; divergence between models lowers certainty by inconsistency, and model choice is a source of bias.

Evidence and tag basis

Practice. Craik (1943) and Johnson-Laird (1983) are documented as psychological theory; the multidisciplinary use for decisions is practice with no effectiveness evidence found. (Wikipedia, Mental model)

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.