FQ-05 Multiple mental models (applying explicit models from several fields to one topic)
Reads one topic through several explicit models from different fields and produces one reading per model.
What it does
Reads the same topic through several explicit models. Artefact: one reading per model; divergences mark areas of uncertainty.
When to use it
Use when you suspect that a single view of the topic hides alternative explanations and want to see where models disagree.
When it does not fit
A model is applied outside its domain, or models are chosen after the answer is known.
Result format
The result has one reading of the topic for each explicit model applied, with the model named at the head of each reading. It ends with a list of the points where the readings diverge, marked as areas of uncertainty.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Unit of analysis | Always applies | requires=topic |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Content type, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | At least three models whose assumptions are stated. |
|---|---|
| Additional sources needed | reference structure |
| Not for (rules) | none |
| Not for (text) | A model is applied outside its domain, or models are chosen after the answer is known. |
Choosing and ordering
| Kind of technique | Question technique, runs in step 5.1 |
|---|---|
| Phase tag | frame |
| Other phase tags | analyse |
| Kind of finding | difference; contradiction |
| Question answered | what; why |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to frame |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | spot check | optional | no |
| decision-informing | spot check | optional | no |
| decision-informing | assumption and limitation statement | none | no |
| high-stakes | spot check | optional | no |
| high-stakes | assumption and limitation statement | none | no |
| high-stakes | independent review | needed | no |
| high-stakes | second technique with different assumptions | none | conditional |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Applies a model by name only, repeating one common reading under several labels. |
| Error sources | input data; coder or rater judgement; language model |
| Certainty limits | Indirectness when a model is used outside its domain; divergence between models lowers certainty by inconsistency, and model choice is a source of bias. |
Related techniques
- pairs with FQ-04 Reframing and issue redefinition (changing the level of analysis or baseline; five-step issue redefinition): Reframing tests wording and level while multiple models test the assumptions behind the reading
- pairs with DM-16 Levels-of-analysis models (Marr's three levels, micro, meso and macro levels): Levels of analysis give one set of models that differ by level
Evidence and tag basis
Practice. Craik (1943) and Johnson-Laird (1983) are documented as psychological theory; the multidisciplinary use for decisions is practice with no effectiveness evidence found. (Wikipedia, Mental model)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.