DM-16 Levels-of-analysis models (Marr's three levels, micro, meso and macro levels)
Examines a topic at several distinct levels, each answering a different kind of question, and produces findings organised by level.
What it does
Examines the topic at several distinct levels, each answering a different kind of question. Artefact: findings organised by level; read levels with no findings and contradictions between levels.
When to use it
Use when a question can be answered at more than one level, such as individual, organisation and system, and you need to know which levels have findings.
When it does not fit
Levels interact so strongly that findings cannot be assigned to one, or an important effect lies between levels.
Result format
The result has findings organised under each level examined (such as micro, meso and macro, or the three levels of Marr), with the kind of question each level answers stated. It names the levels with no findings and lists the contradictions between levels.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Unit of analysis | Always applies | requires=topic |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Content type, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | The topic and a chosen set of levels. |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | Levels interact so strongly that findings cannot be assigned to one, or an important effect lies between levels. |
Choosing and ordering
| Kind of technique | Question technique, runs in step 5.1 |
|---|---|
| Phase tag | frame |
| Other phase tags | analyse |
| Kind of finding | gap; contradiction |
| Question answered | what; why |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to analyse |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | spot check | optional | no |
| decision-informing | spot check | optional | no |
| decision-informing | assumption and limitation statement | none | no |
| high-stakes | spot check | optional | no |
| high-stakes | assumption and limitation statement | none | no |
| high-stakes | expert review | needed | no |
| high-stakes | independent review | needed | no |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Assigns findings to a level by keyword, leaving the empty levels unreported. |
| Error sources | input data; coder or rater judgement; language model |
| Certainty limits | Levels are not necessarily exclusive and the framework is rarely applied in scholarly articles in some fields; cross-level contradictions lower certainty by inconsistency. |
Related techniques
- pairs with FQ-04 Reframing and issue redefinition (changing the level of analysis or baseline; five-step issue redefinition): Reframing also changes the level of analysis
- pairs with FQ-05 Multiple mental models (applying explicit models from several fields to one topic): Multiple models can be chosen to match the levels
Evidence and tag basis
Documented. Levels are not necessarily exclusive, and the framework is widely discussed but rarely applied in scholarly articles in international relations. Marr (1982) was not opened. (Wikipedia, Marr's levels of analysis)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.