startthat.work home

DM-16 Levels-of-analysis models (Marr's three levels, micro, meso and macro levels)

Examines a topic at several distinct levels, each answering a different kind of question, and produces findings organised by level.

Decompose and mapEvidence: DocumentedQuestion technique, runs in step 5.1Strongest statement: describe

What it does

Examines the topic at several distinct levels, each answering a different kind of question. Artefact: findings organised by level; read levels with no findings and contradictions between levels.

When to use it

Use when a question can be answered at more than one level, such as individual, organisation and system, and you need to know which levels have findings.

When it does not fit

Levels interact so strongly that findings cannot be assigned to one, or an important effect lies between levels.

Result format

The result has findings organised under each level examined (such as micro, meso and macro, or the three levels of Marr), with the kind of question each level answers stated. It names the levels with no findings and lists the contradictions between levels.

Requirements on the material

PropertyRequirement typeRequirement
Unit of analysisAlways appliesrequires=topic
Appraises source credibilityApplies in some casesno

Not restricted on: Structure, Content type, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materialThe topic and a chosen set of levels.
Additional sources needednone
Not for (rules)none
Not for (text)Levels interact so strongly that findings cannot be assigned to one, or an important effect lies between levels.

Choosing and ordering

Kind of techniqueQuestion technique, runs in step 5.1
Phase tagframe
Other phase tagsanalyse
Kind of findinggap; contradiction
Question answeredwhat; why
Strongest statement it supportsdescribe
Needs as input
Makes as output
Must exist firstNone
Loop targetreturn to analyse

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.

StakesCheckPerson involvedCounts as a different method
exploratoryspot checkoptionalno
decision-informingspot checkoptionalno
decision-informingassumption and limitation statementnoneno
high-stakesspot checkoptionalno
high-stakesassumption and limitation statementnoneno
high-stakesexpert reviewneededno
high-stakesindependent reviewneededno

Failure modes and limits

Model suitabilityhuman judgement required
Typical model failureAssigns findings to a level by keyword, leaving the empty levels unreported.
Error sourcesinput data; coder or rater judgement; language model
Certainty limitsLevels are not necessarily exclusive and the framework is rarely applied in scholarly articles in some fields; cross-level contradictions lower certainty by inconsistency.

Evidence and tag basis

Documented. Levels are not necessarily exclusive, and the framework is widely discussed but rarely applied in scholarly articles in international relations. Marr (1982) was not opened. (Wikipedia, Marr's levels of analysis)

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.