startthat.work home

DM-06 Affinity diagram (KJ method)

Groups many recorded items, such as survey comments or interview quotes, into clusters that form from the relationships among the items, and produces labelled clusters.

Decompose and mapEvidence: DocumentedPrimary technique, runs in step 5.3Strongest statement: describe

What it does

Groups many recorded items, such as survey comments or interview quotes, into clusters that form from relationships among the items. Artefact: labelled clusters; read cluster size, number of clusters and orphan items.

When to use it

Use when you have many comments or quotes and want themes to emerge from the items without fixed categories.

When it does not fit

One catch-all cluster dominates, or items move between clusters when a second person sorts them.

Result format

The result is a set of labelled clusters, each holding the recorded items (such as survey comments or interview quotes) that belong together. It gives the number of clusters, the size of each cluster, and the orphan items that joined no cluster.

Requirements on the material

PropertyRequirement typeRequirement
Content typeAlways appliesrequires=text
Unit of analysisAlways appliesrequires=document; requires=claim
Appraises source credibilityApplies in some casesno

Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materialAt least 20 items recorded individually.
Additional sources needednone
Not for (rules)none
Not for (text)One catch-all cluster dominates, or items move between clusters when a second person sorts them.

Choosing and ordering

Kind of techniquePrimary technique, runs in step 5.3
Phase taganalyse
Other phase tagsverify and prepare
Kind of findingpattern; gap
Question answeredwhat
Strongest statement it supportsdescribe
Needs as input
Makes as output
Must exist firstNone
Loop targetreturn to analyse

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.

StakesCheckPerson involvedCounts as a different method
exploratoryspot checkoptionalno
decision-informingspot checkoptionalno
decision-informinghuman review sampleneeded; left out below high stakesno
decision-informingprompt variationnoneno
high-stakesspot checkoptionalno
high-stakeshuman review sampleneededno
high-stakesprompt variationnoneno
high-stakesindependent reviewneededno
high-stakessecond technique with different assumptionsnoneconditional

Failure modes and limits

Model suitabilitymodel alone
Typical model failureForces items into clusters named after the first items seen and leaves orphan items unreported.
Error sourcesinput data; coder or rater judgement; language model
Certainty limitsNo inter-rater reliability evidence; cluster membership is not set in advance, so reliability depends on a second sort. Risk of bias from the sorter.

Evidence and tag basis

Documented. Group membership is not set in advance; no inter-rater reliability evidence found. (Wikipedia, Affinity diagram)

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.