HE1-14 Framework analysis (Framework Method)
Sorts coded qualitative data into a case by theme matrix and produces the matrix for reading across cases and themes.
What it does
Sorts coded data into a case by theme matrix. Artefact: a matrix; read across rows for cases, down columns for themes, and look for empty cells.
When to use it
Use when you have many cases such as interviews and need to compare themes across them with a visible audit trail.
When it does not fit
The data are heterogeneous, or the spreadsheet look tempts counting of responses. Documents may call for discourse or narrative analysis instead.
Result format
The result is a matrix with one row per case and one column per theme, each cell holding a short summary of the coded data for that case and theme. It notes the empty cells and states what reading across the rows and down the columns shows.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Content type | Always applies | requires=text |
| Unit of analysis | Always applies | requires=document; requires=record |
| Amount of material | Applies in some cases | requires=readable by a person |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | similar topics across cases; an experienced qualitative lead |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | The data are heterogeneous, or the spreadsheet layout tempts counting of responses. Documents may call for discourse or narrative analysis instead. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | none |
| Kind of finding | pattern; difference; gap |
| Question answered | what; why |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | proceed with limit stated |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | spot check | optional | no |
| decision-informing | spot check | optional | no |
| decision-informing | human review sample | needed; left out below high stakes | no |
| high-stakes | spot check | optional | no |
| high-stakes | human review sample | needed | no |
| high-stakes | independent review | needed | no |
| high-stakes | second technique with different assumptions | none | conditional |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Fills matrix cells with summaries that drift from the data, and reports counts of cells as response frequencies. |
| Error sources | input data; coder or rater judgement |
| Certainty limits | Certainty drops with heterogeneous cases, a single coder, and summaries that no longer trace to the data. |
Related techniques
- substitutes for HE1-13 Reflexive thematic analysis (Braun and Clarke): when volume_class is readable by a person and comparison across cases is the aim
Evidence and tag basis
Documented. Seven stages are documented; it is time consuming and needs an experienced qualitative lead. (Gale et al. (2013), the Framework Method, BMC Medical Research Methodology)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.