HE1-12 Narrative, thematic and qualitative evidence synthesis (including meta-ethnography)
Combines findings across studies in words or themes when pooling numbers is not appropriate, and produces a structured narrative or theme set linked back to studies.
What it does
Combines findings across studies in words or themes when pooling numbers is not appropriate. Artefact: a structured narrative or theme set; read how themes link back to studies.
When to use it
Use when studies are too different to pool and you still need to say what they find together.
When it does not fit
It becomes an unstructured summary.
Result format
The result is a structured narrative or a set of themes, with each theme described in words and linked back to the studies that support it. It states the findings across studies without pooling numbers.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Content type | Always applies | requires=text |
| Unit of analysis | Always applies | requires=document; requires=claim |
| Number of sources | Always applies | requires=two or more |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Level of detail available, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | none |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | The synthesis becomes an unstructured summary with no link from each theme back to the studies. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | conclude |
| Kind of finding | pattern; contradiction |
| Question answered | what; why |
| Strongest statement it supports | show a link between things |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to gather |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | spot check | optional | no |
| decision-informing | spot check | optional | no |
| decision-informing | human review sample | needed; left out below high stakes | no |
| high-stakes | spot check | optional | no |
| high-stakes | human review sample | needed | no |
| high-stakes | independent review | needed | no |
| high-stakes | second technique with different assumptions | none | conditional |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Writes a fluent summary that blends studies together and loses which study supports which theme. |
| Error sources | input data; coder or rater judgement; language model |
| Certainty limits | Certainty drops when themes do not trace to studies, when study quality is unappraised (risk of bias), and when findings conflict (inconsistency). |
Related techniques
- should follow HE1-08 Systematic review: synthesised studies should come from a reproducible search
- substitutes for HE1-11 Meta-analysis: when content_type is text and effect estimates are not comparable
Evidence and tag basis
Documented. Cochrane guidance says to synthesise narratively unless studies are similar; named qualitative techniques (Thomas and Harden 2008; Noblit and Hare) were recalled and not opened. (Cochrane Rapid Reviews Methods Group guidance (2020))
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.