HE-08 Living systematic review
Keeps a systematic review continuously updated as new studies appear and produces a versioned evidence summary and an update log.
What it does
Keeps a review continuously updated as new studies appear. Artefact: a versioned evidence summary and an update log. Read the date of the last search.
When to use it
Use when a topic moves fast and a review would be out of date by the time it is used.
When it does not fit
Fits fast-moving topics where new studies keep arriving. The page read gives no limits.
Result format
The result is a versioned evidence summary with an update log that lists each change as new studies were added. It states the date of the last search.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Content type | Always applies | requires=text |
| Unit of analysis | Always applies | requires=topic; requires=document |
| Number of sources | Always applies | requires=two or more |
| Known data problems | Applies in some cases | requires=out of date |
| Appraises source credibility | Applies in some cases | yes |
Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Level of detail available, Whether sources can be joined, Amount of material, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | none |
|---|---|
| Additional sources needed | earlier period |
| Not for (rules) | none |
| Not for (text) | The topic is stable, so updates add effort without changing the answer. The page read gives no operating limits. |
Choosing and ordering
| Kind of technique | Preparation technique, runs in step 5.2 |
|---|---|
| Phase tag | gather |
| Other phase tags | analyse; conclude |
| Kind of finding | trend; gap |
| Question answered | what; what next |
| Strongest statement it supports | estimate the effect of an action |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to gather |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | spot check | optional | no |
| decision-informing | spot check | optional | no |
| decision-informing | human review sample | needed; left out below high stakes | no |
| high-stakes | spot check | optional | no |
| high-stakes | human review sample | needed | no |
| high-stakes | independent review | needed | no |
| high-stakes | second technique with different assumptions | none | conditional |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | States the date of the last search from memory and does not log which new studies were screened out. |
| Error sources | input data; source selection; coder or rater judgement |
| Certainty limits | Certainty drops when the date of the last search is unclear, and when updates change inclusion rules (reporting bias). |
Related techniques
- should follow HE1-08 Systematic review: an existing systematic review is the baseline to update
Evidence and tag basis
Documented. Definition only; operating demands were not confirmed. (Elliott et al., PLoS Medicine 2014)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.