startthat.work home

HE1-09 Rapid review

Runs a systematic review with streamlined steps to meet a deadline and produces a narrative synthesis that states the shortcuts taken.

Handle evidenceEvidence: DocumentedPreparation technique, runs in step 5.2Strongest statement: estimate the effect of an action

What it does

A systematic review with steps streamlined to meet a deadline of about one week to six months. Artefact: a narrative synthesis; read which shortcuts were taken, because they define the risk of missed studies.

When to use it

Use when a review is needed within about a week to six months and the cost of a missed study is moderate.

When it does not fit

A missed study could change the conclusion.

Result format

The result is a narrative synthesis of the included studies that comes with a list of the shortcuts taken in the review. It states for each shortcut the risk of missed studies that it creates.

Requirements on the material

PropertyRequirement typeRequirement
Content typeAlways appliesrequires=text
Unit of analysisAlways appliesrequires=document
Number of sourcesAlways appliesrequires=two or more
Appraises source credibilityApplies in some casesyes

Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Level of detail available, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materialat least two eligible studies; dual screening of at least 20 per cent of abstracts
Additional sources needednone
Not for (rules)stakes_tier=high-stakes :: a missed study could change a high-stakes conclusion
Not for (text)A missed study could change the conclusion even at lower stakes.

Choosing and ordering

Kind of techniquePreparation technique, runs in step 5.2
Phase taggather
Other phase tagsverify and prepare; analyse; conclude
Kind of findingpattern; gap
Question answeredwhat; how much
Strongest statement it supportsestimate the effect of an action
Needs as input
Makes as output
Must exist firstNone
Loop targetreturn to gather

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.

StakesCheckPerson involvedCounts as a different method
exploratoryspot checkoptionalno
decision-informingspot checkoptionalno
decision-informinghuman review sampleneeded; left out below high stakesno
high-stakesspot checkoptionalno
high-stakeshuman review sampleneededno
high-stakesindependent reviewneededno
high-stakessecond technique with different assumptionsnoneconditional

Failure modes and limits

Model suitabilityhuman judgement required
Typical model failurePresents the output as a full systematic review and does not list which steps were cut.
Error sourcesinput data; source selection; coder or rater judgement
Certainty limitsCertainty drops with every shortcut: limited databases, English only, little grey literature (reporting bias) and single screening.

Evidence and tag basis

Documented. Cochrane guidance recommends dual screening of at least 20 per cent of abstracts, English-language searching and limited grey literature; its recommendations are provisional and based mainly on a survey of 20 Cochrane entities. (Cochrane Rapid Reviews Methods Group guidance (2020))

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.