HE1-03 CRAAP test (currency, relevance, authority, accuracy, purpose)
Screens one source against five criteria (currency, relevance, authority, accuracy, purpose) and produces a checklist judgement for the evidence base.
What it does
Screens a single source against five criteria. Artefact: a checklist judgement; read authority, accuracy and purpose first for vendor material.
When to use it
Use when you need a quick check on whether a web page, report or vendor document is fit to cite.
When it does not fit
It is used to judge a specific claim, because it examines the page, not the claim's wider support. The URL domain heuristic is weak (note author's judgement).
Result format
The result is a checklist with one row per criterion (currency, relevance, authority, accuracy, purpose), each giving a judgement and the reason for it. It ends with an overall judgement of the single source, with the authority, accuracy and purpose rows stated first when the source is vendor material.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Content type | Always applies | requires=text |
| Unit of analysis | Always applies | requires=source; requires=document |
| Producer interest | Changes the order | prefers=sponsored; prefers=self-interested seller; prefers=unknown |
| Origin | Changes the order | prefers=secondary; prefers=tertiary; prefers=unknown |
| Appraises source credibility | Applies in some cases | yes |
Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Source dependence, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | none |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | The target is a specific claim and not the page, because the test does not examine the claim's wider support. A domain name used as a proxy for authority is weak. |
Choosing and ordering
| Kind of technique | Preparation technique, runs in step 5.2 |
|---|---|
| Phase tag | verify and prepare |
| Other phase tags | none |
| Kind of finding | risk |
| Question answered | what; who |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | proceed with limit stated |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | spot check | optional | no |
| decision-informing | spot check | optional | no |
| decision-informing | repeat runs | none | no |
| decision-informing | prompt variation | none | no |
| high-stakes | spot check | optional | no |
| high-stakes | repeat runs | none | no |
| high-stakes | prompt variation | none | no |
| high-stakes | human review sample | needed | no |
| high-stakes | independent review | needed | no |
Failure modes and limits
| Model suitability | model alone |
|---|---|
| Typical model failure | Infers authority from how professional the page looks, and invents author credentials not shown on the page. |
| Error sources | input data; language model; coder or rater judgement |
| Certainty limits | Certainty drops when the criteria are scored without a rule, when authority cannot be checked outside the page, or when purpose is hidden (risk of bias). |
Related techniques
- pairs with HE1-04 SIFT (stop, investigate the source, find better coverage, trace claims to the original; claim verification and fact-checking): moving off the page tests the authority and purpose judged here
- substitutes for HE-01 Grey literature appraisal checklist (AACODS (Authority, Accuracy, Coverage, Objectivity, Date, Significance)): when document_genre is organisation report and only a short screen is needed
Evidence and tag basis
Documented. A library handout with criteria and questions; its creator is not named on it. (Meriam Library CRAAP test handout)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.