HE1-19 Bibliometric analysis (citation analysis, science mapping, co-citation, co-word analysis)
Counts and maps publications, authors and citations to show the structure and growth of a field and produces performance tables and network maps.
What it does
Counts and maps publications, authors and citations to show the structure and growth of a field. Artefact: performance tables and network maps; read clusters and trends, not single counts.
When to use it
Use when you want to know who publishes on a topic, how it has grown and which clusters of work exist.
When it does not fit
The topic is small, the database covers the field poorly, or citation counts are read as quality.
Result format
The result has performance tables of publications, authors and citations, and network maps of the field. It describes the clusters and trends shown by the maps and does not rest on single counts.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Structure | Applies in some cases | requires=structured; requires=semi-structured |
| Content type | Always applies | requires=tabular; requires=text |
| Unit of analysis | Always applies | requires=document; requires=dataset |
| Level of detail available | Always applies | requires=record-level |
| Amount of material | Applies in some cases | requires=needs automation |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Variable types, Time structure, How the sample was chosen, Number of sources, Whether sources can be joined, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | a bibliographic export from a citation database |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | The topic is small, the database covers the field poorly, or citation counts are read as quality. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | none |
| Kind of finding | pattern; trend |
| Question answered | what; who; how much |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | proceed with limit stated |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: deterministic.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | input validation | none | no |
| decision-informing | input validation | none | no |
| decision-informing | spot check | optional | no |
| high-stakes | input validation | none | no |
| high-stakes | spot check | optional | no |
| high-stakes | independent review | needed | no |
| high-stakes | provenance log | none | no |
Failure modes and limits
| Model suitability | model plus code |
|---|---|
| Typical model failure | Miscounts records, merges authors who share a name, and reads citation counts as a measure of quality. |
| Error sources | input data; data transformation; source selection |
| Certainty limits | Certainty drops with poor database coverage of the field (indirectness), name ambiguity, duplicated records and citation lags (risk of bias). |
Related techniques
- should follow PE-03 Near-duplicate detection (shingling; MinHash; locality-sensitive hashing; text reuse detection): duplicate publication records inflate counts
- pairs with DM-21 Social network analysis (sociogram, network analysis) Also serves: Assess actors, options and risks.: network structure of authors or citations can be examined with social network analysis
Evidence and tag basis
Unconfirmed. A guidelines paper was found in search results and not opened.
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.