startthat.work home

HE1-19 Bibliometric analysis (citation analysis, science mapping, co-citation, co-word analysis)

Counts and maps publications, authors and citations to show the structure and growth of a field and produces performance tables and network maps.

Handle evidenceEvidence: UnconfirmedPrimary technique, runs in step 5.3Strongest statement: describe

What it does

Counts and maps publications, authors and citations to show the structure and growth of a field. Artefact: performance tables and network maps; read clusters and trends, not single counts.

When to use it

Use when you want to know who publishes on a topic, how it has grown and which clusters of work exist.

When it does not fit

The topic is small, the database covers the field poorly, or citation counts are read as quality.

Result format

The result has performance tables of publications, authors and citations, and network maps of the field. It describes the clusters and trends shown by the maps and does not rest on single counts.

Requirements on the material

PropertyRequirement typeRequirement
StructureApplies in some casesrequires=structured; requires=semi-structured
Content typeAlways appliesrequires=tabular; requires=text
Unit of analysisAlways appliesrequires=document; requires=dataset
Level of detail availableAlways appliesrequires=record-level
Amount of materialApplies in some casesrequires=needs automation
Appraises source credibilityApplies in some casesno

Not restricted on: Variable types, Time structure, How the sample was chosen, Number of sources, Whether sources can be joined, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materiala bibliographic export from a citation database
Additional sources needednone
Not for (rules)none
Not for (text)The topic is small, the database covers the field poorly, or citation counts are read as quality.

Choosing and ordering

Kind of techniquePrimary technique, runs in step 5.3
Phase taganalyse
Other phase tagsnone
Kind of findingpattern; trend
Question answeredwhat; who; how much
Strongest statement it supportsdescribe
Needs as input
Makes as output
Must exist firstNone
Loop targetproceed with limit stated

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: deterministic.

StakesCheckPerson involvedCounts as a different method
exploratoryinput validationnoneno
decision-informinginput validationnoneno
decision-informingspot checkoptionalno
high-stakesinput validationnoneno
high-stakesspot checkoptionalno
high-stakesindependent reviewneededno
high-stakesprovenance lognoneno

Failure modes and limits

Model suitabilitymodel plus code
Typical model failureMiscounts records, merges authors who share a name, and reads citation counts as a measure of quality.
Error sourcesinput data; data transformation; source selection
Certainty limitsCertainty drops with poor database coverage of the field (indirectness), name ambiguity, duplicated records and citation lags (risk of bias).

Evidence and tag basis

Unconfirmed. A guidelines paper was found in search results and not opened.

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.