HE1-06 Triangulation (source, method, investigator and theory triangulation; corroboration)
Compares independent lines of evidence on one question and produces a convergence table of agreement, disagreement and reasons.
What it does
Compares independent lines of evidence on one question. Artefact: a convergence table; read agreement, disagreement and the reasons.
When to use it
Use when two or more independent sources or methods address the same question and you need to know whether they agree.
When it does not fit
The sources copy each other, which looks like corroboration but is one source.
Result format
The result is a convergence table with one row per line of evidence and columns for what each line shows on the question. It states where the lines agree, where they disagree, and the reason given for each disagreement.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Content type | Always applies | requires=text |
| Unit of analysis | Always applies | requires=claim; requires=topic |
| Number of sources | Always applies | requires=two or more |
| Producer interest | Changes the order | prefers=independent |
| Source dependence | Changes the order | requires=independent |
| Origin | Changes the order | prefers=primary; prefers=secondary |
| Appraises source credibility | Applies in some cases | yes |
Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Level of detail available, Whether sources can be joined, Amount of material, Known data problems, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | none |
|---|---|
| Additional sources needed | none |
| Not for (rules) | source_dependence=copied or derived :: sources that copy each other count as one source |
| Not for (text) | The sources share an origin, so agreement looks like corroboration but is one source repeated. |
Choosing and ordering
| Kind of technique | Preparation technique, runs in step 5.2 |
|---|---|
| Phase tag | verify and prepare |
| Other phase tags | none |
| Kind of finding | contradiction; pattern |
| Question answered | what; why |
| Strongest statement it supports | show a link between things |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to gather |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | spot check | optional | no |
| decision-informing | spot check | optional | no |
| decision-informing | human review sample | needed; left out below high stakes | no |
| high-stakes | spot check | optional | no |
| high-stakes | human review sample | needed | no |
| high-stakes | independent review | needed | no |
| high-stakes | second technique with different assumptions | none | conditional |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Counts agreement between sources that cite each other as independent corroboration. |
| Error sources | input data; source selection; coder or rater judgement |
| Certainty limits | Certainty drops when sources share an upstream origin or method, or when disagreement is explained away without evidence (inconsistency and risk of bias). |
Related techniques
- should follow HE1-01 Admiralty system (source reliability and information credibility grading): grade each source before comparing lines of evidence
- should follow IS-06 Source dependence and copy detection (source independence analysis): test source dependence before counting agreement
Evidence and tag basis
Unconfirmed. The general technique (Denzin 1970) was recalled and not opened. The independence requirement appears in the Admiralty definition of the best credibility grade. (Wikipedia, Admiralty code)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.