IS-06 Source dependence and copy detection (source independence analysis)
Estimates whether sources copy from each other so that their agreement is not counted as independent support and produces a dependence estimate for source pairs or groups.
What it does
Estimates whether sources copy from each other, so that their agreement is not counted as independent support. Artefact: a dependence estimate for source pairs or groups. Read which sources should be grouped as one.
When to use it
Use when several sources agree and you need to know whether they are independent or share one upstream origin.
When it does not fit
Fits when copying leaves shared errors. Misfit: a source copies from a good source, so there are no shared mistakes to detect. Co-copying and chains are harder to detect.
Result format
The result is a dependence estimate for each pair or group of sources, stating how likely it is that one copies from the other. It ends with the sources that should be grouped and counted as one.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Structure | Applies in some cases | requires=structured; requires=semi-structured |
| Content type | Always applies | requires=tabular; requires=text |
| Unit of analysis | Always applies | requires=source |
| Level of detail available | Always applies | requires=aggregate tables |
| Number of sources | Always applies | requires=two or more |
| Producer interest | Changes the order | prefers=unknown |
| Source dependence | Changes the order | prefers=copied or derived; prefers=unknown |
| Origin | Changes the order | prefers=secondary; prefers=tertiary; prefers=unknown |
| Appraises source credibility | Applies in some cases | yes |
Not restricted on: Variable types, Time structure, How the sample was chosen, Whether sources can be joined, Amount of material, Known data problems, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | at least three sources with overlapping claims |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | A source copies from a good source, so no shared mistakes exist to detect. Co-copying and chains are harder to detect. |
Choosing and ordering
| Kind of technique | Preparation technique, runs in step 5.2 |
|---|---|
| Phase tag | verify and prepare |
| Other phase tags | none |
| Kind of finding | pattern; risk |
| Question answered | who; what |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | proceed with limit stated |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: deterministic.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | input validation | none | no |
| decision-informing | input validation | none | no |
| decision-informing | spot check | optional | no |
| high-stakes | input validation | none | no |
| high-stakes | spot check | optional | no |
| high-stakes | independent review | needed | no |
| high-stakes | provenance log | none | no |
Failure modes and limits
| Model suitability | model plus code |
|---|---|
| Typical model failure | Concludes sources are independent because the wording differs, without checking shared errors. |
| Error sources | input data; statistical assumptions |
| Certainty limits | Certainty drops when copying leaves no shared errors, and when sources are few (imprecision). |
Related techniques
- pairs with HE1-06 Triangulation (source, method, investigator and theory triangulation; corroboration): dependence results decide whether agreement counts as corroboration
Evidence and tag basis
Documented. In the tutorial example, two sources copy from a third, so treating them as independent would wrongly confirm everything the third provides. (Dong and Naumann, VLDB tutorial; Li et al., A survey on truth discovery, arXiv 1505.02463)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.