IS-04 Data fusion with conflict resolution (majority voting; deciding and mediating resolution functions)
Combines records on the same entity into one record, resolving conflicting values by a rule, and produces a fused record per entity with uncertain and contradictory values marked.
What it does
Combines records on the same entity into one record and resolves conflicting values by a rule: choose an existing value (deciding) or compute a new one (mediating). Majority voting is the simplest rule. Artefact: a fused record per entity. Read which values were uncertain (a value against a null) or contradictory (different non-null values).
When to use it
Use when sources give different values for the same entity and you need one value with the conflicts shown.
When it does not fit
Fits when entities are reliably identified. Misfit: mis-linked records or dependent sources. Voting suits only independent sources of similar accuracy. Text sources need claims extracted first, which adds uncertainty.
Result format
The result is one fused record per entity, with the rule used for each field named as deciding or mediating. It marks each value as agreed, uncertain (a value against a null) or contradictory (different non-null values).
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Structure | Applies in some cases | requires=structured; requires=semi-structured |
| Content type | Always applies | requires=tabular; requires=text |
| Unit of analysis | Always applies | requires=record |
| Level of detail available | Always applies | requires=record-level |
| Number of sources | Always applies | requires=two or more |
| Whether sources can be joined | Always applies | requires=shared identifier available |
| Known data problems | Applies in some cases | requires=inconsistent |
| Source dependence | Changes the order | prefers=independent |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Variable types, Time structure, How the sample was chosen, Amount of material, Producer interest, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | none |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | Records may be mis-linked or sources depend on each other. Majority voting suits only independent sources of similar accuracy, and text sources need claims extracted first. |
Choosing and ordering
| Kind of technique | Preparation technique, runs in step 5.2 |
|---|---|
| Phase tag | verify and prepare |
| Other phase tags | none |
| Kind of finding | contradiction; gap |
| Question answered | what |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | proceed with limit stated |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: deterministic.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | input validation | none | no |
| decision-informing | input validation | none | no |
| decision-informing | spot check | optional | no |
| high-stakes | input validation | none | no |
| high-stakes | spot check | optional | no |
| high-stakes | independent review | needed | no |
| high-stakes | provenance log | none | no |
Failure modes and limits
| Model suitability | model plus code |
|---|---|
| Typical model failure | Takes the most common value when sources copy each other, or the most recent value without checking it. |
| Error sources | input data; data transformation; statistical assumptions |
| Certainty limits | Certainty drops with mis-linked entities, dependent sources and values that change over time (inconsistency and risk of bias). |
Related techniques
- should follow IS-01 Entity resolution and linking (record linkage; entity matching; entity linking; coreference resolution; blocking): entities must be resolved before values are fused
- pairs with IS-06 Source dependence and copy detection (source independence analysis): copy detection stops voting from counting copies
- substitutes for IS-05 Truth discovery with source reliability weighting (truth finding; source reliability estimation): when source_dependence is independent and sources have similar accuracy
Evidence and tag basis
Documented. Truth changes over time, so the most common value can be out of date and the most recent can be wrong. Neither equal treatment of sources nor unchecked trust in accurate ones works. The strategy classification comes from a tutorial that draws on earlier work not opened. (Dong and Naumann, VLDB tutorial; Dong and Naumann, fusion strategies; Li et al., A survey on truth discovery, arXiv 1505.02463)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.