PE-11 Knowledge graph construction from text (entity-relation graph; ontology population)
Convert resolved entities and extracted relations into a graph of typed nodes and edges, each linked to its source sentence, giving a graph with provenance as a draft result.
What it does
Converts extracted entities and relations into a graph of typed nodes and edges, each linked to its source sentence. Artefact: a graph with provenance. Read paths between entities and areas with few or contradictory edges.
When to use it
Use when you need to trace paths between people, organisations or concepts reported across many documents.
When it does not fit
Needs a fixed ontology and kept provenance. Extraction errors compound, and duplicates of one entity stay as separate nodes. No human-agreement figures for graph quality from text were found.
Result format
The result is a graph of typed nodes and edges, with each edge linked to the source sentence it came from. It names the paths between entities and the areas with few or contradictory edges.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Structure | Applies in some cases | requires=unstructured; requires=semi-structured |
| Content type | Always applies | requires=text |
| Unit of analysis | Always applies | requires=document |
| Appraises source credibility | Applies in some cases | no |
| Personal information | Always applies | requires=no personal information; requires=personal information |
Not restricted on: Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Security classification, Licence.
| Minimum material | A fixed ontology and a source sentence kept for every node and edge. |
|---|---|
| Additional sources needed | reference structure |
| Not for (rules) | none |
| Not for (text) | No ontology is fixed and provenance is not kept, so extraction errors cannot be traced to the sentence. |
Choosing and ordering
| Kind of technique | Preparation technique, runs in step 5.2 |
|---|---|
| Phase tag | verify and prepare |
| Other phase tags | analyse |
| Kind of finding | pattern; gap |
| Question answered | who; what |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to verify and prepare |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: repeatable with fixed settings.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | spot check | optional | no |
| decision-informing | spot check | optional | no |
| decision-informing | human review sample | needed; left out below high stakes | no |
| decision-informing | source-span citation | none | no |
| high-stakes | spot check | optional | no |
| high-stakes | human review sample | needed | no |
| high-stakes | source-span citation | none | no |
| high-stakes | gold standard agreement | conditional | no |
| high-stakes | independent review | needed | no |
| high-stakes | provenance log | none | no |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Keeps duplicate nodes for one entity and drops the link from an edge to its source sentence. |
| Error sources | input data; data transformation; language model |
| Certainty limits | Certainty drops because extraction errors compound across steps (risk of bias), duplicate nodes remain (inconsistency), and no agreement figures exist for graph quality from text (indirectness). |
Related techniques
- should follow PE-09 Relation and event extraction (information extraction; open information extraction; temporal expression extraction): relation and event extraction supplies the edges
- should follow IS-01 Entity resolution and linking (record linkage; entity matching; entity linking; coreference resolution; blocking): entity resolution stops one entity becoming several nodes
- pairs with DM-21 Social network analysis (sociogram, network analysis) Also serves: Assess actors, options and risks.: social network analysis measures the structure of the graph
Evidence and tag basis
Documented. The survey abstract covers creation, enrichment, quality assessment, refinement and publication, and does not mention extraction from text. (Hogan et al., Knowledge graphs, arXiv 2003.02320)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.