IS-03 Common data model harmonisation (OMOP (Observational Medical Outcomes Partnership) common data model; data harmonisation)
Transforms source datasets into one shared structure and vocabulary so that the same analysis runs on each and produces a standardised dataset with a coverage report.
What it does
Transforms source datasets into one shared structure and vocabulary so that the same analysis runs on each. Artefact: a standardised database. Read concept coverage, unmapped records (concept identifier 0) and capture differences between sources.
When to use it
Use when you must run one analysis across several datasets that record the same domain in different formats.
When it does not fit
Fits when a domain standard exists. Misfit: many source values have no standard concept, or sources capture events differently. Only the OMOP instance was read; questionnaire harmonisation was not.
Result format
The result is a standardised database in one shared structure and vocabulary, with a report of concept coverage, the unmapped records (concept identifier 0) and the capture differences between sources.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Structure | Applies in some cases | requires=structured; requires=semi-structured |
| Content type | Always applies | requires=tabular |
| Unit of analysis | Always applies | requires=record; requires=dataset |
| Level of detail available | Always applies | requires=record-level |
| Number of sources | Always applies | requires=two or more |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Variable types, Time structure, How the sample was chosen, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | none |
|---|---|
| Additional sources needed | reference structure |
| Not for (rules) | none |
| Not for (text) | Many source values have no standard concept, or sources capture events differently. Only the OMOP instance was read; questionnaire harmonisation was not. |
Choosing and ordering
| Kind of technique | Preparation technique, runs in step 5.2 |
|---|---|
| Phase tag | verify and prepare |
| Other phase tags | none |
| Kind of finding | gap; difference |
| Question answered | what |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | proceed with limit stated |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: deterministic.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | input validation | none | no |
| decision-informing | input validation | none | no |
| decision-informing | spot check | optional | no |
| high-stakes | input validation | none | no |
| high-stakes | spot check | optional | no |
| high-stakes | independent review | needed | no |
| high-stakes | provenance log | none | no |
Failure modes and limits
| Model suitability | model plus code |
|---|---|
| Typical model failure | Maps source values to the wrong standard concept and does not report unmapped records. |
| Error sources | input data; data transformation |
| Certainty limits | Certainty drops with a high share of unmapped values and differences in what each source records (indirectness and inconsistency). |
Related techniques
- should follow IS-02 Schema matching and ontology matching (schema mapping; field mapping): the field mapping defines the transformation
Evidence and tag basis
Documented. No observational database captures all events equally well, and source values are not harmonised across sources. (Book of OHDSI, Common Data Model)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.