CM-01 Sponsor versus non-sponsor comparison (meta-epidemiological sponsorship analysis)
Compares the share of favourable results and conclusions between sponsored and independently funded reports on one topic, producing a risk ratio or odds ratio.
What it does
Compares the share of favourable results and conclusions between sponsored and independently funded reports on one topic. Artefact: a risk ratio or odds ratio. In health research the risk ratios were 1.27 for favourable efficacy results and 1.34 for favourable conclusions.
When to use it
Use when a user asks whether industry or sponsor funding is linked to more favourable findings in the reports on a topic.
When it does not fit
Needs enough independent reports on one question. The health studies are observational, so the result is an association. The harms result was not significant. No study of surveys or consultancy reports was found, so applying the result to them is an inference.
Result format
The result gives the number of sponsored and independently funded reports on the topic and the share of favourable results and favourable conclusions in each group. It reports a risk ratio or odds ratio for each of results and conclusions, and ends with a statement of what the ratio shows about sponsorship.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Content type | Always applies | requires=text; requires=tabular |
| Unit of analysis | Always applies | requires=source; requires=document |
| Number of sources | Always applies | requires=two or more |
| Producer interest | Changes the order | requires=independent; requires=sponsored; requires=self-interested seller |
| Source dependence | Changes the order | prefers=independent |
| Appraises source credibility | Applies in some cases | yes |
Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Level of detail available, Whether sources can be joined, Amount of material, Known data problems, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | Enough independent and sponsored reports on one question to form a ratio, with a funder recorded for each report. |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | Needs enough independent reports on one question. Health studies are observational, so the result is an association. No study of surveys or consultancy reports was found, so applying the health result to them is an inference. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | validate |
| Kind of finding | difference; risk |
| Question answered | how much; what |
| Strongest statement it supports | show a link between things |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to gather |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | spot check | optional | no |
| decision-informing | spot check | optional | no |
| decision-informing | human review sample | needed; left out below high stakes | no |
| decision-informing | code execution for arithmetic | none | no |
| high-stakes | spot check | optional | no |
| high-stakes | human review sample | needed | no |
| high-stakes | code execution for arithmetic | none | no |
| high-stakes | sensitivity analysis | none | no |
| high-stakes | independent review | needed | no |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Assigns a sponsor from the logo alone and treats independence as proof of quality. |
| Error sources | input data; source selection; coder or rater judgement |
| Certainty limits | Certainty drops because the evidence is observational (risk of bias), when few reports fall in one group (imprecision), and when the result is carried from health studies to other fields (indirectness). |
Related techniques
- pairs with HE1-02 Quality of information check: a per-source quality rating covers accuracy, which a funding comparison does not
- should follow HE1-08 Systematic review: a systematic search supplies a defensible set of reports to compare
Evidence and tag basis
Documented. A Cochrane review of 75 papers found the pattern was not explained by standard risk of bias items. An older review of 30 studies gave an odds ratio of 4.05. (Lundh et al. 2017, Cochrane abstract; Cochrane summary page, industry sponsorship and research outcome; Pharmaceutical industry sponsorship and research outcome and quality)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.