PJ-05 Prediction markets (information markets)
Read the price of a defined contract as a probability for an event, giving a price series and a liquidity-qualified probability as a draft result.
What it does
Aggregates traders' beliefs into a price read as a probability for a defined event. Artefact: a price series; read the price as a probability only where the market is liquid.
When to use it
Use when a liquid public market already prices the event you care about and you want an aggregated probability.
When it does not fit
Trading in the market is limited, contract wording differs from the question, the horizon is long, or participants can manipulate the price.
Result format
The result is a price series for the defined event, with the price read as a probability. It says whether the market is liquid enough for that reading to hold.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Structure | Applies in some cases | requires=structured |
| Content type | Always applies | requires=time series |
| Unit of analysis | Always applies | requires=topic |
| Variable types | Raises a warning | prefers=counts or fractions |
| Time structure | Applies in some cases | requires=aggregate time series; requires=continuous stream |
| Level of detail available | Always applies | requires=aggregate tables |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: How the sample was chosen, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | A precisely defined contract and enough traders and trading volume for the price to be liquid. |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | Trading is limited, contract wording differs from the question, the horizon is long, or participants can manipulate the price. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | none |
| Kind of finding | risk; trend |
| Question answered | what next |
| Strongest statement it supports | predict, without claiming a cause |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to analyse |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | input validation | none | no |
| decision-informing | input validation | none | no |
| decision-informing | spot check | optional | no |
| decision-informing | sensitivity analysis | none | no |
| high-stakes | input validation | none | no |
| high-stakes | spot check | optional | no |
| high-stakes | sensitivity analysis | none | no |
| high-stakes | second technique with different assumptions | none | conditional |
| high-stakes | assumption and limitation statement | none | no |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Reads a thin or differently worded market price as a probability for the question. |
| Error sources | input data; expert opinion |
| Certainty limits | Certainty drops when trading volume is low (imprecision), when contract wording differs from the question (indirectness), or when the price may be manipulated (risk of bias). |
Related techniques
- pairs with PJ-03 Forecasting tournaments and superforecasting practice: dated, scored forecasts from a team give a second probability with a different mechanism
- pairs with CM1-13 Forecaster and source comparison (forecast scoring, aggregation, track record comparison) Also serves: Project forward.: scoring market prices against resolved outcomes shows whether they were calibrated
Evidence and tag basis
Tested. Market forecasts are fairly accurate across settings and generally beat moderately sophisticated benchmarks. (Wolfers and Zitzewitz (2004), Prediction Markets, Journal of Economic Perspectives; AI Impacts, summary of Good Judgment Project research)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.