AO-15 Risk matrix (likelihood and consequence matrix, risk heat map)
Rates each risk by plotting likelihood against consequence, producing a grid of ratings that shows which risks need treatment first.
What it does
Rates each risk by plotting likelihood against consequence. Artefact: a grid of ratings; read which risks need treatment first.
When to use it
Use when a user must decide which of a few risks to treat first, such as the risks attached to candidate initiatives, and has judged likelihood and consequence but has no data to quantify them.
When it does not fit
Many risks need to be ranked precisely. Cox (2008), cited on the page, found typical matrices reliably compare under 10 per cent of random hazard pairs.
Result format
The result is a grid with likelihood on one axis and consequence on the other, with each risk placed in a cell and given a rating. It names the risks that need treatment first.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Unit of analysis | Always applies | requires=topic |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Content type, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | Likelihood and consequence scales and a judgement for each risk. |
|---|---|
| Additional sources needed | reference structure |
| Not for (rules) | none |
| Not for (text) | Wrong choice when many risks must be ranked precisely. Typical matrices reliably compare under 10 per cent of random hazard pairs, and quantitative methods are recommended instead. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | report |
| Kind of finding | risk |
| Question answered | what |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to analyse |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | assumption and limitation statement | none | no |
| decision-informing | assumption and limitation statement | none | no |
| decision-informing | source-span citation | none | no |
| decision-informing | human review sample | needed; left out below high stakes | no |
| high-stakes | assumption and limitation statement | none | no |
| high-stakes | source-span citation | none | no |
| high-stakes | human review sample | needed | no |
| high-stakes | second technique with different assumptions | none | conditional |
| high-stakes | expert review | needed | no |
| high-stakes | independent review | needed | no |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Assigns each risk a precise-looking cell from vague scales, and orders many risks by cell position although matrices rank few pairs reliably. |
| Error sources | input data; coder or rater judgement; expert opinion |
| Certainty limits | Certainty drops through range compression and arbitrary rankings that depend on how the matrix is designed (imprecision), and when ratings come from one rater (risk of bias). |
Related techniques
- pairs with AO-17 Bow-tie analysis: barriers and pathways add detail that a single cell cannot show
- should follow CH-08 Premortem (prospective hindsight, inversion) Also serves: Project forward.: a premortem generates the list of failure reasons to rate
Evidence and tag basis
Documented. Criticised for range compression and arbitrary rankings that depend on matrix design; quantitative methods are recommended instead. Findings read through a secondary page. (Wikipedia, Risk matrix)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.