AO-11 Cost-effectiveness and cost-utility analysis
Compares options on cost per unit of one quantified effect when benefits cannot be monetised, producing cost per unit of effect for each option.
What it does
Compares options on cost per unit of one quantified effect when benefits cannot be monetised. Artefact: cost per unit of effect.
When to use it
Use when a user asks which option delivers a given outcome at the lowest cost and the benefit is not easily valued in money.
When it does not fit
Several outcomes matter and the single measure ignores them.
Result format
The result is a table with one row per option, giving its cost, the quantified effect it produces and the cost per unit of that effect. It names the single effect measure used for the comparison.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Content type | Always applies | requires=tabular |
| Unit of analysis | Always applies | requires=topic |
| Variable types | Raises a warning | prefers=ratio; prefers=counts or fractions |
| Level of detail available | Always applies | requires=aggregate tables |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Time structure, How the sample was chosen, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | Costs for each option and a single outcome measure for each option, at least two options. |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | Wrong choice when several outcomes matter and the single measure ignores them. The measure must capture most of the benefits. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | conclude |
| Kind of finding | option ranking |
| Question answered | which option; how much |
| Strongest statement it supports | predict, without claiming a cause |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to analyse |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: deterministic.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | input validation | none | no |
| exploratory | code execution for arithmetic | none | no |
| decision-informing | input validation | none | no |
| decision-informing | code execution for arithmetic | none | no |
| decision-informing | assumption and limitation statement | none | no |
| decision-informing | sensitivity analysis | none | no |
| high-stakes | input validation | none | no |
| high-stakes | code execution for arithmetic | none | no |
| high-stakes | assumption and limitation statement | none | no |
| high-stakes | sensitivity analysis | none | no |
| high-stakes | second technique with different assumptions | none | conditional |
| high-stakes | expert review | needed | no |
Failure modes and limits
| Model suitability | model plus code |
|---|---|
| Typical model failure | Divides cost by an outcome that is not comparable across options and ignores outcomes outside the chosen measure. |
| Error sources | input data; statistical assumptions; data transformation |
| Certainty limits | Certainty drops when the measure omits material benefits (indirectness), when outcome estimates are imprecise, and when costs are not counted the same way across options (inconsistency). |
Related techniques
- substitutes for AO-10 Cost-benefit analysis: when benefits cannot be monetised and one quantified outcome measure captures most of them
- pairs with AO-12 Multi-criteria decision analysis (MCDA): criteria outside the single measure can be scored beside cost per unit of effect
Evidence and tag basis
Documented. Reasonable only if the measure captures most of the benefits; the Magenta Book notes it may limit decision support compared with cost-benefit analysis. (Office of Impact Analysis, cost-benefit analysis guidance note; Magenta Book, Annex A, analytical methods for use within an evaluation)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.