AO-08 Eightfold path (Bardach)
Structures a policy question into eight steps from defining the problem to telling the story, producing a written options analysis with criteria, projected outcomes and trade-offs.
What it does
Structures a policy question into eight steps from defining the problem to telling the story. Artefact: a written options analysis with criteria, projected outcomes and trade-offs.
When to use it
Use when a user asks which policy option to recommend and needs a step-by-step structure from problem definition to recommendation.
When it does not fit
Projected outcomes cannot be estimated because evidence is missing.
Result format
The result is a written options analysis that follows the eight steps from defining the problem to telling the story. It states the criteria, the projected outcome of each option against them and the trade-offs, with a comparison matrix of options against criteria.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Content type | Always applies | requires=text; requires=tabular |
| Unit of analysis | Always applies | requires=topic |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | A policy problem, evidence on it, a set of alternatives and criteria for judging them. |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | Wrong choice when projected outcomes cannot be estimated because evidence is missing. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | frame; report |
| Kind of finding | option ranking; risk |
| Question answered | which option; what next |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to gather |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | assumption and limitation statement | none | no |
| decision-informing | assumption and limitation statement | none | no |
| decision-informing | source-span citation | none | no |
| decision-informing | sensitivity analysis | none | no |
| high-stakes | assumption and limitation statement | none | no |
| high-stakes | source-span citation | none | no |
| high-stakes | sensitivity analysis | none | no |
| high-stakes | alternative explanations check | none | no |
| high-stakes | expert review | needed | no |
| high-stakes | independent review | needed | no |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Fills the projected outcomes step with unsupported estimates and skips the step that confronts the trade-offs. |
| Error sources | input data; source selection; coder or rater judgement; expert opinion |
| Certainty limits | Certainty drops when projected outcomes rest on weak evidence (indirectness), when criteria are chosen after the preferred option is known (risk of bias), and when step outputs and criticisms were not verified. |
Related techniques
- should follow FQ-02 Decision-first framing (decision-focused or value-focused question design): a decision-first frame states the decision that the analysis serves
- pairs with AO-12 Multi-criteria decision analysis (MCDA): explicit weights make the trade-off step transparent
- pairs with AO-10 Cost-benefit analysis: monetised outcomes can fill the projection step when benefits can be valued
Evidence and tag basis
Documented. Step names verified on a secondary page; step-level outputs and criticisms were not. (Wikipedia, Eightfold path (policy analysis))
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.