startthat.work home

PJ-21 Robust decision making, adaptive pathways and info-gap analysis

Test many model runs or futures to find the conditions under which a strategy fails and design strategies that adapt, giving vulnerability scenarios and pathway maps with trigger points as a draft result.

Project forwardEvidence: UnconfirmedPrimary technique, runs in step 5.3Strongest statement: describe

What it does

Tests many model runs or futures to find the conditions under which a strategy fails, then designs strategies that adapt. Artefact: vulnerability scenarios and pathway maps with trigger points.

When to use it

Use when you have a simulation model and a decision under deep uncertainty and need strategies that adapt as conditions change.

When it does not fit

No quantitative performance model exists, or trigger points are not tied to something that can be monitored.

Result format

The result lists the vulnerability scenarios, meaning the conditions under which each strategy fails, and a pathway map for the adapted strategies. Each pathway names its trigger points.

Requirements on the material

PropertyRequirement typeRequirement
Content typeAlways appliesrequires=tabular
Unit of analysisAlways appliesrequires=topic
Level of detail availableAlways appliesrequires=aggregate tables
Appraises source credibilityApplies in some casesno

Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materialA simulation model or explicit uncertain parameters, candidate strategies and performance thresholds.
Additional sources neededreference structure
Not for (rules)none
Not for (text)No quantitative performance model exists, or trigger points are not tied to something that can be monitored.

Choosing and ordering

Kind of techniquePrimary technique, runs in step 5.3
Phase taganalyse
Other phase tagsvalidate
Kind of findingrisk; option ranking
Question answeredwhich option; what next
Strongest statement it supportsdescribe
Needs as input
Makes as output
Must exist firstNone
Loop targetreturn to analyse

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: repeatable with fixed settings.

StakesCheckPerson involvedCounts as a different method
exploratoryinput validationnoneno
decision-informinginput validationnoneno
decision-informingsensitivity analysisnoneno
decision-informingspot checkoptionalno
high-stakesinput validationnoneno
high-stakessensitivity analysisnoneno
high-stakesspot checkoptionalno
high-stakessecond technique with different assumptionsnoneconditional
high-stakesexpert reviewneededno
high-stakesassumption and limitation statementnoneno

Failure modes and limits

Model suitabilitymodel plus code
Typical model failureDefines trigger points that no available indicator can measure.
Error sourcesinput data; statistical assumptions; expert opinion
Certainty limitsConfidence drops when the performance model is unvalidated (indirectness), thresholds are set by one group (risk of bias), or the technique source was not confirmed.

Evidence and tag basis

Unconfirmed. Attributed to the RAND Corporation and to Haasnoot and colleagues from memory; not opened.

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.