startthat.work home

DM-20 Stock and flow modelling (system dynamics, including simulation) Also serves: Project forward.

Represents accumulations that change only through inflows and outflows and, when simulated, produces a diagram and simulated time paths.

Decompose and mapEvidence: DocumentedPrimary technique, runs in step 5.3Strongest statement: predict, without claiming a cause

What it does

Represents accumulations that change only through inflows and outflows, and when simulated produces time paths. Artefact: a diagram and simulated paths; read accumulation, durations and sensitivity to parameters, not point values.

When to use it

Use when the question concerns a quantity that builds up or runs down over time and you want to see durations and sensitivity to assumptions.

When it does not fit

The quantity cannot be framed as an accumulation, flow data are unavailable, the model cannot reproduce the history it should explain, or the conclusion rests on one untested parameter.

Result format

The result is a diagram of stocks, inflows and outflows with the simulated time path of each stock. It reports accumulation, durations and sensitivity to parameters, and does not rest on point values.

Requirements on the material

PropertyRequirement typeRequirement
Unit of analysisAlways appliesrequires=variable; requires=topic
Variable typesRaises a warningprefers=ratio; prefers=counts or fractions
Time structureApplies in some casesprefers=aggregate time series
Level of detail availableAlways appliesrequires=narrative only; prefers=aggregate tables
Appraises source credibilityApplies in some casesno

Not restricted on: Structure, Content type, How the sample was chosen, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materialStocks, flows, units and initial values, plus calibration data and parameters for simulation.
Additional sources needednone
Not for (rules)none
Not for (text)The quantity cannot be framed as an accumulation, flow data are unavailable, the model cannot reproduce the history it should explain, or the conclusion rests on one untested parameter.

Choosing and ordering

Kind of techniquePrimary technique, runs in step 5.3
Phase taganalyse
Other phase tagsframe
Kind of findingtrend; cause
Question answeredwhat next; why; how much
Strongest statement it supportspredict, without claiming a cause
Needs as input
Makes as output
Must exist firstNone
Loop targetreturn to analyse

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.

StakesCheckPerson involvedCounts as a different method
exploratoryassumption and limitation statementnoneno
decision-informingassumption and limitation statementnoneno
decision-informingsensitivity analysisnoneno
decision-informingcode execution for arithmeticnoneno
high-stakesassumption and limitation statementnoneno
high-stakessensitivity analysisnoneno
high-stakescode execution for arithmeticnoneno
high-stakesexpert reviewneededno
high-stakessecond technique with different assumptionsnoneconditional
high-stakesheld-out validationnoneno

Failure modes and limits

Model suitabilityhuman judgement required
Typical model failureCalculates simulated paths in text instead of code and reports point values from parameters that were guessed.
Error sourcesinput data; statistical assumptions; expert opinion; language model
Certainty limitsDelays and feedback strengths often rest on expert judgement; simulation accuracy is contested and paths are conditional on parameters, which lowers certainty by imprecision and risk of bias.

Evidence and tag basis

Documented. The diagram form is documented (Wikipedia, Stock and flow). Simulation accuracy is contested: a 2008 working paper by Turner reportedly found that observed data tracked the Limits to Growth standard run, but it was not opened.

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.