DM-20 Stock and flow modelling (system dynamics, including simulation) Also serves: Project forward.
Represents accumulations that change only through inflows and outflows and, when simulated, produces a diagram and simulated time paths.
What it does
Represents accumulations that change only through inflows and outflows, and when simulated produces time paths. Artefact: a diagram and simulated paths; read accumulation, durations and sensitivity to parameters, not point values.
When to use it
Use when the question concerns a quantity that builds up or runs down over time and you want to see durations and sensitivity to assumptions.
When it does not fit
The quantity cannot be framed as an accumulation, flow data are unavailable, the model cannot reproduce the history it should explain, or the conclusion rests on one untested parameter.
Result format
The result is a diagram of stocks, inflows and outflows with the simulated time path of each stock. It reports accumulation, durations and sensitivity to parameters, and does not rest on point values.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Unit of analysis | Always applies | requires=variable; requires=topic |
| Variable types | Raises a warning | prefers=ratio; prefers=counts or fractions |
| Time structure | Applies in some cases | prefers=aggregate time series |
| Level of detail available | Always applies | requires=narrative only; prefers=aggregate tables |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Content type, How the sample was chosen, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | Stocks, flows, units and initial values, plus calibration data and parameters for simulation. |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | The quantity cannot be framed as an accumulation, flow data are unavailable, the model cannot reproduce the history it should explain, or the conclusion rests on one untested parameter. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | frame |
| Kind of finding | trend; cause |
| Question answered | what next; why; how much |
| Strongest statement it supports | predict, without claiming a cause |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to analyse |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | assumption and limitation statement | none | no |
| decision-informing | assumption and limitation statement | none | no |
| decision-informing | sensitivity analysis | none | no |
| decision-informing | code execution for arithmetic | none | no |
| high-stakes | assumption and limitation statement | none | no |
| high-stakes | sensitivity analysis | none | no |
| high-stakes | code execution for arithmetic | none | no |
| high-stakes | expert review | needed | no |
| high-stakes | second technique with different assumptions | none | conditional |
| high-stakes | held-out validation | none | no |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Calculates simulated paths in text instead of code and reports point values from parameters that were guessed. |
| Error sources | input data; statistical assumptions; expert opinion; language model |
| Certainty limits | Delays and feedback strengths often rest on expert judgement; simulation accuracy is contested and paths are conditional on parameters, which lowers certainty by imprecision and risk of bias. |
Related techniques
- should follow DM-19 Causal loop diagram Also serves: Trace cause and test claims.: A causal loop diagram identifies the feedback that the stock and flow structure must include
- pairs with TC1-17 Sensitivity analysis (robustness check, leave-one-out): Sensitivity analysis tests which parameters drive the paths
Evidence and tag basis
Documented. The diagram form is documented (Wikipedia, Stock and flow). Simulation accuracy is contested: a 2008 working paper by Turner reportedly found that observed data tracked the Limits to Growth standard run, but it was not opened.
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.