PJ-20 Wargaming and simulation exercises (policy gaming, tabletop exercise)
Have players take the roles of competing actors in a structured scenario, giving a record of decisions and surprises as a draft result.
What it does
Has human players take the roles of competing actors in a structured scenario. Artefact: a record of decisions and surprises; read unexpected moves and points where the plan failed, not the outcome as a prediction.
When to use it
Use when you need to see how real people in the roles of competing actors respond to a plan and where it breaks down.
When it does not fit
Players do not represent the actors, one outcome is reported as what will happen, or adjudicators steer the result.
Result format
The result is a record of the scenario, the roles played and the decisions each player made, in the order they were made. It lists the unexpected moves and the points where the plan failed, and does not present the outcome as a prediction.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Unit of analysis | Always applies | requires=topic |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Content type, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | A scenario, role descriptions, adjudication rules and players who know the actors they represent. |
|---|---|
| Additional sources needed | reference structure |
| Not for (rules) | none |
| Not for (text) | Players do not represent the actors, one outcome is reported as what will happen, or adjudicators steer the result. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | validate |
| Kind of finding | risk; contradiction |
| Question answered | what next; who |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to gather |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | assumption and limitation statement | none | no |
| exploratory | provenance log | none | no |
| decision-informing | assumption and limitation statement | none | no |
| decision-informing | provenance log | none | no |
| decision-informing | independent review | needed; left out below high stakes | no |
| decision-informing | expert review | needed; left out below high stakes | no |
| high-stakes | assumption and limitation statement | none | no |
| high-stakes | provenance log | none | no |
| high-stakes | independent review | needed | no |
| high-stakes | expert review | needed | no |
| high-stakes | second technique with different assumptions | none | conditional |
| high-stakes | source-span citation | none | no |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Plays all actors itself and reports one simulated outcome as a prediction. |
| Error sources | expert opinion; source selection |
| Certainty limits | Outputs are insight, not prediction; confidence drops when players do not represent the actors (indirectness) or adjudication steers the result (risk of bias). |
Related techniques
- pairs with CH-05 Red team analysis (red team, red cell): red team analysis supplies the adversary view for the player roles
- should follow PJ-12 Scenario planning (intuitive logics, Shell approach): scenarios supply the starting conditions
Evidence and tag basis
Unconfirmed. No source on predictive accuracy was found; the usual position, not verified here, is that wargames generate insight and do not predict.
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.