CH-11 Steelmanning Also serves: Compare.
Builds the strongest version of a position the analyst disagrees with, responds to it, and produces a strengthened opposing argument and a response.
What it does
Builds the strongest version of a position the analyst disagrees with, then responds to it. Artefact: a strengthened opposing argument and a response, which tests the analyst's own position.
When to use it
Use when you want to test your own position against the best form of the opposing argument and not a weak version.
When it does not fit
The strengthened version is no longer recognisable as the opponent's position, or adds claims the opponent rejects.
Result format
The result has two parts: the opposing position restated in its strongest form, and a response to that restated version. It must keep the restated position recognisable to its holder and end with a statement of what the response shows about the analyst's own position.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Unit of analysis | Always applies | requires=claim |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Content type, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | The opposing argument and enough domain knowledge to repair its weak assumptions. |
|---|---|
| Additional sources needed | comparator |
| Not for (rules) | none |
| Not for (text) | The strengthened version is no longer recognisable as the opponent position, or adds claims the opponent rejects. |
Choosing and ordering
| Kind of technique | Challenge technique, runs in step 6 |
|---|---|
| Phase tag | validate |
| Other phase tags | analyse |
| Kind of finding | contradiction; risk |
| Question answered | what |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to analyse |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | assumption and limitation statement | none | no |
| decision-informing | assumption and limitation statement | none | no |
| decision-informing | independent review | needed; left out below high stakes | no |
| high-stakes | assumption and limitation statement | none | no |
| high-stakes | independent review | needed | no |
| high-stakes | expert review | needed | no |
| high-stakes | second technique with different assumptions | none | conditional |
Failure modes and limits
| Model suitability | model alone |
|---|---|
| Typical model failure | Adds claims the opponent does not hold, or strengthens the position in a way that makes it easy to answer. |
| Error sources | input data; coder or rater judgement; language model |
| Certainty limits | No evidence that it works better than other techniques; the result depends on the analyst domain knowledge to repair weak assumptions. |
Related techniques
- pairs with CH-10 Rapoport's rules (fair restatement of an opposing position) Also serves: Compare.: Fair restatement keeps the strengthened version faithful to what the opponent holds
- pairs with CH-03 Devil's advocacy: Devil advocacy argues against the plan using the strengthened case
Evidence and tag basis
Practice. Described on encyclopaedia pages with no evidence that it works better than other techniques. (Wikipedia, Steelmanning; Wikipedia, Straw man)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.