startthat.work home

CH-05 Red team analysis (red team, red cell)

Models how an adversary or other actor would decide by reasoning in that actor first-person voice, or examines a plan from outside the planning team, and produces first-person memos predicting decisions.

ChallengeEvidence: DocumentedChallenge technique, runs in step 6Strongest statement: predict, without claiming a cause

What it does

Models how an adversary or other actor would decide by reasoning in that actor's first-person voice (CIA), or examines a plan from outside the planning team (UK). Artefact: first-person memos predicting decisions; read decisions that differ from the home team's expectation.

When to use it

Use when you need to anticipate how another actor will decide or want an outside team to examine a plan.

When it does not fit

The analysts cannot escape their own mindsets, or an external team is misused to attack the plan.

Result format

The result is a set of first-person memos, written in the voice of the adversary or other actor, that predict its decisions. It names the decisions that differ from the home team's expectation.

Requirements on the material

PropertyRequirement typeRequirement
Unit of analysisAlways appliesrequires=topic
Appraises source credibilityApplies in some casesno

Not restricted on: Structure, Content type, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materialExperts on the actor environment and thinking style, kept apart from routine analysis.
Additional sources needednone
Not for (rules)none
Not for (text)The analysts cannot escape their own mindsets, or an external team is misused to attack the plan.

Choosing and ordering

Kind of techniqueChallenge technique, runs in step 6
Phase tagvalidate
Other phase tagsanalyse
Kind of findingrisk; difference
Question answeredwhat next; who
Strongest statement it supportspredict, without claiming a cause
Needs as input
Makes as output
Must exist firstNone
Loop targetreturn to analyse

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.

StakesCheckPerson involvedCounts as a different method
exploratoryassumption and limitation statementnoneno
decision-informingassumption and limitation statementnoneno
decision-informingindependent reviewneeded; left out below high stakesno
high-stakesassumption and limitation statementnoneno
high-stakesindependent reviewneededno
high-stakesexpert reviewneededno
high-stakessecond technique with different assumptionsnoneconditional

Failure modes and limits

Model suitabilityhuman judgement required
Typical model failureWrites the other actor decisions in the home team terms and values, and so mirrors its own expectation.
Error sourcesinput data; expert opinion; language model
Certainty limitsThe CIA and UK sources use the same name for different purposes and give no effectiveness evidence; predictions rest on expert knowledge of the actor and carry imprecision.

Evidence and tag basis

Documented. The two sources use the same name for different purposes: the UK red cell is closest to the CIA red team analysis. No effectiveness evidence found. (CIA Tradecraft Primer (2009); UK Red Teaming Handbook)

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.