startthat.work home

FQ-04 Reframing and issue redefinition (changing the level of analysis or baseline; five-step issue redefinition)

Restates the question at another level, with another baseline, or by rephrasing, broadening, narrowing and reversing it, and produces answers side by side.

Frame the questionEvidence: PracticeQuestion technique, runs in step 5.1Strongest statement: describe

What it does

Restates the question at another level (individual, organisation, system), with another baseline, or by rephrasing, broadening, narrowing and reversing it. Artefact: answers side by side; an answer that reverses between frames depends on wording.

When to use it

Use when the answer may depend on how the question is worded or at what level it is asked.

When it does not fit

The alternative frames differ only in wording. A reversal between frames is a finding about the topic, not a failure of the technique.

Result format

The result states the question in each frame used (such as individual, organisation and system level, a different baseline, or a rephrased, broadened, narrowed or reversed form) and places the answer to each frame side by side. It names the answers that reverse between frames and says that these depend on wording.

Requirements on the material

PropertyRequirement typeRequirement
Unit of analysisAlways appliesrequires=topic
Appraises source credibilityApplies in some casesno

Not restricted on: Structure, Content type, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materialThe current framing and at least one alternative framing.
Additional sources needednone
Not for (rules)none
Not for (text)The alternative frames differ only in wording. A reversal between frames is a finding about the topic, not a failure of the technique.

Choosing and ordering

Kind of techniqueQuestion technique, runs in step 5.1
Phase tagframe
Other phase tagsanalyse
Kind of findingcontradiction; difference
Question answeredwhat; why
Strongest statement it supportsdescribe
Needs as input
Makes as output
Must exist firstNone
Loop targetreturn to frame

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.

StakesCheckPerson involvedCounts as a different method
exploratoryspot checkoptionalno
decision-informingspot checkoptionalno
decision-informingassumption and limitation statementnoneno
high-stakesspot checkoptionalno
high-stakesassumption and limitation statementnoneno
high-stakesindependent reviewneededno
high-stakessecond technique with different assumptionsnoneconditional

Failure modes and limits

Model suitabilityhuman judgement required
Typical model failureProduces frames that differ only in wording, so that the answers agree for a trivial reason.
Error sourcesinput data; coder or rater judgement; language model
Certainty limitsInconsistency is reported when answers reverse between frames; limited evidence that deliberate reframing improves research quality.

Evidence and tag basis

Practice. The framing effect is documented in psychology (in the Asian disease problem, 72 per cent chose the certain option when outcomes were framed as lives saved and 78 per cent chose the risky option when framed as deaths) (Wikipedia, Framing effect (psychology)). Deliberate reframing as a research technique was not sourced; issue redefinition is named in the UK handbook (UK Red Teaming Handbook).

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.