startthat.work home

IS-10 Explanatory sequential integration (explanatory sequential design)

Uses a completed quantitative result, especially an unexpected or extreme one, to choose the qualitative material read to explain it and produces an explanation linked to the numeric pattern.

Integrate across sourcesEvidence: DocumentedPrimary technique, runs in step 5.3Strongest statement: show a link between things

What it does

Takes a completed quantitative result, especially an unexpected or extreme one, and uses it to choose the qualitative material read to explain it. Artefact: an explanation linked to the numeric pattern. Read which accounts explain which result.

When to use it

Use when a number or pattern is surprising and you need to find what in the texts or accounts explains it.

When it does not fit

Fits when a number needs explaining. Misfit: the first stage yields nothing to explain. As defined, the design collects new qualitative data, so with desktop sources it works only if existing texts cover the cases.

Result format

The result names the unexpected or extreme quantitative result that needs explaining and lists the qualitative accounts chosen to explain it, each with its source reference. It ends with a statement of which accounts explain which numeric result.

Requirements on the material

PropertyRequirement typeRequirement
Content typeAlways appliesrequires=text; requires=tabular
Unit of analysisAlways appliesrequires=topic
Number of sourcesAlways appliesrequires=two or more
Appraises source credibilityApplies in some casesno

Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Level of detail available, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materialnone
Additional sources needednone
Not for (rules)none
Not for (text)The first stage yields nothing to explain. As defined, the design collects new qualitative data, so with desktop sources it works only if existing texts cover the cases.

Choosing and ordering

Kind of techniquePrimary technique, runs in step 5.3
Phase taganalyse
Other phase tagsnone
Kind of findingcause; pattern
Question answeredwhy
Strongest statement it supportsshow a link between things
Needs as input
Makes as output
Must exist firstNone
Loop targetproceed with limit stated

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.

StakesCheckPerson involvedCounts as a different method
exploratoryspot checkoptionalno
decision-informingspot checkoptionalno
decision-informinghuman review sampleneeded; left out below high stakesno
high-stakesspot checkoptionalno
high-stakeshuman review sampleneededno
high-stakesindependent reviewneededno
high-stakessecond technique with different assumptionsnoneconditional

Failure modes and limits

Model suitabilityhuman judgement required
Typical model failureSelects accounts that fit a story it has already formed and presents them as the explanation.
Error sourcesinput data; coder or rater judgement; source selection
Certainty limitsCertainty drops when the texts do not cover the cases behind the number and when explanations are not tested (indirectness).

Evidence and tag basis

Documented. Definition only. (Fetters, Curry and Creswell 2013, via core.ac.uk)

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.