startthat.work home

CM1-07 Qualitative comparative analysis (QCA; crisp-set, fuzzy-set and multi-value variants)

Uses set theory and Boolean algebra to find combinations of conditions that are necessary or sufficient for an outcome across a medium number of cases, producing a truth table and minimal solution formulas with consistency and coverage scores.

CompareEvidence: DocumentedPrimary technique, runs in step 5.3Strongest statement: show a link between things

What it does

Uses set theory and Boolean algebra to find combinations of conditions necessary or sufficient for an outcome across a medium number of cases. Artefact: a truth table and minimal solution formulas with consistency and coverage scores.

When to use it

Use when a user has a medium number of comparable cases and asks which combinations of conditions go with an outcome.

When it does not fit

Consistency and coverage are low, continuous variables are split arbitrarily into crisp sets, or a causal mechanism is claimed (other techniques, such as process tracing, are needed for mechanisms).

Result format

The result has a truth table with one row per combination of conditions and the outcome for the cases that show it, and the minimal solution formulas of conditions necessary or sufficient for the outcome. Each formula carries its consistency and coverage scores.

Requirements on the material

PropertyRequirement typeRequirement
StructureApplies in some casesrequires=structured
Content typeAlways appliesrequires=tabular
Unit of analysisAlways appliesrequires=record
Variable typesRaises a warningprefers=nominal; prefers=counts or fractions
Level of detail availableAlways appliesrequires=record-level
Appraises source credibilityApplies in some casesno

Not restricted on: Time structure, How the sample was chosen, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materialA medium number of comparable cases with calibrated set memberships on each condition and on the outcome.
Additional sources neededreference structure
Not for (rules)none
Not for (text)Wrong choice when consistency and coverage are low, when continuous variables are split into crisp sets without a reason, or when a causal mechanism is claimed. Process tracing is needed for mechanisms.

Choosing and ordering

Kind of techniquePrimary technique, runs in step 5.3
Phase taganalyse
Other phase tagsnone
Kind of findingcause; pattern
Question answeredwhy
Strongest statement it supportsshow a link between things
Needs as input
Makes as output
Must exist firstNone
Loop targetreturn to verify and prepare

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: deterministic.

StakesCheckPerson involvedCounts as a different method
exploratoryinput validationnoneno
decision-informinginput validationnoneno
decision-informingsensitivity analysisnoneno
decision-informingcode execution for arithmeticnoneno
high-stakesinput validationnoneno
high-stakessensitivity analysisnoneno
high-stakescode execution for arithmeticnoneno
high-stakessecond technique with different assumptionsnoneconditional
high-stakesexpert reviewneededno

Failure modes and limits

Model suitabilitymodel plus code
Typical model failureCalibrates thresholds to produce clean solutions, reports consistency without coverage, and reads solution formulas as mechanisms.
Error sourcesinput data; data transformation; statistical assumptions; coder or rater judgement
Certainty limitsCertainty drops because results are sensitive to calibration and to small model changes, because limited diversity leaves combinations unobserved, and because false positives are reported by critics.

Evidence and tag basis

Documented. Critics argue that results are fragile, sensitive to small model changes and prone to type I error (false positives). Ragin's primary texts were not read. (Wikipedia, Qualitative comparative analysis)

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.