CM1-07 Qualitative comparative analysis (QCA; crisp-set, fuzzy-set and multi-value variants)
Uses set theory and Boolean algebra to find combinations of conditions that are necessary or sufficient for an outcome across a medium number of cases, producing a truth table and minimal solution formulas with consistency and coverage scores.
What it does
Uses set theory and Boolean algebra to find combinations of conditions necessary or sufficient for an outcome across a medium number of cases. Artefact: a truth table and minimal solution formulas with consistency and coverage scores.
When to use it
Use when a user has a medium number of comparable cases and asks which combinations of conditions go with an outcome.
When it does not fit
Consistency and coverage are low, continuous variables are split arbitrarily into crisp sets, or a causal mechanism is claimed (other techniques, such as process tracing, are needed for mechanisms).
Result format
The result has a truth table with one row per combination of conditions and the outcome for the cases that show it, and the minimal solution formulas of conditions necessary or sufficient for the outcome. Each formula carries its consistency and coverage scores.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Structure | Applies in some cases | requires=structured |
| Content type | Always applies | requires=tabular |
| Unit of analysis | Always applies | requires=record |
| Variable types | Raises a warning | prefers=nominal; prefers=counts or fractions |
| Level of detail available | Always applies | requires=record-level |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Time structure, How the sample was chosen, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | A medium number of comparable cases with calibrated set memberships on each condition and on the outcome. |
|---|---|
| Additional sources needed | reference structure |
| Not for (rules) | none |
| Not for (text) | Wrong choice when consistency and coverage are low, when continuous variables are split into crisp sets without a reason, or when a causal mechanism is claimed. Process tracing is needed for mechanisms. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | none |
| Kind of finding | cause; pattern |
| Question answered | why |
| Strongest statement it supports | show a link between things |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to verify and prepare |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: deterministic.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | input validation | none | no |
| decision-informing | input validation | none | no |
| decision-informing | sensitivity analysis | none | no |
| decision-informing | code execution for arithmetic | none | no |
| high-stakes | input validation | none | no |
| high-stakes | sensitivity analysis | none | no |
| high-stakes | code execution for arithmetic | none | no |
| high-stakes | second technique with different assumptions | none | conditional |
| high-stakes | expert review | needed | no |
Failure modes and limits
| Model suitability | model plus code |
|---|---|
| Typical model failure | Calibrates thresholds to produce clean solutions, reports consistency without coverage, and reads solution formulas as mechanisms. |
| Error sources | input data; data transformation; statistical assumptions; coder or rater judgement |
| Certainty limits | Certainty drops because results are sensitive to calibration and to small model changes, because limited diversity leaves combinations unobserved, and because false positives are reported by critics. |
Related techniques
- pairs with TC1-04 Process tracing (diagnostic tests: straw in the wind, hoop, smoking gun, doubly decisive): set relations show configurations, and process tracing tests the mechanism
- substitutes for CM1-05 Comparative case study (structured focused comparison, small-N comparison): when there are enough cases and conditions can be calibrated into set memberships
- should follow CM1-06 Case selection techniques (extreme, deviant, diverse, index, most similar): case selection fixes which cases enter the matrix
Evidence and tag basis
Documented. Critics argue that results are fragile, sensitive to small model changes and prone to type I error (false positives). Ragin's primary texts were not read. (Wikipedia, Qualitative comparative analysis)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.