CM1-02 Mill's method of agreement and most different systems design (MDSD)
Looks across dissimilar cases that share an outcome for the factor present in all of them, producing a table of candidate factors by case in which the common factor is the candidate cause.
What it does
Looks for the factor present in every case that shows the outcome, across dissimilar contexts. Artefact: a table of candidate factors by case; the factor common to all is the candidate cause.
When to use it
Use when a user has several different cases with the same outcome and asks what they have in common.
When it does not fit
The candidate list is incomplete, the shared factor differs in kind from case to case, or the result is read as confirmation. Agreement only rules out factors that were absent when the effect occurred.
Result format
The result is a table of candidate factors by case, for cases that show the outcome in dissimilar contexts, with each cell showing whether the factor is present. It names the factor common to all cases as the candidate cause.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Content type | Always applies | requires=text; requires=tabular |
| Unit of analysis | Always applies | requires=topic; requires=record |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Variable types, Time structure, How the sample was chosen, Level of detail available, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | At least two cases with the same outcome, deliberately dissimilar in context, and an explicit list of candidate factors with comparable data. |
|---|---|
| Additional sources needed | none |
| Not for (rules) | none |
| Not for (text) | Wrong choice when the candidate list is incomplete, when the shared factor differs in kind from case to case, or when agreement is read as confirmation. Agreement only rules out factors that were absent when the effect occurred. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | none |
| Kind of finding | cause; pattern |
| Question answered | why; what |
| Strongest statement it supports | show a link between things |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to gather |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | assumption and limitation statement | none | no |
| decision-informing | assumption and limitation statement | none | no |
| decision-informing | alternative explanations check | none | no |
| decision-informing | spot check | optional | no |
| high-stakes | assumption and limitation statement | none | no |
| high-stakes | alternative explanations check | none | no |
| high-stakes | spot check | optional | no |
| high-stakes | second technique with different assumptions | none | conditional |
| high-stakes | expert review | needed | no |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Declares the shared factor the cause without checking that the candidate list is complete, and treats factors that differ in kind as the same factor. |
| Error sources | input data; source selection; coder or rater judgement |
| Certainty limits | Certainty drops when the candidate list may be incomplete or the outcome has several causes (indirectness), and when cases were selected on the outcome (risk of bias). |
Related techniques
- should follow CM1-06 Case selection techniques (extreme, deviant, diverse, index, most similar): a stated case selection rule shows how the dissimilar cases were chosen
- pairs with CM1-03 Mill's method of difference and most similar systems design (MSSD; joint method of agreement and difference): the method of difference adds a case without the outcome, which agreement alone lacks
- pairs with TC1-04 Process tracing (diagnostic tests: straw in the wind, hoop, smoking gun, doubly decisive): the shared factor is only a candidate, and process tracing tests whether it operated
Evidence and tag basis
Documented. Described in an encyclopaedia entry and a design summary of Przeworski and Teune (1970). Plurality-of-causes criticisms were not in a retrieved source. (Britannica, Mill's methods; Wikipedia, Mill's Methods; Przeworski and Teune design summary)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.