startthat.work home

Compare

These techniques compare a present topic with a past case, or compare cases with each other, to find what differs between those that share an outcome and those that do not. They include historical analogy, Mill's methods of agreement and difference, comparative case studies and the selection of cases to compare.

17 techniques. Open one to see what it does, when it fits and what it needs from your material.

IDTechniquePurposeEvidence status
CM1-01Historical analogy and parallel analysis (likenesses and differences, analogical explanation)Places the present topic beside a past case and rates each likeness and difference, producing a likenesses and differences table that shows where a lesson from the past case may and may not be applied.Documented
CM1-02Mill's method of agreement and most different systems design (MDSD)Looks across dissimilar cases that share an outcome for the factor present in all of them, producing a table of candidate factors by case in which the common factor is the candidate cause.Documented
CM1-03Mill's method of difference and most similar systems design (MSSD; joint method of agreement and difference)Looks for the factor present where an outcome occurs and absent in an otherwise similar case where it does not, producing a short list of the remaining differences between matched cases.Documented
CM1-04Concomitant variation and method of residues (Mill)Infers a link when a factor varies with the effect (concomitant variation) or attributes the unexplained part of an effect to the remaining circumstances (residues), producing a co-movement pattern or a residual.Documented
CM1-05Comparative case study (structured focused comparison, small-N comparison)Examines a small number of cases with the same questions for each, producing a case by case matrix that shows consistent patterns and deviant cases.Documented
CM1-06Case selection techniques (extreme, deviant, diverse, index, most similar)Chooses which cases to compare by their position on a variable distribution or on a model prediction, producing a chosen case set with the rule used.Unconfirmed
CM1-07Qualitative comparative analysis (QCA; crisp-set, fuzzy-set and multi-value variants)Uses set theory and Boolean algebra to find combinations of conditions that are necessary or sufficient for an outcome across a medium number of cases, producing a truth table and minimal solution formulas with consistency and coverage scores.Documented
CM1-08Cross-case synthesis (replication logic)Combines completed within-case write-ups into one cross-case matrix, producing a matrix that shows repeating patterns and diverging cases.Unconfirmed
CM1-09Contrast with a structural opposite (term from earlier work)Sets the topic beside a case or position that differs from it on a stated defining structure, producing a table of contrasting features that shows what each assumes or lacks.Unconfirmed
CM1-10Cross-sectional and longitudinal comparison (cohort and panel comparison; cross-cycle comparison)Compares different units at one time (cross-sectional) or the same units repeatedly (longitudinal), producing group differences at one time or change paths over time.Documented
CM1-11Before and after comparison (pre-post design)Compares an outcome for the same unit before and after an event, producing a change estimate.Unconfirmed
CM1-12Benchmarking and peer comparison (best-practice comparison, competitor analysis)Compares an organisation processes and metrics with those of peers or leaders, producing a gap table of own against benchmark performance.Documented
CM1-13Forecaster and source comparison (forecast scoring, aggregation, track record comparison) Also serves: Project forward.Scores a forecast against those of other forecasters on resolved outcomes and aggregates them, producing an accuracy ranking and an aggregate forecast.Tested
CM1-14Absence analysis (argument from silence, the dog that did not bark) Also serves: Handle evidence.Draws a conclusion from an item missing from a document or comparison set where it would be expected if a claim were true, producing a list of expected but absent items.Documented
CM1-15Gap analysisCompares current with desired performance, producing a prioritised list of gaps and the means to close each.Documented
CM1-16Maturity model and capability assessment (Capability Maturity Model Integration, CMMI)Rates processes against staged levels, producing a maturity level or capability profile that shows where an organisation stands and what to improve.Documented
CM-01Sponsor versus non-sponsor comparison (meta-epidemiological sponsorship analysis)Compares the share of favourable results and conclusions between sponsored and independently funded reports on one topic, producing a risk ratio or odds ratio.Documented