startthat.work home

MM-04 Dimensionality reduction (PCA (principal component analysis); factor analysis; non-negative matrix factorisation)

Replace many correlated numeric fields with a few components and produce loadings, explained variance and a score per record.

Measure and modelEvidence: DocumentedPrimary technique, runs in step 5.3Strongest statement: describe

What it does

Replaces many correlated numeric fields with a few components that capture most of the variance. Artefact: loadings, explained variance ratio and scores per record. Read loadings to name components and explained variance to choose their number.

When to use it

Use when there are many correlated numeric variables and you want a smaller set of dimensions to read or model.

When it does not fit

Fits correlated fields with linear structure. PCA centres but does not scale, so large-variance fields dominate unless standardised. Misfit: the first components explain little variance, or loadings cannot be interpreted.

Result format

The result has a table of loadings for each component, the explained variance ratio for each component, and a score for each record. It names each component from its loadings and states how many components were kept and why.

Requirements on the material

PropertyRequirement typeRequirement
StructureApplies in some casesrequires=structured
Content typeAlways appliesrequires=tabular
Unit of analysisAlways appliesrequires=variable; requires=dataset
Variable typesRaises a warningprefers=interval; prefers=ratio
Level of detail availableAlways appliesrequires=record-level
Appraises source credibilityApplies in some casesno

Not restricted on: Time structure, How the sample was chosen, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.

Minimum materialat least 3 numeric variables and more records than variables
Additional sources needednone
Not for (rules)none
Not for (text)Wrong choice when the first components explain little variance or the loadings cannot be interpreted. Non-negative matrix factorisation also needs non-negative data.

Choosing and ordering

Kind of techniquePrimary technique, runs in step 5.3
Phase taganalyse
Other phase tagsverify and prepare
Kind of findingpattern
Question answeredwhat
Strongest statement it supportsdescribe
Needs as input
Makes as output
Must exist firstNone
Loop targetreturn to analyse

Library checks by stakes

Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: deterministic.

StakesCheckPerson involvedCounts as a different method
exploratoryinput validationnoneno
decision-informinginput validationnoneno
decision-informingsensitivity analysisnoneno
decision-informingspot checkoptionalno
high-stakesinput validationnoneno
high-stakessensitivity analysisnoneno
high-stakesspot checkoptionalno
high-stakesindependent reviewneededno

Failure modes and limits

Model suitabilityhuman judgement required
Typical model failureInvents plausible names for components without checking loadings.
Error sourcesinput data; data transformation; statistical assumptions
Certainty limitsCertainty drops when variables are not standardised (risk of bias), when components are named without reading loadings (indirectness) and when results change with the number of components kept (inconsistency).

Evidence and tag basis

Documented. Non-negative matrix factorisation needs non-negative data. (scikit-learn decomposition)

Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.