Measure and model
These techniques work on tables of records: exploratory plots and summaries, detection of outliers, clustering, reduction of many correlated fields to a few, survival and duration analysis, and survey weighting. They need record-level data, so step 2 removes them when you only have summary tables or narrative text.
16 techniques. Open one to see what it does, when it fits and what it needs from your material.
| ID | Technique | Purpose | Evidence status |
|---|---|---|---|
| MM-01 | Exploratory data analysis with plots and distribution checks (EDA (exploratory data analysis); summary statistics; Q-Q plot; scatterplot matrix) | Examine a cleaned table with plots and summary statistics to find shape, outliers, trends, subgroup differences and broken assumptions, and produce a draft result of plots and summaries. | Documented |
| MM-02 | Algorithmic outlier and anomaly detection (Isolation Forest; Local Outlier Factor; Elliptic Envelope; One-Class SVM (support vector machine)) | Score each record by how far it differs from the rest, using distance, density, isolation or a covariance estimate that resists outliers, and produce an outlier score and label per record. | Documented |
| MM-03 | Clustering of records (k-means; hierarchical (agglomerative) clustering; DBSCAN (density-based spatial clustering of applications with noise); HDBSCAN (hierarchical DBSCAN)) | Group records by distance or density without predefined categories and produce a cluster label per record, with centroids, a dendrogram or a noise label. | Documented |
| MM-04 | Dimensionality reduction (PCA (principal component analysis); factor analysis; non-negative matrix factorisation) | Replace many correlated numeric fields with a few components and produce loadings, explained variance and a score per record. | Documented |
| MM-05 | Survival and duration analysis (Kaplan-Meier estimator; Nelson-Aalen estimator; Cox proportional hazards; time-to-event analysis) | Estimate the time until an event while using records whose event has not yet been seen, and produce survival curves with intervals and a median duration. | Documented |
| MM-06 | Survey weighting and subgroup estimation (design weights; calibration; post-stratification; relative standard error) | Apply survey weights so that sample results represent the population and produce weighted estimates with standard errors by subgroup. | Tested |
| MM-07 | Supervised classification and dictionary methods (text classification; fine-tuned classifier; lexicon method) | Assign documents to predefined categories using human-labelled examples or word lists and produce coded documents with confidence and a confusion matrix. | Tested |
| MM-08 | LLM coding and zero-shot classification of text (LLM annotation; LLM-assisted deductive coding; few-shot classification; natural language inference classification) | Apply a human-written codebook or category descriptions to text with a large language model and produce codes, rationales and per-code agreement with human coders. | Tested |
| MM-09 | Sentiment analysis (polarity detection; opinion mining; affect lexicon) | Score text as positive, negative or neutral, or by emotion, and produce scores per document with aggregates by group or period. | Documented |
| MM-10 | Stance detection (position detection) | Label whether each text favours, opposes or is neutral toward a named target and produce a stance label per text and target. | Tested |
| MM-11 | Framing analysis at scale (frame detection; issue framing; media frames coding) | Identify which aspects of an issue each text emphasises using a defined frame scheme and produce frame labels with frame shares by source and period. | Tested |
| MM-12 | Probabilistic topic modelling (LDA (latent Dirichlet allocation); STM (structural topic model); mixed-membership model) | Model each document as a mixture of topics and each topic as a distribution over words, and produce topic word lists and document-topic proportions. | Tested |
| MM-13 | Embedding-based topic modelling (BERTopic; Top2Vec; clustering-based topic models) | Embed documents with a neural model, cluster the embeddings and describe each cluster by distinctive words, and produce topics with representative words, representative documents and an outlier group. | Documented |
| MM-14 | Document clustering (computer-assisted clustering; k-means on document vectors) | Group similar documents without predefined categories using counts or embeddings and produce cluster assignments, centroids and exemplar documents. | Documented |
| MM-15 | Computer-assisted theme building (reading-assisted thematic analysis; human-guided topic labelling) | Have a person read exemplars from computer-generated groups, then merge, split and name them, and produce a named theme set with exemplar quotations and a count per theme. | Documented |
| MM-16 | Word embeddings for concept measurement and semantic change (diachronic embeddings; concept direction) | Measure how terms relate in meaning within a corpus or across periods and produce nearest neighbours, similarity to seed words and change scores. | Tested |