startthat.work home

Measure and model

These techniques work on tables of records: exploratory plots and summaries, detection of outliers, clustering, reduction of many correlated fields to a few, survival and duration analysis, and survey weighting. They need record-level data, so step 2 removes them when you only have summary tables or narrative text.

16 techniques. Open one to see what it does, when it fits and what it needs from your material.

IDTechniquePurposeEvidence status
MM-01Exploratory data analysis with plots and distribution checks (EDA (exploratory data analysis); summary statistics; Q-Q plot; scatterplot matrix)Examine a cleaned table with plots and summary statistics to find shape, outliers, trends, subgroup differences and broken assumptions, and produce a draft result of plots and summaries.Documented
MM-02Algorithmic outlier and anomaly detection (Isolation Forest; Local Outlier Factor; Elliptic Envelope; One-Class SVM (support vector machine))Score each record by how far it differs from the rest, using distance, density, isolation or a covariance estimate that resists outliers, and produce an outlier score and label per record.Documented
MM-03Clustering of records (k-means; hierarchical (agglomerative) clustering; DBSCAN (density-based spatial clustering of applications with noise); HDBSCAN (hierarchical DBSCAN))Group records by distance or density without predefined categories and produce a cluster label per record, with centroids, a dendrogram or a noise label.Documented
MM-04Dimensionality reduction (PCA (principal component analysis); factor analysis; non-negative matrix factorisation)Replace many correlated numeric fields with a few components and produce loadings, explained variance and a score per record.Documented
MM-05Survival and duration analysis (Kaplan-Meier estimator; Nelson-Aalen estimator; Cox proportional hazards; time-to-event analysis)Estimate the time until an event while using records whose event has not yet been seen, and produce survival curves with intervals and a median duration.Documented
MM-06Survey weighting and subgroup estimation (design weights; calibration; post-stratification; relative standard error)Apply survey weights so that sample results represent the population and produce weighted estimates with standard errors by subgroup.Tested
MM-07Supervised classification and dictionary methods (text classification; fine-tuned classifier; lexicon method)Assign documents to predefined categories using human-labelled examples or word lists and produce coded documents with confidence and a confusion matrix.Tested
MM-08LLM coding and zero-shot classification of text (LLM annotation; LLM-assisted deductive coding; few-shot classification; natural language inference classification)Apply a human-written codebook or category descriptions to text with a large language model and produce codes, rationales and per-code agreement with human coders.Tested
MM-09Sentiment analysis (polarity detection; opinion mining; affect lexicon)Score text as positive, negative or neutral, or by emotion, and produce scores per document with aggregates by group or period.Documented
MM-10Stance detection (position detection)Label whether each text favours, opposes or is neutral toward a named target and produce a stance label per text and target.Tested
MM-11Framing analysis at scale (frame detection; issue framing; media frames coding)Identify which aspects of an issue each text emphasises using a defined frame scheme and produce frame labels with frame shares by source and period.Tested
MM-12Probabilistic topic modelling (LDA (latent Dirichlet allocation); STM (structural topic model); mixed-membership model)Model each document as a mixture of topics and each topic as a distribution over words, and produce topic word lists and document-topic proportions.Tested
MM-13Embedding-based topic modelling (BERTopic; Top2Vec; clustering-based topic models)Embed documents with a neural model, cluster the embeddings and describe each cluster by distinctive words, and produce topics with representative words, representative documents and an outlier group.Documented
MM-14Document clustering (computer-assisted clustering; k-means on document vectors)Group similar documents without predefined categories using counts or embeddings and produce cluster assignments, centroids and exemplar documents.Documented
MM-15Computer-assisted theme building (reading-assisted thematic analysis; human-guided topic labelling)Have a person read exemplars from computer-generated groups, then merge, split and name them, and produce a named theme set with exemplar quotations and a count per theme.Documented
MM-16Word embeddings for concept measurement and semantic change (diachronic embeddings; concept direction)Measure how terms relate in meaning within a corpus or across periods and produce nearest neighbours, similarity to seed words and change scores.Tested