CM1-12 Benchmarking and peer comparison (best-practice comparison, competitor analysis)
Compares an organisation processes and metrics with those of peers or leaders, producing a gap table of own against benchmark performance.
What it does
Compares an organisation's processes and metrics with those of peers or leaders. Artefact: a gap table of own against benchmark performance; read relative position and practices to adopt.
When to use it
Use when a user asks how an organisation performs against peers or best practice, or which practices a leader uses that it lacks.
When it does not fit
Metrics are defined differently across organisations or over time, or the function (human resources, information technology) is hard to compare directly.
Result format
The result is a gap table with one row per process or metric, giving the organisation's own performance, the benchmark performance of the peers or leaders, and the gap. It names the organisation's relative position and the practices to adopt.
Requirements on the material
| Property | Requirement type | Requirement |
|---|---|---|
| Content type | Always applies | requires=tabular; requires=text |
| Unit of analysis | Always applies | requires=variable; requires=topic |
| Variable types | Raises a warning | prefers=ratio; prefers=counts or fractions |
| Level of detail available | Always applies | requires=aggregate tables |
| Appraises source credibility | Applies in some cases | no |
Not restricted on: Structure, Time structure, How the sample was chosen, Number of sources, Whether sources can be joined, Amount of material, Known data problems, Producer interest, Source dependence, Origin, Document genre, Language, Personal information, Security classification, Licence.
| Minimum material | Comparable, consistently defined metrics or practice data for the organisation and at least one peer or benchmark. |
|---|---|
| Additional sources needed | comparator |
| Not for (rules) | none |
| Not for (text) | Wrong choice when metrics are defined differently across organisations or over time, or when the function is hard to compare directly. Cost and the absence of a universal standard process are further limits. |
Choosing and ordering
| Kind of technique | Primary technique, runs in step 5.3 |
|---|---|
| Phase tag | analyse |
| Other phase tags | none |
| Kind of finding | difference; gap |
| Question answered | what; how much |
| Strongest statement it supports | describe |
| Needs as input |
|
| Makes as output |
|
| Must exist first | None |
| Loop target | return to gather |
Library checks by stakes
Each stakes level includes the checks of the level below it. Checks that need a person apply at high stakes only, so the process leaves them out at lower stakes (decision 38). Repeatability: judgement dependent.
| Stakes | Check | Person involved | Counts as a different method |
|---|---|---|---|
| exploratory | input validation | none | no |
| decision-informing | input validation | none | no |
| decision-informing | code execution for arithmetic | none | no |
| decision-informing | spot check | optional | no |
| high-stakes | input validation | none | no |
| high-stakes | code execution for arithmetic | none | no |
| high-stakes | spot check | optional | no |
| high-stakes | second technique with different assumptions | none | conditional |
| high-stakes | expert review | needed | no |
Failure modes and limits
| Model suitability | human judgement required |
|---|---|
| Typical model failure | Compares figures whose definitions differ between organisations and presents the gap as real. |
| Error sources | input data; source selection; data transformation |
| Certainty limits | Certainty drops when metric definitions differ between organisations or years (inconsistency), when peers are not comparable (indirectness), or when published metrics are selectively reported (reporting bias). |
Related techniques
- pairs with CM1-15 Gap analysis: the benchmark supplies the target state for a gap analysis
- pairs with DM-04 Value chain analysis (Porter): a value chain split makes functions comparable before metrics are compared
Evidence and tag basis
Documented. The source page notes cost, inconsistent metric definitions and no universal standard process, and flags sections needing citations. Competitor analysis had no dedicated source. (Wikipedia, Benchmarking)
Tag basis: input profile inference; selection inference; sequencing inference; robustness inference. All tag values are inference unless a source is named.