startthat.work home

Step 5: Run the techniques

5.1 Examine the question

Question techniques run first. Each one produces findings about the request, such as a term that can be read two ways.

When 5.1 produced findings, the process shows them and asks the user one thing: keep the request as it is, or edit it.

  • If the user keeps the request, the run continues at 5.2 with the same techniques.
  • If the user edits the request, steps 2 to 4 run again on the new request, because different techniques may now fit. Question techniques that already ran are not chosen again. The user is asked only once per round.
  • If the user does not reply, the request stays as it is, the run continues, and the answer says the request was not confirmed.
  • If no question technique was chosen, 5.1 is skipped and nothing is asked.

The only choices are keep and edit. A user who wants the answer to draw on more than their own material edits the request to say so, and steps 2 to 4 then show which techniques need additional sources. The process does not add other options to the question.

The findings from 5.1 are kept in every case. They go to step 7 with the other findings and appear in the answer.

5.2 Prepare the material

Preparation techniques run in the order their inputs require. Their output is still the brief's material.

Additional sources. For each chosen technique that needs one, 5.2 resolves the need in this order, after the plan exists:

  1. Look in the user's material. If the item is already there, use it and note where.
  2. If not, find the one item the technique needs, from a source that is not marketing or personal opinion. Ask the user to supply it only when no suitable item is found.
  3. Use the item. Record the item, its source, its source type, the technique that used it and whether code could check its wording.
  4. If none is found, the technique is dropped. The answer says which technique was dropped and why.

Nothing else is gathered. No source is searched for before the plan, and no list of sources is offered. The user is not asked to approve an item, for three reasons. Techniques already work without approval. The user chose the scope when they kept or edited the request at 5.1. The rule on sources applies to the model. The answer lists every additional source (section 7), so the user can check or reject any of them, and a follow-up round can run again without one. A finding that rests on a source whose wording code could not check, such as a summary returned by a fetch tool, is limited in confidence (section 7).

5.3 Analyse the material

Each primary technique runs on the brief, independently of the others.

How a technique is run

The model receives the technique record and its result format, and writes a result in that format. A result format is two to three sentences describing the parts of the result, what each row or cell contains and what the result must name. All 236 techniques have one.

Test result: five techniques were each run with the record only and with the record plus the result format, and scored blind against eight-item checklists. The totals were 33 of 40 without and 37 of 40 with. The result format helped most for absence analysis and disconfirmation search. A full method card is therefore written only for a technique where a test run shows the record and result format produce a wrong or incomplete result. The test had one run per cell, and the same author wrote the result formats and the checklists.