Which tool, when: a decision matrix for bots

Test before you trust. These prompts are starting points, not finished tools. Your data, your bot and the model behind it all change what comes back, and a prompt that works for us may need tweaking for you. Run each one on a small, known example first and check the result yourself before you rely on it. Don't paste it in and assume it works. We share these as-is, and we're not responsible for results from prompts used without testing.

A bot that knows fifty tools has a new problem: it will want to use all of them. A full FMEA for a two-line email. A fault tree for a lunch order. The first skill isn't running the tool. It's picking the right one.

What already exists

Two well-known guides do part of this:

  • The IEC guide to risk assessment techniques, an international standard, describes several dozen techniques. It helps you choose by purpose, stage of the work, how much data you have, how uncertain things are, and how complex the decision is.
  • Six Sigma tool guides sort tools by DMAIC phase: SIPOC in Define, fishbone and 5 Whys in Analyze, Pugh in Improve, and so on.

Both are useful. Neither covers management tools, and neither was written with bots in mind. This page borrows their logic and covers every tool in this series.

The selector in three steps

Step 1. What's the question?

Find the situation. Start with the first tool. Add the next ones only if you need them.

SituationStart withThen, if neededDon't start with
Starting a new product, service or botKano model, SIPOC and turtleAPQP, QFD, Map the processFMEA (nothing to analyze yet)
Finding risk before launch, broadPre-mortemFMEA, then the 80 percent lineFault tree (too narrow at first)
One outcome you can't acceptFault tree analysisBow-tieRisk matrix (too coarse)
Work handed between bots or teamsHAZOP guidewordsFMEA on the worst handoffs—
A bot with powerful tools (send, spend, delete)Hierarchy of controlsBow-tie, poka-yoke, e-stops, Nothing ships without a yesWriting more rules
Something is about to changeDRBFMLockout/tagout, Change on purpose, VerificationA full new FMEA
Something just went wrongContain it first (8D step 3)Kepner-Tregoe, fishbone, 5 Whys, Fix the causeJumping to a fix
It reached a customer8DLessons learned entry5 Whys alone
The same problem keeps coming backThe 80 percent line, on real countsSix Sigma DMAIC, design of experimentsAnother quick fix
Choosing between optionsPugh or weighted matrixRed team, pre-mortem on the winnerGut feel in a meeting
Stuck on a trade-off ("stronger but lighter")TRIZTime, cost, qualitySplitting the difference
Is this price or quote fair?Should-costPugh matrix for suppliersComparing three quotes only
Uncertain numbers adding up (fit, schedule, budget)Monte CarloDesign of experimentsWorst case only
Work is slow or wastefulValue stream mappingLean, A3Speeding up the fastest step
Is it still working?Verification and evalsSPC, control plan, tester botWaiting for complaints
Can we trust the checker?SPC and checking the checker (MSA part)Verification and evalsTrusting a checker that passes everything
Periodic step-backManagement reviewHoshin kanri—
Rolling out a change to peopleStakeholder analysisForce field analysis, RACIThe rollout plan alone
Who owns this?RACIWho owns what—
Running a projectRAID logAfter-action review at the end—
A project or job just endedAfter-action reviewLessons learned that actually get read—
Looking outside the companyPESTLE and five forcesSWOT, then hoshin kanriSWOT alone
What if a supplier, system or person disappears?Business impact analysisFault tree—
Any new job, any sizeLessons learned search——

Step 2. How much rigor?

The same question deserves different tools depending on what's at stake. See Risk sets the rigor.

RigorWhenFits here
Light (minutes; a skim)Two-way doors: drafts, internal notes, easy to undo5 Whys, risk matrix, SWOT, pre-mortem (short), A3, RAID log, Pugh, force field, stakeholder analysis, after-action review, PDSA
Medium (an hour of review)Affects a customer, money, or other teams; undo is possible but costlyFishbone, Kepner-Tregoe, FMEA (focused), 80 percent line, control plan, DRBFM, value stream map, should-cost, RACI, SIPOC/turtle, verification and evals, poka-yoke, lockout/tagout, PESTLE, business impact analysis
Heavy (a real review meeting, sign-off)One-way doors: money moves, things ship, safety, legal, the brandFault tree, bow-tie, HAZOP, full FMEA with action priority, APQP, QFD, 8D, DMAIC, design of experiments, Monte Carlo, SPC and MSA, hierarchy of controls, e-stops and fail-safe, machine-safety risk assessment, hoshin kanri

Rules: - Severity overrides size. A small job that could hurt someone, break a law or move money gets heavy tools. - Go up a tier after a change. A new model or new skills means the old results don't count yet. - Go down a tier only by decision, in writing.

Step 3. What do you have to work with?

Some tools need real data. Others work from documents. Others work from judgment. Using a data tool without data produces confident nonsense.

Input you haveTools that fit
Counts and measurements (defect logs, timestamps, test results, prices)80 percent line, SPC and MSA, Six Sigma, design of experiments, Monte Carlo, value stream mapping, Kepner-Tregoe, should-cost
Documents (drawings, process maps, skills, tool lists, plans)FMEA, fault tree, HAZOP, bow-tie, DRBFM, quality chain, control plan, SIPOC/turtle, RACI, hierarchy of controls, business impact analysis, hoshin kanri
Customer words (complaints, reviews, interviews)Kano model, QFD, APQP
Judgment and opinionsPre-mortem, SWOT, risk matrix, red team, force field, stakeholder analysis, Pugh (weights)
History (old reports, past projects)Lessons learned, after-action review, 8D step 7

If the tool needs data you don't have: collect it, or drop to a judgment tool and label the results as judgment. Never let a bot fill a data tool with invented numbers. See Don't make it up.

Common chains

Many jobs need tools in a sequence, each feeding the next.

JobChain
New productKano → QFD → APQP → FMEA → the quality chain → control plan
New botSIPOC/turtle → map the process → HAZOP on handoffs → FMEA → hierarchy of controls → control plan → evals → SPC
Problem that reached a customer8D: contain → Kepner-Tregoe → fishbone → 5 Whys → fix the cause → verify → lessons learned
Chronic problem80 percent line → DMAIC → design of experiments → control plan → SPC
Change to a working process or botDRBFM → lockout/tagout → change on purpose → verification → tester bot
Big decisionPugh → red team → pre-mortem on the winner → RAID log
Rolling out bots to a teamStakeholder analysis → force field → RACI → after-action review
Annual planningPESTLE and five forces → SWOT → hoshin kanri → management review

The full matrix

Plan tools mostly look ahead, Do tools run or guard the work, Check tools watch it, Act tools fix and improve. The bot drafts every one; the "Person" column is the part to keep for a human.

ToolAnswersPDCANeedsRigorPerson's part
Kano modelWhich wants matter, and how?PlanCustomer wordsLight–MedConfirm categories
QFD / House of QualityWhich specs deliver what customers want?PlanCustomer wordsHeavySet weights, judge strong links
APQPHow do we plan this to come out right?PlanCustomer words, specsHeavyReal voice of the customer, sign-off
The quality chainDoes every spec reach a check?PlanSpecs, FMEA, control planMediumSign off links
SIPOC and turtleWhat are the edges and needs of this process?PlanDocumentsLight–MedConfirm with the people who do it
Map the process / data and schemaWhat are the steps and handoffs?PlanDocumentsMediumAgree the map
Time, cost, qualityWhich side do we hold fixed?PlanJob descriptionLightChoose
Should-costWhat should this cost?PlanDrawing, rate tableMediumCheck routing and cycle times
Pugh / decision matrixWhich option?PlanEvidence per optionLight–MedSet weights first, decide
TRIZHow to beat a trade-off?PlanProblem statementMediumPick ideas to test
Monte CarloHow does uncertainty add up?PlanReal rangesHeavySupply inputs, accept risk
Pre-mortemHow could this fail?PlanPlan documentsLightPick the believable stories
Risk matrixWhere to look first?PlanJudgmentLightAdjust placements
SWOTWhere do we stand?PlanJudgment, researchLightCorrect it
PESTLE and five forcesWhat's changing outside?PlanSourced researchMediumRead the high-impact items
FMEAWhat could fail, how bad, how caught?PlanProcess or design documentsMed–HeavyReview severe rows, decide actions
The 80 percent lineWhich few items matter most?Plan/ActScores or countsMediumConfirm the line, severity first
Fault treeHow could the worst outcome happen?PlanSystem descriptionHeavyCheck gates, fix single points
Bow-tieHow do we prevent it and recover?PlanTools, barriers, backupsHeavyConfirm barriers are real
HAZOP guidewordsWhat if a handoff goes wrong?PlanProcess map with handoffsHeavyFix gaps with no safeguard
Machine-safety risk assessmentWhat can this bot touch, and how bad?PlanTool and access listHeavyAccept residual risk
Hierarchy of controlsStrongest way to control this hazard?Plan/DoTool and access listMed–HeavyRemove capabilities
Business impact analysisWhat if it disappears?PlanProcess map, suppliers, RACIMediumCorrect impacts, choose fallbacks
Stakeholder analysisWho's affected and who can stop it?PlanPlan, org chartLightAdd what you know about people
Force field analysisWhat pushes back?PlanNotes, commentsLightAdd the unspoken forces
RACIWho does, who decides?Plan/DoProcess, org chartMediumSettle conflicts; one A, a person
Hoshin kanriDoes all work connect to the goals?PlanStrategy, projects, KPIsHeavyCatchball
RAID logWhat are we assuming?DoNotes, emailLightConfirm or convert assumptions
Lessons learned searchHas this bitten us before?Plan/DoArchiveLightThrow out bad matches
Poka-yokeCan we make the mistake impossible?DoProcess, failure listMediumApprove the change
Nothing ships without a yesWho releases this?Do—AllSay yes
Lockout/tagoutIs it safe to work on?DoRoutine and access listMediumLock and unlock
E-stops and fail-safeCan we stop it, and does it fail safe?DoRoutines, settingsHeavyKnow the real off switch
Control planWhat do we check, how often, and what then?Do/CheckFMEA, specsMediumOwn the reaction plan
Verification and evalsDid it come out right? Does the bot do it right?CheckResults, test setMediumWrite known answers, review samples
Tester bot / internal auditDoes the bot follow its instructions?CheckTest scriptsMediumReview runs now and then
SPC and MSAHas it really changed? Can we trust the checker?CheckCounts over time; repeat verdictsHeavyReact to signals; supply known answers
Management reviewIs the whole system working?Check/ActRecords, tests, costsMediumMake the decisions
Value stream mappingWhere does work wait?CheckTimestampsMediumWalk the process once
5 WhysWhy did it happen?ActEvidenceLightCheck each why is real
FishboneWhat could be causing it?ActEvidenceMediumPick likely causes
Kepner-TregoeWhere is it, and where isn't it?ActRecordsMediumVerify the top cause
8DHow do we fix this and keep it fixed?ActComplaint, recordsHeavyContainment, sign-off
A3What's the problem and plan, on one page?ActFactsLightTake it to people, revise
DRBFMWhat does this change touch?Act/PlanBefore and after versionsMediumReview unexpected effects
Change on purposeIs this change approved and recorded?ActChange requestMediumApprove
PDCA / PDSADid the change do what we predicted?ActPrediction, resultsLightDecide: adopt, adapt, drop
Six Sigma DMAICHow do we cut a chronic problem?ActBaseline dataHeavyApprove fixes, own Control
Design of experimentsWhich factors actually matter?ActTest runsHeavyPick factors, run tests
Lean (waste, jidoka)Where's the waste? When do we stop?ActProcess, logsMediumDecide what to cut
After-action reviewWhat happened vs. the plan?ActPlan, recordsLightDiscuss why, decide next time
Red teamWhat's wrong with this?CheckThe planLight–MedAnswer the top objections

The selector bot brief

You are choosing an analysis tool. Do not run a tool yet.
Job: [description]. What's at stake: [money / customers / safety / legal / internal only].
Inputs available: [list files and data].
1. Name the situation from the "Step 1" table that fits best. If two fit, say both.
2. Set the rigor: Light, Medium or Heavy, using these rules: one-way door or
   severe harm = Heavy; customer, money or other teams = Medium; else Light.
   Severity overrides size. A recent change to the model or skills raises it one tier.
3. Check inputs against "Step 3". If a data tool's data is missing, say what to
   collect, or choose a judgment tool and label results as judgment.
4. Recommend the smallest set of tools that answers the question: usually one,
   at most three, in order. For each: why it fits, inputs it will use, what a
   person must do.
5. Say which tools you considered and rejected, in one line each.
6. Always include the lessons-learned search for new work.
For Heavy jobs, a person confirms the tool choice before you start.

Starting point only. Test it on your own data and model, and adjust as needed before you rely on it.

Where bots differ

People tend to under-analyze, because analysis is slow. Bots tend to over-analyze, because it's cheap and they were asked to be thorough. Both are waste. The selector's job is to pick the smallest tool that answers the question, and stop.

Bots also like tools that produce big, impressive tables. A three-line pre-mortem that finds the real risk beats a hundred-row FMEA nobody reads. See The analysis got cheap.

What this means for you

  • Put the selector brief at the top of any analysis skill.
  • Ask "what's the question?" before "which tool?"
  • Match the rigor to what's at stake.
  • Don't use a data tool without data.
  • Start small. Add tools only when the first one leaves a real question open.

Related