03 / 08Systems

Make it a checklist

Some mistakes happen more to experienced people than to beginners. The step everyone knows, done a hundred times, is the one that slips on a busy day. Leaving for the airport without a passport. Uploading a lab report without the data table. Sending an invoice without the order number. Memory handles the hard parts of a routine well and drops the dull ones, most of all under pressure or after an interruption. A checklist holds the dull parts on paper so attention can go to the rest. A good one is short. It lists the steps that are easy to skip and costly to miss. It has a set moment when it gets read: before takeoff, before the first cut, before pressing send. This lesson turns one routine into a checklist and tests it.

In five minutesThink of the last time a routine went wrong. Write the step that got missed on a sticky note, and put the note where the routine starts: the front door, the laptop, the folder.

Method · Checklist  /  Aviation · Medicine

↺From last time · Break it into parts

Answer these from memory before you start. Tap to check.

When do you stop breaking a piece down?

When it fits one sitting and the first move is obvious. Descartes's second rule holds the same limit: as many parts as the solution needs, and no more.

Why test each level against the one above it?

Splitting can drop a piece into the cracks. Asking whether all the parts would finish the whole catches the missing bibliography or change of address before the deadline does.

Why name each piece as a result with a verb?

"Section 2" leaves the action open every time you look at it. "Draft section 2" says what to do, and how to tell when it is done.

01Where it comes from

On October 30, 1935, Boeing's Model 299, the prototype of the B-17 bomber, crashed on takeoff at Wright Field in Ohio [1]. The Army board traced it to the elevator control, still held by its internal lock. The pilot, Major Ployer P. Hill, and Boeing's chief test pilot, Leslie Tower, died of their injuries. The board judged it unlikely any pilot would have found the locked controls in time. The Air Corps then developed checklists for takeoff, flight, before landing and after landing. Lists like this existed in scattered form before, including a 1918 squadron guide to the Bristol Fighter. The crash made them standard [1]. Medicine took up the idea much later. A program in Michigan intensive care units reported results in 2006 [2], and the World Health Organization's 19-item surgical checklist was tested in eight countries in 2009 [3]. Atul Gawande, a surgeon on that study, tells both stories in The Checklist Manifesto (2009) [4].

Also called Preflight checklist, surgical safety checklist, read-do checklist, do-confirm checklist.

02The method

Checklist

  1. Pick one routine you repeat where a skipped step costs something: a lab write-up, a weekly report, packing for a trip.
  2. List every step. Cross out the ones no one ever forgets. Keep the steps that are easy to skip and costly to miss.
  3. Cut the list to five to nine lines, each a short check: "Data table attached."
  4. Choose the pause point, the moment the list gets read: before uploading, before leaving, before the meeting starts.
  5. Choose the style. Read each line and then do it, or do the work from memory and read the list after to confirm.
  6. Use it five times. Cut lines that never catch anything, and add any step that was missed.

03An example

What it looks like done

Worked on Two routines: uploading a lab report for an introductory chemistry course, and leaving for a two-day work trip

What this checklist is for

  • Lab report. Read at the pause point, the minute before uploading. Do the work from memory, then read the list to confirm.

Checklist

  • Units on every column of the data table
  • One sample calculation shown for each formula
  • Error analysis paragraph included
  • Figures numbered, with captions
  • Citations in the course's required style
  • File named Lastname_Lab4.pdf
  • Under the six-page limit

What this checklist is for

  • Leaving for the trip. Read at the front door, each line read and then done.

Checklist

  • ID in the bag
  • Laptop, charger and badge
  • Medication for the trip plus two days
  • Stove off, back door locked
  • Trash out

After five uses

  • Lab list: "Figures numbered" never caught anything. Cut it. Lab 3 lost points for a missing title page. Added "Title page with section number".

04Try it · 20 minutes

For a class

Write a submission checklist for your next lab report, problem set or essay. Go through the assignment sheet and the comments on your last graded piece. Keep five to nine lines that are easy to miss: a rubric item, the citation style, the file name, the page limit. Set the pause point as the minute before you upload. Use it on this assignment and the next. About 20 minutes.

For work and life

Pick a routine that has gone wrong before: a weekly report, a handoff to a client, closing up a shop, leaving for a work trip. Write five to nine lines for the steps that get skipped. Decide when it gets read and who reads it. With two people, one reads each line aloud and the other confirms. Use it for two weeks, then cut and add.

The blank page for this is in the Systems workbook.

05Where it goes wrong

  • Too long. A list of thirty lines gets skimmed or skipped. Keep the steps that are easy to miss, and leave the rest to skill.
  • Ticking without looking. A box marked from habit keeps the paper and loses the check. Look at the thing, then mark it.
  • No pause point. A list meant for "sometime" rarely gets read. Tie it to one moment in the routine.
  • Handed down, not owned. In Ontario, checklists adopted under a provincial policy did not change outcomes. In Michigan, each unit wrote its own version and nurses could stop a procedure that skipped a step.

06Research

What research has measured

Surgical checklists

Shown in before-and-after studies to be linked with fewer deaths and complications after surgery, though no high-quality trial confirms it.

The numbers and sources
Effect
In eight hospitals in eight countries, deaths fell from 1.5% to 0.8% and inpatient complications from 11.0% to 7.0% after the 19-item checklist came in [3]. A meta-analysis of seven studies found risk ratios of 0.59 for any complication, 0.77 for death and 0.57 for surgical-site infection. Larger drops went with closer adherence to the care the checklist names [5].
Population
3,733 patients before and 3,955 after in the eight-hospital study [3]. Seven of 723 screened studies in the meta-analysis [5].
Caveats
A before-and-after design cannot separate the checklist from other changes made at the same time. The meta-analysis found marked differences in methods between studies, and called its evidence suggestive, not definitive [5].

When a checklist is required

One large study found that after Ontario hospitals adopted surgical checklists under a provincial policy, deaths and complications did not fall significantly.

The numbers and sources
Effect
Across 101 hospitals, adjusted operative deaths were 0.71% before and 0.65% after adoption (odds ratio 0.91, P = 0.13). Complications were 3.86% before and 3.82% after (P = 0.29) [6].
Population
109,341 procedures in the three months before adoption and 106,370 in the three months after [6].
Caveats
The comparison covered three months on each side of adoption. Administrative data show whether a hospital adopted a checklist, not how its teams used it.

A checklist inside a larger program

One study found bloodstream infections from central lines in Michigan ICUs fell by up to 66% under a program built around a checklist, nurse oversight and shared infection data.

The numbers and sources
Effect
The mean infection rate per 1,000 catheter-days fell from 7.7 at baseline to 1.4 at 16 to 18 months [2]. A later analysis of the program argued that the checklist worked through people: nurses watched each insertion and could stop it, units wrote their own versions, and infection rates were fed back to every unit [7].
Population
103 ICUs, mostly in Michigan, with 375,757 catheter-days [2].
Caveats
No control group. The program combined a checklist with staff education, a stocked supply cart, monthly team meetings and data feedback, so the checklist's own share is unknown [2][7].

07Check yourself

Answer from memory first. The next lesson asks these again.

Why leave the easy steps off a checklist?

A long list gets skimmed, and the lines that matter drown. A checklist holds the steps that are easy to skip and costly to miss. Skill and habit handle the rest.

What does the pause point do?

It fixes the moment the list gets read, so reading it becomes part of the routine. A list without a set moment gets read when someone remembers, which is rarely when it is needed.

Why did checklists help in some hospitals and not others?

Results tracked how the lists were used. In Michigan, units wrote their own and nurses could stop a procedure. In Ontario, adoption under a policy showed no significant change.

Sources
  1. Boyne WJ. The checklist. Air Force Magazine. August 2013:52-56. https://www.airandspaceforces.com/MagazineArchive/Documents/2013/August%202013/0813checklist.pdf
  2. Pronovost P, Needham D, Berenholtz S, et al. An intervention to decrease catheter-related bloodstream infections in the ICU. New England Journal of Medicine. 2006;355(26):2725-2732. https://doi.org/10.1056/NEJMoa061115
  3. Haynes AB, Weiser TG, Berry WR, et al. A surgical safety checklist to reduce morbidity and mortality in a global population. New England Journal of Medicine. 2009;360(5):491-499. https://doi.org/10.1056/NEJMsa0810119
  4. Gawande A. The Checklist Manifesto: How to Get Things Right. Metropolitan Books; 2009. first edition
  5. Bergs J, Hellings J, Cleemput I, et al. Systematic review and meta-analysis of the effect of the World Health Organization surgical safety checklist on postoperative complications. British Journal of Surgery. 2014;101(3):150-158. https://doi.org/10.1002/bjs.9381
  6. Urbach DR, Govindarajan A, Saskin R, Wilton AS, Baxter NN. Introduction of surgical safety checklists in Ontario, Canada. New England Journal of Medicine. 2014;370(11):1029-1038. https://doi.org/10.1056/NEJMsa1308261
  7. Dixon-Woods M, Bosk CL, Aveling EL, Goeschel CA, Pronovost PJ. Explaining Michigan: Developing an ex post theory of a quality improvement program. Milbank Quarterly. 2011;89(2):167-205. https://doi.org/10.1111/j.1468-0009.2011.00625.x

MVIII puts the day in front of you each morning. Get MVIII