05 / 08Think

Common traps

A movie ticket is already paid for and the film is bad, and walking out feels like wasting the money. A friend's car broke down twice, so the whole brand seems unreliable, whatever the repair figures say. A first impression of a new coworker forms, and after that mostly the things that fit it get noticed. None of these marks one careless mind. They show up across people, in the same direction, which is why researchers can study them. In a class they show up in reading only the sources that back a thesis. At work they show up in a project kept alive because of what it already cost. This lesson names three, gives each a check, and says plainly how far the checks reach.

In five minutesBefore your next purchase over $50, or the next renewal, ask one question out loud: "If I were starting fresh today, with nothing already spent, would I still choose this?"

Method · Cognitive biases  /  Research psychology · Philosophy

↺From last time · The other side at its strongest

Answer these from memory before you start. Tap to check.

Why answer the strongest version of a view and not the one most people state?

Beating a weak version leaves the strong one standing, and its holders unpersuaded. A reply that survives the best case is worth more, and you learn what the view actually gets right.

Why check your version with someone who holds the view?

A version built from the outside often misses the reason that matters most to its holders. If they would sign it, you have their case. If not, they will tell you what's missing.

Why does being smart not protect against favoring your own side?

In the studies, myside bias had little relation to intelligence. Skill at arguing can build a better case for what you already think. Practice at stating the other side is a separate habit.

01Where it comes from

Francis Bacon described these errors in 1620, in the Novum Organum. He called them idols: false images the mind sets up for itself. The first group, the idols of the tribe, he traced to human nature itself (see Voices). Modern research named them one at a time. Peter Wason's 1960 rule-finding task studied how people test their own guesses [1], and Raymond Nickerson's 1998 review gathered the evidence for confirmation bias [2]. Amos Tversky and Daniel Kahneman described availability in 1973: judging how often something happens by how easily examples come to mind [3]. Hal Arkes and Catherine Blumer showed the sunk cost effect in 1985, in experiments that included theater season tickets sold at randomly assigned discounts [4]. In 2015 Carey Morewedge and colleagues tested whether short training could reduce biases, and the honest answer since then has been: partly [5].

Also called Confirmation bias, sunk cost fallacy, availability heuristic, Bacon's idols, debiasing.

Drawing all things to agree

The human understanding when it has once adopted an opinion (either as being the received opinion or as being agreeable to itself) draws all things else to support and agree with it. And though there be a greater number and weight of instances to be found on the other side, yet these it either neglects and despises, or else by some distinction sets aside and rejects

Francis Bacon, Novum Organum Book I, aphorism 46. Works, volume IV, page 56 · tr. James Spedding

Bacon is describing the idols of the tribe, errors rooted in human nature itself. Next he tells of a man shown paintings of sailors who prayed and survived a shipwreck, who asked where the paintings were of those who prayed and drowned. Bacon wrote in Latin in 1620. The psychologists who tested "consider the opposite" in 1984 credited him with first noting the failure they were correcting.

Read it in full

What strikes the mind suddenly

The human understanding is moved by those things most which strike and enter the mind simultaneously and suddenly, and so fill the imagination; and then it feigns and supposes all other things to be somehow, though it cannot see how, similar to those few things by which it is surrounded.

Francis Bacon, Novum Organum Book I, aphorism 47. Works, volume IV, pages 56 to 57 · tr. James Spedding

The next aphorism describes judging the world by the few vivid things in view. Tversky and Kahneman measured a version of it in 1973 and called it availability. Bacon adds that the slow work of testing an idea against distant, different cases is something the mind avoids unless rules force it. A written check that asks for a count is one such rule.

Read it in full

02The method

Cognitive biases

  1. Before a decision you care about, write the decision and your current leaning in one line.
  2. Confirmation check: write what evidence would count against your leaning. Spend a few minutes looking only for that.
  3. Sunk cost check: ask, "If I were starting fresh today, with nothing spent, would I choose this?" Decide on what comes next, not on what is gone.
  4. Availability check: for any vivid example you are relying on, look up how often it actually happens. Use a count, not a memory.
  5. Run all three as a written checklist, every time, and keep the list where you make decisions.

03An example

What it looks like done

Worked on Whether to renew a language-learning app subscription, $90 a year, used twice in the last two months

What this checklist is for

Deciding whether to renew before the auto-charge on the 30th.

The checklist

  • Decision and leaning: renew. I've already put a year into it.
  • Evidence against: app history shows 2 sessions in 60 days. Before that, about 3 a week.
  • Fresh start: with nothing spent, would I pay $90 today for something I used twice in two months? No.
  • What I'd lose is the streak and the year of progress. The progress is in my head, not the app. The streak is a sunk cost.
  • Vivid example: a friend got fluent with this app. One case. I don't know how many people quit it.
  • Decision: cancel the renewal. Use the free tier for a month. Resubscribe if I'm back to 3 sessions a week.

04Try it · 20 minutes

For a class

Take a research paper or essay you're writing. Fifteen minutes. List your sources and mark each as supporting or challenging your thesis. If the challenging column is short, search for two sources that disagree and read their abstracts. Then find one vivid example you used and check how typical it is against a figure from a reliable source.

For work and life

Pick a decision on the table: keep a subscription, continue a project, buy a certain car brand. Run the three checks on paper. Write the evidence against your leaning and look for it. Ask whether you would choose it fresh today. Replace one vivid story with a count. Note whether your leaning changed, and which check moved it.

The blank page for this is in the Think workbook.

05Where it goes wrong

  • Spotting traps only in others. Each of these is easy to see in someone else's reasoning. Run the checks on your own leaning, and on views you share with the people around you.
  • Naming the bias as the argument. Calling a view "confirmation bias" does not show it is wrong. Look at the evidence.
  • Learning names, skipping checks. Knowing a list of biases is not the same as checking for them. A written list used at the moment of decision does the work.
  • Ignoring what past costs taught. Money spent is gone. What it taught is not. A project that ran over budget may say something true about the next phase.
  • Expecting a cure. Training reduced some biases for weeks or months in studies. Nothing shows they disappear. Keep the checklist.

06Research

What research has measured

Confirmation bias

Shown that people tend to seek out and interpret evidence in ways that favor what they already believe or expect.

The numbers and sources
Effect
A review gathered evidence of the bias in many guises, from laboratory hypothesis testing to practical settings, and weighed possible explanations for it [2].
Population
A narrative review of many studies. It does not pool participants [2].
Caveats
A narrative review, not a meta-analysis, so it gives no single effect size. Nickerson also asks when the tendency is useful as well as harmful [2].

The pull of what's already spent

Shown that money already spent makes people more likely to keep going with a course of action, by amounts that depend on the kind of decision.

The numbers and sources
Effect
A meta-analysis of 98 effect sizes found clear evidence of the sunk-cost effect. In decisions about using something already paid for, it weakened as time passed. Older adults showed it less than younger adults [6].
Population
98 effect sizes from studies of money already spent [6].
Caveats
Only monetary sunk costs were pooled, not time or effort. The size of the effect varied with the type of decision [6].

Training against biases

Training reduced some biases for at least two months in tests, but evidence that it carries over to real decisions is still thin.

The numbers and sources
Effect
One-shot training reduced measured biases, including confirmation bias, by at least 31.94% for games and 18.60% for videos right away, and by at least 23.57% and 19.20% two months later [5]. Graduate students trained before an unannounced business case were 19% less likely to pick the inferior, confirming solution [7]. A systematic review found only 12 studies that properly tested retention and one that tested transfer, and judged the evidence insufficient for real-life benefit [8]. An analogy-based training improved only statistical reasoning tasks four weeks later [9].
Population
Two longitudinal experiments [5]. 290 graduate students in three professional programs [7]. 12 studies [8]. 154 participants [9].
Caveats
Most retention studies used similar computer games from a few research groups [8]. The field study relied on natural variation in training dates, not random assignment [7].

07Check yourself

Answer from memory first. The next lesson asks these again.

Why ask whether you'd choose something fresh today?

Money and time already spent are gone whatever you choose next. The fresh-start question takes them off the scale, so the decision rests on what each option will cost and give from here.

Why look up a count instead of trusting a vivid example?

Vivid cases come to mind easily, and how easily something comes to mind feels like how often it happens. A count measures how often it actually happens.

Why use a written checklist if you already know the names of the biases?

Knowing the names doesn't run the checks, and training effects carry over to real decisions only partly. A list used at the moment of deciding does the checking whether or not you remember to.

Sources
  1. Wason PC. On the failure to eliminate hypotheses in a conceptual task. Quarterly Journal of Experimental Psychology. 1960;12(3):129-140. https://doi.org/10.1080/17470216008416717
  2. Nickerson RS. Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology. 1998;2(2):175-220. https://doi.org/10.1037/1089-2680.2.2.175
  3. Tversky A, Kahneman D. Availability: A heuristic for judging frequency and probability. Cognitive Psychology. 1973;5(2):207-232. https://doi.org/10.1016/0010-0285(73)90033-9
  4. Arkes HR, Blumer C. The psychology of sunk cost. Organizational Behavior and Human Decision Processes. 1985;35(1):124-140. https://doi.org/10.1016/0749-5978(85)90049-4
  5. Morewedge CK, Yoon H, Scopelliti I, Symborski CW, Korris JH, Kassam KS. Debiasing decisions: Improved decision making with a single training intervention. Policy Insights from the Behavioral and Brain Sciences. 2015;2(1):129-140. https://doi.org/10.1177/2372732215600886
  6. Roth S, Robbert T, Straus L. On the sunk-cost effect in economic decision-making: A meta-analytic review. Business Research. 2015;8(1):99-138. https://doi.org/10.1007/s40685-014-0014-8
  7. Sellier AL, Scopelliti I, Morewedge CK. Debiasing training improves decision making in the field. Psychological Science. 2019;30(9):1371-1379. https://doi.org/10.1177/0956797619861429
  8. Korteling JE, Gerritsma JYJ, Toet A. Retention and transfer of cognitive bias mitigation interventions: A systematic literature study. Frontiers in Psychology. 2021;12:629354. https://doi.org/10.3389/fpsyg.2021.629354
  9. Aczel B, Bago B, Szollosi A, Foldes A, Lukacs B. Is it time for studying real-life debiasing? Evaluation of the effectiveness of an analogical intervention technique. Frontiers in Psychology. 2015;6:1120. https://doi.org/10.3389/fpsyg.2015.01120

MVIII puts the day in front of you each morning. Get MVIII