Logic
Confirmation Bias
Are you certain your beliefs are based on facts? Here's the bad news: your brain systematically distorts information to confirm what you already believe. The good news: understanding this mechanism is the first step toward more accurate thinking.
- **Investing:** investors read news that confirms their position and ignore warnings. The result: financial bubbles and crashes
- **Politics:** people choose media that agrees with their views and end up living in 'parallel realities' with different 'facts'
- **Science:** even scientists suffer from confirmation bias - this is why blind peer review and replication of experiments are necessary
The Tendency to Confirm
**Confirmation bias** - the tendency to search for, interpret, and remember information in a way that confirms pre-existing beliefs. It is one of the most powerful and universal cognitive biases.
**The Wason Experiment (1960):** Participants are shown the sequence: 2, 4, 6 Rule: 'the numbers follow some rule' Task: figure out the rule by proposing your own sequences Most try: 8, 10, 12 → 'Yes, correct' 20, 22, 24 → 'Yes, correct' And confidently conclude: 'The rule is even numbers increasing by 2' **But the actual rule was:** 'any ascending numbers' People never tried 1, 2, 3 or 5, 17, 99 - they only tested confirming examples.
**Evolutionary explanation:** in tribal societies, agreeing with the group mattered more than being correct. Anyone who constantly questioned the tribe's beliefs risked being cast out. The brain is optimized for social cooperation, not for objective truth-seeking.
A person believes coffee is harmful. They read an article: 'Scientists discover: coffee reduces the risk of Parkinson's disease.' What reaction is typical of confirmation bias?
Actively Seeking Confirmation
We don't just passively accept confirming information - we **actively seek it out**. This shows up in our choice of information sources, the way we frame questions, and even the social environment we create for ourselves.
**Echo chambers and filter bubbles:** • **Echo chamber:** a social environment where everyone agrees with each other. We choose friends with similar views and follow like-minded people. • **Filter bubble:** algorithms show content we'll enjoy (= that confirms our views). Google and Facebook personalize their results. **Result:** we live in an illusion of consensus - it seems like 'all reasonable people' think the way we do.
**Positive test strategy:** people prefer asking questions that will confirm a hypothesis rather than refute it. 'Do you like parties?' (if we think someone is an extrovert) instead of 'Do you enjoy spending time alone?' Both questions are informative, but the first *feels* more natural.
**Motivated reasoning:** when we are emotionally attached to a belief, we apply different standards. For confirming data we ask 'Can I believe this?', for contradicting data - 'Must I believe this?' The bar for 'must' is much higher.
You want to test the hypothesis 'my new employee is incompetent.' Which question avoids confirmation bias?
The Art of Disconfirmation
The antidote to confirmation bias is **actively seeking refutations**. Instead of asking 'What confirms my theory?' ask 'What could disprove it? Am I seeing that?'
**Strategies for overcoming confirmation bias:** 1. **Consider the opposite:** before making a decision, spend time developing arguments against it 2. **Pre-mortem:** imagine the decision has failed. Why? What went wrong? 3. **Devil's advocate:** appoint someone whose role is to criticize the idea 4. **Red team:** a team that tries to find vulnerabilities (in security plans, in strategy) 5. **Steelman:** before criticizing an opponent, strengthen their argument to its maximum
**Pre-mortem** is a powerful technique for planning. Instead of 'How will our project succeed?' ask 'It's one year later, and the project has failed. Write the story of its failure.' People generate risks that simply don't come to mind during positive thinking.
**Important:** these techniques only work if applied *sincerely*. A formal 'consideration of alternatives' without a genuine desire to find the truth is theater, not critical thinking.
A team is planning a product launch. Everyone is confident it will succeed. Which technique best reveals hidden risks?
Intellectual Honesty
**Intellectual honesty** - the willingness to update beliefs when confronted with contradicting evidence. This is not weakness or inconsistency. It is a sign that truth matters more than ego.
**Signs of intellectual honesty:** • You can name a fact that would change your mind • You acknowledge when an opponent makes a good argument • You distinguish between 'I don't know' and 'nobody knows' • You quote opponents accurately, not in caricature • You don't apply different standards to 'your side' versus 'their side' • You are willing to say 'I was wrong'
**Updating as a skill:** the best forecasters (superforecasters) constantly revise their estimates when new information arrives. They don't cling to forecasts for the sake of consistency. Changing your mind is not weakness - it's a sign that you are learning.
**The consistency trap:** people value 'principled' thinkers - those who never change their mind. But this creates pressure not to update beliefs even when it's necessary. Politicians are especially vulnerable: admitting an error is perceived as weakness, even though it is intellectual strength.
Changing your mind is a sign of weakness and inconsistency
Changing your mind in response to new data is a sign of intellectual honesty and strength
The world is complex and information is incomplete. Someone who never changes their mind either was correct about everything from the start (unlikely) or is ignoring contradicting evidence (confirmation bias). Updating beliefs is learning, and the ability to learn is strength, not weakness.
Which of the following is NOT a sign of intellectual honesty?
Key Takeaways
- **Confirmation bias** operates on three levels: information search, interpretation, and memory
- **Echo chambers and filter bubbles** amplify the effect - we live in an illusion of consensus
- **Techniques to counter it:** consider the opposite, pre-mortem, devil's advocate, steelman
- **Intellectual honesty** - the willingness to update beliefs when new data arrives
Related Topics
Confirmation bias is connected to probabilistic thinking and critical source evaluation:
- Bayes' Theorem — Bayesian updating - a formal model of how beliefs should be revised
- Falsifiability — The scientific method is specifically designed to overcome confirmation bias
Вопросы для размышления
- Think of a belief you hold with great confidence. What could refute it? Have you ever actually looked for such refutations?
- Evaluate your information sources (media, blogs, friends). How diverse are they in terms of viewpoints?
- When was the last time you said 'I was wrong'? How hard was it?