Advertisement

Delusional Optimism vs Metacognition

Can thinking increase the probability of reality?

A philosophical and psychological question runs through these arguments: when does confidence create possibilities, and when does it distort reality?

The strongest position, I would argue, is neither that thoughts magically become things nor that optimism is inherently delusional. Thoughts can shift the probability of outcomes, but only through cognition, attention, decision-making, behaviour and interaction with the environment.

The key distinction is between believing that something will happen and understanding how to make it more likely.

1Thoughts become things: what is scientifically defensible?

The claim that everything humans create was once a thought is essentially correct, though it needs qualifying. A lamp, a chair, a scientific instrument or a new technology each begins as a mental representation of something that does not yet exist in finished form.

This links to mental simulation, prospective cognition and intentional action. Humans can represent possible future states, evaluate them, and organise behaviour to bring chosen possibilities into being. But each step in that chain does different work:

• Thinking about something creates a mental representation.
• Believing it is achievable can strengthen motivation.
• Planning supplies a sequence of actions.
• Acting changes the conditions under which the outcome becomes possible.
• Environmental constraints determine whether it can actually occur.

Thoughts, then, do not automatically become things. They become causal components in the processes that make things possible.

Taylor, Pham, Rivkin and Armor (1998), writing in American Psychologist, showed that mental simulation helps people develop plans, regulate emotions and begin solving problems. Imagining the process of reaching a goal can contribute to real progress.

Pham and Taylor (1999), in Personality and Social Psychology Bulletin, found that students who mentally rehearsed how they would prepare for an exam studied more effectively and performed better. The effect was partly explained by better planning and lower anxiety.

Imagination does not replace physical causation. It organises it.

2Delusional optimism versus metacognition

Delusional optimism means holding excessively positive expectations despite insufficient or contradictory evidence. Metacognition means monitoring and evaluating one's own thinking. The contrast is sharp:

Delusional optimism	Metacognitive optimism
I know it will happen.	I have reasons to believe it can happen.
Failure is impossible.	Failure is a possibility I must account for.
Contrary evidence is dismissed.	Contrary evidence changes my assessment.
Confidence replaces investigation.	Confidence motivates investigation.
The desired outcome is assumed.	The desired outcome is pursued strategically.

The difference is not how optimistic someone is. It is whether their confidence is calibrated against the evidence available.

Fleming (2024), in the Annual Review of Psychology, explains that metacognitive confidence involves judging the reliability of one's own judgments, and that subjective confidence and actual accuracy often diverge. Someone can be extremely confident and profoundly wrong.

Shepperd et al. (2015), in Current Directions in Psychological Science, reviewed the evidence on unrealistic optimism. People routinely underestimate their chances of negative outcomes and overestimate their chances of positive ones.

Optimism, therefore, is not in itself evidence of superior thinking. The real question is whether it stays responsive to reality.

3Increasing the probability distribution

One argument deserves particular attention:

"I hold something in mind and know that it can be so, it will be so. Often it comes to pass. It's not magic. It's increasing the probability distribution."

There is a scientifically interesting reading of this. Imagine someone setting out to build a successful business. Their initial chances depend on many variables:

• Knowledge and competence
• Available resources
• Social networks
• Market conditions
• Timing
• Decision-making
• Persistence
• External circumstances

Now add a strong mental representation of the desired outcome. That representation shapes how the person allocates attention, spots opportunities, weighs risks and makes decisions. As a result, the probability of success may change. Conceptually:

P(O | I, A, E) > P(O | E)

where O is the desired outcome, I the intention or mental representation, A the actions shaped by that intention, and E the environmental conditions.

This is a conceptual expression, not a universal law. It shows how intention-mediated behaviour can alter the likelihood of an outcome. The mental representation does not change external probabilities on its own; it works through the mechanisms that connect cognition to action.

There is also a feedback loop:

Imagination → Expectation → Attention → Action → Feedback → Revised expectation → Further action

This helps explain why some optimistic expectations become self-fulfilling.

Meta-analytic research supports the general point. A systematic review and multilevel meta-analysis by Cole, Smith, Ragan, Suurmond and Armitage (2021), in Psychonomic Bulletin & Review, pooled 123 effect sizes from 5,685 participants and found a significant positive effect of mental simulation on behaviour change (Hedges' g = 0.49).

Not all imagination is equally useful, however. What matters is the nature and purpose of the simulation, and especially the difference between imagining the desired outcome and rehearsing the process of achieving it.

4The third-variable problem: what actually makes things work?

The argument about intelligence raises another issue. Suppose two people imagine the same outcome, and only one achieves it. Can we conclude that optimism made the difference?

Not necessarily. Third variables may be at work:

• Prior knowledge
• Cognitive ability
• Access to resources
• Experience
• Social advantages
• Risk assessment
• Environmental opportunities

This is a problem of causal inference. A correlation between optimism and success does not show that optimism caused the success.

Intelligence, too, is more than solving complex problems. It involves identifying relevant variables, recognising relationships, building mental models, testing predictions and adapting when reality contradicts expectation. A useful working definition:

Intelligence is the ability to comprehend complex relationships and apply that understanding to produce reasonably predictable outcomes.

Predictive accuracy matters here. Someone who consistently makes successful predictions demonstrates something stronger than someone who constructs impressive explanations after the fact.

This also bears on the relationship between intelligence and knowledge. Knowing more does not mean understanding how that information interacts. The person who recognises the most important variables is often better placed to solve a problem than the one who holds the most facts.

5Is intuitive pattern recognition higher than metacognition?

This may be the most interesting proposition, and it deserves serious consideration. I would distinguish three processes:

Pattern recognition

The brain identifies regularities, relationships and recurring structures in the information available.

Metacognition

The individual monitors their own thinking, evaluates their confidence and recognises possible errors.

Intuitive pattern recognition

The individual rapidly identifies meaningful relationships without being able to articulate every intermediate step.

This third process is central to expertise. An experienced physician may recognise a diagnostic pattern before consciously naming the features that triggered it. A strong chess player may see a strategically important position without calculating every move.

Klein's (2008) research on naturalistic decision-making describes how experienced professionals use recognition-primed decisions in complex environments. Pachur et al. (2011), in Frontiers in Psychology, showed that the recognition heuristic can be an effective strategy when recognition is ecologically valid.

Still, I would challenge the idea that intuitive pattern recognition is a higher form of metacognition. They do different jobs. Intuition identifies patterns; metacognition evaluates the reliability of the processes producing those judgments. Without metacognitive monitoring, intuition can become an efficient engine for confident mistakes.

Simmons and Nelson (2006), in the Journal of Experimental Psychology: General, showed that confidence in intuitive judgments can drive decisions even when that confidence does not track greater accuracy.

Perhaps the more advanced capacity is the integration of intuitive pattern recognition, analytical reasoning and metacognitive calibration. That combination lets someone recognise a pattern, grasp its significance, question its reliability and revise their conclusions.

6A reverse Murphy's Law?

Murphy's Law is popularly stated as: anything that can go wrong will go wrong. A psychological counterpart might be:

Anything that can reasonably go right becomes more achievable when we recognise the conditions that make it possible and deliberately work towards them.

But positive thinking and probabilistic thinking are not the same. Positive thinking focuses on the desired outcome. Probabilistic thinking examines the conditions that make that outcome more or less likely, and it is considerably more useful.

Gollwitzer and Sheeran (2006), in a meta-analysis published in Advances in Experimental Social Psychology, examined 94 independent tests of implementation intentions. Forming specific if-then plans had a medium-to-large positive effect on goal attainment (d = 0.65). For example:

If I encounter this particular obstacle, I will take this particular action.

Such plans turn an abstract intention into an actionable strategy. Optimism becomes productive when it is tied to mechanisms of execution.

7The child who believes the universe revolves around them

The final observation draws on developmental psychology. Children show developmental forms of egocentric thinking, though Piaget's concept of egocentrism should not be confused with selfishness or an inability to learn. Through experience, social interaction and cognitive development, children grow better at distinguishing their own perspective from others'.

Adults, however, do not outgrow every form of cognitive egocentrism. Some continue to believe that their intuitions are inherently reliable, that their expectations predict reality, or that contradictory evidence must be mistaken.

This is where metacognition becomes essential. Intelligence is not only the ability to generate possibilities; it is also the ability to recognise when our preferred possibilities conflict with reality. The irony is that a person can grow ever more knowledgeable while remaining unaware of the limits of their own thinking.

8The deeper philosophical conclusion

I would put the central argument this way:

Imagination generates possibilities. Intuition recognises patterns. Intelligence evaluates relationships. Metacognition monitors the reliability of our judgments. Action turns selected possibilities into actual outcomes.

None of these alone guarantees success. Together, they offer a powerful account of how human beings can shape their futures. Several distinctions are worth keeping:

• Delusional optimism assumes reality must conform to expectation.
• Rational optimism recognises that reality can be influenced by deliberate action.
• Metacognition recognises that our understanding of reality may itself be mistaken.
• Intuitive pattern recognition lets us see relationships that step-by-step reasoning might miss.

The highest form of confidence, then, may not be believing that something will happen. It may be understanding why it could happen, what conditions would bring it about, what could prevent it, and what must change when the evidence shows our prediction is wrong.

Imagination is not only the faculty by which we represent things that do not yet exist. It is also how we explore possible relationships between things that do. That makes it central not just to creativity but to scientific discovery, prediction and problem-solving.

The ultimate challenge is distinguishing a possibility the mind can construct from one the world can actually sustain.

References

1. Cole, S. N., Smith, D. M., Ragan, K., Suurmond, R., & Armitage, C. J. (2021). Synthesizing the effects of mental simulation on behavior change: Systematic review and multilevel meta-analysis. Psychonomic Bulletin & Review, 28, 1514–1537. https://doi.org/10.3758/s13423-021-01880-6
2. Fleming, S. M. (2024). Metacognition and confidence: A review and synthesis. Annual Review of Psychology, 75, 241–268. https://doi.org/10.1146/annurev-psych-022423-032425
3. Gollwitzer, P. M., & Sheeran, P. (2006). Implementation intentions and goal achievement: A meta-analysis of effects and processes. Advances in Experimental Social Psychology, 38, 69–119. https://doi.org/10.1016/S0065-2601(06)38002-1
4. Klein, G. (2008). Naturalistic decision making. Human Factors, 50(3), 456–460. https://doi.org/10.1518/001872008X288385
5. Pachur, T., Todd, P. M., Gigerenzer, G., Schooler, L. J., & Goldstein, D. G. (2011). The recognition heuristic: A review of theory and tests. Frontiers in Psychology, 2, 147. https://doi.org/10.3389/fpsyg.2011.00147
6. Pham, L. B., & Taylor, S. E. (1999). From thought to action: Effects of process- versus outcome-based mental simulations on performance. Personality and Social Psychology Bulletin, 25(2), 250–260. https://doi.org/10.1177/0146167299025002010
7. Shepperd, J. A., Waters, E. A., Weinstein, N. D., & Klein, W. M. P. (2015). A primer on unrealistic optimism. Current Directions in Psychological Science, 24(3), 232–237. https://doi.org/10.1177/0963721414568341
8. Simmons, J. P., & Nelson, L. D. (2006). Intuitive confidence: Choosing between intuitive and nonintuitive alternatives. Journal of Experimental Psychology: General, 135(3), 409–428. https://doi.org/10.1037/0096-3445.135.3.409
9. Taylor, S. E., Pham, L. B., Rivkin, I. D., & Armor, D. A. (1998). Harnessing the imagination: Mental simulation, self-regulation, and coping. American Psychologist, 53(4), 429–439. https://doi.org/10.1037/0003-066X.53.4.429