Does the Cognitive Reflection Test measure math or intuition?
The Cognitive Reflection Test predicts better decisions because it measures math skills, not because it measures the ability to override intuitive errors.
Source
Cognitive reflection vs. calculation in decision making
What they did
Researchers analyzed data from internet surveys with 1413 and 1478 participants to separate the Cognitive Reflection Test into distinct skills: catching intuitive errors and calculating the correct math answers. They measured participants' math abilities, general intelligence, decision-making biases (such as framing effects and conjunction fallacies), and real-world financial choices. By statistically separating these skills, they tested which one actually predicts logical decision-making and better financial outcomes.
What they found
The statistical model revealed that mathematical calculation ability, rather than the ability to detect intuitive traps, was the primary driver behind better decision-making performance. Across the studies, higher calculation scores and general numeracy scores predicted fewer decision biases, whereas intuitive-error detection had no independent predictive power. Furthermore, only general numeracy predicted positive real-world financial outcomes, such as saving for retirement and paying bills on time.
The limits
What it doesn't show
The study relies on self-reported financial outcomes, which may be subject to memory errors or social desirability bias. Because the research is correlational, it cannot prove that high mathematical ability directly causes better decision-making or financial success. Additionally, the decision-making tasks used in the lab might not fully capture how people make intuitive or calculated choices in highly stressful, real-world environments.
Key terms
- Cognitive Reflection
- The tendency to override automatic, intuitive gut-responses in order to engage in more deliberate, analytical thinking.
- Dual-Systems Theory
- A cognitive framework proposing that human decision-making relies on distinct processing modes, with some being fast and intuitive, and others being slow and deliberative.
- Numeracy
- An individual's capacity to understand, reason with, and apply numerical concepts and mathematical operations.
- Conjunction Fallacy
- A cognitive bias where a person mistakenly judges a specific, combined condition to be more likely than a general one.
- Framing Inconsistency
- A decision-making error where a person makes different choices depending on whether the options are presented as potential gains or losses.
- Intertemporal Choice
- Decisions that involve trade-offs between immediate costs or benefits and those that occur in the future.
Flashcards
Want these cards to stick?
Save the deck to NoteFren and study it with spaced repetition.
Quiz yourself
What is the Cognitive Reflection Test (CRT) historically thought to measure?
Common questions
Why is the bat-and-ball problem so famous in cognitive psychology?
It is the classic example of a problem that triggers an immediate, incorrect intuitive answer that must be actively overridden using basic algebra to find the correct answer.
Does this mean the Cognitive Reflection Test is just a math test?
Yes, these findings suggest that the test's ability to predict smart decision-making comes almost entirely from measuring mathematical computation skills rather than a unique mental ability to double-check gut instincts.
How did the researchers separate math skills from the ability to check intuition?
They used a statistical model that categorized incorrect answers into intuitive errors and non-intuitive math errors, allowing them to score both skills separately.
Did general intelligence explain these findings?
No, even after controlling for general intelligence and demographics, specific mathematical skills remained significant predictors of fewer decision-making biases.
More on Decision making