Decision making
Does the Cognitive Reflection Test measure math or intuition?
Open access · cc by · source: Europe PMC
The Cognitive Reflection Test predicts better decisions because it measures math skills, not because it measures the ability to override intuitive errors.
How this study connects
Role on claims
Each row is a claim on a concept or method page where this paper supports, challenges, or qualifies the statement. Roles are hand-checked — not a model guess.
The reflective-thinking story and the numeracy story make different predictions, and numeracy won here.
The individual difference that predicts fewer decision biases is calculation ability, not the knack for spotting intuitive traps. Calculation and numeracy scores predicted fewer biases across studies, while intuitive-error detection did not.
Evidence for the claim as stated.
Whether deliberation can be improved by instruction is unsettled across these designs. Calculation ability predicted fewer decision biases in a correlational sample, while guided reflection produced no improvement in medical students' diagnostic accuracy — reflective students more often listed the correct answer among alternatives but rarely changed their initial choice to select it.
Evidence for the claim as stated.
Open questions
Tensions this paper is part of
From concept pages' “where studies disagree.” Disagreement means the same question; scope means different assays, populations, or outcomes.
Whether deliberation can be improved by instruction is unsettled across these designs. Calculation ability predicted fewer decision biases in a correlational sample, while guided reflection produced no improvement in medical students' diagnostic accuracy — reflective students more often listed the correct answer among alternatives but rarely changed their initial choice to select it.
Inspect source passages
Does the Cognitive Reflection Test measure math or intuition?
These passages occur verbatim in the stored paper text. They support the points listed below; they do not verify every statement in the explanation.
1413 participants
As part of the Understanding America Study, data were collected over the internet from a diverse sample ( N = 1413) from 5/31/14 to 10/22/14.
1478 participants
A total of 1478 participants provided demographic information and responses to CRT and other numeracy items.
Key findings
The statistical model revealed that mathematical calculation ability, rather than the ability to detect intuitive traps, was the primary driver behind better decision-making performance. Across the studies, higher calculation scores and general numeracy scores predicted fewer decision biases, whereas intuitive-error detection had no independent predictive power. Furthermore, only general numeracy predicted positive real-world financial outcomes, such as saving for retirement and paying bills on time.
Methodology
Researchers analyzed data from internet surveys with 1413 and 1478 participants to separate the Cognitive Reflection Test into distinct skills: catching intuitive errors and calculating the correct math answers. They measured participants' math abilities, general intelligence, decision-making biases (such as framing effects and conjunction fallacies), and real-world financial choices. By statistically separating these skills, they tested which one actually predicts logical decision-making and better financial outcomes.
Limitations
The study relies on self-reported financial outcomes, which may be subject to memory errors or social desirability bias. Because the research is correlational, it cannot prove that high mathematical ability directly causes better decision-making or financial success. Additionally, the decision-making tasks used in the lab might not fully capture how people make intuitive or calculated choices in highly stressful, real-world environments.
Related papers in this topic
Same topic cluster — not a recommendation engine.