Does guided reflection help medical students make better diagnoses?
Slowing down to reflect and list alternative possibilities does not help medical students arrive at a more accurate final diagnosis.
Source
Guided Reflection Interventions Show No Effect on Diagnostic Accuracy in Medical Students
What they did
The researchers recruited 186 medical students to diagnose four clinical cases using different decision-making styles. Participants were randomly divided into three groups: a control group making immediate decisions, a short-reflection group listing two alternative diagnoses, and a long-reflection group listing six alternatives. The study measured whether this guided reflection changed their diagnostic accuracy or their confidence levels.
What they found
The study revealed that guiding students to reflect did not improve the accuracy of their final diagnoses compared to first-impression judgments. While reflective students were more likely to include the correct answer somewhere in their list of alternative ideas, they rarely changed their initial minds to select it. Furthermore, forcing students to generate more alternatives did not boost their accuracy or change their confidence, with participants in both reflection groups changing their minds in only 17% of cases.
The limits
What it doesn't show
The study cannot show how practicing clinicians would perform, as the participants were senior medical students rather than experienced doctors. It also cannot rule out floor effects, because the case scenarios were highly challenging and resulted in low overall diagnostic accuracy. Additionally, because students in the long-reflection group only listed an average of three alternatives instead of the requested six, the cognitive impact of highly exhaustive reflection remains unmeasured.
Key terms
- Guided reflection
- A structured metacognitive intervention that encourages clinical reasoning by prompting a clinician to systematically generate and evaluate alternative diagnoses.
- Dual-process model
- A cognitive theory proposing that decision-making is governed by two systems: one fast, intuitive, and automatic, and the other slow, analytical, and deliberate.
- Lenient scoring
- An evaluation method where a diagnosis is marked correct if the true condition is listed anywhere among the participant's brainstormed alternatives, even if it is not their final choice.
- Strict scoring
- An evaluation method where a diagnosis is marked correct only if the participant's final chosen diagnosis matches the true condition.
- Backfiring
- A reasoning error where a clinician initially holds a correct diagnosis but changes their mind to an incorrect one after further reflection.
- Availability bias
- A cognitive shortcut where people judge the likelihood of an event based on how easily examples of it come to mind.
Flashcards
Want these cards to stick?
Save the deck to NoteFren and study it with spaced repetition.
Quiz yourself
What proportion of diagnostic errors in medicine are estimated to involve cognitive factors?
Common questions
Why didn't reflecting help the students make better final diagnoses?
Students rarely changed their minds after their initial hunch, meaning they retained their first impression in the vast majority of cases even when they successfully listed the correct diagnosis as an alternative.
Did asking students to generate more alternatives make them more confident?
No, students who had to brainstorm more options did not show a significant change in confidence compared to those who listed fewer options.
Were students prone to 'talking themselves out' of correct answers?
Yes, when students did change their minds, they were just as likely to switch from a correct diagnosis to an incorrect one as they were to correct a mistake.
How did the researchers score whether a diagnosis was correct?
They used several ways, including checking whether the first impression was correct, whether the final selected answer was correct, and whether the correct answer was listed anywhere in their brainstormed alternatives.
More on Decision making