Skip to content
PaperFren

Social cognition

Can a shorter eyes test better measure theory of mind?

Olderbak S, Wilhelm O, Olaru G, et al. · Frontiers in psychology · 2015

Open access · cc by · source: Europe PMC

The original Reading the Mind in the Eyes Test has poor statistical reliability, but a new 10-item short form provides a more reliable measure that is heavily influenced by vocabulary.

Save to libraryView originalAsk PaperFrenStudy this in NoteFren
Watch this

How this study connects

Role on claims

Each row is a claim on a concept or method page where this paper supports, challenges, or qualifies the statement. Roles are hand-checked — not a model guess.

  • SupportsTheory of Mindconcept

    Standardized clinical measures of Theory of Mind, such as the Reading the Mind in the Eyes Test, suffer from notable psychometric limitations, including poor reliability and a heavy performance bias linked to vocabulary size.

    Evidence for the claim as stated.

Study at a glance

Design
Cross-sectional — MTurk factor analyses of the 36-item RMET and a 10-item short form, plus vocabulary and empathy correlates
N
N=484 · Study 1 n = 484; Study 2 analytic n = 210 after dropping low-variance responders
Population
Amazon Mechanical Turk adults
Outcome
Internal consistency of the RMET versus a 10-item short form, and correlations with vocabulary

Structured fields used in claim comparison tables when every cited study has a complete layer.

Inspect source passages

Can a shorter eyes test better measure theory of mind?

These passages occur verbatim in the stored paper text. They support the points listed below; they do not verify every statement in the explanation.

36 items in the original test

First, all 36 items were modeled in a single CFA, with all items loading on a single factor.

10-item solution

A 10-item solution was identified as the shortest scale that matched both criteria (and in an additional 100 runs of the ACO, the same 10 items were identified over 90% of the time with deviating solutions of lesser psychometric quality; please see (Olaru et al., ), for details on the procedure).
Read passages in the original paper

Key findings

The original 36-item test showed poor statistical reliability and did not measure a single, unified construct. In contrast, the newly developed 10-item short-form demonstrated acceptable reliability across both studies, with internal consistency values of 0.70 and 0.73. However, performance on this shorter test was strongly linked to vocabulary size, with correlation coefficients ranging from 0.49 to 0.62, while showing only moderate associations with actual emotion perception and empathy.

Methodology

Researchers analyzed the statistical structure of the 36-item Reading the Mind in the Eyes Test using data from an initial sample of 484 participants. They evaluated several existing shortened versions and used a computational algorithm to identify a superior 10-item short-form. This 10-item version was then tested on a second sample of 210 online participants to verify its reliability and evaluate how it related to measures of vocabulary, emotion recognition, and empathy.

Limitations

The study does not establish whether these findings apply to clinical groups, such as individuals on the autism spectrum, as the samples consisted solely of healthy online adults. Additionally, because the data are correlational, the study cannot prove that vocabulary knowledge directly causes higher test scores, though the strong association remains a major confound. It also does not prove that the test measures purely social cognitive ability, given its heavy overlap with language skills.

Related papers in this topic

Same topic cluster — not a recommendation engine.