Can We Do Number Research Online?
Online browser experiments can reliably measure fine differences in human reaction times for numerical processing tasks, replicating classic laboratory findings.
Source
Conducting Web-Based Experiments for Numerical Cognition Research
What they did
To test if web-based tools are viable for numerical research, the researcher conducted online replications of classic reaction-time experiments. In Experiment 1, 23 participants chose which digit was numerically larger while the font size was either congruent or incongruent with the number's value across 96 total trials. In Experiment 2, 72 participants judged whether a target digit was higher or lower than the standard number 5, preceded by an 83 millisecond masked prime digit across 256 experimental trials.
What they found
Both experiments successfully replicated classic laboratory findings online, demonstrating robust reaction-time differences. In Experiment 1, participants responded 86 milliseconds faster when physical size matched numerical size compared to when they conflicted. In Experiment 2, participants were 21 milliseconds faster when the brief prime digit matched the target's category, showing that complex cognitive effects like masked priming can be detected over the web.
The limits
What it doesn't show
This study cannot guarantee perfect timing control, as modern web browsers lack access to the exact refresh rates of participants' varying computer screens. It does not prove that online research is suitable for tasks where milliseconds of display deviation would disrupt the cognitive effect, such as very short-latency masked priming. Finally, because researchers cannot directly observe the remote testing environment, the design cannot completely rule out participants being distracted or multitasking during the tasks.
Key terms
- Numerical Cognition
- A subfield of cognitive psychology that studies how the human mind and brain process numbers and mathematical concepts.
- Size Congruity Effect
- A phenomenon where judgments about a number's numerical value are influenced by its physical font size, leading to faster responses when physical and numerical sizes match.
- Masked Priming
- An experimental technique where a brief stimulus is hidden before and after by other visual patterns to study unconscious processing of that stimulus.
- Within-Participant Design
- An experimental setup where the same group of participants takes part in all experimental conditions, allowing them to act as their own comparison control.
- Monitor Refresh Rate
- The number of times per second a computer screen updates its displayed image, which dictates the precision with which visual stimuli can be presented.
Flashcards
Want these cards to stick?
Save the deck to NoteFren and study it with spaced repetition.
Quiz yourself
What are the primary advantages of web-based data collection in psychological research?
Common questions
How does the researcher know if online participants are actually paying attention?
The researcher suggests using simple quality checks, such as measuring how long participants spend reading instructions (excluding those who spend less than 10 seconds) or inserting clear catch trials.
Why are reaction times slower in web-based studies compared to physical lab tests?
Different keyboards, operating systems, and web browser lag introduce an extra delay of 25 to 100 milliseconds between a physical keypress and its digital recording.
Does the lack of display precision ruin the validity of online cognitive experiments?
No, because the timing delays are generally stable for each individual participant, meaning the relative differences between experimental conditions remain highly accurate in within-participant designs.
Can children's cognitive development be easily studied using these web methods?
While possible, the author notes that this specific review and its experiments focused on adult participants, as children present different challenges regarding attention and remote instructions.
More on Numerical cognition