Skip to content
PaperFren

Research method

Likert Scale

A Likert item asks someone to locate themselves on an ordered agreement or intensity scale (for example 1–5). Researchers then compare groups, correlate domains, or feed the items into profiles. Ordered ticks are not automatically equal intervals, a summed score is not a latent truth, and a high mean is not a test grade. Likert data in this set sit next to eye-tracking, simulation performance and course grades — and they often disagree with those.

Online-learning papers use Likert items because they travel: satisfaction, self-efficacy, perceived digital competence, simulation experience, transcript usefulness. They answer 'how did this sample rate X?' Their main limitation is interpretation: Kruskal–Wallis on valued peer videos, a 0.39 coefficient on teacher digital competence, or a median satisfaction of 69 can look like learning when the outcome is still a rating.

Studies

10

Findings

6

6 supporting · 0 challenging · 0 qualifying citations

Open tensions

2

Currently

What we know

  1. Over two years, 78 Economics and Business engineering students rated a peer-created video project on Likert items analysed with Kruskal–Wallis tests. They valued the activity highly and preferred peer videos to traditional lectures; Student-Teachers especially linked the role to motivation and retention. Voluntary ratings cannot prove that peer videos raise exam scores versus instructor content.
  2. One hundred fifty pre-service teachers from seven German programmes completed questionnaires plus a video-based classroom-assessment simulation. Latent profiles split 61 knowledgeable, 37 motivated and 52 potentially struggling learners; profiles differed in situative experiences and assessment-process indicators, with knowledgeable learners generally higher on several process measures. Participation was voluntary and remunerated, not a randomised curriculum experiment.
  3. Germany’s summer 2020 'Studying in Corona Times' survey invited about 192,000 students; analyses used over 18,000. Teacher-related conditions (videoconference share, interaction, digital competence) and student factors both predicted satisfaction with acquired knowledge. Satisfaction with teachers’ digital competencies was especially predictive (regression coefficient 0.39). The outcome is self-reported learning-success satisfaction, not test scores.
  4. Across 22 Saudi universities, 1,226 students produced a remote-learning satisfaction median of 69 (IQR 21), with 599 (49%) below that median. Online-learning self-efficacy domains related to those Likert satisfaction scores. The correlation does not show that raising self-efficacy would raise satisfaction.
  5. In a Japanese Zoom academic-reading course, 129 sophomores remained after attendance exclusions (class sizes about 30–34 per cell). Higher-proficiency students outperformed lower-proficiency peers on grades regardless of live transcripts; transcripts did not significantly improve grades for either group. Lower-proficiency students participated more with transcripts available. Both proficiency groups generally viewed transcripts positively on questionnaires despite accuracy concerns — a Likert/perception win without a grade win.

Largest unresolved question

High Likert approval is not a common learning result. Peer-video students preferred peer content to lectures; transcript groups viewed captions positively; German students’ learning-success satisfaction tracked teacher digital-competence ratings (0.39). Transcripts still did not raise grades, and the emotional-interface Likert measures did not rise even when recall did. Treating 'students rated it well' as 'students learned more' collides those papers.

Procedure

How it works

The main stages of the method. Specific protocols and analysis choices vary between studies.

  1. Write ordered agreement items

    Each item asks someone to locate themselves on an intensity scale (for example 1–5). Anchors, missing options, and whether the ticks are treated as equal intervals are already a measurement decision; ordered judgements are not automatically interval units of learning.

  2. Administer the scale

    Students or instructors tick the items at one or a few moments — after a peer-video project, during emergency-remote teaching, beside a simulation. Who sits the form, and when, bounds what the later mean can mean.

  3. Sum, rank, or profile the ticks

    Items are summed, compared with Kruskal–Wallis tests, or clustered into latent profiles of reported competence. A summed score is not a latent truth, and a high mean is not a test grade.

  4. Compare groups or correlate domains

    Papers relate satisfaction, self-efficacy, perceived digital competence, or simulation experience to other ratings or, sometimes, to grades and eye-tracking. Those other measures often disagree with the Likert enthusiasm.

  5. Do not treat the rating as achievement

    Likert data answer how this sample rated X. A high satisfaction or self-efficacy mean is still a rating; it is not a grade, not an eye-tracking trace, and not proof that a positively rated tool raised achievement.

Common misconceptions

  • Summing Likert items produces an interval measure of the true construct, so a one-point difference is a one-unit difference in learning.

    Items are ordered judgements. German 'satisfaction with acquired knowledge' and Saudi satisfaction (median 69) are ratings of perceived success, not equal-interval test points. Kruskal–Wallis on peer-video items similarly ranks groups on approval, not on exam marks.

  • If learners rate a tool positively, it raised achievement.

    Transcript questionnaires were generally positive while grades did not improve with transcripts for either proficiency group. Peer-video Likert enthusiasm is likewise not an exam contrast.

  • Self-reported positive emotion is the mechanism that must move if an 'emotional' interface works.

    Neither emotional layout increased positive-emotion ratings, yet the local layout improved recall and problem-solving and shifted gaze to text. The Likert emotion scale did not carry the learning effect.

Related