Research method
Likert Scale
A Likert item asks someone to locate themselves on an ordered agreement or intensity scale (for example 1–5). Researchers then compare groups, correlate domains, or feed the items into profiles. Ordered ticks are not automatically equal intervals, a summed score is not a latent truth, and a high mean is not a test grade. Likert data in this set sit next to eye-tracking, simulation performance and course grades — and they often disagree with those.
Online-learning papers use Likert items because they travel: satisfaction, self-efficacy, perceived digital competence, simulation experience, transcript usefulness. They answer 'how did this sample rate X?' Their main limitation is interpretation: Kruskal–Wallis on valued peer videos, a 0.39 coefficient on teacher digital competence, or a median satisfaction of 69 can look like learning when the outcome is still a rating.
Evidence
What the evidence shows
Drawn from 10 studies in this library. Each finding starts with a plain-language takeaway, then the denser detail. Supports means evidence for a finding; Challenges means evidence against a stated position; Qualifies marks scope with a short note on each study’s contribution. Challenged positions are labeled — they are not findings.
Over two years, 78 Economics and Business engineering students rated a peer-created video project on Likert items analysed with Kruskal–Wallis tests. They valued the activity highly and preferred peer videos to traditional lectures; Student-Teachers especially linked the role to motivation and retention. Voluntary ratings cannot prove that peer videos raise exam scores versus instructor content.
One hundred fifty pre-service teachers from seven German programmes completed questionnaires plus a video-based classroom-assessment simulation. Latent profiles split 61 knowledgeable, 37 motivated and 52 potentially struggling learners; profiles differed in situative experiences and assessment-process indicators, with knowledgeable learners generally higher on several process measures. Participation was voluntary and remunerated, not a randomised curriculum experiment.
Germany’s summer 2020 'Studying in Corona Times' survey invited about 192,000 students; analyses used over 18,000. Teacher-related conditions (videoconference share, interaction, digital competence) and student factors both predicted satisfaction with acquired knowledge. Satisfaction with teachers’ digital competencies was especially predictive (regression coefficient 0.39). The outcome is self-reported learning-success satisfaction, not test scores.
Across 22 Saudi universities, 1,226 students produced a remote-learning satisfaction median of 69 (IQR 21), with 599 (49%) below that median. Online-learning self-efficacy domains related to those Likert satisfaction scores. The correlation does not show that raising self-efficacy would raise satisfaction.
In a Japanese Zoom academic-reading course, 129 sophomores remained after attendance exclusions (class sizes about 30–34 per cell). Higher-proficiency students outperformed lower-proficiency peers on grades regardless of live transcripts; transcripts did not significantly improve grades for either group. Lower-proficiency students participated more with transcripts available. Both proficiency groups generally viewed transcripts positively on questionnaires despite accuracy concerns — a Likert/perception win without a grade win.
Eighty-three college students learned a lightning lesson in a lab under neutral, holistic-emotional, or local-emotional layouts while eye movements were tracked. The local layout improved recall and problem-solving versus both alternatives and pulled gaze toward written text, yet neither emotional layout increased positive-emotion self-reports. Friendly interface Likert/emotion ratings and learning traces parted company.
Open questions
Tensions and limits
Some items are genuine disagreements on the same question. Others mark different assays, populations, or outcomes — limits on how far one study travels — not a forced fight between papers.
High Likert approval is not a common learning result. Peer-video students preferred peer content to lectures; transcript groups viewed captions positively; German students’ learning-success satisfaction tracked teacher digital-competence ratings (0.39). Transcripts still did not raise grades, and the emotional-interface Likert measures did not rise even when recall did. Treating 'students rated it well' as 'students learned more' collides those papers.
- Peer-created videos for hybrid learning
- Do live captions raise online L2 course grades?
- What helped German students learn online in COVID?
- Does a friendly screen layout help students learn better?
Study Role Design N Population Outcome Peer-created videos for hybrid learning Supports OtherTwo-year peer-learning project with Student-Teachers creating supervised problem videos N=78 · 78 Economics and Business engineering students across 2020/21–2021/22 Engineering students in hybrid/online economics and business courses Ratings of peer-created problem videos vs traditional lectures and motivation gains Do live captions raise online L2 course grades? Supports Other2×2 quasi-experiment crossing L2 proficiency with Zoom live-transcript availability N=129 · 129 science/engineering sophomores after attendance exclusions Japanese university students in synchronous Zoom English academic reading classes Reading grades and in-class participation with vs without live transcripts What helped German students learn online in COVID? Supports Cross-sectionalNationwide German summer 2020 survey modeling predictors of perceived learning success N=18000 · Analyses based on over 18,000 students (~192,000 invited) German higher-education students in the first digital COVID semester Satisfaction with acquired knowledge/competencies predicted by teacher and student digital factors Does a friendly screen layout help students learn better? Supports Human experimentRandomized multimedia lesson layouts (neutral, holistic, local emotional design) with eye tracking N=83 · 83 college students across three interface conditions College students learning a lightning multimedia lesson Recall, problem-solving, and attention patterns under emotional interface designs Scale and population disagree even when the item type is Likert. Germany models >18,000 national emergency-remote ratings; Saudi satisfaction uses 1,226 students (median 69); emergency-remote challenge catalogues use 138 students (132 with multiple challenges); simulation profiles use 150 volunteers. A nationwide coefficient is not a replication of a 138-person experience survey.
- What helped German students learn online in COVID?
- Online self-efficacy and remote-learning satisfaction
- What made emergency remote learning hard for students?
- Which future teachers struggle in classroom simulations?
Study Role Design N Population Outcome What helped German students learn online in COVID? Supports Cross-sectionalNationwide German summer 2020 survey modeling predictors of perceived learning success N=18000 · Analyses based on over 18,000 students (~192,000 invited) German higher-education students in the first digital COVID semester Satisfaction with acquired knowledge/competencies predicted by teacher and student digital factors Online self-efficacy and remote-learning satisfaction Supports Cross-sectionalMay 2020 survey of OLSE domains vs e-learning satisfaction in Saudi universities N=1226 · 1,226 students across 22 universities Saudi undergraduate and postgraduate students in emergency remote learning Learning satisfaction associated with online learning, time-management, and technology self-efficacy What made emergency remote learning hard for students? Supports OtherSurvey plus interview/diary follow-up of ERL experiences in Finland and India N=138 · 138 university students across two pandemic waves University students in Finland and India during emergency remote learning Shared ERL challenges (schedules, distractions, peer communication) and moderate engagement Which future teachers struggle in classroom simulations? Supports Cross-sectionalLatent profile analysis of pre-service teachers in a video-based assessment simulation N=150 · 150 pre-service teachers from seven German teacher-education programs German pre-service teachers completing a video-based teaching simulation Learner profiles (knowledgeable/motivated/struggling) and simulation assessment performance
Common misconceptions
Summing Likert items produces an interval measure of the true construct, so a one-point difference is a one-unit difference in learning.
Items are ordered judgements. German 'satisfaction with acquired knowledge' and Saudi satisfaction (median 69) are ratings of perceived success, not equal-interval test points. Kruskal–Wallis on peer-video items similarly ranks groups on approval, not on exam marks.
If learners rate a tool positively, it raised achievement.
Transcript questionnaires were generally positive while grades did not improve with transcripts for either proficiency group. Peer-video Likert enthusiasm is likewise not an exam contrast.
Self-reported positive emotion is the mechanism that must move if an 'emotional' interface works.
Neither emotional layout increased positive-emotion ratings, yet the local layout improved recall and problem-solving and shifted gaze to text. The Likert emotion scale did not carry the learning effect.
Exam-style questions
Short-answer questions that ask you to explain or compare, not recall.
A Zoom reading course finds positive Likert views of live transcripts and more participation among lower-proficiency students when transcripts are on, but no significant grade gain. Which claim is supported?
Transcripts can change participation and perceived usefulness in that 129-student sample without raising grades. Classes were not randomly assigned and no-transcript classes did not get the questionnaire, so even the perception comparison is incomplete.
Germany’s model reports a 0.39 coefficient linking satisfaction with teachers’ digital competencies to perceived learning success in >18,000 students. Why is that not evidence that training teachers’ digital skills caused better learning?
The outcome is self-reported satisfaction with knowledge, the survey is cross-sectional, and the context is emergency COVID teaching. The coefficient is an association among ratings, not a trial of a competence intervention with test scores.
Why can 61/37/52 simulation profiles not be read as three types of teacher you should stream into different curricula?
They are latent groupings of 150 volunteers in one video-simulation design, associated with process indicators in that task. Participation was not a randomised curriculum experiment, so the profiles do not prescribe interventions.
How do the lightning-lesson emotion Likert results warn you against treating a summed 'positive affect' score as the learning outcome?
Affect ratings did not rise under either emotional layout, while recall, problem-solving and text-directed gaze did under the local layout. If you had used only the Likert emotion sum, you would have concluded the designs did nothing.
The studies
10 studies in this library bear on Likert Scale, ordered by citations. The first 8 are shown.
- Online self-efficacy and remote-learning satisfaction
Among Saudi university students in emergency remote learning, online learning, time-management, and technology self-efficacy were central to satisfaction with e-learning.
- What made emergency remote learning hard for students?
Students in Finland and India reported many similar ERL challenges—schedules, distractions, weak peer communication—and only moderate engagement.
- Does TikTok microlearning engage nursing students?
Nursing and health students rated TikTok microlearning positively for engagement, motivation, and technology acceptance.
- What made digital distance teaching worth students’ effort?
For German ninth graders, richer observed learning activities predicted more effort via cognitive activation, while prior tablet familiarity mattered less than expected.
- Which future teachers struggle in classroom simulations?
In video-based teaching simulations, three learner profiles emerged; knowledgeable pre-service teachers navigated tasks more successfully than struggling peers.
- Does a friendly screen layout help students learn better?
Adding pleasant visual elements to specific areas of a learning screen helps students pay more attention and learn better than styling the entire interface.
- Technology integration quality and engagement
Among Swiss upper-secondary students, validated TIQS dimensions—especially support for learning and classroom management—were positively related to behavioral engagement, while cognitive activation related to digital competencies.
- Peer-created videos for hybrid learning
Engineering students in hybrid/online courses highly rated peer-created problem videos, with Student-Teachers reporting motivation gains and learners preferring peer content to traditional lectures.
Show 2 more studiesShow fewer studies
- What helped German students learn online in COVID?
In Germany’s first digital semester, teacher digital competence and interactive online courses strongly predicted students’ satisfaction with what they learned.
- Do live captions raise online L2 course grades?
Live Zoom transcripts did not raise academic reading grades, but they helped lower-proficiency students join more in-class activities.
Learn alongside