Do educational chatbots raise project-course grades?
In a Malaysian team design course, students using an educational chatbot outperformed a traditional class on learning achievement, without clear gains on motivation or creative self-efficacy.
Source
Educational chatbots for project-based learning: investigating learning outcomes for a team-based design course
Study at a glance
- Design
- Other — Quasi-experimental intact-class comparison of chatbot-supported vs conventional project-based learning
- N
- N=60 · Two classes of 30 students each (chatbot vs conventional)
- Population
- Malaysian students in a team design course
- Outcome
- Achievement (and secondary motivation/creativity measures) with educational chatbot support
Structured fields used in claim comparison tables when every cited study has a complete layer.
Inspect source passages
Do educational chatbots raise project-course grades?
These passages occur verbatim in the stored paper text. They support the points listed below; they do not verify every statement in the explanation.
60 students in two classes of 30
The 60 students were grouped into two classes (30 students per class) as either traditional learning class (control group-CT) or chatbot learning class (treatment group-EC).
What was the main learning-performance result?
hence indicating difference in learning achievement where the EC group outperformed the control group
What they did
Sixty second-year TESOL/multimedia education students in Malaysia were assigned by class to a chatbot-supported project-based learning condition or a traditional control class. Both groups shared content, duration, and instructor; researchers compared learning achievement and several affective/perception measures.
What they found
The chatbot group scored significantly higher on course learning performance than the control group, with a large Cohen’s d. Need for cognition, motivational beliefs, creative self-efficacy, and perception of learning did not differ significantly between groups.
The limits
What it doesn't show
Class-level assignment (not individual randomization) limits causal certainty, and null effects on motivation measures mean chatbots were not a general engagement booster here. Findings are from one design course in one institution.
Key terms
- Educational chatbot
- A conversational software agent used to support teaching and learning tasks.
- Project-based learning
- Instruction organized around extended team projects that produce authentic products.
- Learning achievement
- Measured course performance showing what students learned or produced.
- Creative self-efficacy
- Belief in one’s ability to generate creative ideas or products.
- Need for cognition
- Tendency to enjoy and engage in effortful thinking.
Flashcards
0 of 12 answers reviewed
Research intelligence for this paper
See its role on concept claims, tensions it is part of, placement history, and related discoveries.
Quiz yourself
What outcome favored the chatbot group?
Common questions
Did the chatbot help every measured outcome?
No. Achievement improved, but motivation-related and creative self-efficacy measures did not differ significantly.
How were groups formed?
Two intact classes of 30 students each were assigned to chatbot or traditional conditions.
What was the control condition?
A traditional learning class covering the same content with the same instructor and duration.
Was the achievement difference large?
Yes; the reported Cohen’s d for learning performance was about 0.978.
More on Collaborative learning