How does artificial intelligence compare to human feedback? A meta-analysis of performance, feedback perception, and learning dispositions

Article Status
Published
Authors/contributors
Title
How does artificial intelligence compare to human feedback? A meta-analysis of performance, feedback perception, and learning dispositions
Abstract
This exploratory meta-analysis synthesises current research on the effectiveness of Artificial Intelligence (AI)-generated feedback compared to traditional human-provided feedback. Drawing on 41 studies involving a total of 4813 students, the findings reveal no statistically significant differences in learning performance between students who received AI-generated feedback and those who received human-provided feedback. The pooled effect size was small and statistically insignificant (Hedge’s g = 0.25, CI [−0.11; 0.60]), indicating that AI feedback is potentially as effective as human feedback. A separate meta-analysis focusing exclusively on studies in the domain of language and writing confirmed similar findings, with high heterogeneity persisting (I2 = 95%). The study further explored differences in feedback perception and found a small, negative, and statistically insignificant effect size (Hedge’s g = −0.20, CI [−0.67; 0.27]). The study advocates for a hybrid approach, leveraging the scalability of AI while retaining the deep, empathetic, and contextual features of human feedback.
Publication
Educational Psychology
Volume
0
Issue
0
Pages
1-32
Date
2025-09-28 04:22:41
Journal Abbr
Educ. Psychol-uk.
ISSN
0144-3410
Short Title
How does artificial intelligence compare to human feedback?
Accessed
28/09/2025, 04:22
Library Catalogue
Taylor and Francis+NEJM
Extra
Citation Key: kaliisa2025
Citation
Kaliisa, R., Misiejuk, K., López-Pernas, S., & Saqr, M. (2025). How does artificial intelligence compare to human feedback? A meta-analysis of performance, feedback perception, and learning dispositions. Educational Psychology, 0(0), 1–32. https://doi.org/10.1080/01443410.2025.2553639
Powered by Zotero and Kerko.