A Human-AI Integrated Rating System for Improving Second Language Writing:The Case of Japanese Learners of English for General Academic Purposes
Article Status
Published
Author/contributor
- Spring, Ryan (Author)
Title
A Human-AI Integrated Rating System for Improving Second Language Writing:The Case of Japanese Learners of English for General Academic Purposes
Abstract
Abstract
In order to solve the problem of teachers not assigning and evaluating student writing
but not completely trusting AI raters, I created and tested a rating scheme in which an AI
model would rate students’ language use based on understandable criteria and humans
would quickly check the AI responses while rating content and structure. Teachers tried
the scheme and improvements were made based on new data and newly available
research. An online practice tool was also created for students so that they could
understand how the AI would rate their language use and practice accordingly. The AI
rating models were improved over the course of three semesters based on student data
and the ratings of external professional raters. As a result, an increasing number of
teachers used the rating scheme, the number of students that practiced writing and were
evaluated increased university-wide, and reasonable levels of fairness assessment were
maintained.
Date
2023-10-11
Accessed
07/06/2024, 19:46
Short Title
A Human-AI Integrated Rating System for Improving Second Language Writing
Library Catalogue
In Review
Extra
<标题>: 一种人机整合评分系统以提高第二语言写作:以日语学习者的通用学术英语为例
Citation Key: spring2023
Citation
Spring, R. (2023). A Human-AI Integrated Rating System for Improving Second Language Writing:The Case of Japanese Learners of English for General Academic Purposes. https://doi.org/10.21203/rs.3.rs-3350837/v2
Link to this record