Measuring the Expressive Language and Vocabulary of Latino English Learners Using Hand Transcribed Speech Data and Automated Scoring

Article Status
Published
Authors/contributors
Title
Measuring the Expressive Language and Vocabulary of Latino English Learners Using Hand Transcribed Speech Data and Automated Scoring
Abstract
Purpose: Explore how different automated scoring (AS) models score reliably the expressive language and vocabulary knowledge in depth of young second grade Latino English learners. Design/methodology/approach: Analyze a total of 13,471 English utterances from 217 Latino English learners with random forest, end-to-end memory networks, long short-term memory, and other AS models. Findings: Random forest outperformed the other AS models as measured by the mean of quadratic weighted kappa (QWK = 0.70) followed by the end-to-end memory networks-long short-term memory (QWK = 0.69) across all tasks and data points. The QWK between humans was 0.90, while the human-machine agreement of three AS models and humans ranged from 0.66 to 0.70. Practical implications: Examine closely misclassifications between human and machine scoring to better understand the specific words and structures the systems were not capturing. Originality/value: Discuss findings in the context of developing efficient and reliable ways to analyze the natural speech of young English learners. This information could guide the vocabulary and language proficiency instruction in the early grades.
Publication
International Journal of Intelligent Technologies and Applied Statistics
Volume
13
Issue
3
Date
September 1, 2020
Language
en
Library Catalogue
DOI.org (CSL JSON)
Extra
Citation Key: makotosano2020 <标题>: 使用手工转录语音数据和自动评分测量拉美裔英语学习者的表达性语言和词汇
Citation
Makoto Sano, Doris Luft Baker, Marlen Collazo, Nancy Le, & Akihito Kamata. (2020). Measuring the Expressive Language and Vocabulary of Latino English Learners Using Hand Transcribed Speech Data and Automated Scoring. International Journal of Intelligent Technologies and Applied Statistics, 13(3). https://doi.org/10.6148/IJITAS.202009_13(3).0003
Powered by Zotero and Kerko.