Responsible AI for Test Equity and Quality: The Duolingo English Test as a Case Study

Article Status
Published
Authors/contributors
Title
Responsible AI for Test Equity and Quality: The Duolingo English Test as a Case Study
Abstract
Artificial intelligence (AI) creates opportunities for assessments, such as efficiencies for item generation and scoring of spoken and written responses. At the same time, it poses risks (such as bias in AI-generated item content). Responsible AI (RAI) practices aim to mitigate risks associated with AI. This chapter addresses the critical role of RAI practices in achieving test quality (appropriateness of test score inferences), and test equity (fairness to all test takers). To illustrate, the chapter presents a case study using the Duolingo English Test (DET), an AI-powered, high-stakes English language assessment. The chapter discusses the DET RAI standards, their development and their relationship to domain-agnostic RAI principles. Further, it provides examples of specific RAI practices, showing how these practices meaningfully address the ethical principles of validity and reliability, fairness, privacy and security, and transparency and accountability standards to ensure test equity and quality.
Archive ID
arXiv:2409.07476
Date
2024-08-28
Citation Key
burstein2024
Accessed
14/09/2024, 06:25
Short Title
Responsible AI for Test Equity and Quality
Library Catalogue
Extra
arXiv:2409.07476 [cs] <标题>: 负责任的人工智能在测试公平性与质量中的应用:以多邻国英语测试为案例研究 <AI Smry>: The chapter provides examples of specific RAI practices, showing how these practices meaningfully address the ethical principles of validity and reliability, fairness, privacy and security, and transparency and accountability standards to ensure test equity and quality.
Citation
Burstein, J., LaFlair, G. T., Yancey, K., von Davier, A. A., & Dotan, R. (2024). Responsible AI for Test Equity and Quality: The Duolingo English Test as a Case Study (arXiv:2409.07476). https://doi.org/10.48550/arXiv.2409.07476
Powered by Zotero and Kerko.