Search
5 resources
-
Jill Burstein, Geoffrey T. LaFlair, Anto...|Mar 23rd, 2022|reportJill Burstein, Geoffrey T. LaFlair, Anto...Mar 23rd, 2022
The Duolingo English Test is a groundbreaking, digital-first, computer-adaptive English language proficiency test intended to support stakeholder admissions decisions at English-medium institutions. The test measures four key constructs for university English language proficiency: Speaking, Writing, Reading, and Listening (SWRL), and is aligned with the Common European Framework of Reference for Languages (CEFR) proficiency levels and descriptors. As a digital-first assessment, the test...
-
Andrew Runge, Yigal Attali, Geoffrey T. ...|Nov 4th, 2024|journalArticleAndrew Runge, Yigal Attali, Geoffrey T. ...Nov 4th, 2024
Introduction Assessments of interactional competence have traditionally been limited in large-scale language assessments. The listening portion suffers from construct underrepresentation, whereas the speaking portion suffers from limited task formats such as in-person interviews or role plays. Human-delivered tasks are challenging to administer at large scales, while automated assessments are typically very narrow in their assessment of the construct because they have carried...
-
Jill Burstein, Geoffrey T. LaFlair, Kevi...|Aug 28th, 2024|preprintJill Burstein, Geoffrey T. LaFlair, Kevi...Aug 28th, 2024
Artificial intelligence (AI) creates opportunities for assessments, such as efficiencies for item generation and scoring of spoken and written responses. At the same time, it poses risks (such as bias in AI-generated item content). Responsible AI (RAI) practices aim to mitigate risks associated with AI. This chapter addresses the critical role of RAI practices in achieving test quality (appropriateness of test score inferences), and test equity (fairness to all test takers). To illustrate,...
-
Yigal Attali, Andrew Runge, Geoffrey T. ...|Jul 22nd, 2022|journalArticleYigal Attali, Andrew Runge, Geoffrey T. ...Jul 22nd, 2022
Automatic item generation (AIG) has the potential to greatly expand the number of items for educational assessments, while simultaneously allowing for a more construct-driven approach to item development. However, the traditional item modeling approach in AIG is limited in scope to content areas that are relatively easy to model (such as math problems), and depends on highly skilled content experts to create each model. In this paper we describe the interactive reading task, a...
-
Yigal Attali, Andrew Runge, Geoffrey T. ...|Jul 22nd, 2022|journalArticleYigal Attali, Andrew Runge, Geoffrey T. ...Jul 22nd, 2022
Automatic item generation (AIG) has the potential to greatly expand the number of items for educational assessments, while simultaneously allowing for a more construct-driven approach to item development. However, the traditional item modeling approach in AIG is limited in scope to content areas that are relatively easy to model (such as math problems), and depends on highly skilled content experts to create each model. In this paper we describe the interactive reading task, a...