Search
702 resources
-
Ou Lydia Liu, Chris Brew, John Blackmore...|Mar 6th, 2014|journalArticleOu Lydia Liu, Chris Brew, John Blackmore...Mar 6th, 2014
Content‐based automated scoring has been applied in a variety of science domains. However, many prior applications involved simplified scoring rubrics without considering rubrics representing multiple levels of understanding. This study tested a concept‐based scoring tool for content‐based scoring, c‐rater™, for four science items with rubrics aiming to differentiate among multiple levels of understanding. The items showed moderate to good agreement with human scores. The findings suggest...
-
Russell G. Almond|Dec 11th, 2013|journalArticleRussell G. AlmondDec 11th, 2013
-
J.A. León, R. Olmos, I. Escudero|Jul 15th, 2013|journalArticleJ.A. León, R. Olmos, I. EscuderoJul 15th, 2013
-
Questar Assessment, Inc.|Apr 15th, 2013|reportQuestar Assessment, Inc.Apr 15th, 2013
A reverse engineering approach to automatic item generation (AIG) was applied to a figurebased publicly released test item from the Organisation for Economic Cooperation and Development (OECD) Programme for International Student Assessment (PISA) mathematical literacy cognitive instrument as part of a proof of concept. The author created an item template from which three items were randomly generated from within each of six types defined by a feature deemed to be most likely to affect item...
-
Sara Cushing Weigle|Jan 15th, 2013|journalArticleSara Cushing WeigleJan 15th, 2013
-
Sara Cushing Weigle|Jan 15th, 2013|journalArticleSara Cushing WeigleJan 15th, 2013
-
Mark J. Gierl, Thomas M. Haladyna|Dec 15th, 2013|bookMark J. Gierl, Thomas M. HaladynaDec 15th, 2013
"Automatic item generation (AIG) represents a relatively new and unique research area where specific cognitive and psychometric theories are applied to test construction practices for the purpose of producing test items using technology. The purpose of this book is to bring researchers and practitioners up-to-date on the growing body of research on AIG by organizing in one volume what is currently known about this research area. Part I begins with an overview of the concepts and topics...
-
Kellie Morrissey, Jurek Kirakowski, Masa...|Dec 15th, 2013|bookSectionKellie Morrissey, Jurek Kirakowski, Masa...Dec 15th, 2013
-
Yoav Cohen, Yael Safran|Apr 15th, 2012|conferencePaperYoav Cohen, Yael SafranApr 15th, 2012
-
Brent Bridgeman, Catherine Trapani, Yiga...|Jan 15th, 2012|journalArticleBrent Bridgeman, Catherine Trapani, Yiga...Jan 15th, 2012
-
Issac I. Bejar|Sep 15th, 2012|journalArticleIssac I. BejarSep 15th, 2012
-
Brent Bridgeman, Catherine Trapani, Yiga...|Jan 15th, 2012|journalArticleBrent Bridgeman, Catherine Trapani, Yiga...Jan 15th, 2012
-
Lise Getoor, Ashwin Machanavajjhala|Aug 15th, 2012|journalArticleLise Getoor, Ashwin MachanavajjhalaAug 15th, 2012
This tutorial brings together perspectives on ER from a variety of fields, including databases, machine learning, natural language processing and information retrieval, to provide, in one setting, a survey of a large body of work. We discuss both the practical aspects and theoretical underpinnings of ER. We describe existing solutions, current challenges, and open research problems.
-
David M. Williamson, Xiaoming Xi, F. Jay...|Mar 15th, 2012|journalArticleDavid M. Williamson, Xiaoming Xi, F. Jay...Mar 15th, 2012
-
Miao Chen, Klaus Zechner|Jun 15th, 2011|conferencePaperMiao Chen, Klaus ZechnerJun 15th, 2011
-
Cynthia Dwork, Moritz Hardt, Toniann Pit...|Dec 15th, 2011|journalArticleCynthia Dwork, Moritz Hardt, Toniann Pit...Dec 15th, 2011
We study fairness in classification, where individuals are classified, e.g., admitted to a university, and the goal is to prevent discrimination against individuals based on their membership in some group, while maintaining utility for the classifier (the university). The main conceptual contribution of this paper is a framework for fair classification comprising (1) a (hypothetical) task-specific metric for determining the degree to which individuals are similar with respect to the...
-
T. Solorio, M. Sherman, Y. Liu|Oct 22nd, 2010|journalArticleT. Solorio, M. Sherman, Y. LiuOct 22nd, 2010
In this work we study how features typically used in natural language processing tasks, together with measures from syntactic complexity, can be adapted to the problem of developing language profiles of bilingual children. Our experiments show that these features can provide high discriminative value for predicting language dominance from story retells in a Spanish–English bilingual population of children. Moreover, some of our proposed features are even more powerful than measures commonly...
-
R.S.J.d Baker, B. McGaw, P. Peterson|Dec 15th, 2010|bookSectionR.S.J.d Baker, B. McGaw, P. PetersonDec 15th, 2010
-
Xiaoming Xi|Jul 15th, 2010|journalArticleXiaoming XiJul 15th, 2010
-
Ehud Reiter, Anja Belz|Dec 15th, 2009|journalArticleEhud Reiter, Anja BelzDec 15th, 2009
There is growing interest in using automatically computed corpus-based evaluation metrics to evaluate Natural Language Generation (NLG) systems, because these are often considerably cheaper than the human-based evaluations which have traditionally been used in NLG. We review previous work on NLG evaluation and on validation of automatic metrics in NLP, and then present the results of two studies of how well some metrics which are popular in other areas of NLP (notably BLEU and ROUGE)...