Search
702 resources
-
Ou Lydia Liu, Chris Brew, John Blackmore...|Mar 6th, 2014|journalArticleOu Lydia Liu, Chris Brew, John Blackmore...Mar 6th, 2014
Content‐based automated scoring has been applied in a variety of science domains. However, many prior applications involved simplified scoring rubrics without considering rubrics representing multiple levels of understanding. This study tested a concept‐based scoring tool for content‐based scoring, c‐rater™, for four science items with rubrics aiming to differentiate among multiple levels of understanding. The items showed moderate to good agreement with human scores. The findings suggest...
-
Russell G. Almond|Dec 11th, 2013|journalArticleRussell G. AlmondDec 11th, 2013
-
J.A. León, R. Olmos, I. Escudero|Jul 31st, 2013|journalArticleJ.A. León, R. Olmos, I. EscuderoJul 31st, 2013
-
Questar Assessment, Inc.|Apr 30th, 2013|reportQuestar Assessment, Inc.Apr 30th, 2013
A reverse engineering approach to automatic item generation (AIG) was applied to a figurebased publicly released test item from the Organisation for Economic Cooperation and Development (OECD) Programme for International Student Assessment (PISA) mathematical literacy cognitive instrument as part of a proof of concept. The author created an item template from which three items were randomly generated from within each of six types defined by a feature deemed to be most likely to affect item...
-
Sara Cushing Weigle|Jan 31st, 2013|journalArticleSara Cushing WeigleJan 31st, 2013
-
Sara Cushing Weigle|Jan 31st, 2013|journalArticleSara Cushing WeigleJan 31st, 2013
-
Mark J. Gierl, Thomas M. Haladyna|Jan 31st, 2013|bookMark J. Gierl, Thomas M. HaladynaJan 31st, 2013
"Automatic item generation (AIG) represents a relatively new and unique research area where specific cognitive and psychometric theories are applied to test construction practices for the purpose of producing test items using technology. The purpose of this book is to bring researchers and practitioners up-to-date on the growing body of research on AIG by organizing in one volume what is currently known about this research area. Part I begins with an overview of the concepts and topics...
-
Kellie Morrissey, Jurek Kirakowski, Masa...|Jan 31st, 2013|bookSectionKellie Morrissey, Jurek Kirakowski, Masa...Jan 31st, 2013
-
Yoav Cohen, Yael Safran|Apr 30th, 2012|conferencePaperYoav Cohen, Yael SafranApr 30th, 2012
-
Brent Bridgeman, Catherine Trapani, Yiga...|Jan 31st, 2012|journalArticleBrent Bridgeman, Catherine Trapani, Yiga...Jan 31st, 2012
-
Issac I. Bejar|Sep 30th, 2012|journalArticleIssac I. BejarSep 30th, 2012
-
Brent Bridgeman, Catherine Trapani, Yiga...|Jan 31st, 2012|journalArticleBrent Bridgeman, Catherine Trapani, Yiga...Jan 31st, 2012
-
Lise Getoor, Ashwin Machanavajjhala|Aug 31st, 2012|journalArticleLise Getoor, Ashwin MachanavajjhalaAug 31st, 2012
This tutorial brings together perspectives on ER from a variety of fields, including databases, machine learning, natural language processing and information retrieval, to provide, in one setting, a survey of a large body of work. We discuss both the practical aspects and theoretical underpinnings of ER. We describe existing solutions, current challenges, and open research problems.
-
David M. Williamson, Xiaoming Xi, F. Jay...|Mar 31st, 2012|journalArticleDavid M. Williamson, Xiaoming Xi, F. Jay...Mar 31st, 2012
-
Miao Chen, Klaus Zechner|Jun 30th, 2011|conferencePaperMiao Chen, Klaus ZechnerJun 30th, 2011
-
Cynthia Dwork, Moritz Hardt, Toniann Pit...|Jan 31st, 2011|journalArticleCynthia Dwork, Moritz Hardt, Toniann Pit...Jan 31st, 2011
We study fairness in classification, where individuals are classified, e.g., admitted to a university, and the goal is to prevent discrimination against individuals based on their membership in some group, while maintaining utility for the classifier (the university). The main conceptual contribution of this paper is a framework for fair classification comprising (1) a (hypothetical) task-specific metric for determining the degree to which individuals are similar with respect to the...
-
T. Solorio, M. Sherman, Y. Liu|Oct 22nd, 2010|journalArticleT. Solorio, M. Sherman, Y. LiuOct 22nd, 2010
In this work we study how features typically used in natural language processing tasks, together with measures from syntactic complexity, can be adapted to the problem of developing language profiles of bilingual children. Our experiments show that these features can provide high discriminative value for predicting language dominance from story retells in a Spanish–English bilingual population of children. Moreover, some of our proposed features are even more powerful than measures commonly...
-
R.S.J.d Baker, B. McGaw, P. Peterson|Jan 31st, 2010|bookSectionR.S.J.d Baker, B. McGaw, P. PetersonJan 31st, 2010
-
Xiaoming Xi|Jul 31st, 2010|journalArticleXiaoming XiJul 31st, 2010
-
Ehud Reiter, Anja Belz|Dec 31st, 2009|journalArticleEhud Reiter, Anja BelzDec 31st, 2009
There is growing interest in using automatically computed corpus-based evaluation metrics to evaluate Natural Language Generation (NLG) systems, because these are often considerably cheaper than the human-based evaluations which have traditionally been used in NLG. We review previous work on NLG evaluation and on validation of automatic metrics in NLP, and then present the results of two studies of how well some metrics which are popular in other areas of NLP (notably BLEU and ROUGE)...