Search
702 resources
-
Ou Lydia Liu, Chris Brew, John Blackmore...|Mar 6th, 2014|journalArticleOu Lydia Liu, Chris Brew, John Blackmore...Mar 6th, 2014
Content‐based automated scoring has been applied in a variety of science domains. However, many prior applications involved simplified scoring rubrics without considering rubrics representing multiple levels of understanding. This study tested a concept‐based scoring tool for content‐based scoring, c‐rater™, for four science items with rubrics aiming to differentiate among multiple levels of understanding. The items showed moderate to good agreement with human scores. The findings suggest...
-
Russell G. Almond|Dec 11th, 2013|journalArticleRussell G. AlmondDec 11th, 2013
-
J.A. León, R. Olmos, I. Escudero|Jul 27th, 2013|journalArticleJ.A. León, R. Olmos, I. EscuderoJul 27th, 2013
-
Questar Assessment, Inc.|Apr 27th, 2013|reportQuestar Assessment, Inc.Apr 27th, 2013
A reverse engineering approach to automatic item generation (AIG) was applied to a figurebased publicly released test item from the Organisation for Economic Cooperation and Development (OECD) Programme for International Student Assessment (PISA) mathematical literacy cognitive instrument as part of a proof of concept. The author created an item template from which three items were randomly generated from within each of six types defined by a feature deemed to be most likely to affect item...
-
Sara Cushing Weigle|Jan 27th, 2013|journalArticleSara Cushing WeigleJan 27th, 2013
-
Sara Cushing Weigle|Jan 27th, 2013|journalArticleSara Cushing WeigleJan 27th, 2013
-
Mark J. Gierl, Thomas M. Haladyna|Oct 27th, 2013|bookMark J. Gierl, Thomas M. HaladynaOct 27th, 2013
"Automatic item generation (AIG) represents a relatively new and unique research area where specific cognitive and psychometric theories are applied to test construction practices for the purpose of producing test items using technology. The purpose of this book is to bring researchers and practitioners up-to-date on the growing body of research on AIG by organizing in one volume what is currently known about this research area. Part I begins with an overview of the concepts and topics...
-
Kellie Morrissey, Jurek Kirakowski, Masa...|Oct 27th, 2013|bookSectionKellie Morrissey, Jurek Kirakowski, Masa...Oct 27th, 2013
-
Yoav Cohen, Yael Safran|Apr 27th, 2012|conferencePaperYoav Cohen, Yael SafranApr 27th, 2012
-
Brent Bridgeman, Catherine Trapani, Yiga...|Jan 27th, 2012|journalArticleBrent Bridgeman, Catherine Trapani, Yiga...Jan 27th, 2012
-
Issac I. Bejar|Sep 27th, 2012|journalArticleIssac I. BejarSep 27th, 2012
-
Brent Bridgeman, Catherine Trapani, Yiga...|Jan 27th, 2012|journalArticleBrent Bridgeman, Catherine Trapani, Yiga...Jan 27th, 2012
-
Lise Getoor, Ashwin Machanavajjhala|Aug 27th, 2012|journalArticleLise Getoor, Ashwin MachanavajjhalaAug 27th, 2012
This tutorial brings together perspectives on ER from a variety of fields, including databases, machine learning, natural language processing and information retrieval, to provide, in one setting, a survey of a large body of work. We discuss both the practical aspects and theoretical underpinnings of ER. We describe existing solutions, current challenges, and open research problems.
-
David M. Williamson, Xiaoming Xi, F. Jay...|Mar 27th, 2012|journalArticleDavid M. Williamson, Xiaoming Xi, F. Jay...Mar 27th, 2012
-
Miao Chen, Klaus Zechner|Jun 27th, 2011|conferencePaperMiao Chen, Klaus ZechnerJun 27th, 2011
-
Cynthia Dwork, Moritz Hardt, Toniann Pit...|Oct 27th, 2011|journalArticleCynthia Dwork, Moritz Hardt, Toniann Pit...Oct 27th, 2011
We study fairness in classification, where individuals are classified, e.g., admitted to a university, and the goal is to prevent discrimination against individuals based on their membership in some group, while maintaining utility for the classifier (the university). The main conceptual contribution of this paper is a framework for fair classification comprising (1) a (hypothetical) task-specific metric for determining the degree to which individuals are similar with respect to the...
-
T. Solorio, M. Sherman, Y. Liu|Oct 22nd, 2010|journalArticleT. Solorio, M. Sherman, Y. LiuOct 22nd, 2010
In this work we study how features typically used in natural language processing tasks, together with measures from syntactic complexity, can be adapted to the problem of developing language profiles of bilingual children. Our experiments show that these features can provide high discriminative value for predicting language dominance from story retells in a Spanish–English bilingual population of children. Moreover, some of our proposed features are even more powerful than measures commonly...
-
R.S.J.d Baker, B. McGaw, P. Peterson|Oct 27th, 2010|bookSectionR.S.J.d Baker, B. McGaw, P. PetersonOct 27th, 2010
-
Xiaoming Xi|Jul 27th, 2010|journalArticleXiaoming XiJul 27th, 2010
-
Ehud Reiter, Anja Belz|Dec 27th, 2009|journalArticleEhud Reiter, Anja BelzDec 27th, 2009
There is growing interest in using automatically computed corpus-based evaluation metrics to evaluate Natural Language Generation (NLG) systems, because these are often considerably cheaper than the human-based evaluations which have traditionally been used in NLG. We review previous work on NLG evaluation and on validation of automatic metrics in NLP, and then present the results of two studies of how well some metrics which are popular in other areas of NLP (notably BLEU and ROUGE)...