The m-rater™ engine: Introduction to the automated scoring of mathematics items

Article Status
Published
Author/contributor
Title
The m-rater™ engine: Introduction to the automated scoring of mathematics items
Abstract
This report provides an introduction to the m-rater™ engine, ETS’s automated scoring engine for computer-delivered constructed-response items when the response is a number, an equation (or mathematical expression), or a graph. This introduction is intended to acquaint the reader with the types of items that m-rater can score, the requirements for authoring these items onscreen, the methods m-rater uses to score these items, and the features these items must possess to be reliably scored. M-rater can score 3 types of responses—numeric responses, equations, and graphs—and these 3 types of responses are considered separately. Each type of response has certain technical requirements that must be satisfied and certain considerations for scoring. These requirements are discussed in detail in the Numeric Response Items, Equation Items, and Graph Items sections. Also discussed are generating example items—items with many correct solutions for which the student must produce 1 correct solution. The final chapter explains how to convert scoring rubrics into concepts and scoring rules, a necessary step for building m-rater scoring models.
Publication
Research Memorandum No. Rm-17-02
Language
English
Extra
Citation Key: fife <标题>: m-rater™ 引擎:数学题目自动评分简介
Citation
Fife, J. H. (n.d.). The m-raterTM engine: Introduction to the automated scoring of mathematics items. Research Memorandum No. Rm-17-02.
Powered by Zotero and Kerko.