Open Access. Powered by Scholars. Published by Universities.®

Education Commons

Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research

PDF

Selected Works

Nathanael Reinertsen

2018

Assessing writing

Articles 1 - 1 of 1

Full-Text Articles in Education

Why Can’T It Mark This One? A Qualitative Analysis Of Student Writing Rejected By An Automated Essay Scoring System, Nathanael Reinertsen Dec 2017

Why Can’T It Mark This One? A Qualitative Analysis Of Student Writing Rejected By An Automated Essay Scoring System, Nathanael Reinertsen

Nathanael Reinertsen

The difference in how humans read and how Automatic Essay Scoring (AES) systems process written language leads to a situation where a portion of student responses will be comprehensible to human markers, while being unable to be parsed by AES systems. This paper examines a number of pieces of student writing that were marked by trained human markers, but subsequently rejected by an AES system during the development of a scoring model for the eWrite online writing assessment that is offered by The Australian Council for Educational Research. The features of these ‘unscoreable’ responses are examined through a qualitative analysis. …