Open Access. Powered by Scholars. Published by Universities.®
![Digital Commons Network](http://assets.bepress.com/20200205/img/dcn/DCsunburst.png)
Social and Behavioral Sciences Commons™
Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 1 of 1
Full-Text Articles in Social and Behavioral Sciences
Assessing The Costs Of Machine-Assisted Corpus Annotation Through A User Study, Deryle W. Lonsdale, Eric K. Ringger, Marc A. Carmen, Robbie A. Haertel, Kevin Seppi, Peter J. Mcclanahan, James Carroll, Noel Ellison
Assessing The Costs Of Machine-Assisted Corpus Annotation Through A User Study, Deryle W. Lonsdale, Eric K. Ringger, Marc A. Carmen, Robbie A. Haertel, Kevin Seppi, Peter J. Mcclanahan, James Carroll, Noel Ellison
Faculty Publications
Fixed, limited budgets often constrain the amount of expert annotation that can go into the construction of annotated corpora. Estimating the cost of annotation is the first step toward using annotation resources wisely. We present here a study of the cost of annotation. This study includes the participation of annotators at various skill levels and with varying backgrounds. Conducted over the web, the study consists of tests that simulate machine-assisted pre-annotation, requiring correction by the annotator rather than annotation from scratch. The study also includes tests representative of an annotation scenario involving Active Learning as it progresses from a naïve …