Tag Dictionaries Accelerate Manual Annotation,
2010
Brigham Young University
Tag Dictionaries Accelerate Manual Annotation, Deryle W. Lonsdale, Marc A. Carmen, Paul Felt, Robbie A. Haertel, Peter J. Mcclanahan, Eric K. Ringger, Kevin Seppi
Faculty Publications
Expert human input can contribute in various ways to facilitate automatic annotation of natural language text. For example, a part-of-speech tagger can be trained on labeled input provided offline by experts. In addition, expert input can be solicited by way of active learning to make the most of annotator expertise. However, hiring individuals to perform manual annotation is costly both in terms of money and time. This paper reports on a user study that was performed to determine the degree of effect that a part-of-speech dictionary has on a group of subjects performing the annotation task. The user study was …
Principled Construction Of Elicited Imitation Tests,
2010
Brigham Young University
Principled Construction Of Elicited Imitation Tests, Deryle W. Lonsdale, Carl Chritensen, Ross Hendrickson
Faculty Publications
In this paper we discuss the methodology behind the construction of elicited imitation (EI) test items. First we examine varying uses for EI tests in research and in testing overall oral proficiency. We also mention criticisms of previous test items. Then we identify the factors that contribute to the difficulty of an EI item as shown in previous studies. Based on this discussion, we describe a way of automating the creation of test items in order to better evaluate language learners’ oral proficiency while improving item naturalness. We present a new item construction tool and the process that it implements …
