Principled Construction Of Elicited Imitation Tests,
2010
Brigham Young University
Principled Construction Of Elicited Imitation Tests, Deryle W. Lonsdale, Carl Chritensen, Ross Hendrickson
Faculty Publications
In this paper we discuss the methodology behind the construction of elicited imitation (EI) test items. First we examine varying uses for EI tests in research and in testing overall oral proficiency. We also mention criticisms of previous test items. Then we identify the factors that contribute to the difficulty of an EI item as shown in previous studies. Based on this discussion, we describe a way of automating the creation of test items in order to better evaluate language learners’ oral proficiency while improving item naturalness. We present a new item construction tool and the process that it implements …
Tag Dictionaries Accelerate Manual Annotation,
2010
Brigham Young University
Tag Dictionaries Accelerate Manual Annotation, Deryle W. Lonsdale, Marc A. Carmen, Paul Felt, Robbie A. Haertel, Peter J. Mcclanahan, Eric K. Ringger, Kevin Seppi
Faculty Publications
Expert human input can contribute in various ways to facilitate automatic annotation of natural language text. For example, a part-of-speech tagger can be trained on labeled input provided offline by experts. In addition, expert input can be solicited by way of active learning to make the most of annotator expertise. However, hiring individuals to perform manual annotation is costly both in terms of money and time. This paper reports on a user study that was performed to determine the degree of effect that a part-of-speech dictionary has on a group of subjects performing the annotation task. The user study was …
A Probabilistic Morphological Analyzer For Syriac,
2010
Brigham Young University
A Probabilistic Morphological Analyzer For Syriac, Deryle W. Lonsdale, Peter J. Mcclanahan, George Busby, Robbie A. Haertel, Kristian Heal, Kevin Seppi, Eric Ringger
Faculty Publications
We define a probabilistic morphological analyzer using a data-driven approach for Syriac in order to facilitate the creation of an annotated corpus. Syriac is an under-resourced Semitic language for which there are no available language tools such as morphological analyzers. We introduce novel probabilistic models for segmentation, dictionary linkage, and morphological tagging and connect them in a pipeline to create a probabilistic morphological analyzer requiring only labeled data. We explore the performance of models with varying amounts of training data and find that with about 34,500 labeled tokens, we can outperform a reasonable baseline trained on over 99,000 tokens and …
Kbb: A Knowledge-Bundle Builder For Research Studies,
2010
Brigham Young University - Provo
Kbb: A Knowledge-Bundle Builder For Research Studies, Deryle W. Lonsdale, David W. Embley, Stephen W. Liddle, Aaron Stewart, Cui Tao
Faculty Publications
Researchers struggle to manage vast amounts of data coming from hundreds of sources in online repositories. To successfully conduct research studies, researchers need to find, retrieve, filter, extract, integrate, organize, and share information in a timely and high-precision manner. Active conceptual modeling for learning can give researchers the tools they need to perform their tasks in a more efficient, user-friendly, and computer-supported way. The idea is to create “knowledge bundles” (KBs), which are conceptual-model representations of organized information superimposed over a collection of source documents. A “knowledgebundle builder” (KBB) helps researchers develop KBs in a synergistic and incremental manner and …
