Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 1 of 1
Full-Text Articles in Speech and Hearing Science
Autoscore: An Open-Source Automated Tool For Scoring Listener Perception Of Speech, Stephanie A. Borrie, Tyson S. Barrett, Sarah E. Yoho Leopold
Autoscore: An Open-Source Automated Tool For Scoring Listener Perception Of Speech, Stephanie A. Borrie, Tyson S. Barrett, Sarah E. Yoho Leopold
Psychology Faculty Publications
Speech perception studies typically rely on trained research assistants to score orthographic listener transcripts for words correctly identified. While the accuracy of the human scoring protocol has been validated with strong intra- and inter-rater reliability, the process of hand-scoring the transcripts is time-consuming and resource intensive. Here, an open-source computer-based tool for automated scoring of listener transcripts is built (Autoscore) and validated on three different human-scored data sets. Results show that not only is Autoscore highly accurate, achieving approximately 99% accuracy, but extremely efficient. Thus, Autoscore affords a practical research tool, with clinical application, for scoring listener intelligibility of speech.