Phonetics and Phonology Commons^™

Iconicity As An Organizing Principle Of The Lexicon, Erin E. Campbell, Zed Sevcikova Sehyr, Elana Pontecorvo, Ariel Cohen-Goldberg, Karen Emmorey, Naomi Caselli

Communication Sciences and Disorders Faculty Articles and Research

The view that words are arbitrary is a foundational assumption about language, used to set human languages apart from nonhuman communication. We present here a study of the alignment between the semantic and phonological structure (systematicity) of American Sign Language (ASL), and for comparison, two spoken languages—English and Spanish. Across all three languages, words that are semantically related are more likely to be phonologically related, highlighting systematic alignment between word form and word meaning. Critically, there is a significant effect of iconicity (a perceived physical resemblance between word form and word meaning) on this alignment: words are most likely to …

Do Deaf Readers Pre-Activate Phonology During Sentence Comprehension?, Danielle Moraga, Lauren Fillet, Eva Gutierrez-Sigut, Zed Sehyr

Student Scholar Symposium Abstracts and Posters

Readers can use linguistic and contextual clues to predict upcoming words in a sentence. This predictive processing allows for more efficient recognition of upcoming words, particularly when the context of a sentence is predictable (Federmeier & Kutas, 1999; Metusalem et al., 2012). Evidence suggests that for hearing readers, preactivation of word semantics and phonology facilitates the recognition of upcoming words in a sentence (Ito et al., 2016). Readers who became deaf/hard-of-hearing before learning a language rely primarily on visual rather than auditory input, and it is unclear if they engage in similar predictive processes. The study aims to investigate the …

Exploring Strategies For Modeling Sign Language Phonology, Lee Kezar, Riley Carlin, Tejas Srinivasan, Zed Sehyr, Naomi Caselli, Jesse Thomason

Communication Sciences and Disorders Faculty Articles and Research

Like speech, signs are composed of discrete, recombinable features called phonemes. Prior work shows that models which can recognize phonemes are better at sign recognition, motivating deeper exploration into strategies for modeling sign language phonemes. In this work, we learn graph convolution networks to recognize the sixteen phoneme “types” found in ASL-LEX 2.0. Specifically, we explore how learning strategies like multi-task and curriculum learning can leverage mutually useful information between phoneme types to facilitate better modeling of sign language phonemes. Results on the Sem-Lex Benchmark show that curriculum learning yields an average accuracy of 87% across all phoneme types, outperforming …

Improving Sign Recognition With Phonology, Lee Kezar, Jesse Thomason, Zed Sevcikova Sehyr

Communication Sciences and Disorders Faculty Articles and Research

We use insights from research on American Sign Language (ASL) phonology to train models for isolated sign language recognition (ISLR), a step towards automatic sign language understanding. Our key insight is to explicitly recognize the role of phonology in sign production to achieve more accurate ISLR than existing work which does not consider sign language phonology. We train ISLR models that take in pose estimations of a signer producing a single sign to predict not only the sign but additionally its phonological characteristics, such as the handshape. These auxiliary predictions lead to a nearly 9% absolute gain in sign recognition …

An Interactive Visual Database For American Sign Language Reveals How Signs Are Organized In The Mind, Zed Sevcikova Sehyr, Ariel Goldberg, Karen Emmory, Naomi Caselli

Communication Sciences and Disorders Faculty Articles and Research

"We are four researchers who study psycholinguistics, linguistics, neuroscience and deaf education. Our team of deaf and hearing scientists worked with a group of software engineers to create the ASL-LEX database that anyone can use for free. We cataloged information on nearly 3,000 signs and built a visual, searchable and interactive database that allows scientists and linguists to work with ASL in entirely new ways."

The Asl-Lex 2.0 Project: A Database Of Lexical And Phonological Properties For 2,723 Signs In American Sign Language, Zed Sevcikova Sehyr, Naomi Caselli, Ariel M. Cohen-Goldberg, Karen Emmory

Communication Sciences and Disorders Faculty Articles and Research

ASL-LEX is a publicly available, large-scale lexical database for American Sign Language (ASL). We report on the expanded database (ASL-LEX 2.0) that contains 2,723 ASL signs. For each sign, ASL-LEX now includes a more detailed phonological description, phonological density and complexity measures, frequency ratings (from deaf signers), iconicity ratings (from hearing non-signers and deaf signers), transparency (“guessability”) ratings (from non-signers), sign and videoclip durations, lexical class, and more. We document the steps used to create ASL-LEX 2.0 and describe the distributional characteristics for sign properties across the lexicon and examine the relationships among lexical and phonological properties of signs. Correlation …

Vowel Formant Dispersion Reflects Severity Of Apraxia Of Speech, Dirk B. Den Ouden, Elena Galkina, Alexandra Basilakos, Julius Fridriksson

Communication Sciences and Disorders Faculty Articles and Research

Background: Apraxia of Speech (AOS) has been associated with deviations in consonantal voice onset time (VOT), but studies of vowel acoustics have yielded conflicting results. However, a speech motor planning disorder that is not bound by phonological categories is expected to affect vowel as well as consonant articulations.

Aims: We measured consonant VOTs and vowel formants produced by a large sample of stroke survivors, and assessed to what extent these variables and their dispersion are predictive of AOS presence and severity, based on a scale that uses clinical observations to rate gradient presence of AOS, aphasia, and dysarthria. …

Shiwilu (Jebero), Pilar Valenzuela, Carlos Gussenhoven

World Languages and Cultures Faculty Articles and Research

Shiwilu (a.k.a. Jebero) is a critically endangered language from Peruvian Amazonia and one of the two members of the Kawapanan linguistic family. Most of its nearly 30 remaining fluent speakers live in and around the village of Jeberos (District of Jeberos, Province of Alto Amazonas, Loreto Region), at approximately 5° S, 75° W. The documentation of Shiwilu is scarce and no survey grammar is available. Until very recently, the only trained linguist who had worked on Shiwilu was John Bendor- Samuel, who carried out fieldwork in 1955–1956 and completed a doctoral thesis in 1958 (see Bendor-Samuel 1981 [1958]). An abridged …