Sign Languages Commons^™

Exploring Strategies For Modeling Sign Language Phonology, Lee Kezar, Riley Carlin, Tejas Srinivasan, Zed Sehyr, Naomi Caselli, Jesse Thomason

Communication Sciences and Disorders Faculty Articles and Research

Like speech, signs are composed of discrete, recombinable features called phonemes. Prior work shows that models which can recognize phonemes are better at sign recognition, motivating deeper exploration into strategies for modeling sign language phonemes. In this work, we learn graph convolution networks to recognize the sixteen phoneme “types” found in ASL-LEX 2.0. Specifically, we explore how learning strategies like multi-task and curriculum learning can leverage mutually useful information between phoneme types to facilitate better modeling of sign language phonemes. Results on the Sem-Lex Benchmark show that curriculum learning yields an average accuracy of 87% across all phoneme types, outperforming …

Asymmetric Event-Related Potential Priming Effects Between English Letters And American Sign Language Fingerspelling Fonts, Zed Sevcikova Sehyr, Katherine J. Midgley, Karen Emmory, Phillip J. Holcomb

Communication Sciences and Disorders Faculty Articles and Research

Letter recognition plays an important role in reading and follows different phases of processing, from early visual feature detection to the access of abstract letter representations. Deaf ASL–English bilinguals experience orthography in two forms: English letters and fingerspelling. However, the neurobiological nature of fingerspelling representations, and the relationship between the two orthographies, remains unexplored. We examined the temporal dynamics of single English letter and ASL fingerspelling font processing in an unmasked priming paradigm with centrally presented targets for 200 ms preceded by 100 ms primes. Event-related brain potentials were recorded while participants performed a probe detection task. Experiment 1 examined …

Improving Sign Recognition With Phonology, Lee Kezar, Jesse Thomason, Zed Sevcikova Sehyr

Communication Sciences and Disorders Faculty Articles and Research

We use insights from research on American Sign Language (ASL) phonology to train models for isolated sign language recognition (ISLR), a step towards automatic sign language understanding. Our key insight is to explicitly recognize the role of phonology in sign production to achieve more accurate ISLR than existing work which does not consider sign language phonology. We train ISLR models that take in pose estimations of a signer producing a single sign to predict not only the sign but additionally its phonological characteristics, such as the handshape. These auxiliary predictions lead to a nearly 9% absolute gain in sign recognition …

Stolperstein/Stumbling Stone For Holocaust Survivor Otto Heimann/Bob Hymann, Bochum/German, Toronto/Kanada Und New York, Ny, Usa, Courtney Conte, Mona Eikel-Pohen

Languages, Literatures, and Linguistics - All Scholarship

The documentation tries to capture the life of Holocaust survivor Otto Heimann/Bob Hyman who spent his youth in Bochum-Langendreer, Germany, and was forced by the National Socialists to leave parents, home, and country. The documentation does not claim to give a full picture, just an insight into Otto Heimann's/Bob Hyman's life.

It will be read out on June 6, 2023 in Bochum, Germany when a Stolperstein, a stumbling stone, will be place near Alte Bahnhstraße 6 in Bochum-Langendreer, Germany, to commemorate Otto Heimann/Bob Hyman, so that we and future generations may learn from history.

Diese Dokumentation versucht, das Leben Bob …