Sign Languages Commons^™

Exploring Strategies For Modeling Sign Language Phonology, Lee Kezar, Riley Carlin, Tejas Srinivasan, Zed Sehyr, Naomi Caselli, Jesse Thomason

Communication Sciences and Disorders Faculty Articles and Research

Like speech, signs are composed of discrete, recombinable features called phonemes. Prior work shows that models which can recognize phonemes are better at sign recognition, motivating deeper exploration into strategies for modeling sign language phonemes. In this work, we learn graph convolution networks to recognize the sixteen phoneme “types” found in ASL-LEX 2.0. Specifically, we explore how learning strategies like multi-task and curriculum learning can leverage mutually useful information between phoneme types to facilitate better modeling of sign language phonemes. Results on the Sem-Lex Benchmark show that curriculum learning yields an average accuracy of 87% across all phoneme types, outperforming …

Improving Sign Recognition With Phonology, Lee Kezar, Jesse Thomason, Zed Sevcikova Sehyr

Communication Sciences and Disorders Faculty Articles and Research

We use insights from research on American Sign Language (ASL) phonology to train models for isolated sign language recognition (ISLR), a step towards automatic sign language understanding. Our key insight is to explicitly recognize the role of phonology in sign production to achieve more accurate ISLR than existing work which does not consider sign language phonology. We train ISLR models that take in pose estimations of a signer producing a single sign to predict not only the sign but additionally its phonological characteristics, such as the handshape. These auxiliary predictions lead to a nearly 9% absolute gain in sign recognition …

Stolperstein/Stumbling Stone For Holocaust Survivor Otto Heimann/Bob Hymann, Bochum/German, Toronto/Kanada Und New York, Ny, Usa, Courtney Conte, Mona Eikel-Pohen

Languages, Literatures, and Linguistics - All Scholarship

The documentation tries to capture the life of Holocaust survivor Otto Heimann/Bob Hyman who spent his youth in Bochum-Langendreer, Germany, and was forced by the National Socialists to leave parents, home, and country. The documentation does not claim to give a full picture, just an insight into Otto Heimann's/Bob Hyman's life.

It will be read out on June 6, 2023 in Bochum, Germany when a Stolperstein, a stumbling stone, will be place near Alte Bahnhstraße 6 in Bochum-Langendreer, Germany, to commemorate Otto Heimann/Bob Hyman, so that we and future generations may learn from history.

Diese Dokumentation versucht, das Leben Bob …

An Interactive Visual Database For American Sign Language Reveals How Signs Are Organized In The Mind, Zed Sevcikova Sehyr, Ariel Goldberg, Karen Emmory, Naomi Caselli

Communication Sciences and Disorders Faculty Articles and Research

"We are four researchers who study psycholinguistics, linguistics, neuroscience and deaf education. Our team of deaf and hearing scientists worked with a group of software engineers to create the ASL-LEX database that anyone can use for free. We cataloged information on nearly 3,000 signs and built a visual, searchable and interactive database that allows scientists and linguists to work with ASL in entirely new ways."

The Asl-Lex 2.0 Project: A Database Of Lexical And Phonological Properties For 2,723 Signs In American Sign Language, Zed Sevcikova Sehyr, Naomi Caselli, Ariel M. Cohen-Goldberg, Karen Emmory

Communication Sciences and Disorders Faculty Articles and Research

ASL-LEX is a publicly available, large-scale lexical database for American Sign Language (ASL). We report on the expanded database (ASL-LEX 2.0) that contains 2,723 ASL signs. For each sign, ASL-LEX now includes a more detailed phonological description, phonological density and complexity measures, frequency ratings (from deaf signers), iconicity ratings (from hearing non-signers and deaf signers), transparency (“guessability”) ratings (from non-signers), sign and videoclip durations, lexical class, and more. We document the steps used to create ASL-LEX 2.0 and describe the distributional characteristics for sign properties across the lexicon and examine the relationships among lexical and phonological properties of signs. Correlation …

Zoomprov. Improvisation Exercises For Language Learning In Online Classes With Zoom Or Similar Tech For Beginning And Intermediate Learners And Beyond, Mona Eikel-Pohen

Languages, Literatures, and Linguistics - All Scholarship

The improv language exercises in this compilation are chosen from the experience I gathered 20 years ago, but also from the amazing work of Lauren Esposito and Scranton Improv & Comedy that have been more real than anything else to me this past summer, and from Jim Ansaldo, who taught me how to structure improv exercises online. They are organized by level, referring to the Common European Framework of References for Languages. That means, A1 exercises can be conducted at the beginners level but also at all other higher levels, but B2 exercises should not be imposed upon beginners or …

Cross-Linguistic Metaphor Priming In Asl-English Bilinguals: Effects Of The Double Mapping Constraint, Franziska Schaller, Brittany Lee, Zed Sevcikova Sehyr, Lucinda O'Grady Farnady, Karen Emmorey

Communication Sciences and Disorders Faculty Articles and Research

Meir’s (2010) Double Mapping Constraint (DMC) states the use of iconic signs in metaphors is restricted to signs that preserve the structural correspondence between the articulators and the concrete source domain and between the concrete and metaphorical domains. We investigated ASL signers’ comprehension of English metaphors whose translations complied with the DMC (Communication collapsed during the meeting) or violated the DMC (The acid ate the metal). Metaphors were preceded by the ASL translation of the English verb, an unrelated sign, or a still video. Participants made sensibility judgments. Response times (RTs) were faster for DMC-Compliant sentences …

A Lexical Frequency Analysis Of Irish Sign Language, Robert G. Smith, Markus Hofmann

Articles

Word frequency has a significant impact on language acquisition and fluency. It is often a point of reference for the teaching and assessing of a language and indeed, as a control for psycholinguistic studies. This paper presents the results of the first objective frequency analysis of lexical tokens from the Signs of Ireland corpus. We investigate the frequency of fully lexical, partly lexical and non-lexical signs in Irish Sign Language as they are presented in the corpus. We confirm the accuracy of the lexical gloss frequency data with a supplementary corpus subset that is tagged for grammatical class and additional …

Unique N170 Signatures To Words And Faces In Deaf Asl Signers Reflect Experience-Specific Adaptations During Early Visual Processing, Zed Sevcikova Sehyr, Katherine J. Midgley, Phillipp J. Holcomb, Karen Emmorey, David C. Plaut, Marlene Behrmann

Communication Sciences and Disorders Faculty Articles and Research

Previous studies with deaf adults reported reduced N170 waveform asymmetry to visual words, a finding attributed to reduced phonological mapping in left-hemisphere temporal regions compared to hearing adults. An open question remains whether this pattern indeed results from reduced phonological processing or from general neurobiological adaptations in visual processing of deaf individuals. Deaf ASL signers and hearing nonsigners performed a same-different discrimination task with visually presented words, faces, or cars, while scalp EEG time-locked to the onset of the first item in each pair was recorded. For word recognition, the typical left-lateralized N170 in hearing participants and reduced left-sided asymmetry …

A Data-Driven Approach To The Semantics Of Iconicity In American Sign Language And English, Bill Thompson, Marcus Perlman, Gary Lupyan, Zed Sevcikova Sehyr, Karen Emmory

Communication Sciences and Disorders Faculty Articles and Research

A growing body of research shows that both signed and spoken languages display regular patterns of iconicity in their vocabularies. We compared iconicity in the lexicons of American Sign Language (ASL) and English by combining previously collected ratings of ASL signs (Caselli, Sevcikova Sehyr, Cohen-Goldberg, & Emmorey, 2017) and English words (Winter, Perlman, Perry, & Lupyan, 2017) with the use of data-driven semantic vectors derived from English. Our analyses show that models of spoken language lexical semantics drawn from large text corpora can be useful for predicting the iconicity of signs as well as words. Compared to English, ASL has …

The Perceived Mapping Between Form And Meaning In American Sign Language Depends On Linguistic Knowledge And Task: Evidence From Iconicity And Transparency Judgments, Zed Sevcikova Sehyr, Karen Emmorey

Communication Sciences and Disorders Faculty Articles and Research

Iconicity is often defined as the resemblance between a form and a given meaning, while transparency is defined as the ability to infer a given meaning based on the form. This study examined the influence of knowledge of American Sign Language (ASL) on the perceived iconicity of signs and the relationship between iconicity, transparency (correctly guessed signs), ‘perceived transparency’ (transparency ratings of the guesses), and ‘semantic potential’ (the diversity (H index) of guesses). Experiment 1 compared iconicity ratings by deaf ASL signers and hearing non-signers for 991 signs from the ASL-LEX database. Signers and non-signers’ ratings were highly correlated; however, …

Second Language Acquisition Of American Sign Language Influences Co-Speech Gesture Production, Jill Weisberg, Shannon Casey, Zed Sevcikova Sehyr, Karen Emmorey

Communication Sciences and Disorders Faculty Articles and Research

Previous work indicates that 1) adults with native sign language experience produce more manual co-speech gestures than monolingual non-signers, and 2) one year of ASL instruction increases gesture production in adults, but not enough to differentiate them from non-signers. To elucidate these effects, we asked early ASL–English bilinguals, fluent late second language (L2) signers (≥ 10 years of experience signing), and monolingual non-signers to retell a story depicted in cartoon clips to a monolingual partner. Early and L2 signers produced manual gestures at higher rates compared to non-signers, particularly iconic gestures, and used a greater variety of handshapes. These results …

Referring Strategies In American Sign Language And English (With Co-Speech Gesture): The Role Of Modality In Referring To Non-Nameable Objects, Zed Sevcikova Sehyr, Brenda Nicodemus, Jennifer Petrich, Karen Emmorey

Communication Sciences and Disorders Faculty Articles and Research

American Sign Language (ASL) and English differ in linguistic resources available to express visual–spatial information. In a referential communication task, we examined the effect of language modality on the creation and mutual acceptance of reference to non-nameable figures. In both languages, description times reduced over iterations and references to the figures’ geometric properties (“shape-based reference”) declined over time in favor of expressions describing the figures’ resemblance to nameable objects (“analogy-based reference”). ASL signers maintained a preference for shape-based reference until the final (sixth) round, while English speakers transitioned toward analogy-based reference by Round 3. Analogy-based references were more time efficient …

Memory And The Realization Of The Nothingness. On A Letter Of Vittorio Sereni To Giuseppe Ungaretti, Stefano Giannini

Languages, Literatures, and Linguistics - All Scholarship

The problematic relationship of Giuseppe Ungaretti (1888-1970) with Alexandria of Egypt – his city of birth – sheds light on the interplay between memory and oblivion in his poetry and prose. The shuttling back and forth between these poles marks the nature of his unfulfilled desire to recreate a lost Alexandrian atmosphere. In Ungaretti’s works, language opacity is coupled with his attempts to represent a city—as he writes—that is suffocated by the sun and whose hidden ancient port is submerged in the depth of the sea. Blinding light and the darkness of the deep waters make the understanding of Ungaretti’s …

The N170 Erp Component Differs In Laterality, Distribution, And Association With Continuous Reading Measures For Deaf And Hearing Readers, Karen Emmorey, Katherine J. Midgley, Casey B. Kohen, Zed Sevcikova Sehyr, Phillipp J. Holcomb

Communication Sciences and Disorders Faculty Articles and Research

The temporo-occipitally distributed N170 ERP component is hypothesized to reflect print-tuning in skilled readers. This study investigated whether skilled deaf and hearing readers (matched on reading ability, but not phonological awareness) exhibit similar N170 patterns, given their distinct experiences learning to read. Thirty-two deaf and 32 hearing adults viewed words and symbol strings in a familiarity judgment task. In the N170 epoch (120–240 ms) hearing readers produced greater negativity for words than symbols at left hemisphere (LH) temporo-parietal and occipital sites, while deaf readers only showed this asymmetry at occipital sites. Linear mixed effects regression was used to examine the …

Implicit Co-Activation Of American Sign Language In Deaf Readers: An Erp Study, Gabriela Meade, Katherine J. Midgley, Zed Sevcikova Sehyr, Phillipp J. Holcomb, Karen Emmorey

Communication Sciences and Disorders Faculty Articles and Research

In an implicit phonological priming paradigm, deaf bimodal bilinguals made semantic relatedness decisions for pairs of English words. Half of the semantically unrelated pairs had phonologically related translations in American Sign Language (ASL). As in previous studies with unimodal bilinguals, targets in pairs with phonologically related translations elicited smaller negativities than targets in pairs with phonologically unrelated translations within the N400 window. This suggests that the same lexicosemantic mechanism underlies implicit co-activation of a non-target language, irrespective of language modality. In contrast to unimodal bilingual studies that find no behavioral effects, we observed phonological interference, indicating that bimodal bilinguals may …

Pirandello And Satire. The Imaginary Journey Of Four Authors In Search Of A Character According To Charles Kenneth Scott Moncrieff (1889-1930), Stefano Giannini

Languages, Literatures, and Linguistics - All Scholarship

Drawing on a little-known work by Scott-Moncrieff, this article investigates Luigi Pirandello’s intellectual and literary reach across genres and space, from theater to pamphlets, from Italy to the English-speaking world. A talented writer and translator, Charles K. Scott-Moncrieff published “The Strange & Striking Adventures of Four Authors in Search of a Character” by P. G. Lear & L. O in 1926. The title of the pamphlet, and the acronym of the fictional author are references to Pirandello and to his Six Characters in Search of an Author. Scott-Moncrieff had all the documents in order to write about, or in …

Predicate Structures, Gesture, And Simultaneity In The Representation Of Action In British Sign Language: Evidence From Deaf Children And Adults, Kearsy Cormier, Sandra Smith, Zed Sehyr

Communication Sciences and Disorders Faculty Articles and Research

British Sign Language (BSL) signers use a variety of structures, such as constructed action (CA), depicting constructions (DCs), or lexical verbs, to represent action and other verbal meanings. This study examines the use of these verbal predicate structures and their gestural counterparts, both separately and simultaneously, in narratives by deaf children with various levels of exposure to BSL (ages 5;1 to 7;5) and deaf adult native BSL signers. Results reveal that all groups used the same types of predicative structures, including children with minimal BSL exposure. However, adults used CA, DCs, and/or lexical signs simultaneously more frequently than children. These …

The Paradox Of Amnesia: Tondelli's Un Weekend Postmoderno, Stefano Giannini

Languages, Literatures, and Linguistics - All Scholarship

Tondelli opens his Un weekend postmoderno. Cronache dagli anni Ottanta declaring an intention opposite to the display of amnesia. In the long table of contents of his book, he writes down everything, in an excruciating streaming of details, so that the table of content becomes an exhaustive index of names and ideas. Yet, hidden within the hundreds of analytical snapshots, one of its many characters mentions the importance of dissimulation. Dissimulation, according to Tondelli, hides what is known, to protect the dissimulator and to mask the truth. Also, amnesia is a voluntary practice that can be enacted in order to …

Lexicalization And De-Lexicalization Processes In Sign Languages: Comparing Depicting Constructions And Viewpoint Gestures, Kearsy Cormier, David Quinto-Pozos, Zed Sehyr, Adam Schembri

Communication Sciences and Disorders Faculty Articles and Research

In this paper, we compare so-called “classifier” constructions in signed languages (which we refer to as “depicting constructions”) with comparable iconic gestures produced by non-signers. We show clear correspondences between entity constructions and observer viewpoint gestures on the one hand, and handling constructions and character viewpoint gestures on the other. Such correspondences help account for both lexicalisation and de-lexicalisation processes in signed languages and how these processes are influenced by viewpoint. Understanding these processes is crucial when coding and annotating natural sign language data.

Luciano Bianciardi’S Aprire Il Fuoco: On The Function Of Literature In Society, Stefano Giannini

Languages, Literatures, and Linguistics - All Scholarship

This is the first article to assess the importance of Luciano Bianciardi’s last novel, Aprire il fuoco [Open Fire!](1969), a work often overlooked, that offers crucial insights into Bianciardi’s commitments to social causes. A so-called “irregular” of 20th-century Italian literary panorama, Luciano Bianciardi (1922-1971) in his Aprire il fuoco discusses his idea of literature as an activity that must aim at assuming the role of ethical guide in societies. In my article, I gloss the often obscure historical and literary references of the novel, and provide a critical assessment of its impact.

Hidden Sentiments, Unfinished Project: Pirandello’S Film La Nuova Colonia, Stefano Giannini

Languages, Literatures, and Linguistics - All Scholarship

This article investigates the notion of the unfinished work. In Pirandello studies the word unfinished holds particular importance. Luigi Pirandello's last, and one of his major works, I giganti della montagna [The Mountain Giants] was not completed. The many years devoted to its making weaken the assumption that Pirandello was not capable of completing it in favor of his decision not to complete his work. I considered the overlapping of the writing of I giganti della montagna and of the attempts to produce the film La nuova colonia [The New Colony] an important, and insofar unnoticed, key element for understanding …

Un Nuovo Dato Per La Cronologia Della Versione Cinematografica Della Nuova Colonia Di Luigi Pirandello, Stefano Giannini

Languages, Literatures, and Linguistics - All Scholarship

Luigi Pirandello (1867-1936) wrote numerous film-treatments inspired by his short-stories and plays that were not completed as films. Among the never completed films there is La Nuova Colonia. The history of the film-project La Nuova Colonia [The New Colony] is important for the further understanding of Pirandello’s poetics. Nestled in the plot of Pirandello’s novel Suo marito [Her Husband], La Nuova Colonia took on independent life in 1926 as the play of the same name that premiered in Rome in March 1928. The two dates indicated for the play are not the chronological limits for the La Nuova Colonia …

Piero Chiara E La Tradizione, Stefano Giannini

Languages, Literatures, and Linguistics - All Scholarship

Piero Chiara (Luino 1913- Varese 1986) wrote many novels and short stories that immediately met great public success. Critics devoted mixed attention to him but his works deserve a new critical assessment to analyze the rich and sophisticated web of cultural and literary references that permeate them. Through readings of Il piatto piange, “L’uovo al cianuro” and other novels and short stories, this paper analyses the complex textual relations Chiara entertains with Pirandello’s Il fu Mattia Pascal. Chiara investigates the themes of identity and the double. His narrative depicts an apparently lighthearted reality that in fact reveals despair. …

Un’Agra Salita. Lettura Di ‘Autostrada Della Cisa’ Di Vittorio Sereni, Stefano Giannini

Languages, Literatures, and Linguistics - All Scholarship

Luciano Bianciardi (1922-1971) wants to open a dialogue with his friend Vittorio Sereni (1913-1983) through the pages of his best-selling novel La vita agra (1962). Sereni does not respond immediately, and the approach seems not to have received Sereni’s attention. The analysis of Sereni’s 1981 poem “Autostrada della Cisa” proves that he ultimately decided to reply to his friend’s irreverent, yet congenial, comments, albeit nearly 20 years later. This article underlines the existential crisis expressed by Sereni in his poem, accompanied by his willingness to enter into a dialogue with any reader, despite the nihilistic outcomes he foresees. His efforts …