American Sign Language Commons^™

The Missing Link: Connecting Hearing Parents Of Deaf Children To Resources That Re-Center Language Access Decisions Around Their Deaf Child, Ella Stromberg

Undergraduate University Honors Capstones

Countless DHH children around the world experience language deprivation (National Association of the Deaf, n.d.). The deprivation of language severely impacts on a child’s comprehension and communication, limiting essential information for growth; in contrast, a hearing child would have advantageous access. Language deprivation occurs when parents cannot access or are unaware about resources to make educated decisions that center around their child (National Association of the Deaf, n.d.). This three-section project examines the experience of a Deaf individual born into a hearing family with no structural language access until his teenage years, highlighting the long-term impact of limited language exposure …

Iconicity As An Organizing Principle Of The Lexicon, Erin E. Campbell, Zed Sevcikova Sehyr, Elana Pontecorvo, Ariel Cohen-Goldberg, Karen Emmorey, Naomi Caselli

Communication Sciences and Disorders Faculty Articles and Research

The view that words are arbitrary is a foundational assumption about language, used to set human languages apart from nonhuman communication. We present here a study of the alignment between the semantic and phonological structure (systematicity) of American Sign Language (ASL), and for comparison, two spoken languages—English and Spanish. Across all three languages, words that are semantically related are more likely to be phonologically related, highlighting systematic alignment between word form and word meaning. Critically, there is a significant effect of iconicity (a perceived physical resemblance between word form and word meaning) on this alignment: words are most likely to …

Evidence For Explicitation: Working From Asl Into English, Campbell Mcdermid, Carrie Humphrey, Anita Harding

Journal of Interpretation

A study was done to examine the explicitation and compression strategies used by interpreters working from American Sign Language (ASL) into spoken English. To date, most research has focused only on their work from English into ASL. A review of the literature identified several expansion and compression strategies that interpreters and translators utilize, and these served as a model of coding the data and for triangulation. The methodology for this study was qualitative and descriptive. Twenty-two interpreters volunteered to simultaneously interpret four ASL recorded texts into spoken English, for a total of 88 target texts. The researchers identified 9 expansions …

Beyond The Hands: Exploring Intersectional Identities Of Black American Sign Language Users, Tatum Turner

Theses and Dissertations--Linguistics

There is a significant gap in research related to the impact of intersectionality on linguistic identity performance among individuals negotiating multiple marginalized identities. This gap is especially significant among deaf Black and African American individuals who use the American Sign Language (ASL) variety deemed Black American Sign Language (BASL) (Hairston & Smith, 1983). This research aims to identify and discuss the use of the eight distinguishing features of BASL (McCaskill et al. 2011) as indexes of intersectional identities.

My data consists of videos sourced from YouTube, each chosen according to the following criteria: must have at least one self-identifying Black …

Exploring Strategies For Modeling Sign Language Phonology, Lee Kezar, Riley Carlin, Tejas Srinivasan, Zed Sehyr, Naomi Caselli, Jesse Thomason

Communication Sciences and Disorders Faculty Articles and Research

Like speech, signs are composed of discrete, recombinable features called phonemes. Prior work shows that models which can recognize phonemes are better at sign recognition, motivating deeper exploration into strategies for modeling sign language phonemes. In this work, we learn graph convolution networks to recognize the sixteen phoneme “types” found in ASL-LEX 2.0. Specifically, we explore how learning strategies like multi-task and curriculum learning can leverage mutually useful information between phoneme types to facilitate better modeling of sign language phonemes. Results on the Sem-Lex Benchmark show that curriculum learning yields an average accuracy of 87% across all phoneme types, outperforming …

Improving Sign Recognition With Phonology, Lee Kezar, Jesse Thomason, Zed Sevcikova Sehyr

Communication Sciences and Disorders Faculty Articles and Research

We use insights from research on American Sign Language (ASL) phonology to train models for isolated sign language recognition (ISLR), a step towards automatic sign language understanding. Our key insight is to explicitly recognize the role of phonology in sign production to achieve more accurate ISLR than existing work which does not consider sign language phonology. We train ISLR models that take in pose estimations of a signer producing a single sign to predict not only the sign but additionally its phonological characteristics, such as the handshape. These auxiliary predictions lead to a nearly 9% absolute gain in sign recognition …

How Hearing Parents With Deaf Or Hard Of Hearing Children Construct Deafness Through Their Early Intervention Experience, Bettie T. Petersen

Language, Literacy, and Sociocultural Studies ETDs

This dissertation explores how hearing parents with deaf/hard of hearing children come to understand deafness. This mixed methods study used an online survey and multiple case studies (volunteers from survey). Participants were asked about early intervention experiences and beliefs about deafness. The survey had 74 respondents and five families participated in the interviews. Survey participants’ beliefs about deafness were primarily medical, focusing on the perceived barriers caused by deafness and the remediation of those barriers through spoken language options. A small number of respondents adopted a cultural perspective of deafness and focused on remediation of barriers through involvement in the …

Bilingual Language Stimulation Strategies: Recasting And Expansion: A Creative Research Based Product, Merri Lindsey

Undergraduate University Honors Capstones

The purpose of this research-based creative product was to provide a workshop to parents of toddlers providing information on preventative language stimulation strategies, specifically recasting and expansion. The original proposed study intended to analyze outcomes based on a pretest/posttest design, but due to recruitment challenges, it changed. Four remote synchronous workshops were planned: one for hearing parents of children acquiring ASL, one for hearing parents of children acquiring spoken English, one for deaf parents of children acquiring spoken English and ASL, and one for deaf parents of children acquiring ASL. Due to struggles with participant recruitment, I instead developed a …

Timing Comparisons Across American Sign Language And English, Jillian Bartlett

Thinking Matters Symposium

American Sign Language (ASL) and spoken English differ in modalities, but prosody can be found in both. Previous studies show that the Closure Positive Shift (CPS) (an established component of an Event-Related Potential [ERP]) occurs in response to acoustic stimuli indicative of prosodic phrasing (Pannekamp et al., 2005; Steinhauer et al., 1999). Prosodic processing in relation to these two modalities was studied using EEG. Sixteen Deaf ASL speakers and 34 hearing English speakers participated in the study by watching video or listening to audio recordings of stimuli while a portable electroencephalogram, or EEG (a device that detects abnormalities in brain …

An Interactive Visual Database For American Sign Language Reveals How Signs Are Organized In The Mind, Zed Sevcikova Sehyr, Ariel Goldberg, Karen Emmory, Naomi Caselli

Communication Sciences and Disorders Faculty Articles and Research

"We are four researchers who study psycholinguistics, linguistics, neuroscience and deaf education. Our team of deaf and hearing scientists worked with a group of software engineers to create the ASL-LEX database that anyone can use for free. We cataloged information on nearly 3,000 signs and built a visual, searchable and interactive database that allows scientists and linguists to work with ASL in entirely new ways."

The Asl-Lex 2.0 Project: A Database Of Lexical And Phonological Properties For 2,723 Signs In American Sign Language, Zed Sevcikova Sehyr, Naomi Caselli, Ariel M. Cohen-Goldberg, Karen Emmory

Communication Sciences and Disorders Faculty Articles and Research

ASL-LEX is a publicly available, large-scale lexical database for American Sign Language (ASL). We report on the expanded database (ASL-LEX 2.0) that contains 2,723 ASL signs. For each sign, ASL-LEX now includes a more detailed phonological description, phonological density and complexity measures, frequency ratings (from deaf signers), iconicity ratings (from hearing non-signers and deaf signers), transparency (“guessability”) ratings (from non-signers), sign and videoclip durations, lexical class, and more. We document the steps used to create ASL-LEX 2.0 and describe the distributional characteristics for sign properties across the lexicon and examine the relationships among lexical and phonological properties of signs. Correlation …

Cross-Linguistic Metaphor Priming In Asl-English Bilinguals: Effects Of The Double Mapping Constraint, Franziska Schaller, Brittany Lee, Zed Sevcikova Sehyr, Lucinda O'Grady Farnady, Karen Emmorey

Communication Sciences and Disorders Faculty Articles and Research

Meir’s (2010) Double Mapping Constraint (DMC) states the use of iconic signs in metaphors is restricted to signs that preserve the structural correspondence between the articulators and the concrete source domain and between the concrete and metaphorical domains. We investigated ASL signers’ comprehension of English metaphors whose translations complied with the DMC (Communication collapsed during the meeting) or violated the DMC (The acid ate the metal). Metaphors were preceded by the ASL translation of the English verb, an unrelated sign, or a still video. Participants made sensibility judgments. Response times (RTs) were faster for DMC-Compliant sentences …

Unique N170 Signatures To Words And Faces In Deaf Asl Signers Reflect Experience-Specific Adaptations During Early Visual Processing, Zed Sevcikova Sehyr, Katherine J. Midgley, Phillipp J. Holcomb, Karen Emmorey, David C. Plaut, Marlene Behrmann

Communication Sciences and Disorders Faculty Articles and Research

Previous studies with deaf adults reported reduced N170 waveform asymmetry to visual words, a finding attributed to reduced phonological mapping in left-hemisphere temporal regions compared to hearing adults. An open question remains whether this pattern indeed results from reduced phonological processing or from general neurobiological adaptations in visual processing of deaf individuals. Deaf ASL signers and hearing nonsigners performed a same-different discrimination task with visually presented words, faces, or cars, while scalp EEG time-locked to the onset of the first item in each pair was recorded. For word recognition, the typical left-lateralized N170 in hearing participants and reduced left-sided asymmetry …

A Data-Driven Approach To The Semantics Of Iconicity In American Sign Language And English, Bill Thompson, Marcus Perlman, Gary Lupyan, Zed Sevcikova Sehyr, Karen Emmory

Communication Sciences and Disorders Faculty Articles and Research

A growing body of research shows that both signed and spoken languages display regular patterns of iconicity in their vocabularies. We compared iconicity in the lexicons of American Sign Language (ASL) and English by combining previously collected ratings of ASL signs (Caselli, Sevcikova Sehyr, Cohen-Goldberg, & Emmorey, 2017) and English words (Winter, Perlman, Perry, & Lupyan, 2017) with the use of data-driven semantic vectors derived from English. Our analyses show that models of spoken language lexical semantics drawn from large text corpora can be useful for predicting the iconicity of signs as well as words. Compared to English, ASL has …

Deaf Translators: What Are They Thinking?, Janis Cole Ms.

Journal of Interpretation

The examination of work performed by Deaf translators in creating translations between written texts and signed languages is an emerging area of inquiry in Translation Studies. Deaf people have been performing ad hoc translations within their community for hundreds of years (Adam, Carty & Stone, 2011; Bartley & Stone, 2008). More recently, Deaf translators have begun to work as paid professionals, creating a new subfield of Translation Studies, one that, to date, is largely unexplored. Using qualitative data, this pilot study examines the thought processes of two Deaf individuals in the rendering of an academic text from written English into …

The Perceived Mapping Between Form And Meaning In American Sign Language Depends On Linguistic Knowledge And Task: Evidence From Iconicity And Transparency Judgments, Zed Sevcikova Sehyr, Karen Emmorey

Communication Sciences and Disorders Faculty Articles and Research

Iconicity is often defined as the resemblance between a form and a given meaning, while transparency is defined as the ability to infer a given meaning based on the form. This study examined the influence of knowledge of American Sign Language (ASL) on the perceived iconicity of signs and the relationship between iconicity, transparency (correctly guessed signs), ‘perceived transparency’ (transparency ratings of the guesses), and ‘semantic potential’ (the diversity (H index) of guesses). Experiment 1 compared iconicity ratings by deaf ASL signers and hearing non-signers for 991 signs from the ASL-LEX database. Signers and non-signers’ ratings were highly correlated; however, …

Second Language Acquisition Of American Sign Language Influences Co-Speech Gesture Production, Jill Weisberg, Shannon Casey, Zed Sevcikova Sehyr, Karen Emmorey

Communication Sciences and Disorders Faculty Articles and Research

Previous work indicates that 1) adults with native sign language experience produce more manual co-speech gestures than monolingual non-signers, and 2) one year of ASL instruction increases gesture production in adults, but not enough to differentiate them from non-signers. To elucidate these effects, we asked early ASL–English bilinguals, fluent late second language (L2) signers (≥ 10 years of experience signing), and monolingual non-signers to retell a story depicted in cartoon clips to a monolingual partner. Early and L2 signers produced manual gestures at higher rates compared to non-signers, particularly iconic gestures, and used a greater variety of handshapes. These results …

Referring Strategies In American Sign Language And English (With Co-Speech Gesture): The Role Of Modality In Referring To Non-Nameable Objects, Zed Sevcikova Sehyr, Brenda Nicodemus, Jennifer Petrich, Karen Emmorey

Communication Sciences and Disorders Faculty Articles and Research

American Sign Language (ASL) and English differ in linguistic resources available to express visual–spatial information. In a referential communication task, we examined the effect of language modality on the creation and mutual acceptance of reference to non-nameable figures. In both languages, description times reduced over iterations and references to the figures’ geometric properties (“shape-based reference”) declined over time in favor of expressions describing the figures’ resemblance to nameable objects (“analogy-based reference”). ASL signers maintained a preference for shape-based reference until the final (sixth) round, while English speakers transitioned toward analogy-based reference by Round 3. Analogy-based references were more time efficient …

The N170 Erp Component Differs In Laterality, Distribution, And Association With Continuous Reading Measures For Deaf And Hearing Readers, Karen Emmorey, Katherine J. Midgley, Casey B. Kohen, Zed Sevcikova Sehyr, Phillipp J. Holcomb

Communication Sciences and Disorders Faculty Articles and Research

The temporo-occipitally distributed N170 ERP component is hypothesized to reflect print-tuning in skilled readers. This study investigated whether skilled deaf and hearing readers (matched on reading ability, but not phonological awareness) exhibit similar N170 patterns, given their distinct experiences learning to read. Thirty-two deaf and 32 hearing adults viewed words and symbol strings in a familiarity judgment task. In the N170 epoch (120–240 ms) hearing readers produced greater negativity for words than symbols at left hemisphere (LH) temporo-parietal and occipital sites, while deaf readers only showed this asymmetry at occipital sites. Linear mixed effects regression was used to examine the …

Implicit Co-Activation Of American Sign Language In Deaf Readers: An Erp Study, Gabriela Meade, Katherine J. Midgley, Zed Sevcikova Sehyr, Phillipp J. Holcomb, Karen Emmorey

Communication Sciences and Disorders Faculty Articles and Research

In an implicit phonological priming paradigm, deaf bimodal bilinguals made semantic relatedness decisions for pairs of English words. Half of the semantically unrelated pairs had phonologically related translations in American Sign Language (ASL). As in previous studies with unimodal bilinguals, targets in pairs with phonologically related translations elicited smaller negativities than targets in pairs with phonologically unrelated translations within the N400 window. This suggests that the same lexicosemantic mechanism underlies implicit co-activation of a non-target language, irrespective of language modality. In contrast to unimodal bilingual studies that find no behavioral effects, we observed phonological interference, indicating that bimodal bilinguals may …

Comparing Deaf Native Signers And Deaf Early Signers With Respect To Phonological Perception, Ian Deandrea-Lazarus

Undergraduate University Honors Capstones

Common criteria for a native ASL signer include exposure to ASL from birth and having Deaf parents. This study questions the necessity of the second criterion by comparing two groups: 16 Deaf adults with Deaf parents and exposed to ASL from birth, and 16 Deaf adults with hearing parents and exposed to ASL before age two. All determined whether pairs of pseudosigns, sometimes differing in phonological details, matched. The two groups did not differ significantly on accuracy, but the first group responded faster than the second group on average. These findings suggest processing differences between the two groups, but otherwise …