Sign Languages Commons^™

Advancing Towards A More Complete Sign Language Detection Application, Shane Angel

Undergraduate University Honors Capstones

The goal of this capstone is to improve the experiences of Deaf and Hard of Hearing individuals who use teleconferencing tools through the use of sign language detection software. Popular teleconferencing applications such as Zoom and Google Meet contain features that can automatically spotlight users when they are speaking, but there is currently no equivalent feature for those who used signed languages to communicate on these platforms. Such a feature would need to utilize a sign language detection program to spotlight individuals, but this technology is early in development and is not currently available for large-scale implementation. This capstone strives …

Mixed Reality Prototype Device Showcase: Using Smart Glasses To Enhance Language Access, Aaron Parker, Connor Switenky, Roshan Mathew, Wendy Dannels

Frameless

While the use of American Sign Language (ASL) interpreters and real-time captioning significantly increases deaf individuals’ ability to participate in a wide variety of functions, there are some limitations. The major problem is that current ways of providing communication and information access to deaf people require them to split their attention between the visual focus of the specific content and the interpreter/captioning display. At any given point in time, deaf people are forced to decide what explanation to miss with subsequent effects on topic comprehension and perceptions of the interaction and environments.

Vr Sound Mapping: Make Sound Accessible For Dhh People In Virtual Reality Environments, Ziming Li, Roshan Peiris

Frameless

In-game audio plays an important role in enhancing the sense of reality and immersion in the gaming experience. In many games, sounds are also used to provide notifications and clues, which are essential to the gameplay. However, in this case, the deaf and hard of hearing (DHH) players may fail to access the information conveyed by sounds, which degrades their gaming experience (Jain et al. 2021).

Creation Of A Neural Network For The American Sign Language To Russian Translation App, John T. Simmons

Capstone Projects

1. A large population of people utilize American Sign Language for their primary method of communication.
2. No commercially available product is available for these people for when they need to communicate with speakers of a foreign language.
3. We must investigate methods to make communication between these two parties easier and more accessible.
4. By using a neural network to classify images of American Sign Language letters, we can build a service to make translation of American Sign Language into foreign languages possible.