Physical Sciences and Mathematics Commons^™

A Real-Time American Sign Language Word Recognition System Based On Neural Networks And A Probabilistic Model, Neelesh Sarawate, Ming Chan. Leu, Cemi̇l Öz

Turkish Journal of Electrical Engineering and Computer Sciences

The development of an American Sign Language (ASL) word recognition system based on neural networks and a probabilistic model is presented. We use a CyberGlove and a Flock of Birds motion tracker to extract the gesture data. The finger joint angle data obtained from the sensory glove defines the handshape while the data from the motion tracker describes the trajectory of the hand movement. The four gesture features, namely handshape, hand position, hand orientation, and hand movement, are recognized using different functions that include backpropagation neural networks. The sequence of these features is used to generate a specific sign or …