Open Access. Powered by Scholars. Published by Universities.®
Physical Sciences and Mathematics Commons™
Open Access. Powered by Scholars. Published by Universities.®
- Discipline
Articles 1 - 3 of 3
Full-Text Articles in Physical Sciences and Mathematics
American Sign Language Assistant, Charulata Lodha
American Sign Language Assistant, Charulata Lodha
Master's Projects
Our implementation of a prototype computer vision system to help the deaf and mute
communicate in a shopping setting. Our system uses live video feeds to recognize American Sign Language (ASL) gestures and notify shop clerks of deaf and mute patrons’ intents. It generates a video dataset in the Unity Game Engine of 3D humanoid models in a shop setting performing ASL signs. Our system uses OpenPose to detect and recognize the bone points of the human body
from the live feed. The system then represents the motion sequences as high dimensional skeleton joint point trajectories followed by a time-warping …
Multimodal Detection Of Cyberbullying On Twitter, Jiabao Qiu
Multimodal Detection Of Cyberbullying On Twitter, Jiabao Qiu
Master's Projects
Cyberbullying detection is one of the trending topics of research in recent years, due to the popularity of social media and the lack of limitations about using electronic communications. Detection of cyberbullying may prevent some bullying behaviors online. This paper introduced a Multimodal system that makes use of Convolutional Neural Network (CNN), Tensor Fusion Network, VGG-19 Network, and Multi-Layer Perceptron model, for the purpose of cyberbullying detection. This system can not only analyze the messages sent but also the extra information related to the messages (meta-information) and the images contained in the messages. The proposed system was trained and tested …
End-To-End Learning Utilizing Temporal Information For Vision- Based Autonomous Driving, Dapeng Guo
End-To-End Learning Utilizing Temporal Information For Vision- Based Autonomous Driving, Dapeng Guo
Master's Projects
End-to-End learning models trained with conditional imitation learning (CIL) have demonstrated their capabilities in driving autonomously in dynamic environments. The performance of such models however is limited as most of them fail to utilize the temporal information, which resides in a sequence of observations. In this work, we explore the use of temporal information with a recurrent network to improve driving performance. We propose a model that combines a pre-trained, deeper convolutional neural network to better capture image features with a long short-term memory network to better explore temporal information. Experimental results indicate that the proposed model achieves performance gain …