Engineering Commons^™

Visual Speech Recognition Using A 3d Convolutional Neural Network, Matthew Rochford

Master's Theses

Main stream automatic speech recognition (ASR) makes use of audio data to identify spoken words, however visual speech recognition (VSR) has recently been of increased interest to researchers. VSR is used when audio data is corrupted or missing entirely and also to further enhance the accuracy of audio-based ASR systems. In this research, we present both a framework for building 3D feature cubes of lip data from videos and a 3D convolutional neural network (CNN) architecture for performing classification on a dataset of 100 spoken words, recorded in an uncontrolled envi- ronment. Our 3D-CNN architecture achieves a testing accuracy of …

Non-Intrusive Affective Assessment In The Circumplex Model From Pupil Diameter And Facial Expression Monitoring, Sudarat Tangnimitchok

FIU Electronic Theses and Dissertations

Automatic methods for affective assessment seek to enable computer systems to recognize the affective state of their users. This dissertation proposes a system that uses non-intrusive measurements of the user’s pupil diameter and facial expression to characterize his /her affective state in the Circumplex Model of Affect. This affective characterization is achieved by estimating the affective arousal and valence of the user’s affective state.

In the proposed system the pupil diameter signal is obtained from a desktop eye gaze tracker, while the face expression components, called Facial Animation Parameters (FAPs) are obtained from a Microsoft Kinect module, which also captures …

Development Of A Model And Imbalance Detection System For The Cal Poly Wind Turbine, Ryan Miki Takatsuka

Master's Theses

This thesis develops a model of the Cal Poly Wind Turbine that is used to determine if there is an imbalance in the turbine rotor. A theoretical model is derived to estimate the expected vibrations when there is an imbalance in the rotor. Vibration and acceleration data are collected from the turbine tower during operation to confirm the model is useful and accurate for determining imbalances in the turbine.

Digital signal processing techniques for analyzing the vibration data are explored and tested with simulation data. This includes frequency shifts, lock-in amplifiers, phase-locked loops, discrete Fourier transforms, and decimation filters. The …

Intraoperative Localization Of Subthalamic Nucleus During Deep Brain Stimulation Surgery Using Machine Learning Algorithms, Mahsa Khosravi

Electronic Thesis and Dissertation Repository

This thesis presents a novel technique for localizing the Subthalamic Nucleus (STN) during Deep Brain Stimulation (DBS) surgery. DBS is an accepted treatment for individuals living with Parkinson's Disease (PD). This surgery involves implantation of a permanent electrode inside the STN to deliver electrical current. The STN is a small grey matter structure within the brain, which makes accurate placement a challenging task for the surgical team. Prior to placement of the permanent electrode, intraoperative microelectrode recordings (MERs) of neural activity are used to localize the STN. The placement of the permanent electrode and the success of the stimulation therapy …