Open Access. Powered by Scholars. Published by Universities.®

Electrical and Computer Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

Signal Processing

PDF

The Summer Undergraduate Research Fellowship (SURF) Symposium

2014

Articles 1 - 2 of 2

Full-Text Articles in Electrical and Computer Engineering

Model-Free Method Of Reinforcement Learning For Visual Tasks, Jeff S. Soldate, Jonghoon Jin, Eugenio Culurciello Aug 2014

Model-Free Method Of Reinforcement Learning For Visual Tasks, Jeff S. Soldate, Jonghoon Jin, Eugenio Culurciello

The Summer Undergraduate Research Fellowship (SURF) Symposium

There has been success in recent years for neural networks in applications requiring high level intelligence such as categorization and assessment. In this work, we present a neural network model to learn control policies using reinforcement learning. It takes a raw pixel representation of the current state and outputs an approximation of a Q value function made with a neural network that represents the expected reward for each possible state-action pair. The action is chosen an \epsilon-greedy policy, choosing the highest expected reward with a small chance of random action. We used gradient descent to update the weights and biases …


Multi-Channel Analysis For Gradient Artifact Removal From Concurrent Eeg-Fmri Studies, Miguel R. Castellanos, Zhongming Liu Aug 2014

Multi-Channel Analysis For Gradient Artifact Removal From Concurrent Eeg-Fmri Studies, Miguel R. Castellanos, Zhongming Liu

The Summer Undergraduate Research Fellowship (SURF) Symposium

Concurrent electroencephalogram (EEG) and functional magnetic resonance imaging (fMRI) recordings are susceptible to large amounts of noise due to the static and dynamic magnetic fields present inside the MR scanner. EEG-fMRI studies are conducted to provide better spatial and temporal resolution for each recording, respectively, but the artifacts found in the EEG render the data impossible to interpret. Past studies have focused on signal post-processing techniques which are able to effectively remove noise upon the completion of a study, but there are no techniques able to process the data in real-time without extensive calibration. This research addresses this issue by …