Engineering Commons^™

Energy-Efficient Neuromorphic Architectures For Nuclear Radiation Detection Applications, Jorge I. Canales-Verdial, Jamison R. Wagner, Landon A. Schmucker, Mark Wetzel, Nathan J. Withers, Philippe Erol Proctor, Christof Teuscher, Multiple Additional Authors

Electrical and Computer Engineering Faculty Publications and Presentations

A comprehensive analysis and simulation of two memristor-based neuromorphic architectures for nuclear radiation detection is presented. Both scalable architectures retrofit a locally competitive algorithm to solve overcomplete sparse approximation problems by harnessing memristor crossbar execution of vector–matrix multiplications. The proposed systems demonstrate excellent accuracy and throughput while consuming minimal energy for radionuclide detection. To ensure that the simulation results of our proposed hardware are realistic, the memristor parameters are chosen from our own fabricated memristor devices. Based on these results, we conclude that memristor-based computing is the preeminent technology for a radiation detection platform.

Sequential Frame-Interpolation And Dct-Based Video Compression Framework, Yeganeh Jalalpour, Wu-Chi Feng, Feng Liu

Computer Science Faculty Publications and Presentations

Video data is ubiquitous; capturing, transferring, and storing even compressed video data is challenging because it requires substantial resources. With the large amount of video traffic being transmitted on the internet, any improvement in compressing such data, even small, can drastically impact resource consumption. In this paper, we present a hybrid video compression framework that unites the advantages of both DCT-based and interpolation-based video compression methods in a single framework. We show that our work can deliver the same visual quality or, in some cases, improve visual quality while reducing the bandwidth by 10--20%.

On The (Im)Practicality Of Adversarial Perturbation For Image Privacy, Arezoo Rajabi, Rakesh B. Bobba, Mike Rosulek, Charles Wright, Wu-Chi Feng

Computer Science Faculty Publications and Presentations

Image hosting platforms are a popular way to store and share images with family members and friends. However, such platforms typically have full access to images raising privacy concerns. These concerns are further exacerbated with the advent of Convolutional Neural Networks (CNNs) that can be trained on available images to automatically detect and recognize faces with high accuracy.

Recently, adversarial perturbations have been proposed as a potential defense against automated recognition and classification of images by CNNs. In this paper, we explore the practicality of adversarial perturbation based approaches as a privacy defense against automated face recognition. Specifically, we first …

Extending The Functional Subnetwork Approach To A Generalized Linear Integrate-And-Fire Neuron Model, Nicholas Szczecinski, Roger Quinn, Alexander J. Hunt

Mechanical and Materials Engineering Faculty Publications and Presentations

Engineering neural networks to perform specific tasks often represents a monumental challenge in determining network architecture and parameter values. In this work, we extend our previously-developed method for tuning networks of non-spiking neurons, the “Functional subnetwork approach” (FSA), to the tuning of networks composed of spiking neurons. This extension enables the direct assembly and tuning of networks of spiking neurons and synapses based on the network’s intended function, without the use of global optimization ormachine learning. To extend the FSA, we show that the dynamics of a generalized linear integrate and fire (GLIF) neuronmodel have fundamental similarities to those of …

Flight Simulator Modeling Using Recurrent Neural Networks, Nickolas Sabatini, Andreas Natsis

Undergraduate Research & Mentoring Program

Recurrent neural networks (RNNs) are a form of machine learning used to predict future values. This project uses RNNs tor predict future values for a flight simulator. Coded in Python using the Keras library, the model demonstrates training loss and validation loss, referring to the error when training the model.

The Applications Of Grid Cells In Computer Vision, Keaton Kraiger

Undergraduate Research & Mentoring Program

In this study we present a novel method for position and scale invariant object representation based on a biologically-inspired framework. Grid cells are neurons in the entorhinal cortex whose multiple firing locations form a periodic triangular array, tiling the surface of an animal’s environment. We propose a model for simple object representation that maintains position and scale invariance, in which grid maps capture the fundamental structure and features of an object. The model provides a mechanism for identifying feature locations in a Cartesian plane and vectors between object features encoded by grid cells. It is shown that key object features …

Exploring And Expanding The One-Pixel Attack, Umairullah Khan, Walt Woods

Undergraduate Research & Mentoring Program

In machine learning research, adversarial examples are normal inputs to a classifier that have been specifically perturbed to cause the model to misclassify the input. These perturbations rarely affect the human readability of an input, even though the model’s output is drastically different. Recent work has demonstrated that image-classifying deep neural networks (DNNs) can be reliably fooled with the modification of a single pixel in the input image, without knowledge of a DNN’s internal parameters. This “one-pixel attack” utilizes an iterative evolutionary optimizer known as differential evolution (DE) to find the most effective pixel to perturb, via the evaluation of …

Combining Algorithms For More General Ai, Mark Robert Musil

Undergraduate Research & Mentoring Program

Two decades since the first convolutional neural network was introduced the AI sub-domains of classification, regression and prediction still rely heavily on a few ML architectures despite their flaws of being hungry for data, time, and high-end hardware while still lacking generality. In order to achieve more general intelligence that can perform one-shot learning, create internal representations, and recognize subtle patterns it is necessary to look for new ML system frameworks. Research on the interface between neuroscience and computational statistics/machine learning has suggested that combined algorithms may increase AI robustness in the same way that separate brain regions specialize. In …

Early Emerging Pathogen Detection, Mackenzie Wangenstein

Undergraduate Research & Mentoring Program

A supervised learning technique was employed to identify emerging pathogen species. Portland State University has partnered with the University of New Mexico to take encodings of unknown pathogen molecular structures to determine emerging species.

Video Frame Interpolation Via Adaptive Separable Convolution, Simon Niklaus, Long Mai, Feng Liu

Computer Science Faculty Publications and Presentations

Standard video frame interpolation methods first estimate optical flow between input frames and then synthesize an intermediate frame guided by motion. Recent approaches merge these two steps into a single convolution process by convolving input frames with spatially adaptive kernels that account for motion and re-sampling simultaneously. These methods require large kernels to handle large motion, which limits the number of pixels whose kernels can be estimated at once due to the large memory demand. To address this problem, this paper formulates frame interpolation as local separable convolution over input frames using pairs of 1D kernels. Compared to regular 2D …

Fast And Accurate Sparse Coding Of Visual Stimuli With A Simple, Ultra-Low-Energy Spiking Architecture, Walt Woods, Christof Teuscher

Electrical and Computer Engineering Faculty Publications and Presentations

Memristive crossbars have become a popular means for realizing unsupervised and supervised learning techniques. Often, to preserve mathematical rigor, the crossbar itself is separated from the neuron capacitors. In this work, we sought to simplify the design, removing extraneous components to consume significantly lower power at a minimal cost of accuracy. This work provides derivations for the design of such a network, named the Simple Spiking Locally Competitive Algorithm, or SSLCA, as well as CMOS designs and results on the CIFAR and MNIST datasets. Compared to a non-spiking model which scored 33% on CIFAR-10 with a single-layer classifier, this hardware …

Memory And Information Processing In Recurrent Neural Networks, Alireza Goudarzi, Sarah Marzen, Peter Banda, Guy Feldman, Matthew R. Lakin, Christof Teuscher, Darko Stefanovic

Electrical and Computer Engineering Faculty Publications and Presentations

Recurrent neural networks (RNN) are simple dynamical systems whose computational power has been attributed to their short-term memory. Short-term memory of RNNs has been previously studied analytically only for the case of orthogonal networks, and only under annealed approximation, and uncorrelated input. Here for the first time, we present an exact solution to the memory capacity and the task-solving performance as a function of the structure of a given network instance, enabling direct determination of the function-structure relation in RNNs. We calculate the memory capacity for arbitrary networks with exponentially correlated input and further related it to the performance of …

Sparse Adaptive Local Machine Learning Algorithms For Sensing And Analytics, Jack Cannon

Undergraduate Research & Mentoring Program

The goal of digital image processing is to capture, transmit, and display images as efficiently as possible. Such tasks are computationally intensive because an image is digitally represented by large amounts of data. It is possible to render an image by reconstructing it with a subset of the most relevant data. One such procedure used to accomplish this task is commonly referred to as sparse coding. For our purpose, we use images of handwritten digits that are presented to an artificial neural network. The network implements Rozell's locally competitive algorithm (LCA) to generate a sparse code. This sparse code is …

A Brief Review Of Speaker Recognition Technology, Clark D. Shaver, John M. Acken

Electrical and Computer Engineering Faculty Publications and Presentations

This paper reviews the development of speaker recognition systems from pre-computing days to current trends. Advances in various sciences which have allowed autonomous speaker recognition systems to become a practical means of identity authentication are also reviewed.

Modeling And Experimental Demonstration Of A Hopfield Network Analog-To-Digital Converter With Hybrid Cmos/Memristor Circuits, Xinjie Guo, Farnood Merrikh-Bayat, Ligang Gao, Brian D. Hoskins, Fabien Alibart, Bernabe Linares-Barranco, Luke Theogarajan, Christof Teuscher, Dmitri B. Strukov

Electrical and Computer Engineering Faculty Publications and Presentations

The purpose of this work was to demonstrate the feasibility of building recurrent artificial neural networks with hybrid complementary metal oxide semiconductor (CMOS)/memristor circuits. To do so, we modeled a Hopfield network implementing an analog-to-digital converter (ADC) with up to 8 bits of precision. Major shortcomings affecting the ADC's precision, such as the non-ideal behavior of CMOS circuitry and the specific limitations of memristors, were investigated and an effective solution was proposed, capitalizing on the in-field programmability of memristors. The theoretical work was validated experimentally by demonstrating the successful operation of a 4-bit ADC circuit implemented with discrete Pt/TiO_{2− …}

Computational Capacity And Energy Consumption Of Complex Resistive Switch Networks, Jens Bürger, Alireza Goudarzi, Darko Stefanovic, Christof Teuscher

Electrical and Computer Engineering Faculty Publications and Presentations

Resistive switches are a class of emerging nanoelectronics devices that exhibit a wide variety of switching characteristics closely resembling behaviors of biological synapses. Assembled into random networks, such resistive switches produce emerging behaviors far more complex than that of individual devices. This was previously demonstrated in simulations that exploit information processing within these random networks to solve tasks that require nonlinear computation as well as memory. Physical assemblies of such networks manifest complex spatial structures and basic processing capabilities often related to biologically-inspired computing. We model and simulate random resistive switch networks and analyze their computational capacities. We provide a …

Using Oceanic-Atmospheric Oscillations For Long Lead Time Streamflow Forecasting, Ajay Kalra, Sajjad Ahmad

Civil and Environmental Engineering and Construction Faculty Research

We present a data-driven model, Support Vector Machine (SVM), for long lead time streamflow forecasting using oceanic-atmospheric oscillations. The SVM is based on statistical learning theory that uses a hypothesis space of linear functions based on Kernel approach and has been used to predict a quantity forward in time on the basis of training from past data. The strength of SVM lies in minimizing the empirical classification error and maximizing the geometric margin by solving inverse problem. The SVM model is applied to three gages, i.e., Cisco, Green River, and Lees Ferry in the Upper Colorado River Basin in the …

Inference Of Genetic Regulatory Networks With Recurrent Neural Network Models Using Particle Swarm Optimization, Rui Xu, Donald C. Wunsch, Ronald L. Frank

Electrical and Computer Engineering Faculty Research & Creative Works

Genetic regulatory network inference is critically important for revealing fundamental cellular processes, investigating gene functions, and understanding their relations. The availability of time series gene expression data makes it possible to investigate the gene activities of whole genomes, rather than those of only a pair of genes or among several genes. However, current computational methods do not sufficiently consider the temporal behavior of this type of data and lack the capability to capture the complex nonlinear system dynamics. We propose a recurrent neural network (RNN) and particle swarm optimization (PSO) approach to infer genetic regulatory networks from time series gene …

Approximate Dynamic Programming And Neural Networks On Game Hardware, Ryan J. Meuth, Donald C. Wunsch

Electrical and Computer Engineering Faculty Research & Creative Works

Modern graphics processing units (GPU) and game consoles are used for much more than simply 3D graphics applications and video games. From machine vision to finite element analysis, GPU's are being used in diverse applications, collectively called General Purpose computation onf graphics processor units (GPGPU). Additionally, game consoles are entering the market of high performance computing as inexpensive nodes in computing clusters. This paper explores the capabilities and limitations of modern GPU's and game consoles, surveying the ADP and neural network technologies that can be applied to these devices.

Combined Training Of Recurrent Neural Networks With Particle Swarm Optimization And Backpropagation Algorithms For Impedance Identification, Peng Xiao, Ganesh K. Venayagamoorthy, Keith Corzine

Electrical and Computer Engineering Faculty Research & Creative Works

A recurrent neural network (RNN) trained with a combination of particle swarm optimization (PSO) and backpropagation (BP) algorithms is proposed in this paper. The network is used as a dynamic system modeling tool to identify the frequency-dependent impedances of power electronic systems such as rectifiers, inverters, and DC-DC converters. As a category of supervised learning methods, the various backpropagation training algorithms developed for recurrent neural networks use gradient descent information to guide their search for optimal weights solutions that minimize the output errors. While they prove to be very robust and effective in training many types of network structures, they …

Adaptive Neural Network Based Stabilizing Controller Design For Single Machine Infinite Bus Power Systems, Wenxin Liu, Ganesh K. Venayagamoorthy, Donald C. Wunsch, David A. Cartes, Jagannathan Sarangapani, Mariesa Crow

Engineering Management and Systems Engineering Faculty Research & Creative Works

Power system stabilizers are widely used to generate supplementary control signals for the excitation system in order to damp out the low frequency oscillations. In power system control literature, the performances of the proposed controllers were mostly demonstrated using simulation results without any rigorous stability analysis. This paper proposes a stabilizing neural network (NN) controller based on a sixth order single machine infinite bus power system model. The NN is used to approximate the complex nonlinear dynamics of power system. Unlike the other indirect adaptive NN control schemes, there is no offline training process and the NN can be directly …

Neural Network Based Method For Predicting Nonlinear Load Harmonics, Joy Mazumdar, Ronald G. Harley, Frank C. Lambert, Ganesh K. Venayagamoorthy

Electrical and Computer Engineering Faculty Research & Creative Works

Generation of harmonics and the existence of waveform pollution in power system networks are important problems facing the power utilities. The increased use of nonlinear devices in industry has resulted in direct increase of harmonic distortion in the industrial power system in recent years. Interaction between loads and sources in a power distribution network is a complex process and often not possible to explain analytically without making assumptions. The determination of true harmonic current distortion of a load is further complicated by the fact that the supply voltage waveform at the point of common coupling (PCC) is rarely a pure …

Optimal Wide Area Controller And State Predictor For A Power System, Salman Mohagheghi, Ganesh K. Venayagamoorthy, Ronald G. Harley

Electrical and Computer Engineering Faculty Research & Creative Works

An optimal wide area controller is designed in this paper for a 12-bus power system together with a Static Compensator (STATCOM). The controller provides auxiliary reference signals for the automatic voltage regulators (AVR) of the generators as well as the line voltage controller of the STATCOM in such a way that it improves the damping of the rotor speed deviations of the synchronous machines. Adaptive critic designs theory is used to implement the controller and enable it to provide nonlinear optimal control over the infinite horizon time of the problem and at different operating conditions of the power system. Simulation …

Survey Of Clustering Algorithms, Rui Xu, Donald C. Wunsch

Electrical and Computer Engineering Faculty Research & Creative Works

Data analysis plays an indispensable role for understanding various phenomena. Cluster analysis, primitive exploration with little or no prior knowledge, consists of research developed across a wide variety of communities. The diversity, on one hand, equips us with many tools. On the other hand, the profusion of options causes confusion. We survey clustering algorithms for data sets appearing in statistics, computer science, and machine learning, and illustrate their applications in some benchmark data sets, the traveling salesman problem, and bioinformatics, a new field attracting intensive efforts. Several tightly related topics, proximity measure, and cluster validation, are also discussed.

Reinforcement Learning-Based Output Feedback Control Of Nonlinear Systems With Input Constraints, Pingan He, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

A novel neural network (NN) -based output feedback controller with magnitude constraints is designed to deliver a desired tracking performance for a class of multi-input-multi-output (MIMO) discrete-time strict feedback nonlinear systems. Reinforcement learning in discrete time is proposed for the output feedback controller, which uses three NN: 1) a NN observer to estimate the system states with the input-output data; 2) a critic NN to approximate certain strategic utility function; and 3) an action NN to minimize both the strategic utility function and the unknown dynamics estimation errors. The magnitude constraints are manifested as saturation nonlinearities in the output feedback …

Blackfingers A Sophisticated Hand Prothesis, Michele Folgheraiter, Giuseppina Gini, Marek Perkowski, Mikhail Pivtoraiko

Electrical and Computer Engineering Faculty Publications and Presentations

Our goal is to develop the low level control system for an artificial hand ”Blackfingers”. Blackfingers was thought to have two main applications: as humanoid robot’s hand or as a human hand prothesis. In this last application our intent is to realize a device more sophisticated respect the actual commerce prothesis. Also in our intention is to use some biological paradigms to create a human like reflex control easy to be interfaced also with the human nervous system. In this paper we illustrate the properties and the morphology of a human like neural reflex controller, used to set the stiffness …

Implementation Of Large Neural Networks Using Decomposition, Henry Selvaraj, H. Niewiadomski, P. Buciak, M. Pleban, Piotr Sapiecha, Tadeusz Luba, Venkatesan Muthukumar

Electrical & Computer Engineering Faculty Research

The article presents methods of dealing with huge data in the domain of neural networks. The decomposition of neural networks is introduced and its efficiency is proved by the authors’ experiments. The examinations of the effectiveness of argument reduction in the above filed, are presented. Authors indicate, that decomposition is capable of reducing the size and the complexity of the learned data, and thus it makes the learning process faster or, while dealing with large data, possible. According to the authors experiments, in some cases, argument reduction, makes the learning process harder.

Le Bio Wall : Un Tissue Informatique Pour Le Prototypage De Systèmes Bio-Inspirés, Andre Stauffer, Daniel Mange, Gianluca Tempesti, Christof Teuscher

Electrical and Computer Engineering Faculty Publications and Presentations

Dans cet article, nous décrivons le BioWall, un tissu informatique reconfigurable géant développé dans le but d’y implémenter des machines mettant en oeuvre les principes de notre projet Embryonique. Bien que ses dimensions et ses caractéristiques en font d’abord un objet de démonstration publique, le BioWall constitue également un outil de recherche précieux, du fait que sa faculté de reprogrammation et sa structure cellulaire s’adaptent parfaitement à l’implémentation de toutes sortes de systèmes bioinspirés. Pour illustrer ces capacités, nous décrivons un ensemble d’applications qui reflètent différentes sources d’inspiration biologique allant des systèmes biologiques ontogénétiques aux dispositifs évolutifs phylogénétiques, en passant …

Myoelectric Signal Recognition Using Artificial Neural Networks In Real Time, Adrian Del Boca

FIU Electronic Theses and Dissertations

Application of EMG-controlled functional neuromuscular stimulation to a denervated muscle depends largely on the successful discrimination of the EMG signal by which the subject desires to execute control over the impeded movement. This can be achieved by an adaptive and flexible interface regardless of electrodes location, strength of remaining muscle activity or even personal conditions. Adaptability is a natural and important characteristic of artificial neural networks. This research work is restricted to the development of a real-time application of artificial neural network to the EMG signature recognition. Through this new approach, EMG features extracted by Fourier analysis are presented to …