Engineering Commons^™

Energy-Efficient Neuromorphic Architectures For Nuclear Radiation Detection Applications, Jorge I. Canales-Verdial, Jamison R. Wagner, Landon A. Schmucker, Mark Wetzel, Nathan J. Withers, Philippe Erol Proctor, Christof Teuscher, Multiple Additional Authors

Electrical and Computer Engineering Faculty Publications and Presentations

A comprehensive analysis and simulation of two memristor-based neuromorphic architectures for nuclear radiation detection is presented. Both scalable architectures retrofit a locally competitive algorithm to solve overcomplete sparse approximation problems by harnessing memristor crossbar execution of vector–matrix multiplications. The proposed systems demonstrate excellent accuracy and throughput while consuming minimal energy for radionuclide detection. To ensure that the simulation results of our proposed hardware are realistic, the memristor parameters are chosen from our own fabricated memristor devices. Based on these results, we conclude that memristor-based computing is the preeminent technology for a radiation detection platform.

Vessel Trajectory Prediction Using Historical Ais Data, Jagir Laxmichand Charla

Dissertations and Theses

Maritime vessel position coordinates are important information for maritime situational planning and organization. A better estimate of future locations of the maritime vessels, from their current locations, can help maritime authorities to make planned decisions, which can be helpful to avoid traffic congestion and longer waiting times. This thesis develops a method for estimating future locations of the vessels using their current and previous locations and other data.

The motivating scenario for this work is that of determining the future locations of the vessels based on their current location and previous locations for accurate modelling of underwater acoustic noise. As …

Flight Simulator Modeling Using Recurrent Neural Networks, Nickolas Sabatini, Andreas Natsis

Undergraduate Research & Mentoring Program

Recurrent neural networks (RNNs) are a form of machine learning used to predict future values. This project uses RNNs tor predict future values for a flight simulator. Coded in Python using the Keras library, the model demonstrates training loss and validation loss, referring to the error when training the model.

An Application Of Deep Learning Models To Automate Food Waste Classification, Alejandro Zachary Espinoza

Dissertations and Theses

Food wastage is a problem that affects all demographics and regions of the world. Each year, approximately one-third of food produced for human consumption is thrown away. In an effort to track and reduce food waste in the commercial sector, some companies utilize third party devices which collect data to analyze individual contributions to the global problem. These devices track the type of food wasted (such as vegetables, fruit, boneless chicken, pasta) along with the weight. Some devices also allow the user to leave the food in a kitchen container while it is weighed, so the container weight must also …

Communications Using Deep Learning Techniques, Priti Gopal Pachpande

Legacy Theses & Dissertations (2009 - 2024)

Deep learning (DL) techniques have the potential of making communication systems

Radiation Source Localization By Using Backpropagation Neural Network, Jian Meng, Christof Teuscher, Walt Woods

Student Research Symposium

The most difficult part of the radiation localization is that we cannot use the traditional acoustic localization method to determine where the radiation source is. It’s mainly because the electromagnetic waves are totally different with the sound wave. From the expression of the radioactive intensity, we can tell that the intensity of radiation not only depend on the distance from the radiation but also related to the type of the nuclide. In general, the relationship between the intensity and the distance satisfy the inverse-square law, which is a non-linear relationship. In other words, if we can use the measurement and …

Using Reservoir Computing To Build A Robust Interface With Dna Circuits In Determining Genetic Similarities Between Pathogens, Christopher Neighbor, Christof Teuscher

Student Research Symposium

As computational power increases, the field of neural networks has advanced exponentially. In particular recurrent neural networks (RNNs) are being utilized to simulate dynamic systems and to learn to predict time series data. Reservoir computing is an architecture which has the potential to increase training speed while reducing computational costs. Reservoir computing consists of a RNN with a fixed connections “reservoir” while only the output layer is trained. The purpose of this research is to explore the effective use of reservoir computing networks with the eventual application towards use in a DNA based molecular computing reservoir for use in pathogen …

Fast And Accurate Sparse Coding Of Visual Stimuli With A Simple, Ultra-Low-Energy Spiking Architecture, Walt Woods, Christof Teuscher

Electrical and Computer Engineering Faculty Publications and Presentations

Memristive crossbars have become a popular means for realizing unsupervised and supervised learning techniques. Often, to preserve mathematical rigor, the crossbar itself is separated from the neuron capacitors. In this work, we sought to simplify the design, removing extraneous components to consume significantly lower power at a minimal cost of accuracy. This work provides derivations for the design of such a network, named the Simple Spiking Locally Competitive Algorithm, or SSLCA, as well as CMOS designs and results on the CIFAR and MNIST datasets. Compared to a non-spiking model which scored 33% on CIFAR-10 with a single-layer classifier, this hardware …

Architectures And Algorithms For Intrinsic Computation With Memristive Devices, Jens Bürger

Dissertations and Theses

Neuromorphic engineering is the research field dedicated to the study and design of brain-inspired hardware and software tools. Recent advances in emerging nanoelectronics promote the implementation of synaptic connections based on memristive devices. Their non-volatile modifiable conductance was shown to exhibit the synaptic properties often used in connecting and training neural layers. With their nanoscale size and non-volatile memory property, they promise a next step in designing more area and energy efficient neuromorphic hardware.

My research deals with the challenges of harnessing memristive device properties that go beyond the behaviors utilized for synaptic weight storage. Based on devices that exhibit …

Memory And Information Processing In Recurrent Neural Networks, Alireza Goudarzi, Sarah Marzen, Peter Banda, Guy Feldman, Matthew R. Lakin, Christof Teuscher, Darko Stefanovic

Electrical and Computer Engineering Faculty Publications and Presentations

Recurrent neural networks (RNN) are simple dynamical systems whose computational power has been attributed to their short-term memory. Short-term memory of RNNs has been previously studied analytically only for the case of orthogonal networks, and only under annealed approximation, and uncorrelated input. Here for the first time, we present an exact solution to the memory capacity and the task-solving performance as a function of the structure of a given network instance, enabling direct determination of the function-structure relation in RNNs. We calculate the memory capacity for arbitrary networks with exponentially correlated input and further related it to the performance of …

Sparse Adaptive Local Machine Learning Algorithms For Sensing And Analytics, Jack Cannon

Undergraduate Research & Mentoring Program

The goal of digital image processing is to capture, transmit, and display images as efficiently as possible. Such tasks are computationally intensive because an image is digitally represented by large amounts of data. It is possible to render an image by reconstructing it with a subset of the most relevant data. One such procedure used to accomplish this task is commonly referred to as sparse coding. For our purpose, we use images of handwritten digits that are presented to an artificial neural network. The network implements Rozell's locally competitive algorithm (LCA) to generate a sparse code. This sparse code is …

A Brief Review Of Speaker Recognition Technology, Clark D. Shaver, John M. Acken

Electrical and Computer Engineering Faculty Publications and Presentations

This paper reviews the development of speaker recognition systems from pre-computing days to current trends. Advances in various sciences which have allowed autonomous speaker recognition systems to become a practical means of identity authentication are also reviewed.

Modeling And Experimental Demonstration Of A Hopfield Network Analog-To-Digital Converter With Hybrid Cmos/Memristor Circuits, Xinjie Guo, Farnood Merrikh-Bayat, Ligang Gao, Brian D. Hoskins, Fabien Alibart, Bernabe Linares-Barranco, Luke Theogarajan, Christof Teuscher, Dmitri B. Strukov

Electrical and Computer Engineering Faculty Publications and Presentations

The purpose of this work was to demonstrate the feasibility of building recurrent artificial neural networks with hybrid complementary metal oxide semiconductor (CMOS)/memristor circuits. To do so, we modeled a Hopfield network implementing an analog-to-digital converter (ADC) with up to 8 bits of precision. Major shortcomings affecting the ADC's precision, such as the non-ideal behavior of CMOS circuitry and the specific limitations of memristors, were investigated and an effective solution was proposed, capitalizing on the in-field programmability of memristors. The theoretical work was validated experimentally by demonstrating the successful operation of a 4-bit ADC circuit implemented with discrete Pt/TiO_{2− …}

Intelligent Controls For A Semi-Active Hydraulic Prosthetic Knee, Timothy Allen Wilmot

ETD Archive

We discuss open loop control development and simulation results for a semi-active above-knee prosthesis. The control signal consists of two hydraulic valve settings. These valves control a rotary actuator that provides torque to the prosthetic knee. We develop open loop control using biogeography-based optimization (BBO), which is a recently developed evolutionary algorithm, and gradient descent. We use gradient descent to show that the control generated by BBO is locally optimal. This research contributes to the field of evolutionary algorithms by demonstrating that BBO is successful at finding optimal solutions to complex, real-world, nonlinear, time varying control problems. The research contributes …

Design And Operation Of Stationary Distributed Battery Micro-Storage Systems, Ala R. Al-Haj Hussein

Electronic Theses and Dissertations

Due to some technical and environmental constraints, expanding the current electric power generation and transmission system is being challenged by even increasing the deployment of distributed renewable generation and storage systems. Energy storage can be used to store energy from utility during low-demand (off-peak) hours and deliver this energy back to the utility during high-demand (on-peak) hours. Furthermore, energy storage can be used with renewable sources to overcome some of their limitations such as their strong dependence on the weather conditions, which cannot be perfectly predicted, and their unmatched or out-of-synchronization generation peaks with the demand peaks. Generally, energy storage …

Inference Of Genetic Regulatory Networks With Recurrent Neural Network Models Using Particle Swarm Optimization, Rui Xu, Donald C. Wunsch, Ronald L. Frank

Electrical and Computer Engineering Faculty Research & Creative Works

Genetic regulatory network inference is critically important for revealing fundamental cellular processes, investigating gene functions, and understanding their relations. The availability of time series gene expression data makes it possible to investigate the gene activities of whole genomes, rather than those of only a pair of genes or among several genes. However, current computational methods do not sufficiently consider the temporal behavior of this type of data and lack the capability to capture the complex nonlinear system dynamics. We propose a recurrent neural network (RNN) and particle swarm optimization (PSO) approach to infer genetic regulatory networks from time series gene …

Approximate Dynamic Programming And Neural Networks On Game Hardware, Ryan J. Meuth, Donald C. Wunsch

Electrical and Computer Engineering Faculty Research & Creative Works

Modern graphics processing units (GPU) and game consoles are used for much more than simply 3D graphics applications and video games. From machine vision to finite element analysis, GPU's are being used in diverse applications, collectively called General Purpose computation onf graphics processor units (GPGPU). Additionally, game consoles are entering the market of high performance computing as inexpensive nodes in computing clusters. This paper explores the capabilities and limitations of modern GPU's and game consoles, surveying the ADP and neural network technologies that can be applied to these devices.

Combined Training Of Recurrent Neural Networks With Particle Swarm Optimization And Backpropagation Algorithms For Impedance Identification, Peng Xiao, Ganesh K. Venayagamoorthy, Keith Corzine

Electrical and Computer Engineering Faculty Research & Creative Works

A recurrent neural network (RNN) trained with a combination of particle swarm optimization (PSO) and backpropagation (BP) algorithms is proposed in this paper. The network is used as a dynamic system modeling tool to identify the frequency-dependent impedances of power electronic systems such as rectifiers, inverters, and DC-DC converters. As a category of supervised learning methods, the various backpropagation training algorithms developed for recurrent neural networks use gradient descent information to guide their search for optimal weights solutions that minimize the output errors. While they prove to be very robust and effective in training many types of network structures, they …

Neural Network Based Method For Predicting Nonlinear Load Harmonics, Joy Mazumdar, Ronald G. Harley, Frank C. Lambert, Ganesh K. Venayagamoorthy

Electrical and Computer Engineering Faculty Research & Creative Works

Generation of harmonics and the existence of waveform pollution in power system networks are important problems facing the power utilities. The increased use of nonlinear devices in industry has resulted in direct increase of harmonic distortion in the industrial power system in recent years. Interaction between loads and sources in a power distribution network is a complex process and often not possible to explain analytically without making assumptions. The determination of true harmonic current distortion of a load is further complicated by the fact that the supply voltage waveform at the point of common coupling (PCC) is rarely a pure …

Optimal Wide Area Controller And State Predictor For A Power System, Salman Mohagheghi, Ganesh K. Venayagamoorthy, Ronald G. Harley

Electrical and Computer Engineering Faculty Research & Creative Works

An optimal wide area controller is designed in this paper for a 12-bus power system together with a Static Compensator (STATCOM). The controller provides auxiliary reference signals for the automatic voltage regulators (AVR) of the generators as well as the line voltage controller of the STATCOM in such a way that it improves the damping of the rotor speed deviations of the synchronous machines. Adaptive critic designs theory is used to implement the controller and enable it to provide nonlinear optimal control over the infinite horizon time of the problem and at different operating conditions of the power system. Simulation …

Adaptive Neural Network Based Stabilizing Controller Design For Single Machine Infinite Bus Power Systems, Wenxin Liu, Ganesh K. Venayagamoorthy, Donald C. Wunsch, David A. Cartes, Jagannathan Sarangapani, Mariesa Crow

Engineering Management and Systems Engineering Faculty Research & Creative Works

Power system stabilizers are widely used to generate supplementary control signals for the excitation system in order to damp out the low frequency oscillations. In power system control literature, the performances of the proposed controllers were mostly demonstrated using simulation results without any rigorous stability analysis. This paper proposes a stabilizing neural network (NN) controller based on a sixth order single machine infinite bus power system model. The NN is used to approximate the complex nonlinear dynamics of power system. Unlike the other indirect adaptive NN control schemes, there is no offline training process and the NN can be directly …

Survey Of Clustering Algorithms, Rui Xu, Donald C. Wunsch

Electrical and Computer Engineering Faculty Research & Creative Works

Data analysis plays an indispensable role for understanding various phenomena. Cluster analysis, primitive exploration with little or no prior knowledge, consists of research developed across a wide variety of communities. The diversity, on one hand, equips us with many tools. On the other hand, the profusion of options causes confusion. We survey clustering algorithms for data sets appearing in statistics, computer science, and machine learning, and illustrate their applications in some benchmark data sets, the traveling salesman problem, and bioinformatics, a new field attracting intensive efforts. Several tightly related topics, proximity measure, and cluster validation, are also discussed.

Reinforcement Learning-Based Output Feedback Control Of Nonlinear Systems With Input Constraints, Pingan He, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

A novel neural network (NN) -based output feedback controller with magnitude constraints is designed to deliver a desired tracking performance for a class of multi-input-multi-output (MIMO) discrete-time strict feedback nonlinear systems. Reinforcement learning in discrete time is proposed for the output feedback controller, which uses three NN: 1) a NN observer to estimate the system states with the input-output data; 2) a critic NN to approximate certain strategic utility function; and 3) an action NN to minimize both the strategic utility function and the unknown dynamics estimation errors. The magnitude constraints are manifested as saturation nonlinearities in the output feedback …

Blackfingers A Sophisticated Hand Prothesis, Michele Folgheraiter, Giuseppina Gini, Marek Perkowski, Mikhail Pivtoraiko

Electrical and Computer Engineering Faculty Publications and Presentations

Our goal is to develop the low level control system for an artificial hand ”Blackfingers”. Blackfingers was thought to have two main applications: as humanoid robot’s hand or as a human hand prothesis. In this last application our intent is to realize a device more sophisticated respect the actual commerce prothesis. Also in our intention is to use some biological paradigms to create a human like reflex control easy to be interfaced also with the human nervous system. In this paper we illustrate the properties and the morphology of a human like neural reflex controller, used to set the stiffness …

Implementation Of Large Neural Networks Using Decomposition, Henry Selvaraj, H. Niewiadomski, P. Buciak, M. Pleban, Piotr Sapiecha, Tadeusz Luba, Venkatesan Muthukumar

Electrical & Computer Engineering Faculty Research

The article presents methods of dealing with huge data in the domain of neural networks. The decomposition of neural networks is introduced and its efficiency is proved by the authors’ experiments. The examinations of the effectiveness of argument reduction in the above filed, are presented. Authors indicate, that decomposition is capable of reducing the size and the complexity of the learned data, and thus it makes the learning process faster or, while dealing with large data, possible. According to the authors experiments, in some cases, argument reduction, makes the learning process harder.

Le Bio Wall : Un Tissue Informatique Pour Le Prototypage De Systèmes Bio-Inspirés, Andre Stauffer, Daniel Mange, Gianluca Tempesti, Christof Teuscher

Electrical and Computer Engineering Faculty Publications and Presentations

Dans cet article, nous décrivons le BioWall, un tissu informatique reconfigurable géant développé dans le but d’y implémenter des machines mettant en oeuvre les principes de notre projet Embryonique. Bien que ses dimensions et ses caractéristiques en font d’abord un objet de démonstration publique, le BioWall constitue également un outil de recherche précieux, du fait que sa faculté de reprogrammation et sa structure cellulaire s’adaptent parfaitement à l’implémentation de toutes sortes de systèmes bioinspirés. Pour illustrer ces capacités, nous décrivons un ensemble d’applications qui reflètent différentes sources d’inspiration biologique allant des systèmes biologiques ontogénétiques aux dispositifs évolutifs phylogénétiques, en passant …

Voice Command Controller, Hoang Nghia Nguyen

Theses : Honours

Signal processing technology has been strongly developed and it has attracted interest from scientists and engineers around the world from the last decade. Speech synthesis and speech recognition are particular topic in the field that have been widely used and developed in many different area such as business, controlling, education and entertainment. The project's main objective is to study and develop an application program with the Speech SDK through design and implementation of Tele-Control system based on the commercial product of National Semiconductor: Carrier-Current Transceiver (LM 1893) and Speech development kit (Speech SDK4.0) from Microsoft Corporation. The project is suitable …

Training Strategies For Critic And Action Neural Networks In Dual Heuristic Programming Method, Christian Peter Paintz

Dissertations and Theses

This thesis discusses strategies for and details of training procedures for the Dual Heuristic Programming (DHP) methodology. This and other approximate dynamic programming approaches (HDP, DHP, GDHP) have been discussed in some detail in the literature, all being members of the Adaptive Critic Design (ACD) family. The example applications used here are the inverted pendulum problem and a fully nonlinear constant velocity bicycle steering model. The inverted pendulum has been successfully controlled using DHP, as reported in the literature. This thesis suggests and investigates several alternative D HP training procedures and compares their performance with respect to convergence speed and …

Adaptive Neural Network Controller For Atm Traffic, Jeffrey E. Larson

Theses and Dissertations

Broadband-Integrated Services Digital Networks (B-ISDN), along with Asynchronous Transfer Mode (ATM), were designed to meet the requirements of modern communication networks to handle multiple users and a wide variety of diverse traffic including voice, data and video. ATM responds to requests for admission to the network by analyzing whether or not the grade of service (GOS) requirement, specified in the admission request, can be guaranteed without violating the GOS guaranteed to traffic already accepted into the network. The GOS is typically a parameter such as cell loss rate (CLR), average delay, or some other measurement associated with network performance. In …

An Investigation Of Preliminary Feature Screening Using Signal-To-Noise Ratios, David B. Sumrell

Theses and Dissertations

A new saliency metric and a new saliency screening method are developed. This new metric, the SN saliency metric, is based upon signal-to-noise ratios, where the signal is provided by a sum of squared weights associated with a given feature, and the noise is based upon a sum of squared weights associated with a reference noise feature which is injected into the data. The resultant metric allows for a direct comparison of the feature of interest with a reference noise feature which is known to be nonsalient. The SN saliency screening method, which uses the SN saliency metric, offers the …