Engineering Commons^™

Neural Network In Hardware, Jiong Si

UNLV Theses, Dissertations, Professional Papers, and Capstones

This dissertation describes the implementation of several neural networks built on a field programmable gate array (FPGA) and used to recognize a handwritten digit dataset – the Modified National Institute of Standards and Technology (MNIST) database. A novel hardwarefriendly activation function called the dynamic ReLU (D-ReLU) function is proposed. This activation function can decrease chip area and power of neural networks when compared to traditional activation functions at no cost to prediction accuracy.

The implementations of three neural networks on FPGA are presented: 2-layer online training fully-connected neural network, 3-layer offline training fully-connected neural network, and two solutions of Super-Skinny …

On Action Quality Assessment, Paritosh Parmar

UNLV Theses, Dissertations, Professional Papers, and Capstones

In this dissertation, we tackle the task of quantifying the quality of actions, i.e., how well an

action was performed using computer vision. Existing methods used human body pose-based features to express the quality contained in an action sample. Human body pose estimation in actions such as sports actions, like diving and gymnastic vault, is particularly challenging, since the athletes undergo convoluted transformations while performing their routines. Moreover, pose-based features do not take into account visual cues such as water splash in diving. Visual cues are taken into account by human judges. In our first work, we show that using …

An Application Of Deep Learning Models To Automate Food Waste Classification, Alejandro Zachary Espinoza

Dissertations and Theses

Food wastage is a problem that affects all demographics and regions of the world. Each year, approximately one-third of food produced for human consumption is thrown away. In an effort to track and reduce food waste in the commercial sector, some companies utilize third party devices which collect data to analyze individual contributions to the global problem. These devices track the type of food wasted (such as vegetables, fruit, boneless chicken, pasta) along with the weight. Some devices also allow the user to leave the food in a kitchen container while it is weighed, so the container weight must also …

Pixel-Level Deep Multi-Dimensional Embeddings For Homogeneous Multiple Object Tracking, Mateusz Mittek

Department of Electrical and Computer Engineering: Dissertations, Theses, and Student Research

The goal of Multiple Object Tracking (MOT) is to locate multiple objects and keep track of their individual identities and trajectories given a sequence of (video) frames. A popular approach to MOT is tracking by detection consisting of two processing components: detection (identification of objects of interest in individual frames) and data association (connecting data from multiple frames). This work addresses the detection component by introducing a method based on semantic instance segmentation, i.e., assigning labels to all visible pixels such that they are unique among different instances. Modern tracking methods often built around Convolutional Neural Networks (CNNs) and additional, …

Mdt Geolocation Through Machine Learning: Evaluation Of Supervised Regression Ml Algorithms, Aria Canadell Solana

Theses and Dissertations

Minimizing Drive Test is a statistical protocol used to evaluate the network performance. It provides several benefits with respect to traditional drive test analysis; however, multiple inconveniences exist that prevent cell companies from precisely retrieving most of the locations of these reports. . MATLAB and Jupyter Notebook were used to prepare the data and create the models. Multiple supervised regression algorithms were tested and evaluated. The best predictions were obtained from the K-Nearest Neighbor algorithm with one ‘k’ and distance-weighted predictions. The UE geolocation was predicted with a median accuracy of 5.42 meters, a mean error of 61.62 meters, and …

Data Analytics And Machine Learning To Enhance The Operational Visibility And Situation Awareness Of Smart Grid High Penetration Photovoltaic Systems, Aditya Sundararajan

FIU Electronic Theses and Dissertations

Electric utilities have limited operational visibility and situation awareness over grid-tied distributed photovoltaic systems (PV). This will pose a risk to grid stability when the PV penetration into a given feeder exceeds 60% of its peak or minimum daytime load. Third-party service providers offer only real-time monitoring but not accurate insights into system performance and prediction of productions. PV systems also increase the attack surface of distribution networks since they are not under the direct supervision and control of the utility security analysts.

Six key objectives were successfully achieved to enhance PV operational visibility and situation awareness: (1) conceptual cybersecurity …

Machine Learning And Image Processing For Noise Removal And Robust Edge Detection In The Presence Of Mixed Noise, Mehdi Mafi

FIU Electronic Theses and Dissertations

The central goal of this dissertation is to design and model a smoothing filter based on the random single and mixed noise distribution that would attenuate the effect of noise while preserving edge details. Only then could robust, integrated and resilient edge detection methods be deployed to overcome the ubiquitous presence of random noise in images. Random noise effects are modeled as those that could emanate from impulse noise, Gaussian noise and speckle noise.

In the first step, evaluation of methods is performed based on an exhaustive review on the different types of denoising methods which focus on impulse noise, …

Demonstration Of Visible And Near Infrared Raman Spectrometers And Improved Matched Filter Model For Analysis Of Combined Raman Signals, Alexander Matthew Atkinson

Electrical & Computer Engineering Theses & Dissertations

Raman spectroscopy is a powerful analysis technique that has found applications in fields such as analytical chemistry, planetary sciences, and medical diagnostics. Recent studies have shown that analysis of Raman spectral profiles can be greatly assisted by use of computational models with achievements including high accuracy pure sample classification with imbalanced data sets and detection of ideal sample deviations for pharmaceutical quality control. The adoption of automated methods is a necessary step in streamlining the analysis process as Raman hardware becomes more advanced. Due to limits in the architectures of current machine learning based Raman classification models, transfer from pure …

Analyzing Evolution Of Rare Events Through Social Media Data, Xiaoyu Lu

Dissertations

Recently, some researchers have attempted to find a relationship between the evolution of rare events and temporal-spatial patterns of social media activities. Their studies verify that the relationship exists in both time and spatial domains. However, few of those studies can accurately deduce a time point when social media activities are most highly affected by a rare event because producing an accurate temporal pattern of social media during the evolution of a rare event is very difficult. This work expands the current studies along three directions. Firstly, we focus on the intensity of information volume and propose an innovative clustering …

Machine Learning In Support Of Electric Distribution Asset Failure Prediction, Robert D. Flamenbaum, Thomas Pompo, Christopher Havenstein, Jade Thiemsuwan

SMU Data Science Review

In this paper, we present novel approaches to predicting as- set failure in the electric distribution system. Failures in overhead power lines and their associated equipment in particular, pose significant finan- cial and environmental threats to electric utilities. Electric device failure furthermore poses a burden on customers and can pose serious risk to life and livelihood. Working with asset data acquired from an electric utility in Southern California, and incorporating environmental and geospatial data from around the region, we applied a Random Forest methodology to predict which overhead distribution lines are most vulnerable to fail- ure. Our results provide evidence …

Parkinsonian Speech And Voice Quality: Assessment And Improvement, Amr Gaballah

Electronic Thesis and Dissertation Repository

Parkinson’s disease (PD) is the second most common neurodegenerative disease. Statistics show that nearly 90% of people impaired with PD develop voice and speech disorders. Speech production impairments in PD subjects typically result in hypophonia and consequently, poor speech signal-to-noise ratio (SNR) in noisy environments and inferior speech intelligibility and quality. Assessment, monitoring, and improvement of the perceived quality and intelligibility of Parkinsonian voice and speech are, therefore, paramount. In the first study of this thesis, the perceived quality of sustained vowels produced by PD patients was assessed through objective predictors. Subjective quality ratings of sustained vowels were collected from …

Data Analytics And Performance Enhancement In Edge-Cloud Collaborative Internet Of Things Systems, Tianqi Yu

Electronic Thesis and Dissertation Repository

Based on the evolving communications, computing and embedded systems technologies, Internet of Things (IoT) systems can interconnect not only physical users and devices but also virtual services and objects, which have already been applied to many different application scenarios, such as smart home, smart healthcare, and intelligent transportation. With the rapid development, the number of involving devices increases tremendously. The huge number of devices and correspondingly generated data bring critical challenges to the IoT systems. To enhance the overall performance, this thesis aims to address the related technical issues on IoT data processing and physical topology discovery of the subnets …

Machine Learning Methodology Review For Computational Electromagnetics, He Ming Yao, Lijun Jiang, Huan Huan Zhang, Wei E.I. Sha

Electrical and Computer Engineering Faculty Research & Creative Works

While machine learning is revolutionizing every corner of modern technologies, we have been attempting to explore whether machine learning methods could be used in computational electromagnetic (CEM). In this paper, five efforts in line with this direction are reviewed. They include forward methods such as the method of moments (MoM) solved by the artificial neural network training process, FDTD PML (perfectly matched layer) using the hyperbolic tangent basis function (HTBF), etc. There are also inverse problems that use the deep ConvNets for the effective source reconstruction and subwavelength imaging in the far-field. Benchmarks are provided to demonstrate the feasibility of …

Comparative Analysis Of Feature Selection Methods To Identify Biomarkers In A Stroke-Related Dataset, Thomas Clifford, Justin Bruce, Tayo Obafemi-Ajayi, John Matta

Electrical and Computer Engineering Faculty Research & Creative Works

This paper applies machine learning feature selection techniques to the REGARDS stroke-related dataset to identify health-related biomarkers. A data-driven methodological framework is presented to evaluate multiple feature selection methods. In applying the framework, three classifiers are chosen in conjunction with two wrappers, and their performance with diverse classification targets such as Current Smoker, Current Alcohol Use, and Deceased is evaluated. The performance across logistic regression, random forest and naïve Bayes classifier methods, as quantified by the ROC Area Under Curve metric and selected features, was similar. However, significant differences were observed in running time. Performance of the selected features was …

A Hardware-Assisted Insider Threat Detection And Prevention Framework, Kyle W. Denney

FIU Electronic Theses and Dissertations

Today, the USB protocol is among the most widely used protocols. However, the mass-proliferation of USB has led to a threat vector wherein USB devices are assumed innocent, leaving computers open to an attack. Malicious USB devices can disguise themselves as benign devices to insert malicious commands to connected end devices. A rogue device appears benign to the average OS, requiring advanced detection schemes to identify malicious devices. However, using system-level hooks, advanced threats may subvert OS-reliant detection schemes. This thesis showcases USB-Watch, a hardware-based USB threat detection framework. The hardware can collect live USB traffic before the data can …

Towards Efficient Intrusion Detection Using Hybrid Data Mining Techniques, Fadi Salo

Electronic Thesis and Dissertation Repository

The enormous development in the connectivity among different type of networks poses significant concerns in terms of privacy and security. As such, the exponential expansion in the deployment of cloud technology has produced a massive amount of data from a variety of applications, resources and platforms. In turn, the rapid rate and volume of data creation in high-dimension has begun to pose significant challenges for data management and security. Handling redundant and irrelevant features in high-dimensional space has caused a long-term challenge for network anomaly detection. Eliminating such features with spectral information not only speeds up the classification process, but …

Gold Tree Solar Farm - Machine Learning To Predict Solar Power Generation, Jonathon T. Scott

Computer Science and Software Engineering

Solar energy causes a strain on the electrical grid because of the uncontrollable nature of the factors that affect power generation. Utilities are often required to balance solar generation facilities to meet consumer demand, which often includes the costly process of activating/deactivating a fossil fuel facility. Therefore, there is considerable interest in increasing the accuracy and the granularity of solar power generation predictions in order to reduce the cost of grid management. This project aims to evaluate how sky imaging technology may contribute to the accuracy of those predictions.

Data-Driven Integral Reinforcement Learning For Continuous-Time Non-Zero-Sum Games, Yongliang Yang, Liming Wang, Hamidreza Modares, Dawei Ding, Yixin Yin, Donald C. Wunsch

Electrical and Computer Engineering Faculty Research & Creative Works

This paper develops an integral value iteration (VI) method to efficiently find online the Nash equilibrium solution of two-player non-zero-sum (NZS) differential games for linear systems with partially unknown dynamics. To guarantee the closed-loop stability about the Nash equilibrium, the explicit upper bound for the discounted factor is given. To show the efficacy of the presented online model-free solution, the integral VI method is compared with the model-based off-line policy iteration method. Moreover, the theoretical analysis of the integral VI algorithm in terms of three aspects, i.e., positive definiteness properties of the updated cost functions, the stability of the closed-loop …

Source Reconstruction Method Based On Machine Learning Algorithms, He Ming Yao, Lijun Jiang, Wei E.I. Sha

Electrical and Computer Engineering Faculty Research & Creative Works

This paper proposes a new source reconstruction method (SRM) based on deep learning. The conventional SRM usually requires oversampled measurements data to ensure higher accuracy. Thus, conventional SRM numerical system is usually highly singular. A deep convolutional neural network (ConvNet) is proposed to reconstruct the equivalent sources of the target to overcome difficulty. The deep ConvNet allows us to employ less data samples. Besides, the ill-conditioned numerical system can be effectively avoided. Numerical examples are presented to demonstrate the feasibility and accuracy of the proposed method. Its performance is also compared with the traditional neural network and interpolation method. Moreover, …

Explanation Methods For Neural Networks, Jack H. Chen, Christof Teuscher

Student Research Symposium

Neural Networks (NNs) have become a basis of almost all state-of-the-art machine learning algorithms and classifiers. While NNs have been shown to generalize well to real-world examples, researchers have struggled to show why they work on an intuitive level. We designed several methods to explain the decisions of two state-of-the-art NN classifiers, ResNet and an All-CNN, in the context of the Japanese Society of Radiological Technology (JSRT) lung nodule dataset and the CIFAR-10 image dataset. Leading explanation methods LIME and Grad-CAM generate variations of heat maps which represent the regions of the input determined salient by the NN. We analyze …

Reliable Explanations Via Adversarial Examples On Robust Networks, Walt Woods, Jack H. Chen, Christof Teuscher

Student Research Symposium

Neural Networks (NNs) are increasingly used as the basis of advanced machine learning techniques in sensitive fields such as autonomous vehicles and medical imaging. However, NNs have been found vulnerable to a class of imperceptible attacks, called adversarial examples, which arbitrarily alter the output of the network. To close the schism between needing reliability in real-world applications and the fragility of NNs, we propose a new method for stabilizing networks, and show that as an added bonus, our technique results in reliable, high-fidelity explanations for the NN's decision. Compared to the state-of-the-art, this technique increased the area under the curve …

Detection And Classification Of Vibrating Objects In Sar Images, Francisco German Perez Venegas

Electrical and Computer Engineering ETDs

The vibratory response of buildings and machines contains key information that can be exploited to infer their operating conditions and to diagnose failures. Furthermore, since vibration signatures observed from the exterior surfaces of structures are intrinsically linked to the type of machinery operating inside of them, the ability to monitor vibrations remotely can enable the detection and identification of the machinery.

This dissertation focuses on developing novel techniques for the detection and M-ary classification of vibrating objects in SAR images. The work performed in this dissertation is conducted around three central claims. First, the non-linear transformation that the micro-Doppler return …

Machine Learning Methods For Nanophotonic Design, Simulation, And Operation, Alec Michael Hammond

Theses and Dissertations

Interest in nanophotonics continues to grow as integrated optics provides an affordable platform for areas like telecommunications, quantum information processing, and biosensing. Designing and characterizing integrated photonics components and circuits, however, remains a major bottleneck. This is especially true when complex circuits or devices are required to study a particular phenomenon.To address this challenge, this work develops and experimentally validates a novel machine learning design framework for nanophotonic devices that is both practical and intuitive. As case studies, artificial neural networks are trained to model strip waveguides, integrated chirped Bragg gratings, and microring resonators using a small number of simple …

Clinical Research In Pneumonia: Role Of Artificial Intelligence, Timothy L. Wiemken, Robert R. Kelley, William A. Mattingly, Julio A. Ramirez

The University of Louisville Journal of Respiratory Infections

No abstract provided.

Spectral Clustering For Electrical Phase Identification Using Advanced Metering Infrastructure Voltage Time Series, Logan Blakely

Dissertations and Theses

The increasing demand for and prevalence of distributed energy resources (DER) such as solar power, electric vehicles, and energy storage, present a unique set of challenges for integration into a legacy power grid, and accurate models of the low-voltage distribution systems are critical for accurate simulations of DER. Accurate labeling of the phase connections for each customer in a utility model is one area of grid topology that is known to have errors and has implications for the safety, efficiency, and hosting capacity of a distribution system. This research presents a methodology for the phase identification of customers solely using …

Weld Penetration Identification Based On Convolutional Neural Network, Chao Li

Theses and Dissertations--Electrical and Computer Engineering

Weld joint penetration determination is the key factor in welding process control area. Not only has it directly affected the weld joint mechanical properties, like fatigue for example. It also requires much of human intelligence, which either complex modeling or rich of welding experience. Therefore, weld penetration status identification has become the obstacle for intelligent welding system. In this dissertation, an innovative method has been proposed to detect the weld joint penetration status using machine-learning algorithms.

A GTAW welding system is firstly built. Project a dot-structured laser pattern onto the weld pool surface during welding process, the reflected laser pattern …

Novel Applications Of Machine Learning In Bioinformatics, Yi Zhang

Theses and Dissertations--Computer Science

Technological advances in next-generation sequencing and biomedical imaging have led to a rapid increase in biomedical data dimension and acquisition rate, which is challenging the conventional data analysis strategies. Modern machine learning techniques promise to leverage large data sets for finding hidden patterns within them, and for making accurate predictions. This dissertation aims to design novel machine learning-based models to transform biomedical big data into valuable biological insights. The research presented in this dissertation focuses on three bioinformatics domains: splice junction classification, gene regulatory network reconstruction, and lesion detection in mammograms.

A critical step in defining gene structures and mRNA …

Supervised Machine Learning Techniques For Short-Term Load Forecasting, Harish Amarasundar

Electronic Theses and Dissertations

Electric Load Forecasting is essential for the utility companies for energy management based on the demand. Machine Learning Algorithms has been in the forefront for prediction algorithms. This Thesis is mainly aimed to provide utility companies with a better insight about the wide range of Techniques available to forecast the load demands based on different scenarios. Supervised Machine Learning Algorithms were used to come up with the best possible solution for Short-Term Electric Load forecasting. The input Data set has the hourly load values, Weather data set and other details of a Day. The models were evaluated using MAPE and …

Improving Anomaly Detection In Bgp Time-Series Data By New Guide Features And Moderated Feature Selection Algorithm, Mahmoud Hashem, Ahmed Bashandy, Samir Shaheen

Turkish Journal of Electrical Engineering and Computer Sciences

The Internet infrastructure relies on the Border Gateway Protocol (BGP) to provide essential routing information where abnormal routing behavior impairs global Internet connectivity and stability. Hence, employing anomaly detection algorithms is important for improving the performance of BGP routing protocol. In this paper, we propose two algorithms; the first is the guide feature generator (GFG), which generates guide features from traditional features in BGP time-series data using moving regression in combination with smoothed moving average. The second is a modified random forest feature selection algorithm which is employed to automatically select the most dominant features (ASMDF). Our mechanism shows that …

Performance Tuning For Machine Learning-Based Software Development Effort Prediction Models, Egemen Ertuğrul, Zaki̇r Baytar, Çağatay Çatal, Ömer Can Muratli

Turkish Journal of Electrical Engineering and Computer Sciences

Software development effort estimation is a critical activity of the project management process. In this study, machine learning algorithms were investigated in conjunction with feature transformation, feature selection, and parameter tuning techniques to estimate the development effort accurately and a new model was proposed as part of an expert system. We preferred the most general-purpose algorithms, applied parameter optimization technique (GridSearch), feature transformation techniques (binning and one-hot-encoding), and feature selection algorithm (principal component analysis). All the models were trained on the ISBSG datasets and implemented by using the scikit-learn package in the Python language. The proposed model uses a multilayer …