Engineering Commons^™

Neural Network In Hardware, Jiong Si

UNLV Theses, Dissertations, Professional Papers, and Capstones

This dissertation describes the implementation of several neural networks built on a field programmable gate array (FPGA) and used to recognize a handwritten digit dataset – the Modified National Institute of Standards and Technology (MNIST) database. A novel hardwarefriendly activation function called the dynamic ReLU (D-ReLU) function is proposed. This activation function can decrease chip area and power of neural networks when compared to traditional activation functions at no cost to prediction accuracy.

The implementations of three neural networks on FPGA are presented: 2-layer online training fully-connected neural network, 3-layer offline training fully-connected neural network, and two solutions of Super-Skinny …

On Action Quality Assessment, Paritosh Parmar

UNLV Theses, Dissertations, Professional Papers, and Capstones

In this dissertation, we tackle the task of quantifying the quality of actions, i.e., how well an

action was performed using computer vision. Existing methods used human body pose-based features to express the quality contained in an action sample. Human body pose estimation in actions such as sports actions, like diving and gymnastic vault, is particularly challenging, since the athletes undergo convoluted transformations while performing their routines. Moreover, pose-based features do not take into account visual cues such as water splash in diving. Visual cues are taken into account by human judges. In our first work, we show that using …

An Application Of Deep Learning Models To Automate Food Waste Classification, Alejandro Zachary Espinoza

Dissertations and Theses

Food wastage is a problem that affects all demographics and regions of the world. Each year, approximately one-third of food produced for human consumption is thrown away. In an effort to track and reduce food waste in the commercial sector, some companies utilize third party devices which collect data to analyze individual contributions to the global problem. These devices track the type of food wasted (such as vegetables, fruit, boneless chicken, pasta) along with the weight. Some devices also allow the user to leave the food in a kitchen container while it is weighed, so the container weight must also …

Chaotic Time Series Prediction Based On Gaussian Processes Mixture, Zhenjie Feng, Fan Yu

Journal of System Simulation

Abstract: Aiming at the problem that the existing learning algorithms of Gaussian processes mixture (GPM) model, such as Markov Chain Monte Carlo (MCMC), variation or leave one out, have high computational complexity, a hidden variables posterior hard-cut iterative training algorithm is proposed, which simplifies the training process of the model. The GPM model based on the proposed algorithm is applied to chaotic time series prediction. The effects of embedding dimension, time delay, learning sample number, and testing sample numbers on predictive ability are discussed. It is demonstrated by the experimental results that the prediction of the GPM model is more …

Characteristic Index Digging Of Combat Sos Capability Based On Machine Learning, Yongli Yang, Xiaofeng Hu, Rong Ming, Xiaojing Yin, Wenxiang Wang

Journal of System Simulation

Abstract: Aiming at the two difficulties in characteristic index digging of combat system of systems (CSoS), namely operation data generation and digging method selection, this paper proposes a new digging method, that is, using the simulation testbed to generate operation data, then adopting the machine learning to dig characteristic index. Two methods of characteristic index digging based on machine learning are researched: (1) the method based on network convergence, divides the communities for fundamental indexes based on their relationship, and obtains the characteristic indexes by principal component analysis (PCA); this method is applied to dig the characteristic indexes of …

Machine Learning On Acoustic Signals Applied To High-Speed Bridge Deck Defect Detection, Yao Chou

Theses and Dissertations

Machine learning techniques are being applied to many data-intensive problems because they can accurately provide classification of complex data using appropriate training. Often, the performance of machine learning can exceed the performance of traditional techniques because machine learning can take advantage of higher dimensionality than traditional algorithms. In this work, acoustic data sets taken using a rapid scanning technique on concrete bridge decks provided an opportunity to both apply machine learning algorithms to improve detection performance and also to investigate the ways that training of neural networks can be aided by data augmentation approaches. Early detection and repair can enhance …

Self-Driving Toy Car Using Deep Learning, Fahim Ahmed, Suleyman Turac, Mubtasem Ali

Publications and Research

Our research focuses on building a student affordable platform for scale model self-driving cars. The goal of this project is to explore current developments of Open Source hardware and software to build a low-cost platform consisting of the car chassis/framework, sensors, and software for the autopilot. Our research will allow other students with low budget to enter into the world of Deep Learning, self-driving cars, and autonomous cars racing competitions.

Truck Activity Pattern Classification Using Anonymous Mobile Sensor Data, Taslima Akter

Graduate Theses and Dissertations

To construct, operate, and maintain a transportation system that supports the efficient movement of freight, transportation agencies must understand economic drivers of freight flow. This is a challenge since freight movement data available to transportation agencies is typically void of commodity and industry information, factors that tie freight movements to underlying economic conditions. With recent advances in the resolution and availability of big data from Global Positioning Systems (GPS), it may be possible to fill this critical freight data gap. However, there is a need for methodological approaches to enable usage of this data for freight planning and operations.

To …

Extracting Patterns In Medical Claims Data For Predicting Opioid Overdose, Ryan Sanders

Graduate Theses and Dissertations

The goal of this project is to develop an efficient methodology for extracting features from time-dependent variables in transaction data. Transaction data is collected at varying time intervals making feature extraction more difficult. Unsupervised representational learning techniques are investigated, and the results compared with those from other feature engineering techniques. A successful methodology provides features that improve the accuracy of any machine learning technique. This methodology is then applied to insurance claims data in order to find features to predict whether a patient is at risk of overdosing on opioids. This data covers prescription, inpatient, and outpatient transactions. Features created …

Application Of Artificial Neural Networks In The Drilling Processes: Can Equivalent Circulation Density Be Estimated Prior To Drilling?, Husam Hasan Alkinani, Abo Taleb Al-Hameedi, Shari Dunn-Norman, David Lian

Geosciences and Geological and Petroleum Engineering Faculty Research & Creative Works

As the drilling environment became more challenging nowadays, managing equivalent circulating density (ECD) is a key factor to minimize non-productive time (NPT) due to many drilling obstacles such as stuck pipe, formation fracturing, and lost circulation. The goal of this work was to predict ECD prior to drilling by using artificial neural network (ANN). Once ECD is recognized, the crucial drilling variables impact ECD can be modified to control ECD within the acceptable ranges. Data from over 2000 wells collected worldwide were used in this study to create an ANN to predict ECD prior to drilling. Into training, validation, and …

Machine Learning Predictions Electronic Couplings For Charge Transport Calculations Of P3ht, Evan D. Miller, Matthew L. Jones, Mike M. Henry, Bryan Stanfill, Eric Jankowski

Materials Science and Engineering Faculty Publications and Presentations

The purpose of this work is to lower the computational cost of predicting charge mobilities in organic semiconductors, which will benefit the screening of candidates for inexpensive solar power generation. We characterize efforts to minimize the number of expensive quantum chemical calculations we perform by training machines to predict electronic couplings between monomers of poly-(3-hexylthiophene). We test five machine learning techniques and identify random forests as the most accurate, information-dense, and easy-to-implement approach for this problem, achieving mean-absolute-error of 0.02 [× 1.6 × 10⁻¹⁹ J], R² = 0.986, predicting electronic couplings 390 times faster than quantum chemical calculations, …

Pixel-Level Deep Multi-Dimensional Embeddings For Homogeneous Multiple Object Tracking, Mateusz Mittek

Department of Electrical and Computer Engineering: Dissertations, Theses, and Student Research

The goal of Multiple Object Tracking (MOT) is to locate multiple objects and keep track of their individual identities and trajectories given a sequence of (video) frames. A popular approach to MOT is tracking by detection consisting of two processing components: detection (identification of objects of interest in individual frames) and data association (connecting data from multiple frames). This work addresses the detection component by introducing a method based on semantic instance segmentation, i.e., assigning labels to all visible pixels such that they are unique among different instances. Modern tracking methods often built around Convolutional Neural Networks (CNNs) and additional, …

Domain Adaptation In Unmanned Aerial Vehicles Landing Using Reinforcement Learning, Pedro Lucas Franca Albuquerque

Department of Computer Science and Engineering: Dissertations, Theses, and Student Research

Landing an unmanned aerial vehicle (UAV) on a moving platform is a challenging task that often requires exact models of the UAV dynamics, platform characteristics, and environmental conditions. In this thesis, we present and investigate three different machine learning approaches with varying levels of domain knowledge: dynamics randomization, universal policy with system identification, and reinforcement learning with no parameter variation. We first train the policies in simulation, then perform experiments both in simulation, making variations of the system dynamics with wind and friction coefficient, then perform experiments in a real robot system with wind variation. We initially expected that providing …

Mdt Geolocation Through Machine Learning: Evaluation Of Supervised Regression Ml Algorithms, Aria Canadell Solana

Theses and Dissertations

Minimizing Drive Test is a statistical protocol used to evaluate the network performance. It provides several benefits with respect to traditional drive test analysis; however, multiple inconveniences exist that prevent cell companies from precisely retrieving most of the locations of these reports. . MATLAB and Jupyter Notebook were used to prepare the data and create the models. Multiple supervised regression algorithms were tested and evaluated. The best predictions were obtained from the K-Nearest Neighbor algorithm with one ‘k’ and distance-weighted predictions. The UE geolocation was predicted with a median accuracy of 5.42 meters, a mean error of 61.62 meters, and …

Algorithms For Multi-Objective Mixed Integer Programming Problems, Alvaro Miguel Sierra Altamiranda

USF Tampa Graduate Theses and Dissertations

This thesis presents a total of 3 groups of contributions related to multi-objective optimization. The first group includes the development of a new algorithm and an open-source user-friendly package for optimization over the efficient set for bi-objective mixed integer linear programs. The second group includes an application of a special case of optimization over the efficient on conservation planning problems modeled with modern portfolio theory. Finally, the third group presents a machine learning framework to enhance criterion space search algorithms for multi-objective binary linear programming.

In the first group of contributions, this thesis presents the first (criterion space search) algorithm …

Data Analytics And Machine Learning To Enhance The Operational Visibility And Situation Awareness Of Smart Grid High Penetration Photovoltaic Systems, Aditya Sundararajan

FIU Electronic Theses and Dissertations

Electric utilities have limited operational visibility and situation awareness over grid-tied distributed photovoltaic systems (PV). This will pose a risk to grid stability when the PV penetration into a given feeder exceeds 60% of its peak or minimum daytime load. Third-party service providers offer only real-time monitoring but not accurate insights into system performance and prediction of productions. PV systems also increase the attack surface of distribution networks since they are not under the direct supervision and control of the utility security analysts.

Six key objectives were successfully achieved to enhance PV operational visibility and situation awareness: (1) conceptual cybersecurity …

Using Uncertainty To Interpret Supervised Machine Learning Predictions, Michael C. Darling

Electrical and Computer Engineering ETDs

Traditionally, machine learning models are assessed using methods that estimate an average performance against samples drawn from a particular distribution. Examples include the use of cross-validation or hold0out to estimate classification error, F-score, precision, and recall.

While these measures provide valuable information, they do not tell us a model's certainty relative to particular regions of the input space. Typically there are regions where the model can differentiate the classes with certainty, and regions where the model is much less certain about its predictions.

In this dissertation we explore numerous approaches for quantifying uncertainty in the individual predictions made by supervised …

Groundwater Level Mapping Tool: Development Of A Web Application To Effectively Characterize Groundwater Resources, Steven William Evans

Theses and Dissertations

Groundwater is used worldwide as a major source for agricultural irrigation, industrial processes, mining, and drinking water. An accurate understanding of groundwater levels and trends is essential for decision makers to effectively manage groundwater resources throughout an aquifer, ensuring its sustainable development and usage. Unfortunately, groundwater is one of the most challenging and expensive water resources to characterize, quantify, and monitor on a regional basis. Data, though present, are often limited or sporadic, and are generally not used to their full potential to aid decision makers in their groundwater management.This thesis presents a solution to this under-utilization of available data …

Machine Learning And Image Processing For Noise Removal And Robust Edge Detection In The Presence Of Mixed Noise, Mehdi Mafi

FIU Electronic Theses and Dissertations

The central goal of this dissertation is to design and model a smoothing filter based on the random single and mixed noise distribution that would attenuate the effect of noise while preserving edge details. Only then could robust, integrated and resilient edge detection methods be deployed to overcome the ubiquitous presence of random noise in images. Random noise effects are modeled as those that could emanate from impulse noise, Gaussian noise and speckle noise.

In the first step, evaluation of methods is performed based on an exhaustive review on the different types of denoising methods which focus on impulse noise, …

Development Of A National-Scale Big Data Analytics Pipeline To Study The Potential Impacts Of Flooding On Critical Infrastructures And Communities, Nattapon Donratanapat

Theses and Dissertations

With the rapid development of the Internet of Things (IoT) and Big data infrastructure, crowdsourcing techniques have emerged to facilitate data processing and problem solving particularly for flood emergences purposes. A Flood Analytics Information System (FAIS) has been developed as a Python Web application to gather Big data from multiple servers and analyze flooding impacts during historical and real-time events. The application is smartly designed to integrate crowd intelligence, machine learning (ML), and natural language processing of tweets to provide flood warning with the aim to improve situational awareness for flood risk management and decision making. FAIS allows the user …

Discovery Of Materials Through Applied Machine Learning, Travis Williams

Theses and Dissertations

Advances in artificial intelligence technology, specifically machine learning, have cre- ated opportunities in the material sciences to accelerate material discovery and gain fundamental understanding of the interaction between certain the constituent ele- ments of a material and the properties expressed by that material. Application of machine learning to experimental materials discovery is slow due to the monetary and temporal cost of experimental data, but parallel techniques such as continuous com- positional gradients or high-throughput characterization setups are capable of gener- ating larger amounts of data than the typical experimental process, and therefore are suitable for combination with machine learning. A …

Demonstration Of Visible And Near Infrared Raman Spectrometers And Improved Matched Filter Model For Analysis Of Combined Raman Signals, Alexander Matthew Atkinson

Electrical & Computer Engineering Theses & Dissertations

Raman spectroscopy is a powerful analysis technique that has found applications in fields such as analytical chemistry, planetary sciences, and medical diagnostics. Recent studies have shown that analysis of Raman spectral profiles can be greatly assisted by use of computational models with achievements including high accuracy pure sample classification with imbalanced data sets and detection of ideal sample deviations for pharmaceutical quality control. The adoption of automated methods is a necessary step in streamlining the analysis process as Raman hardware becomes more advanced. Due to limits in the architectures of current machine learning based Raman classification models, transfer from pure …

Analyzing Evolution Of Rare Events Through Social Media Data, Xiaoyu Lu

Dissertations

Recently, some researchers have attempted to find a relationship between the evolution of rare events and temporal-spatial patterns of social media activities. Their studies verify that the relationship exists in both time and spatial domains. However, few of those studies can accurately deduce a time point when social media activities are most highly affected by a rare event because producing an accurate temporal pattern of social media during the evolution of a rare event is very difficult. This work expands the current studies along three directions. Firstly, we focus on the intensity of information volume and propose an innovative clustering …

Machine Learning In Support Of Electric Distribution Asset Failure Prediction, Robert D. Flamenbaum, Thomas Pompo, Christopher Havenstein, Jade Thiemsuwan

SMU Data Science Review

In this paper, we present novel approaches to predicting as- set failure in the electric distribution system. Failures in overhead power lines and their associated equipment in particular, pose significant finan- cial and environmental threats to electric utilities. Electric device failure furthermore poses a burden on customers and can pose serious risk to life and livelihood. Working with asset data acquired from an electric utility in Southern California, and incorporating environmental and geospatial data from around the region, we applied a Random Forest methodology to predict which overhead distribution lines are most vulnerable to fail- ure. Our results provide evidence …

Parkinsonian Speech And Voice Quality: Assessment And Improvement, Amr Gaballah

Electronic Thesis and Dissertation Repository

Parkinson’s disease (PD) is the second most common neurodegenerative disease. Statistics show that nearly 90% of people impaired with PD develop voice and speech disorders. Speech production impairments in PD subjects typically result in hypophonia and consequently, poor speech signal-to-noise ratio (SNR) in noisy environments and inferior speech intelligibility and quality. Assessment, monitoring, and improvement of the perceived quality and intelligibility of Parkinsonian voice and speech are, therefore, paramount. In the first study of this thesis, the perceived quality of sustained vowels produced by PD patients was assessed through objective predictors. Subjective quality ratings of sustained vowels were collected from …

Data Analytics And Performance Enhancement In Edge-Cloud Collaborative Internet Of Things Systems, Tianqi Yu

Electronic Thesis and Dissertation Repository

Based on the evolving communications, computing and embedded systems technologies, Internet of Things (IoT) systems can interconnect not only physical users and devices but also virtual services and objects, which have already been applied to many different application scenarios, such as smart home, smart healthcare, and intelligent transportation. With the rapid development, the number of involving devices increases tremendously. The huge number of devices and correspondingly generated data bring critical challenges to the IoT systems. To enhance the overall performance, this thesis aims to address the related technical issues on IoT data processing and physical topology discovery of the subnets …

Asap: A Source Code Authorship Program, Matthew F. Tennyson Phd

Faculty & Staff Research and Creative Activity

Source code authorship attribution is the task of determining who wrote a computer program, based on its source code, usually when the author is either unknown or under dispute. Areas where this can be applied include software forensics, cases of software copyright infringement, and detecting plagiarism. Numerous methods of source code authorship attribution have been proposed and studied. However, there are no known easily accessible and user-friendly programs that perform this task. Instead, researchers typically develop software in an ad hoc manner for use in their studies, and the software is rarely made publicly available. In this paper, we present …

Machine Learning Methodology Review For Computational Electromagnetics, He Ming Yao, Lijun Jiang, Huan Huan Zhang, Wei E.I. Sha

Electrical and Computer Engineering Faculty Research & Creative Works

While machine learning is revolutionizing every corner of modern technologies, we have been attempting to explore whether machine learning methods could be used in computational electromagnetic (CEM). In this paper, five efforts in line with this direction are reviewed. They include forward methods such as the method of moments (MoM) solved by the artificial neural network training process, FDTD PML (perfectly matched layer) using the hyperbolic tangent basis function (HTBF), etc. There are also inverse problems that use the deep ConvNets for the effective source reconstruction and subwavelength imaging in the far-field. Benchmarks are provided to demonstrate the feasibility of …

Understanding Self-Assembly And Charge Transport In Organic Solar Cells Through Efficient Computation, Evan Miller

Boise State University Theses and Dissertations

Organic solar cells capable of sustainably generating electricity are possible if: (1) The structures assembled by photoactive molecules can be controlled, and (2) The structures favorable for charge transport can be determined. In this dissertation we conduct computational studies to understand relationships between organic solar cell compounds, processing, structure and charge transport. We advance tools for encapsulating computational workflows so that simulations are more reproducible and transferable. We find that molecular dynamic simulations using simplified models efficiently predict experimental structures. We find that the mobilities of charges through these structures—as determined by kinetic Monte Carlo simulations—match qualitative trends expected with …

Predicting Hardness Of Friction Stir Processed 304l Stainless Steel Using A Finite Element Model And A Random Forest Algorithm, Tyler Alan Mathis

Theses and Dissertations

Friction stir welding is an advanced welding process that is being investigated for use in many different industries. One area that has been investigated for its application is in healing critical nuclear reactor components that are developing cracks. However, friction stir welding is a complicated process and it is difficult to predict what the final properties of a set of welding parameters will be. This thesis sets forth a method using finite element analysis and a random forest model to accurately predict hardness in the welding nugget after processing. The finite element analysis code used and ALE formulation that enabled …