Engineering Commons^™

Amodal Instance Segmentation And Multi-Object Tracking With Deep Pixel Embedding, Yanfeng Liu

Department of Electrical and Computer Engineering: Dissertations, Theses, and Student Research

This thesis extends upon the representational output of semantic instance segmentation by explicitly including both visible and occluded parts. A fully convolutional network is trained to produce consistent pixel-level embedding across two layers such that, when clustered, the results convey the full spatial extent and depth ordering of each instance. Results demonstrate that the network can accurately estimate complete masks in the presence of occlusion and outperform leading top-down bounding-box approaches.

The model is further extended to produce consistent pixel-level embeddings across two consecutive image frames from a video to simultaneously perform amodal instance segmentation and multi-object tracking. No post-processing …

Multiple Face Detection And Recognition System Design Applying Deep Learning In Web Browsers Using Javascript, Cristhian Gabriel Espinosa Sandoval

Computer Science and Computer Engineering Undergraduate Honors Theses

Deep learning has advanced progressively in the last years and now demonstrates state-of-the-art performance in various fields. In the era of big data, transformation of data into valuable knowledge has become one of the most important challenges in computing. Therefore, we will review multiple algorithms for face recognition that have been researched for a long time and are maturely developed, and analyze deep learning, presenting examples of current research.

To provide a useful and comprehensive perspective, in this paper we categorize research by deep learning architecture, including neural networks, convolutional neural networks, depthwise Separable Convolutions, densely connected convolutional networks, and …

Domain Adaptation In Unmanned Aerial Vehicles Landing Using Reinforcement Learning, Pedro Lucas Franca Albuquerque

Department of Computer Science and Engineering: Dissertations, Theses, and Student Research

Landing an unmanned aerial vehicle (UAV) on a moving platform is a challenging task that often requires exact models of the UAV dynamics, platform characteristics, and environmental conditions. In this thesis, we present and investigate three different machine learning approaches with varying levels of domain knowledge: dynamics randomization, universal policy with system identification, and reinforcement learning with no parameter variation. We first train the policies in simulation, then perform experiments both in simulation, making variations of the system dynamics with wind and friction coefficient, then perform experiments in a real robot system with wind variation. We initially expected that providing …

Scatter Reduction By Exploiting Behaviour Of Convolutional Neural Networks In Frequency Domain, Carlos Ivan Jerez Gonzalez

Theses and Dissertations

In X-ray imaging, scattered radiation can produce a number of artifacts that greatly

undermine the image quality. There are hardware solutions, such as anti-scatter grids.

However, they are costly. A software-based solution is a better option because it is

cheaper and can achieve a higher scatter reduction. Most of the current software-based

approaches are model-based. The main issues with them are the lack of flexibility, expressivity, and the requirement of a model. In consideration of this, we decided to apply

Convolutional Neural Networks (CNNs), since they do not have any of the previously

mentioned issues.

In our approach we split …

Improved Study Of Side-Channel Attacks Using Recurrent Neural Networks, Muhammad Abu Naser Rony Chowdhury

Boise State University Theses and Dissertations

Differential power analysis attacks are special kinds of side-channel attacks where power traces are considered as the side-channel information to launch the attack. These attacks are threatening and significant security issues for modern cryptographic devices such as smart cards, and Point of Sale (POS) machine; because after careful analysis of the power traces, the attacker can break any secured encryption algorithm and can steal sensitive information.

In our work, we study differential power analysis attack using two popular neural networks: Recurrent Neural Network (RNN) and Convolutional Neural Network (CNN). Our work seeks to answer three research questions(RQs):

RQ1: Is it …

Data Analytics And Machine Learning To Enhance The Operational Visibility And Situation Awareness Of Smart Grid High Penetration Photovoltaic Systems, Aditya Sundararajan

FIU Electronic Theses and Dissertations

Electric utilities have limited operational visibility and situation awareness over grid-tied distributed photovoltaic systems (PV). This will pose a risk to grid stability when the PV penetration into a given feeder exceeds 60% of its peak or minimum daytime load. Third-party service providers offer only real-time monitoring but not accurate insights into system performance and prediction of productions. PV systems also increase the attack surface of distribution networks since they are not under the direct supervision and control of the utility security analysts.

Six key objectives were successfully achieved to enhance PV operational visibility and situation awareness: (1) conceptual cybersecurity …

Investigating Semantic Properties Of Images Generated From Natural Language Using Neural Networks, Samuel Ward Schrader

Boise State University Theses and Dissertations

This work explores the attributes, properties, and potential uses of generative neural networks within the realm of encoding semantics. It works toward answering the questions of: If one uses generative neural networks to create a picture based on natural language, does the resultant picture encode the text's semantics in a way a computer system can process? Could such a system be more precise than current solutions at detecting, measuring, or comparing semantic properties of generated images, and thus their source text, or their source semantics?

This work is undertaken in the hope that detecting previously unknown properties, or better understanding …

Stochastic Resonance Enables Bpp/Log∗ Complexity And Universal Approximation In Analog Recurrent Neural Networks, Emmett Redd, A. Steven Younger, Tayo Obafemi-Ajayi

Electrical and Computer Engineering Faculty Research & Creative Works

Stochastic resonance (SR) is a natural process that without limit increases the precision of signal measurements in biological and physical sciences. Most artificial neural networks (NNs) are implemented on digital computers of fixed precision. A NN accessing universal approximation and a computational complexity class more powerful that of a Turing machine needs analog signals utilizing SR's limitless precision increase. This paper links an analog recurrent (AR) NN theorem, SR, BPP/log∗ (a physically realizable, super-Turing computation class), and universal approximation so NNs following them can be made computationally more powerful. An optical neural network mimicking chaos indicates super-Turing computation has been …

Simulation Of Human Balance Control Using An Inverted Pendulum Model, Joshua E. Caneer

Undergraduate Research & Mentoring Program

The nervous system that human beings use to control balance is remarkably adaptable to a wide variety of environments and conditions. This neural system is likely a combination of many inputs and feedback control loops working together. The ability to emulate this system of balance could be of great value in understanding and developing solutions to proprioceptive disorders and other diseases that affect the human balance control system. Additionally, the process of emulating the human balance system may also have widespread applications to the locomotion capabilities of many types of robots, in both bipedal and non-bipedal configurations.

The goal of …

Depressiongnn: Depression Prediction Using Graph Neural Network On Smartphone And Wearable Sensors, Param Bidja

Honors Scholar Theses

Depression prediction is a complicated classification problem because depression diagnosis involves many different social, physical, and mental signals. Traditional classification algorithms can only reach an accuracy of no more than 70% given the complexities of depression. However, a novel approach using Graph Neural Networks (GNN) can be used to reach over 80% accuracy, if a graph can represent the depression data set to capture differentiating features. Building such a graph requires 1) the definition of node features, which must be highly correlated with depression, and 2) the definition for edge metrics, which must also be highly correlated with depression. In …

Receptive Fields Optimization In Deep Learning For Enhanced Interpretability, Diversity, And Resource Efficiency., Babajide Odunitan Ayinde

Electronic Theses and Dissertations

In both supervised and unsupervised learning settings, deep neural networks (DNNs) are known to perform hierarchical and discriminative representation of data. They are capable of automatically extracting excellent hierarchy of features from raw data without the need for manual feature engineering. Over the past few years, the general trend has been that DNNs have grown deeper and larger, amounting to huge number of final parameters and highly nonlinear cascade of features, thus improving the flexibility and accuracy of resulting models. In order to account for the scale, diversity and the difficulty of data DNNs learn from, the architectural complexity and …

Convolutional Neural Network Architecture Study For Aerial Visual Localization, Jedediah M. Berhold

Theses and Dissertations

In unmanned aerial navigation the ability to determine the aircraft's location is essential for safe flight. The Global Positioning System (GPS) is the default modern application used for geospatial location determination. GPS is extremely robust, very accurate, and has essentially solved aerial localization. Unfortunately, the signals from all Global Navigation Satellite Systems (GNSS) to include GPS can be jammed or spoofed. To this response it is essential to develop alternative systems that could be used to supplement navigation systems, in the event of a lost GNSS signal. Public and governmental satellites have provided large amounts of high-resolution satellite imagery. These …

Hyper-Parameter Optimization Of A Convolutional Neural Network, Steven H. Chon

Theses and Dissertations

In the world of machine learning, neural networks have become a powerful pattern recognition technique that gives a user the ability to interpret high-dimensional data whereas conventional methods, such as logistic regression, would fail. There exists many different types of neural networks, each containing its own set of hyper-parameters that are dependent on the type of analysis required, but the focus of this paper will be on the hyper-parameters of convolutional neural networks. Convolutional neural networks are commonly used for classifications of visual imagery. For example, if you were to build a network for the purpose of predicting a specific …

Application Of Artificial Neural Networks To Assess Student Happiness, Gokhan Egilmez, Nadiye O. Erdil, Omid Mohammadi Arani, Mana Vahid

Mechanical and Industrial Engineering Faculty Publications

The purpose of this study is to develop an analytical assessment approach to identify the main factors that affect graduate students' happiness level. The two methods, multiple linear regression (MLR) and artificial neural networks (ANN), were employed for analytical modelling. A sample of 118 students at a small non-profit private university constituted the survey pool. Various factors including education, school facilities, health, social activities, and family were taken into consideration as a result of literature review in happiness assessment. A total of 32 inputs and one output variables were identified during survey design phase. The following survey conduction, data collection, …

Evasive Maneuvers Against Missiles For Unmanned Combat Aerial Vehicle In Autonomous Air Combat, Xizhong Yang, Jianliang Ai

Journal of System Simulation

Abstract: For UCAV having the capability to deal with autonomous air combat, the flight dynamics model with the overload input and the 3-dimensional proportional navigation guidance model were established. Based on artificial neural network, an evasive maneuver decision was presented for avoiding incoming missiles. The degrees of freedom for UCAV-missile system were reduced by coordinate transformation, which simplified the complicated model as a non-linear model with relatively small amount of input and a single output. After the neural network samples were generated and trained, evasive results could be directly predicted from the relationship of positions between UCAV and missile …

Supervised Machine Learning Techniques For Short-Term Load Forecasting, Harish Amarasundar

Electronic Theses and Dissertations

Electric Load Forecasting is essential for the utility companies for energy management based on the demand. Machine Learning Algorithms has been in the forefront for prediction algorithms. This Thesis is mainly aimed to provide utility companies with a better insight about the wide range of Techniques available to forecast the load demands based on different scenarios. Supervised Machine Learning Algorithms were used to come up with the best possible solution for Short-Term Electric Load forecasting. The input Data set has the hourly load values, Weather data set and other details of a Day. The models were evaluated using MAPE and …

An Explainable Autoencoder For Collaborative Filtering Recommendation, Pegah Sagheb Haghighi, Olurotimi Seton, Olfa Nasraoui

Faculty Scholarship

Autoencoders are a common building block of Deep Learning architectures, where they are mainly used for representation learning. They have also been successfully used in Collaborative Filtering (CF) recommender systems to predict missing ratings. Unfortunately, like all black box machine learning models, they are unable to explain their outputs. Hence, while predictions from an Autoencoderbased recommender system might be accurate, it might not be clear to the user why a recommendation was generated. In this work, we design an explainable recommendation system using an Autoencoder model whose predictions can be explained using the neighborhood based explanation style. Our preliminary work …

A Statistical Approach To Provide Explainable Convolutional Neural Network Parameter Optimization, Saman Akbarzadeh, Selam Ahderom, Kamal Alameh

Research outputs 2014 to 2021

Algorithms based on convolutional neural networks (CNNs) have been great attention in image processing due to their ability to find patterns and recognize objects in a wide range of scientific and industrial applications. Finding the best network and optimizing its hyperparameters for a specific application are central challenges for CNNs. Most state-of-the-art CNNs are manually designed, while techniques for automatically finding the best architecture and hyperparameters are computationally intensive, and hence, there is a need to severely limit their search space. This paper proposes a fast statistical method for CNN parameter optimization, which can be applied in many CNN applications …

Feature Extraction Using Spiking Convolutional Neural Networks, Ruthvik Vaila, John Chiasson, Vishal Saxena

Electrical and Computer Engineering Faculty Publications and Presentations

Spiking neural networks are biologically plausible counterparts of the artificial neural networks, artificial neural networks are usually trained with stochastic gradient descent and spiking neural networks are trained with spike timing dependant plasticity. Training deep convolutional neural networks is a memory and power intensive job. Spiking networks could potentially help in reducing the power usage. There is a large pool of tools for one to chose to train artificial neural networks of any size, on the other hand all the available tools to simulate spiking neural networks are geared towards computational neuroscience applications and they are not suitable for real …

An Automated Snick Detection And Classification Scheme As A Cricket Decision Review System, Aftab Khan, Syed Qadir Hussain, Muhammad Waleed, Ashfaq Khan, Umair Khan

Turkish Journal of Electrical Engineering and Computer Sciences

Umpire decisions can greatly affect the outcome of a cricket game. When there is doubt about the umpire?s call for a decision, a decision review system (DRS) may be brought into play by a batsman or bowler to validate the decision. Recently, the latest technologies, including Hotspot, Hawk-eye, and Snickometer, have been employed when there is doubt among the on-field umpire, batsman, or bowlers. This research is a step forward in gaging the true class of a snick generated from the contact of the cricket ball with either (i) the bat, (ii) gloves, (iii) pad, or (iv) a combination of …