Engineering Commons^™

Extracting Patterns In Medical Claims Data For Predicting Opioid Overdose, Ryan Sanders

Graduate Theses and Dissertations

The goal of this project is to develop an efficient methodology for extracting features from time-dependent variables in transaction data. Transaction data is collected at varying time intervals making feature extraction more difficult. Unsupervised representational learning techniques are investigated, and the results compared with those from other feature engineering techniques. A successful methodology provides features that improve the accuracy of any machine learning technique. This methodology is then applied to insurance claims data in order to find features to predict whether a patient is at risk of overdosing on opioids. This data covers prescription, inpatient, and outpatient transactions. Features created …

Seer: An Explainable Deep Learning Midi-Based Hybrid Song Recommender System, Khalil Damak, Olfa Nasraoui

Faculty and Staff Scholarship

State of the art music recommender systems mainly rely on either matrix factorization-based collaborative filtering approaches or deep learning architectures. Deep learning models usually use metadata for content-based filtering or predict the next user interaction by learning from temporal sequences of user actions. Despite advances in deep learning for song recommendation, none has taken advantage of the sequential nature of songs by learning sequence models that are based on content. Aside from the importance of prediction accuracy, other significant aspects are important, such as explainability and solving the cold start problem. In this work, we propose a hybrid deep learning …

Improved Study Of Side-Channel Attacks Using Recurrent Neural Networks, Muhammad Abu Naser Rony Chowdhury

Boise State University Theses and Dissertations

Differential power analysis attacks are special kinds of side-channel attacks where power traces are considered as the side-channel information to launch the attack. These attacks are threatening and significant security issues for modern cryptographic devices such as smart cards, and Point of Sale (POS) machine; because after careful analysis of the power traces, the attacker can break any secured encryption algorithm and can steal sensitive information.

In our work, we study differential power analysis attack using two popular neural networks: Recurrent Neural Network (RNN) and Convolutional Neural Network (CNN). Our work seeks to answer three research questions(RQs):

RQ1: Is it …

Identifying Regional Trends In Avatar Customization, Peter Mawhorter, Sercan Sengun, Haewoon Kwak, D. Fox Harrell

Research Collection School Of Computing and Information Systems

Since virtual identities such as social media profiles and avatars have become a common venue for self-expression, it has become important to consider the ways in which existing systems embed the values of their designers. In order to design virtual identity systems that reflect the needs and preferences of diverse users, understanding how the virtual identity construction differs between groups is important. This paper presents a new methodology that leverages deep learning and differential clustering for comparative analysis of profile images, with a case study of almost 100 000 avatars from a large online community using a popular avatar creation …

Why Deep Learning Is More Efficient Than Support Vector Machines, And How It Is Related To Sparsity Techniques In Signal Processing, Laxman Bokati, Olga Kosheleva, Vladik Kreinovich

Departmental Technical Reports (CS)

Several decades ago, traditional neural networks were the most efficient machine learning technique. Then it turned out that, in general, a different technique called support vector machines is more efficient. Reasonably recently, a new technique called deep learning has been shown to be the most efficient one. These are empirical observations, but how we explain them -- thus making the corresponding conclusions more reliable? In this paper, we provide a possible theoretical explanation for the above-described empirical comparisons. This explanation enables us to explain yet another empirical fact -- that sparsity techniques turned out to be very efficient in signal …

Deep Learning (Partly) Demystified, Vladik Kreinovich, Olga Kosheleva

Departmental Technical Reports (CS)

Successes of deep learning are partly due to appropriate selection of activation function, pooling functions, etc. Most of these choices have been made based on empirical comparison and heuristic ideas. In this paper, we show that many of these choices -- and the surprising success of deep learning in the first place -- can be explained by reasonably simple and natural mathematics.

Image Based Recognition Of The Monuments In Prizren, Bertan Karahoda, Annea Futko

UBT International Conference

Image classification application has recently been covering a high number of research fields. In the other hand as the performance of the mobile devices is being updated day by day, the implementation of image recognition algorithms in them, is not only being trendy but very helpful in everyday tasks. With the automatic monument recognition, visiting a city is easy and fun. This application recognizes the captured monument, gives useful information and describes that particular landmark.

In this paper there are used four historical monuments of the city of Prizren, Kosovo and the aim is to classify these four famous monuments. …

Flood Management Deep Learning Model Inputs: A Review Of Necessary Data And Predictive Tools, Jacob Hale, Suzanna Long, Steven Corns, Tom Shoberg

Engineering Management and Systems Engineering Faculty Research & Creative Works

Current flood management models are often hampered by the lack of robust predictive analytics, as well as incomplete datasets for river basins prone to heavy flooding. This research uses a State-of-the-Art matrix (SAM) analysis and integrative literature review to categorize existing models by method and scope, then determines opportunities for integrating deep learning techniques to expand predictive capability. Trends in the SAM analysis are then used to determine geospatial characteristics of the region that can contribute to flash flood scenarios, as well as develop inputs for future modeling efforts. Preliminary progress on the selection of one urban and one rural …

Limited Data Rolling Bearing Fault Diagnosis With Few-Shot Learning, Ansi Zhang, Shaobo Li, Yuxin Cui, Wanli Yang, Rongzhi Dong, Jianjun Hu

Faculty Publications

This paper focuses on bearing fault diagnosis with limited training data. A major challenge in fault diagnosis is the infeasibility of obtaining sufficient training samples for every fault type under all working conditions. Recently deep learning based fault diagnosis methods have achieved promising results. However, most of these methods require large amount of training data. In this study, we propose a deep neural network based few-shot learning approach for rolling bearing fault diagnosis with limited data. Our model is based on the siamese neural network, which learns by exploiting sample pairs of the same or different categories. Experimental results over …

Artificial Intelligence Based Wrist Fracture Classification, Dineep Thomas

LSU Master's Theses

The problem of predicting wrist fractures from X-rays using Artificial Intelligence (AI) methods is addressed. Wrist fractures are the most commonly misdiagnosed fractures because of the complex anatomical structure of the wrist bone which includes several different bones. This research provides a predictive solution to automate the process of wrist fracture classifications and outlines a visualization technique to identify the probable location of the fractured region on the X-rays. This thesis describes a deep learning based approach for wrist fracture classification. Deep convolutional neural network (CNN) based models have been used for wrist fracture classification by combining different optimization techniques. …

Machine Learning Methodology Review For Computational Electromagnetics, He Ming Yao, Lijun Jiang, Huan Huan Zhang, Wei E.I. Sha

Electrical and Computer Engineering Faculty Research & Creative Works

While machine learning is revolutionizing every corner of modern technologies, we have been attempting to explore whether machine learning methods could be used in computational electromagnetic (CEM). In this paper, five efforts in line with this direction are reviewed. They include forward methods such as the method of moments (MoM) solved by the artificial neural network training process, FDTD PML (perfectly matched layer) using the hyperbolic tangent basis function (HTBF), etc. There are also inverse problems that use the deep ConvNets for the effective source reconstruction and subwavelength imaging in the far-field. Benchmarks are provided to demonstrate the feasibility of …

Towards Automated Understanding Of Laparoscopic Videos, Babak Namazi

Electrical Engineering Dissertations - Archive

Despite the advantages of minimally invasive surgeries, the indirect access and lack of the 3D field of view of the area of interest introduce complications in the procedures. Fortunately, the recorded videos from the operation offer the opportunity for intra-operative and post-operative analyses of the procedures, to improve future performance and safety. Such analysis is essential to provide the tools for evaluation and assessment of the surgeries. In this dissertation, we investigate the potential of deep learning techniques in understanding the videos captured during laparoscopic surgeries. To this end, we describe new methods for identifying the surgical instruments and the …

Mid To Late Season Weed Detection In Soybean Production Fields Using Unmanned Aerial Vehicle And Machine Learning, Arun Narenthiran Veeranampalayam Sivakumar

Department of Agricultural and Biological Systems Engineering: Dissertations, Theses, and Student Research

Mid-late season weeds are those that escape the early season herbicide applications and those that emerge late in the season. They might not affect the crop yield, but if uncontrolled, will produce a large number of seeds causing problems in the subsequent years. In this study, high-resolution aerial imagery of mid-season weeds in soybean fields was captured using an unmanned aerial vehicle (UAV) and the performance of two different automated weed detection approaches – patch-based classification and object detection was studied for site-specific weed management. For the patch-based classification approach, several conventional machine learning models on Haralick texture features were …

Unsupervised-Learning Assisted Artificial Neural Network For Optimization, Varun Kote

Mechanical & Aerospace Engineering Theses & Dissertations

Innovations in computer technology made way for Computational Fluid Dynamics (CFD) into engineering, which supported the development of new designs by reducing the cost and time by lowering the dependency on experimentation. There is a further need to make the process of development more efficient. One such technology is Artificial Intelligence. In this thesis, we explore the application of Artificial Intelligence (AI) in CFD and how it can improve the process of development.

AI is used as a buzz word for the mechanism which can learn by itself and make the decision accordingly. Machine learning (ML) is a subset of …

In Vivo Human-Like Robotic Phenotyping Of Leaf And Stem Traits In Maize And Sorghum In Greenhouse, Abbas Atefi

Department of Agricultural and Biological Systems Engineering: Dissertations, Theses, and Student Research

In plant phenotyping, the measurement of morphological, physiological and chemical traits of leaves and stems is needed to investigate and monitor the condition of plants. The manual measurement of these properties is time consuming, tedious, error prone, and laborious. The use of robots is a new approach to accomplish such endeavors, which enables automatic monitoring with minimal human intervention. In this study, two plant phenotyping robotic systems were developed to realize automated measurement of plant leaf properties and stem diameter which could reduce the tediousness of data collection compare to manual measurements. The robotic systems comprised of a four degree …

Large-Scale Data Analysis And Deep Learning Using Distributed Cyberinfrastructures And High Performance Computing, Richard Dodge Platania

LSU Doctoral Dissertations

Data in many research fields continues to grow in both size and complexity. For instance, recent technological advances have caused an increased throughput in data in various biological-related endeavors, such as DNA sequencing, molecular simulations, and medical imaging. In addition, the variance in the types of data (textual, signal, image, etc.) adds an additional complexity in analyzing the data. As such, there is a need for uniquely developed applications that cater towards the type of data. Several considerations must be made when attempting to create a tool for a particular dataset. First, we must consider the type of algorithm required …

Inverted Cone Convolutional Neural Network For Deboning Mris, Oliver John Palumbo

Theses and Dissertations

Data plenitude is the power but also the bottleneck for data-driven approaches, including neural networks. In particular, Convolutional Neural Networks (CNNs) require an abundant database of training images to achieve a desired high accuracy. Current techniques employed for boosting small datasets are data augmentation and synthetic data generation, which suffer from computational complexity and imprecision compared to original datasets. In this thesis, we intercalate prior knowledge based on the temporal relation between the images in the third dimension. Specifically, we compute the gradient of subsequent images in the dataset to remove extraneous information and highlight subtle variations between the images. …

Viewpoint Optimization For Autonomous Strawberry Harvesting With Deep Reinforcement Learning, Jonathon J. Sather

Master's Theses

Autonomous harvesting may provide a viable solution to mounting labor pressures in the United States' strawberry industry. However, due to bottlenecks in machine perception and economic viability, a profitable and commercially adopted strawberry harvesting system remains elusive. In this research, we explore the feasibility of using deep reinforcement learning to overcome these bottlenecks and develop a practical algorithm to address the sub-objective of viewpoint optimization, or the development of a control policy to direct a camera to favorable vantage points for autonomous harvesting. We evaluate the algorithm's performance in a custom, open-source simulated environment and observe affirmative results. Our trained …

High-Performance Learning Systems Using Low-Precision Nanoscale Devices, Nandakumar Sasidharan Rajalekshmi

Dissertations

Brain-inspired computation promises a paradigm shift in information processing, both in terms of its parallel processing architecture and the ability to learn to tackle problems deemed unsolvable by traditional algorithmic approaches. The computational capability of the human brain is believed to stem from an interconnected network of 100 billion compute nodes (neurons) that interact with each other through approximately 10¹⁵ adjustable memory junctions (synapses). The conductance of synapses is modifiable allowing the network to learn and perform various cognitive functions. Artificial neural networks inspired by this architecture have demonstrated even super-human performance in many complex tasks.

Computational systems based …

Deep Autoencoder Neural Networks For Short-Term Traffic Congestion Prediction Of Transportation Networks, Sen Zhang, Yong Yao, Jie Hu, Yong Zhao, Shaobo Li, Jianjun Hu

Faculty Publications

Traffic congestion prediction is critical for implementing intelligent transportation systems for improving the efficiency and capacity of transportation networks. However, despite its importance, traffic congestion prediction is severely less investigated compared to traffic flow prediction, which is partially due to the severe lack of large-scale high-quality traffic congestion data and advanced algorithms. This paper proposes an accessible and general workflow to acquire large-scale traffic congestion data and to create traffic congestion datasets based on image analysis. With this workflow we create a dataset named Seattle Area Traffic Congestion Status (SATCS) based on traffic congestion map snapshots from a publicly available …

Classification Of The 4 Stages Of Diabetic Retinopathy Using A Low Complexity Convolutional Neural Network., Zeliha Ogur

Electronic Theses and Dissertations

Diabetic Retinopathy is an eye disease that affects the blood vessels of the retina tissue found in the back of the eye. The blood vessels in the retina discharge fluid or cause hemorrhage when affected by diabetic retinopathy. It leads to loss of eye vision with people with diabetics and also among working adults. The disease may advance in four stages which include Mild nonproliferative, moderate nonproliferative, severe nonproliferative and proliferative diabetic retinopathy. In the mild stage also known as background retinopathy, lumps occur in the blood vessel and distort a little amount of blood. At this stage, you are …

Receptive Fields Optimization In Deep Learning For Enhanced Interpretability, Diversity, And Resource Efficiency., Babajide Odunitan Ayinde

Electronic Theses and Dissertations

In both supervised and unsupervised learning settings, deep neural networks (DNNs) are known to perform hierarchical and discriminative representation of data. They are capable of automatically extracting excellent hierarchy of features from raw data without the need for manual feature engineering. Over the past few years, the general trend has been that DNNs have grown deeper and larger, amounting to huge number of final parameters and highly nonlinear cascade of features, thus improving the flexibility and accuracy of resulting models. In order to account for the scale, diversity and the difficulty of data DNNs learn from, the architectural complexity and …

A Deep Learning Approach To Detect Diabetic Retinopathy In Fundus Images., Winston R. Furtado

Electronic Theses and Dissertations

Background: Diabetic retinopathy is a disease caused due by complications of diabetes mellitus which can lead to blindness. About 33% of the US population with diabetes also show symptoms for diabetes retinopathy. If not treated, diabetic retinopathy worsens over time by progressing through two main pathological stages of non-proliferative and proliferative and four clinical stages. While the diagnostic accuracy of detecting diabetic retinopathy through machine learning have shown to be successful for OCT images, the accuracy of ultra-widefield fundus images have yet to be fully reported. This paper describes a method to non-invasively detect and diagnose diabetic retinopathy from ultra-widefield …

Human Action Recognition In Video Surveillance System, Fadwa Subhi Al Azzo

Theses and Dissertations

The human action recognition in video surveillance (HARVS) system is the system that classifies and detects action in videos. The system depends on two modes: training mode, in which the system learns about the human actions in video samples, and testing mode, in which the system recognizes the unknown action in testing video samples. HARVS in computer vision is a desirable approach because of its various desired applications such as surveillance environments, security systems, robot vision machine, human-computer interaction, human traffic accident detectors, multimedia retrieval, entertainment environments, and healthcare systems. The main aim of the work in this dissertation is …

Unresolved Object Detection Using Synthetic Data Generation And Artificial Neural Networks, Yong U. Sinn

Theses and Dissertations

This research presents and solves constrained real-world problems of using synthetic data to train artificial neural networks (ANNs) to detect unresolved moving objects in wide field of view (WFOV) electro-optical/infrared (EO/IR) satellite motion imagery. Objectives include demonstrating the use of the Air Force Institute of Technology (AFIT) Sensor and Scene Emulation Tool (ASSET) as an effective tool for generating EO/IR motion imagery representative of real WFOV sensors and describing the ANN architectures, training, and testing results obtained. Deep learning using a 3-D convolutional neural network (3D ConvNet), long short term memory (LSTM) network, and U-Net are used to solve the …

Deep Learning Segmentation Of Coronary Calcified Plaque From Intravascular Optical Coherence Tomography (Ivoct) Images With Application To Finite Element Modeling Of Stent Deployment, Yazan Gharaibeh, Pengfei Dong, David Prabhu, Chaitanya Kolluru, Juhwan Lee, Vlad Zimin, Hozhabr Mozafari, Hiram Bizzera, Linxia Gu, David Wilson

Department of Mechanical and Materials Engineering: Faculty Publications

Because coronary artery calcified plaques can hinder or eliminate stent deployment, interventional cardiologists need a better way to plan interventions, which might include one of the many methods for calcification modification (e.g., atherectomy). We are imaging calcifications with intravascular optical coherence tomography (IVOCT), which is the lone intravascular imaging technique with the ability to image the extent of a calcification, and using results to build vessel-specific finite element models for stent deployment. We applied methods to a large set of image data (>45 lesions and > 2,600 image frames) of calcified plaques, manually segmented by experts into calcified, lumen and …

Deep Learning Method For Hyperspectral Remote Sensing Images With Small Samples, Xiangbin Shi, Zhong Jian, Cuiwei Liu, Liu Fang, Deyuan Zhang

Journal of System Simulation

Abstract: In order to solve the problem of large information dimension and fewer labeled training samples of hyperspectral remote sensing images, this paper proposes a hyperspectral remote sensing image classification framework HSI-CNN, which reduces the number of model parameters while maintaining the depth of neural network. Image pattern invariance and spectral channel contribution rate are analyzed, and the spectral redundancy information is reduced by principal component analysis. A full convolution neural network structure suitable for small sample hyperspectral remote sensing images is designed and the amount of network parameters is effectively reduced. Three kinds of HSI-CNN structures are proposed …

Video Action Recognition Based On Key-Frame, Mingxiao Li, Qichuan Geng, Mo Hong, Wu Wei, Zhou Zhong

Journal of System Simulation

Abstract: Video action recognition is an important part of intelligent video analysis. In recent years, deep learning methods, especially the two-stream convolutional neural network achieved the state-of-the-art performance. However, most methods simply use uniform sampling to get frames, which may cause the loss of information in sampling interval. We propose a segmentation method and a key-frame extraction method for video action recognition, and combine them with a multi-temporal-scale two-stream network. Our framework achieves a 94.2% accuracy at UCF101 split1, which is the same as the state-of-the-art method’s performance.

A Horizon Detection Method Based On Deep Learning And Random Forest, Jihua Ye, Shuxia Shi, Hanxi Li, Jiali Zuo, Shimin Wang

Journal of System Simulation

Abstract: The detection effect of existing horizon line detection methods is greatly affected by the environment, and the computational complexity is high. Aiming at the problem of horizon line detection in complex road scene in real-life, a horizon line detection method based on deep learning and random forest is proposed. The deep learning model is used to extract the depth features, then the obtained depth features are used for random forest training. The results of horizon line detection are obtained by random forest regression-voting. The simulation results show that this method has good detection effect. The detection results are not …

Traffic Flow Prediction Based On Deep Learning, Mingyu Liu, Jianping Wu, Yubo Wang, He Lei

Journal of System Simulation

Abstract: Traffic flow prediction is an important component of urban intelligent transportation system. With the development of machine learning and artificial intelligence, deep learning has been applied in traffic engineering area. Gated recurrent unit (GRU) neural network is selected to predict urban traffic flow. Cross-validation method is used to explore the optimal number of gated recurrent units. The GRU model is compared with other three predictors such as support vector regression and evaluated in different performance measurements. The results show that GRU model has better performance in traffic flow prediction than the other three models.