Engineering Commons^™

Deep Autoencoder Neural Networks For Short-Term Traffic Congestion Prediction Of Transportation Networks, Sen Zhang, Yong Yao, Jie Hu, Yong Zhao, Shaobo Li, Jianjun Hu

Faculty Publications

Traffic congestion prediction is critical for implementing intelligent transportation systems for improving the efficiency and capacity of transportation networks. However, despite its importance, traffic congestion prediction is severely less investigated compared to traffic flow prediction, which is partially due to the severe lack of large-scale high-quality traffic congestion data and advanced algorithms. This paper proposes an accessible and general workflow to acquire large-scale traffic congestion data and to create traffic congestion datasets based on image analysis. With this workflow we create a dataset named Seattle Area Traffic Congestion Status (SATCS) based on traffic congestion map snapshots from a publicly available …

Machine Intelligence For Advanced Medical Data Analysis: Manifold Learning Approach, Fereshteh S Bashiri

Theses and Dissertations

In the current work, linear and non-linear manifold learning techniques, specifically Principle Component Analysis (PCA) and Laplacian Eigenmaps, are studied in detail. Their applications in medical image and shape analysis are investigated.

In the first contribution, a manifold learning-based multi-modal image registration technique is developed, which results in a unified intensity system through intensity transformation between the reference and sensed images. The transformation eliminates intensity variations in multi-modal medical scans and hence facilitates employing well-studied mono-modal registration techniques. The method can be used for registering multi-modal images with full and partial data.

Next, a manifold learning-based scale invariant global shape …

Receptive Fields Optimization In Deep Learning For Enhanced Interpretability, Diversity, And Resource Efficiency., Babajide Odunitan Ayinde

Electronic Theses and Dissertations

In both supervised and unsupervised learning settings, deep neural networks (DNNs) are known to perform hierarchical and discriminative representation of data. They are capable of automatically extracting excellent hierarchy of features from raw data without the need for manual feature engineering. Over the past few years, the general trend has been that DNNs have grown deeper and larger, amounting to huge number of final parameters and highly nonlinear cascade of features, thus improving the flexibility and accuracy of resulting models. In order to account for the scale, diversity and the difficulty of data DNNs learn from, the architectural complexity and …

A Deep Learning Approach To Detect Diabetic Retinopathy In Fundus Images., Winston R. Furtado

Electronic Theses and Dissertations

Background: Diabetic retinopathy is a disease caused due by complications of diabetes mellitus which can lead to blindness. About 33% of the US population with diabetes also show symptoms for diabetes retinopathy. If not treated, diabetic retinopathy worsens over time by progressing through two main pathological stages of non-proliferative and proliferative and four clinical stages. While the diagnostic accuracy of detecting diabetic retinopathy through machine learning have shown to be successful for OCT images, the accuracy of ultra-widefield fundus images have yet to be fully reported. This paper describes a method to non-invasively detect and diagnose diabetic retinopathy from ultra-widefield …

Unresolved Object Detection Using Synthetic Data Generation And Artificial Neural Networks, Yong U. Sinn

Theses and Dissertations

This research presents and solves constrained real-world problems of using synthetic data to train artificial neural networks (ANNs) to detect unresolved moving objects in wide field of view (WFOV) electro-optical/infrared (EO/IR) satellite motion imagery. Objectives include demonstrating the use of the Air Force Institute of Technology (AFIT) Sensor and Scene Emulation Tool (ASSET) as an effective tool for generating EO/IR motion imagery representative of real WFOV sensors and describing the ANN architectures, training, and testing results obtained. Deep learning using a 3-D convolutional neural network (3D ConvNet), long short term memory (LSTM) network, and U-Net are used to solve the …

Deep Learning Segmentation Of Coronary Calcified Plaque From Intravascular Optical Coherence Tomography (Ivoct) Images With Application To Finite Element Modeling Of Stent Deployment, Yazan Gharaibeh, Pengfei Dong, David Prabhu, Chaitanya Kolluru, Juhwan Lee, Vlad Zimin, Hozhabr Mozafari, Hiram Bizzera, Linxia Gu, David Wilson

Department of Mechanical and Materials Engineering: Faculty Publications

Because coronary artery calcified plaques can hinder or eliminate stent deployment, interventional cardiologists need a better way to plan interventions, which might include one of the many methods for calcification modification (e.g., atherectomy). We are imaging calcifications with intravascular optical coherence tomography (IVOCT), which is the lone intravascular imaging technique with the ability to image the extent of a calcification, and using results to build vessel-specific finite element models for stent deployment. We applied methods to a large set of image data (>45 lesions and > 2,600 image frames) of calcified plaques, manually segmented by experts into calcified, lumen and …

A Horizon Detection Method Based On Deep Learning And Random Forest, Jihua Ye, Shuxia Shi, Hanxi Li, Jiali Zuo, Shimin Wang

Journal of System Simulation

Abstract: The detection effect of existing horizon line detection methods is greatly affected by the environment, and the computational complexity is high. Aiming at the problem of horizon line detection in complex road scene in real-life, a horizon line detection method based on deep learning and random forest is proposed. The deep learning model is used to extract the depth features, then the obtained depth features are used for random forest training. The results of horizon line detection are obtained by random forest regression-voting. The simulation results show that this method has good detection effect. The detection results are not …

Video Action Recognition Based On Key-Frame, Mingxiao Li, Qichuan Geng, Mo Hong, Wu Wei, Zhou Zhong

Journal of System Simulation

Abstract: Video action recognition is an important part of intelligent video analysis. In recent years, deep learning methods, especially the two-stream convolutional neural network achieved the state-of-the-art performance. However, most methods simply use uniform sampling to get frames, which may cause the loss of information in sampling interval. We propose a segmentation method and a key-frame extraction method for video action recognition, and combine them with a multi-temporal-scale two-stream network. Our framework achieves a 94.2% accuracy at UCF101 split1, which is the same as the state-of-the-art method’s performance.

Deep Learning Method For Hyperspectral Remote Sensing Images With Small Samples, Xiangbin Shi, Zhong Jian, Cuiwei Liu, Liu Fang, Deyuan Zhang

Journal of System Simulation

Abstract: In order to solve the problem of large information dimension and fewer labeled training samples of hyperspectral remote sensing images, this paper proposes a hyperspectral remote sensing image classification framework HSI-CNN, which reduces the number of model parameters while maintaining the depth of neural network. Image pattern invariance and spectral channel contribution rate are analyzed, and the spectral redundancy information is reduced by principal component analysis. A full convolution neural network structure suitable for small sample hyperspectral remote sensing images is designed and the amount of network parameters is effectively reduced. Three kinds of HSI-CNN structures are proposed …

Traffic Flow Prediction Based On Deep Learning, Mingyu Liu, Jianping Wu, Yubo Wang, He Lei

Journal of System Simulation

Abstract: Traffic flow prediction is an important component of urban intelligent transportation system. With the development of machine learning and artificial intelligence, deep learning has been applied in traffic engineering area. Gated recurrent unit (GRU) neural network is selected to predict urban traffic flow. Cross-validation method is used to explore the optimal number of gated recurrent units. The GRU model is compared with other three predictors such as support vector regression and evaluated in different performance measurements. The results show that GRU model has better performance in traffic flow prediction than the other three models.

Visual Object Tracking Algorithm Based On Deep Denoising Autoencoder Over Rgb-D Data, Mingxin Jiang, Zhigeng Pan, Lanfang Wang, Taoxin Hu

Journal of System Simulation

Abstract: A visual object tracking algorithm based on cross-modality features deep learning over RGB-D data is proposed. A sparse denoising autoencoder deep learning network is constructed, which can extract cross-modal features of the samples in RGB-D video data. The cross-modal features of the samples are input to the logistic regression classifier, the observation likelihood model is established according to the confidence score of the classifier, and the reasonable state transition model is established. The object tracking results over RGB-D data are obtained using particle filtering algorithm. Experimental results show that the proposed method has strong robustness to abnormal changes. …

Research On Evaluation Framework Of Coa Based On Wargaming, Haiyang Liu, Yubo Tang, Xiaofeng Hu, Guangpeng Qiao

Journal of System Simulation

Abstract: Aiming at the evaluation problem of COA (course of action) level indicators in joint operation, an evaluation framework of COA based on wargaming was proposed. By multidimensional analysis of wargaming data, an evaluation feature space was constructed from basic features generated by data cube models and SoS (system of systems) features based on complex network. Wargaming experiments were used to generate small batch metrics results of COA level indicators, and the corresponding result labels of evaluation feature space data were generated by data fitting method. Two-phase correlation analysis was used for dimensionality reduction of high dimensional evaluation features. …

A Model For Battlefield Situation Change Rate Prediction Based On Deep Learning, Jiuyang Tao, Wu Lin, Wang Chi, Junda Chu, Liao Ying, Zhu Feng

Journal of System Simulation

Abstract: To measure and estimate the uncertainty of the battlefield situation is of great significance for the commanders to plan the reconnaissance mission and reduce the risk of decision-making. Based on Shannon's information theory, firstly, methods and a model on measurement of situation change rate are proposed. Secondly, a scene with two-dimensional grid elements maneuvering is established, based on deep learning, the prediction method for maneuvering trend is explored. It is proved that cross entropy is equivalent to situation change rate. Finally, with the increase of the objective uncertainty, situation change rate and the accuracy of the forecast is …

Multi-Pig Part Detection And Association With A Fully-Convolutional Network, Eric T. Psota, Mateusz Mittek, Lance C. Pérez, Ty Schmidt, Benny Mote

Department of Electrical and Computer Engineering: Faculty Publications

Computer vision systems have the potential to provide automated, non-invasive monitoring of livestock animals, however, the lack of public datasets with well-defined targets and evaluation metrics presents a significant challenge for researchers. Consequently, existing solutions often focus on achieving task-specific objectives using relatively small, private datasets. This work introduces a new dataset and method for instance-level detection of multiple pigs in group-housed environments. The method uses a single fully-convolutional neural network to detect the location and orientation of each animal, where both body part locations and pairwise associations are represented in the image space. Accompanying this method is a new …

Mouldingnet: Deep-Learning For 3d Object Reconstruction, Tobias Burns, Barak Pearlmutter, John B. Mcdonald

Session 2: Deep Learning for Computer Vision

th the rise of deep neural networks a number of approaches for learning over 3D data have gained popularity. In this paper, we take advantage of one of these approaches, bilateral convolutional layers to propose a novel end-to-end deep auto-encoder architecture to efficiently encode and reconstruct 3D point clouds. Bilateral convolutional layers project the input point cloud onto an even tessellation of a hyperplane in the (d Å1)-dimensional space known as the permutohedral lattice and perform convolutions over this representation. In contrast to existing point cloud based learning approaches, this allows us to learn over the underlying geometry of the …

Deep Cnn Frameworks For Comparison For Malaria Diagnosis, Priyadarshini Adyasha Pattanaik, Zelong Wang, Patrick Horain

Session 2: Deep Learning for Computer Vision

Abstract We compare Deep Convolutional Neural Networks (DCNN) frameworks, namely AlexNet and VGGNet, for the classification of healthy and malaria-infected cells in large, grayscale, low quality and low resolution microscopic images, in the case only a small training set is available. Experimental results deliver promising results on the path to quick, automatic and precise classification in unstrained images.

Place Recognition In Challenging Conditions, Saravanabalagi Ramachandran, John Mcdonald

Session 2: Deep Learning for Computer Vision

Place recognition in a visual SLAM system helps build and maintain a map from multiple traversals of the same environment while closing loops to correct drift accumulated over time. Despite the marked success in visual place recognition research over the past decade, it remains a challenging problem in the context of variations caused due to different times of the day, weather, lighting and seasons. In this paper, we address this problem by progressively training convolutional neural networks in a siamese fashion to generate embeddings that encode semantic and visual features for sequence-aligned image pairs taken at different timescales and viewpoints. …

Deep Convolutional Neural Networks For Estimating Lens Distortion Parameters, Sebastian Lutz, Mark Davey, Aljosa Smolic

Session 2: Deep Learning for Computer Vision

In this paper we present a convolutional neural network (CNN) to predict multiple lens distortion parameters from a single input image. Unlike other methods, our network is suitable to create high resolution output as it directly estimates the parameters from the image which then can be used to rectify even very high resolution input images. As our method it is fully automatic, it is suitable for both casual creatives and professional artists. Our results show that our network accurately predicts the lens distortion parameters of high resolution images and corrects the distortions satisfactory.

Synthetic Positron Emission Tomography Using Conditional-Generative Adversarial Networks For Healthy Bone Marrow Baseline Image Generation, Patrick Leydon, Martin O'Connell, Derek Greene, Kathleen Curran

Session 6: Applications, Architecture and Systems Integration

A Conditional-Generative Adversarial Network has been used for a supervised image-to-image transla- tion task which outputs a synthetic PET scan based on real patient CT data. The network is trained using only data of patients with healthy bone marrow metabolism. This allows for a patient specific synthetic healthy baseline scan to be produced. This can be used by a clinician for comparison to real PET data in the absence of a baseline scan or to aid in the diagnosis of conditions such as Multiple Myeloma which manifest as changes in bone marrow metabolism.

Image-Based Roadway Assessment Using Convolutional Neural Networks, Weilian Song

Theses and Dissertations--Computer Science

Road crashes are one of the main causes of death in the United States. To reduce the number of accidents, roadway assessment programs take a proactive approach, collecting data and identifying high-risk roads before crashes occur. However, the cost of data acquisition and manual annotation has restricted the effect of these programs. In this thesis, we propose methods to automate the task of roadway safety assessment using deep learning. Specifically, we trained convolutional neural networks on publicly available roadway images to predict safety-related metrics: the star rating score and free-flow speed. Inference speeds for our methods are mere milliseconds, enabling …

Distribution Level Building Load Prediction Using Deep Learning, Abdulaziz S. Almalaq

Electronic Theses and Dissertations

Load prediction in distribution grids is an important means to improve energy supply scheduling, reduce the production cost, and support emission reduction. Determining accurate load predictions has become more crucial than ever as electrical load patterns are becoming increasingly complicated due to the versatility of the load profiles, the heterogeneity of individual load consumptions, and the variability of consumer-owned energy resources. However, despite the increase of smart grids technologies and energy conservation research, many challenges remain for accurate load prediction using existing methods. This dissertation investigates how to improve the accuracy of load predictions at the distribution level using artificial …

Fisheyemultinet: Real-Time Multi-Task Learning Architecture For Surround-View Automated Parking System., Pullaro Maddu, Wayne Doherty, Ganesh Sistu, Isabelle Leang, Michal Uricar, Sumanth Chennupati, Hazem Rashed, Jonathan Horgan, Ciaran Hughes, Senthil Yogamani

Session 6: Applications, Architecture and Systems Integration

Automated Parking is a low speed manoeuvring scenario which is quite unstructured and complex, requiring full 360° near-field sensing around the vehicle. In this paper, we discuss the design and implementation of an automated parking system from the perspective of camera based deep learning algorithms. We provide a holistic overview of an industrial system covering the embedded system, use cases and the deep learning architecture. We demonstrate a real-time multi-task deep learning network called FisheyeMultiNet, which detects all the necessary objects for parking on a low-power embedded system. FisheyeMultiNet runs at 15 fps for 4 cameras and it has three …

Novel Applications Of Machine Learning In Bioinformatics, Yi Zhang

Theses and Dissertations--Computer Science

Technological advances in next-generation sequencing and biomedical imaging have led to a rapid increase in biomedical data dimension and acquisition rate, which is challenging the conventional data analysis strategies. Modern machine learning techniques promise to leverage large data sets for finding hidden patterns within them, and for making accurate predictions. This dissertation aims to design novel machine learning-based models to transform biomedical big data into valuable biological insights. The research presented in this dissertation focuses on three bioinformatics domains: splice junction classification, gene regulatory network reconstruction, and lesion detection in mammograms.

A critical step in defining gene structures and mRNA …

Lung Segmentation In Chest Radiographs Using Fully Convolutional Networks, Rahul Hooda, Ajay Mittal, Sanjeev Sofat

Turkish Journal of Electrical Engineering and Computer Sciences

Automated segmentation of medical images that aims at extracting anatomical boundaries is a fundamental step in any computer-aided diagnosis (CAD) system. Chest radiographic CAD systems, which are used to detect pulmonary diseases, first segment the lung field to precisely define the region-of-interest from which radiographic patterns are sought. In this paper, a deep learning-based method for segmenting lung fields from chest radiographs has been proposed. Several modifications in the fully convolutional network, which is used for segmenting natural images to date, have been attempted and evaluated to finally evolve a network fine-tuned for segmenting lung fields. The testing accuracy and …

A Statistical Approach To Provide Explainable Convolutional Neural Network Parameter Optimization, Saman Akbarzadeh, Selam Ahderom, Kamal Alameh

Research outputs 2014 to 2021

Algorithms based on convolutional neural networks (CNNs) have been great attention in image processing due to their ability to find patterns and recognize objects in a wide range of scientific and industrial applications. Finding the best network and optimizing its hyperparameters for a specific application are central challenges for CNNs. Most state-of-the-art CNNs are manually designed, while techniques for automatically finding the best architecture and hyperparameters are computationally intensive, and hence, there is a need to severely limit their search space. This paper proposes a fast statistical method for CNN parameter optimization, which can be applied in many CNN applications …

Content-Based Music Recommendation Using Deep Learning, Ryan Whitell

Regis University Student Publications (comprehensive collection)

Music streaming services use recommendation systems to improve the customer experience by generating favorable playlists and by fostering the discovery of new music. State of the art recommendation systems use both collaborative filtering and content-based recommendation methods. Collaborative filtering suffers from the cold start problem; it can only make recommendations for music for which it has enough user data, so content-based methods are preferred. Most current content-based recommendation systems use convolutional neural networks on the spectrograms of track audio. The architectures are commonly borrowed directly from the field of computer vision. It is shown in this study that musically-motivated convolutional …

Multi-Sensory Deep Learning Architectures For Slam Dunk Scene Classification, Paul Minogue

Dissertations

Basketball teams at all levels of the game invest a considerable amount of time and effort into collecting, segmenting, and analysing footage from their upcoming opponents previous games. This analysis helps teams identify and exploit the potential weaknesses of their opponents and is commonly cited as one of the key elements required to achieve success in the modern game. The growing importance of this type of analysis has prompted research into the application of computer vision and audio classification techniques to help teams classify scoring sequences and key events using game footage. However, this research tends to focus on classifying …

The Efficacy Of Weakly Supervised Learning For Biomedical Imaging, Solomon Lee Hatcher

All ETDs from UAB

This paper aims to investigate the use of unsupervised saliency proposals in extracting suitable prior information from computed tomography scans of the head using image-level labels. The weak supervision learning method obtains useful information about an object’s location and fuses this result with an unsupervised saliency proposal to propagate labels to all related pixels. However, it is shown that unsupervised saliency guidance fails to supply the synthetic annotations with enough coherence to produce suitable segmentation.

Enhancing Face Pose Normalization With Deep Learning, Anil Çeli̇k, Nafi̇z Arica

Turkish Journal of Electrical Engineering and Computer Sciences

In this study, we propose a hybrid method for face pose normalization, which combines the 3-D model-based method with stacked denoising autoencoder (SDAE) deep network. Instead of applying a mirroring operation for the invisible face parts of the posed image, SDAE learns how to fill in those regions by a large set of training samples. In the performance evaluation, we compare the proposed method to four different pose normalization methods and investigate their effects on facial emotion recognition and verification problems in addition to visual quality tests. Methods evaluated in the experiments include 2-D alignment, 3-D model-based method, pure SDAE-based …

Improving Word Embeddings Projection For Turkish Hypernym Extraction, Savaş Yildirim

Turkish Journal of Electrical Engineering and Computer Sciences

Corpus-driven approaches can automatically explore is-a relations between the word pairs from corpus. This problem is also called hypernym extraction. Formerly, lexico-syntactic patterns have been used to solve hypernym relations. The language-specific syntactic rules have been manually crafted to build the patterns. On the other hand, recent studies have applied distributional approaches to word semantics. They extracted the semantic relations relying on the idea that similar words share similar contexts. Former distributional approaches have applied one-hot bag-of-word (BOW) encoding. The dimensionality problem of BOW has been solved by various neural network approaches, which represent words in very short and dense …