Engineering Commons^™

High-Performance Learning Systems Using Low-Precision Nanoscale Devices, Nandakumar Sasidharan Rajalekshmi

Dissertations

Brain-inspired computation promises a paradigm shift in information processing, both in terms of its parallel processing architecture and the ability to learn to tackle problems deemed unsolvable by traditional algorithmic approaches. The computational capability of the human brain is believed to stem from an interconnected network of 100 billion compute nodes (neurons) that interact with each other through approximately 10¹⁵ adjustable memory junctions (synapses). The conductance of synapses is modifiable allowing the network to learn and perform various cognitive functions. Artificial neural networks inspired by this architecture have demonstrated even super-human performance in many complex tasks.

Computational systems based …

Deep Autoencoder Neural Networks For Short-Term Traffic Congestion Prediction Of Transportation Networks, Sen Zhang, Yong Yao, Jie Hu, Yong Zhao, Shaobo Li, Jianjun Hu

Faculty Publications

Traffic congestion prediction is critical for implementing intelligent transportation systems for improving the efficiency and capacity of transportation networks. However, despite its importance, traffic congestion prediction is severely less investigated compared to traffic flow prediction, which is partially due to the severe lack of large-scale high-quality traffic congestion data and advanced algorithms. This paper proposes an accessible and general workflow to acquire large-scale traffic congestion data and to create traffic congestion datasets based on image analysis. With this workflow we create a dataset named Seattle Area Traffic Congestion Status (SATCS) based on traffic congestion map snapshots from a publicly available …

Receptive Fields Optimization In Deep Learning For Enhanced Interpretability, Diversity, And Resource Efficiency., Babajide Odunitan Ayinde

Electronic Theses and Dissertations

In both supervised and unsupervised learning settings, deep neural networks (DNNs) are known to perform hierarchical and discriminative representation of data. They are capable of automatically extracting excellent hierarchy of features from raw data without the need for manual feature engineering. Over the past few years, the general trend has been that DNNs have grown deeper and larger, amounting to huge number of final parameters and highly nonlinear cascade of features, thus improving the flexibility and accuracy of resulting models. In order to account for the scale, diversity and the difficulty of data DNNs learn from, the architectural complexity and …

Classification Of The 4 Stages Of Diabetic Retinopathy Using A Low Complexity Convolutional Neural Network., Zeliha Ogur

Electronic Theses and Dissertations

Diabetic Retinopathy is an eye disease that affects the blood vessels of the retina tissue found in the back of the eye. The blood vessels in the retina discharge fluid or cause hemorrhage when affected by diabetic retinopathy. It leads to loss of eye vision with people with diabetics and also among working adults. The disease may advance in four stages which include Mild nonproliferative, moderate nonproliferative, severe nonproliferative and proliferative diabetic retinopathy. In the mild stage also known as background retinopathy, lumps occur in the blood vessel and distort a little amount of blood. At this stage, you are …

A Deep Learning Approach To Detect Diabetic Retinopathy In Fundus Images., Winston R. Furtado

Electronic Theses and Dissertations

Background: Diabetic retinopathy is a disease caused due by complications of diabetes mellitus which can lead to blindness. About 33% of the US population with diabetes also show symptoms for diabetes retinopathy. If not treated, diabetic retinopathy worsens over time by progressing through two main pathological stages of non-proliferative and proliferative and four clinical stages. While the diagnostic accuracy of detecting diabetic retinopathy through machine learning have shown to be successful for OCT images, the accuracy of ultra-widefield fundus images have yet to be fully reported. This paper describes a method to non-invasively detect and diagnose diabetic retinopathy from ultra-widefield …

Human Action Recognition In Video Surveillance System, Fadwa Subhi Al Azzo

Theses and Dissertations

The human action recognition in video surveillance (HARVS) system is the system that classifies and detects action in videos. The system depends on two modes: training mode, in which the system learns about the human actions in video samples, and testing mode, in which the system recognizes the unknown action in testing video samples. HARVS in computer vision is a desirable approach because of its various desired applications such as surveillance environments, security systems, robot vision machine, human-computer interaction, human traffic accident detectors, multimedia retrieval, entertainment environments, and healthcare systems. The main aim of the work in this dissertation is …

Unresolved Object Detection Using Synthetic Data Generation And Artificial Neural Networks, Yong U. Sinn

Theses and Dissertations

This research presents and solves constrained real-world problems of using synthetic data to train artificial neural networks (ANNs) to detect unresolved moving objects in wide field of view (WFOV) electro-optical/infrared (EO/IR) satellite motion imagery. Objectives include demonstrating the use of the Air Force Institute of Technology (AFIT) Sensor and Scene Emulation Tool (ASSET) as an effective tool for generating EO/IR motion imagery representative of real WFOV sensors and describing the ANN architectures, training, and testing results obtained. Deep learning using a 3-D convolutional neural network (3D ConvNet), long short term memory (LSTM) network, and U-Net are used to solve the …

Deep Learning Segmentation Of Coronary Calcified Plaque From Intravascular Optical Coherence Tomography (Ivoct) Images With Application To Finite Element Modeling Of Stent Deployment, Yazan Gharaibeh, Pengfei Dong, David Prabhu, Chaitanya Kolluru, Juhwan Lee, Vlad Zimin, Hozhabr Mozafari, Hiram Bizzera, Linxia Gu, David Wilson

Department of Mechanical and Materials Engineering: Faculty Publications

Because coronary artery calcified plaques can hinder or eliminate stent deployment, interventional cardiologists need a better way to plan interventions, which might include one of the many methods for calcification modification (e.g., atherectomy). We are imaging calcifications with intravascular optical coherence tomography (IVOCT), which is the lone intravascular imaging technique with the ability to image the extent of a calcification, and using results to build vessel-specific finite element models for stent deployment. We applied methods to a large set of image data (>45 lesions and > 2,600 image frames) of calcified plaques, manually segmented by experts into calcified, lumen and …

A Horizon Detection Method Based On Deep Learning And Random Forest, Jihua Ye, Shuxia Shi, Hanxi Li, Jiali Zuo, Shimin Wang

Journal of System Simulation

Abstract: The detection effect of existing horizon line detection methods is greatly affected by the environment, and the computational complexity is high. Aiming at the problem of horizon line detection in complex road scene in real-life, a horizon line detection method based on deep learning and random forest is proposed. The deep learning model is used to extract the depth features, then the obtained depth features are used for random forest training. The results of horizon line detection are obtained by random forest regression-voting. The simulation results show that this method has good detection effect. The detection results are not …

Deep Learning Method For Hyperspectral Remote Sensing Images With Small Samples, Xiangbin Shi, Zhong Jian, Cuiwei Liu, Liu Fang, Deyuan Zhang

Journal of System Simulation

Abstract: In order to solve the problem of large information dimension and fewer labeled training samples of hyperspectral remote sensing images, this paper proposes a hyperspectral remote sensing image classification framework HSI-CNN, which reduces the number of model parameters while maintaining the depth of neural network. Image pattern invariance and spectral channel contribution rate are analyzed, and the spectral redundancy information is reduced by principal component analysis. A full convolution neural network structure suitable for small sample hyperspectral remote sensing images is designed and the amount of network parameters is effectively reduced. Three kinds of HSI-CNN structures are proposed …

Video Action Recognition Based On Key-Frame, Mingxiao Li, Qichuan Geng, Mo Hong, Wu Wei, Zhou Zhong

Journal of System Simulation

Abstract: Video action recognition is an important part of intelligent video analysis. In recent years, deep learning methods, especially the two-stream convolutional neural network achieved the state-of-the-art performance. However, most methods simply use uniform sampling to get frames, which may cause the loss of information in sampling interval. We propose a segmentation method and a key-frame extraction method for video action recognition, and combine them with a multi-temporal-scale two-stream network. Our framework achieves a 94.2% accuracy at UCF101 split1, which is the same as the state-of-the-art method’s performance.

Traffic Flow Prediction Based On Deep Learning, Mingyu Liu, Jianping Wu, Yubo Wang, He Lei

Journal of System Simulation

Abstract: Traffic flow prediction is an important component of urban intelligent transportation system. With the development of machine learning and artificial intelligence, deep learning has been applied in traffic engineering area. Gated recurrent unit (GRU) neural network is selected to predict urban traffic flow. Cross-validation method is used to explore the optimal number of gated recurrent units. The GRU model is compared with other three predictors such as support vector regression and evaluated in different performance measurements. The results show that GRU model has better performance in traffic flow prediction than the other three models.

Research On Evaluation Framework Of Coa Based On Wargaming, Haiyang Liu, Yubo Tang, Xiaofeng Hu, Guangpeng Qiao

Journal of System Simulation

Abstract: Aiming at the evaluation problem of COA (course of action) level indicators in joint operation, an evaluation framework of COA based on wargaming was proposed. By multidimensional analysis of wargaming data, an evaluation feature space was constructed from basic features generated by data cube models and SoS (system of systems) features based on complex network. Wargaming experiments were used to generate small batch metrics results of COA level indicators, and the corresponding result labels of evaluation feature space data were generated by data fitting method. Two-phase correlation analysis was used for dimensionality reduction of high dimensional evaluation features. …

Visual Object Tracking Algorithm Based On Deep Denoising Autoencoder Over Rgb-D Data, Mingxin Jiang, Zhigeng Pan, Lanfang Wang, Taoxin Hu

Journal of System Simulation

Abstract: A visual object tracking algorithm based on cross-modality features deep learning over RGB-D data is proposed. A sparse denoising autoencoder deep learning network is constructed, which can extract cross-modal features of the samples in RGB-D video data. The cross-modal features of the samples are input to the logistic regression classifier, the observation likelihood model is established according to the confidence score of the classifier, and the reasonable state transition model is established. The object tracking results over RGB-D data are obtained using particle filtering algorithm. Experimental results show that the proposed method has strong robustness to abnormal changes. …

A Model For Battlefield Situation Change Rate Prediction Based On Deep Learning, Jiuyang Tao, Wu Lin, Wang Chi, Junda Chu, Liao Ying, Zhu Feng

Journal of System Simulation

Abstract: To measure and estimate the uncertainty of the battlefield situation is of great significance for the commanders to plan the reconnaissance mission and reduce the risk of decision-making. Based on Shannon's information theory, firstly, methods and a model on measurement of situation change rate are proposed. Secondly, a scene with two-dimensional grid elements maneuvering is established, based on deep learning, the prediction method for maneuvering trend is explored. It is proved that cross entropy is equivalent to situation change rate. Finally, with the increase of the objective uncertainty, situation change rate and the accuracy of the forecast is …

Multi-Sensory Deep Learning Architectures For Slam Dunk Scene Classification, Paul Minogue

Dissertations

Basketball teams at all levels of the game invest a considerable amount of time and effort into collecting, segmenting, and analysing footage from their upcoming opponents previous games. This analysis helps teams identify and exploit the potential weaknesses of their opponents and is commonly cited as one of the key elements required to achieve success in the modern game. The growing importance of this type of analysis has prompted research into the application of computer vision and audio classification techniques to help teams classify scoring sequences and key events using game footage. However, this research tends to focus on classifying …

Distribution Level Building Load Prediction Using Deep Learning, Abdulaziz S. Almalaq

Electronic Theses and Dissertations

Load prediction in distribution grids is an important means to improve energy supply scheduling, reduce the production cost, and support emission reduction. Determining accurate load predictions has become more crucial than ever as electrical load patterns are becoming increasingly complicated due to the versatility of the load profiles, the heterogeneity of individual load consumptions, and the variability of consumer-owned energy resources. However, despite the increase of smart grids technologies and energy conservation research, many challenges remain for accurate load prediction using existing methods. This dissertation investigates how to improve the accuracy of load predictions at the distribution level using artificial …

Fisheyemultinet: Real-Time Multi-Task Learning Architecture For Surround-View Automated Parking System., Pullaro Maddu, Wayne Doherty, Ganesh Sistu, Isabelle Leang, Michal Uricar, Sumanth Chennupati, Hazem Rashed, Jonathan Horgan, Ciaran Hughes, Senthil Yogamani

Session 6: Applications, Architecture and Systems Integration

Automated Parking is a low speed manoeuvring scenario which is quite unstructured and complex, requiring full 360° near-field sensing around the vehicle. In this paper, we discuss the design and implementation of an automated parking system from the perspective of camera based deep learning algorithms. We provide a holistic overview of an industrial system covering the embedded system, use cases and the deep learning architecture. We demonstrate a real-time multi-task deep learning network called FisheyeMultiNet, which detects all the necessary objects for parking on a low-power embedded system. FisheyeMultiNet runs at 15 fps for 4 cameras and it has three …

Deep Cnn Frameworks For Comparison For Malaria Diagnosis, Priyadarshini Adyasha Pattanaik, Zelong Wang, Patrick Horain

Session 2: Deep Learning for Computer Vision

Abstract We compare Deep Convolutional Neural Networks (DCNN) frameworks, namely AlexNet and VGGNet, for the classification of healthy and malaria-infected cells in large, grayscale, low quality and low resolution microscopic images, in the case only a small training set is available. Experimental results deliver promising results on the path to quick, automatic and precise classification in unstrained images.

Content-Based Music Recommendation Using Deep Learning, Ryan Whitell

Regis University Student Publications (comprehensive collection)

Music streaming services use recommendation systems to improve the customer experience by generating favorable playlists and by fostering the discovery of new music. State of the art recommendation systems use both collaborative filtering and content-based recommendation methods. Collaborative filtering suffers from the cold start problem; it can only make recommendations for music for which it has enough user data, so content-based methods are preferred. Most current content-based recommendation systems use convolutional neural networks on the spectrograms of track audio. The architectures are commonly borrowed directly from the field of computer vision. It is shown in this study that musically-motivated convolutional …

Image-Based Roadway Assessment Using Convolutional Neural Networks, Weilian Song

Theses and Dissertations--Computer Science

Road crashes are one of the main causes of death in the United States. To reduce the number of accidents, roadway assessment programs take a proactive approach, collecting data and identifying high-risk roads before crashes occur. However, the cost of data acquisition and manual annotation has restricted the effect of these programs. In this thesis, we propose methods to automate the task of roadway safety assessment using deep learning. Specifically, we trained convolutional neural networks on publicly available roadway images to predict safety-related metrics: the star rating score and free-flow speed. Inference speeds for our methods are mere milliseconds, enabling …

Communications Using Deep Learning Techniques, Priti Gopal Pachpande

Legacy Theses & Dissertations (2009 - 2024)

Deep learning (DL) techniques have the potential of making communication systems

Elimination Of Useless Images From Raw Camera-Trap Data, Ulaş Tekeli̇, Yalin Baştanlar

Turkish Journal of Electrical Engineering and Computer Sciences

Camera-traps are motion triggered cameras that are used to observe animals in nature. The number of images collected from camera-traps has increased significantly with the widening use of camera-traps thanks to advances in digital technology. A great workload is required for wild-life researchers to group and label these images. We propose a system to decrease the amount of time spent by the researchers by eliminating useless images from raw camera-trap data. These images are too bright, too dark, blurred, or they contain no animals. To eliminate bright, dark, and blurred images we employ techniques based on image histograms and fast …

Lung Segmentation In Chest Radiographs Using Fully Convolutional Networks, Rahul Hooda, Ajay Mittal, Sanjeev Sofat

Turkish Journal of Electrical Engineering and Computer Sciences

Automated segmentation of medical images that aims at extracting anatomical boundaries is a fundamental step in any computer-aided diagnosis (CAD) system. Chest radiographic CAD systems, which are used to detect pulmonary diseases, first segment the lung field to precisely define the region-of-interest from which radiographic patterns are sought. In this paper, a deep learning-based method for segmenting lung fields from chest radiographs has been proposed. Several modifications in the fully convolutional network, which is used for segmenting natural images to date, have been attempted and evaluated to finally evolve a network fine-tuned for segmenting lung fields. The testing accuracy and …

Improving Word Embeddings Projection For Turkish Hypernym Extraction, Savaş Yildirim

Turkish Journal of Electrical Engineering and Computer Sciences

Corpus-driven approaches can automatically explore is-a relations between the word pairs from corpus. This problem is also called hypernym extraction. Formerly, lexico-syntactic patterns have been used to solve hypernym relations. The language-specific syntactic rules have been manually crafted to build the patterns. On the other hand, recent studies have applied distributional approaches to word semantics. They extracted the semantic relations relying on the idea that similar words share similar contexts. Former distributional approaches have applied one-hot bag-of-word (BOW) encoding. The dimensionality problem of BOW has been solved by various neural network approaches, which represent words in very short and dense …

Novel Applications Of Machine Learning In Bioinformatics, Yi Zhang

Theses and Dissertations--Computer Science

Technological advances in next-generation sequencing and biomedical imaging have led to a rapid increase in biomedical data dimension and acquisition rate, which is challenging the conventional data analysis strategies. Modern machine learning techniques promise to leverage large data sets for finding hidden patterns within them, and for making accurate predictions. This dissertation aims to design novel machine learning-based models to transform biomedical big data into valuable biological insights. The research presented in this dissertation focuses on three bioinformatics domains: splice junction classification, gene regulatory network reconstruction, and lesion detection in mammograms.

A critical step in defining gene structures and mRNA …

Multi-Column Neural Networks And Sparse Coding Novel Techniques In Machine Learning, Ammar O. Hoori

Theses and Dissertations

Accurate and fast machine learning (ML) algorithms are highly vital in artificial intelligence (AI) applications. In complex dataset problems, traditional ML methods such as radial basis function neural network (RBFN), sparse coding (SC) using dictionary learning, and particle swarm optimization (PSO) provide trivial results, large structure, slow training, and/or slow testing. This dissertation introduces four novel ML techniques: the multi-column RBFN network (MCRN), the projected dictionary learning algorithm (PDL) and the multi-column adaptive and non-adaptive particle swarm optimization techniques (MC-APSO and MC-PSO). These novel techniques provide efficient alternatives for traditional ML techniques. Compared to traditional ML techniques, the novel ML …

Enhancing Face Pose Normalization With Deep Learning, Anil Çeli̇k, Nafi̇z Arica

Turkish Journal of Electrical Engineering and Computer Sciences

In this study, we propose a hybrid method for face pose normalization, which combines the 3-D model-based method with stacked denoising autoencoder (SDAE) deep network. Instead of applying a mirroring operation for the invisible face parts of the posed image, SDAE learns how to fill in those regions by a large set of training samples. In the performance evaluation, we compare the proposed method to four different pose normalization methods and investigate their effects on facial emotion recognition and verification problems in addition to visual quality tests. Methods evaluated in the experiments include 2-D alignment, 3-D model-based method, pure SDAE-based …

The Efficacy Of Weakly Supervised Learning For Biomedical Imaging, Solomon Lee Hatcher

All ETDs from UAB

This paper aims to investigate the use of unsupervised saliency proposals in extracting suitable prior information from computed tomography scans of the head using image-level labels. The weak supervision learning method obtains useful information about an object’s location and fuses this result with an unsupervised saliency proposal to propagate labels to all related pixels. However, it is shown that unsupervised saliency guidance fails to supply the synthetic annotations with enough coherence to produce suitable segmentation.

Drive-By Bridge Monitoring And Damage Detection, Chengjun Tan

All ETDs from UAB

Bridges are key components of the transportation network, and their safety is essential to maintain effective and safe operation of the transportation facilities. To maintain the structural integrity of the bridges, it is essential to estimate the extent and location of the structural damage through periodic monitoring. Therefore, there is considerable interest in bridge damage detection and considerable progress has been made in recent years. The traditional bridge health monitoring requires many sensors installed on the bridge to collect vibration data for damage assessment, which is expensive, time-consuming, and even dangerous in-site. Compared with traditional ways, the concept of indirect …