Engineering Commons^™

Urban Flood Extent Segmentation And Evaluation From Real-World Surveillance Camera Images Using Deep Convolutional Neural Network, Yidi Wang, Yawen Shen, Behrouz Salahshour, Mecit Cetin, Khan Iftekharuddin, Navid Tahvildari, Guoping Huang, Devin K. Harris, Kwame Ampofo, Jonathan L. Goodall

Civil & Environmental Engineering Faculty Publications

This study explores the use of Deep Convolutional Neural Network (DCNN) for semantic segmentation of flood images. Imagery datasets of urban flooding were used to train two DCNN-based models, and camera images were used to test the application of the models with real-world data. Validation results show that both models extracted flood extent with a mean F1-score over 0.9. The factors that affected the performance included still water surface with specular reflection, wet road surface, and low illumination. In testing, reduced visibility during a storm and raindrops on surveillance cameras were major problems that affected the segmentation of flood extent. …

Inverse Engineering Of Absorption And Scattering In Nanoparticles: A Machine Learning Approach, Alex Vallone, Nooshin M. Estakhri, Nasim Mohammadi Estrakhri

Engineering Faculty Articles and Research

We use a region-specified machine learning approach to inverse design highly absorptive multilayer plasmonic nanoparticles. We demonstrate the design of particles with a wide range of absorption to scattering ratios (i.e., cloaked absorbers and bright absorbers) and for different visible wavelengths.

Infrared Imaging Segmentation Employing An Explainable Deep Neural Network, Xinfei Liao, Dan Wang, Zairan Li, Nilanjan Dey, Rs Simon, Fuqian Shi

Turkish Journal of Electrical Engineering and Computer Sciences

Explainable AI (XAI) improved by a deep neural network (DNN) of a residual neural network (ResNet) and long short-term memory networks (LSTMs), termed XAIRL, is proposed for segmenting foot infrared imaging datasets. First, an infrared sensor imaging dataset is acquired by a foot infrared sensor imaging device and preprocessed. The infrared sensor image features are then defined and extracted with XAIRL being applied to segment the dataset. This paper compares and discusses our results with XAIRL. Evaluation indices are applied to perform various measurements for foot infrared image segmentation including accuracy, precision, recall, F1 score, intersection over union (IoU), Dice …

Precision Spraying Using Variable Time Delays And Vision-Based Velocity Estimation, Paolo Rommel Sanchez, Hong Zhang

Henry M. Rowan College of Engineering Faculty Scholarship

Traditionally, precision farm equipment often relies on real-time kinematics and global positioning systems (RTK-GPS) for accurate position and velocity estimates. This approach proved effective and widely adopted in developed regions where RTK-GPS satellite and base station availability and visibility are not limited. However, RTK-GPS signal can be limited in farm areas due to topographic and economic constraints. Thus, this study developed a precision sprayer that estimated the travel velocity locally by tracking the relative motion of plants using a deep-learning-based machine vision system. Sprayer valves were then controlled by variable time delay (VTD) queuing and dynamic filtering. The proposed velocity …

Detecting Alzheimer's Disease Using Artificial Neural Networks, Sally Lee, Mia Keegan

Electrical Engineering

This project aims to use artificial neural networks (ANN) in order to detect Alzheimer’s disease. More specifically, convolutional neural networks (CNN) will be utilized as this is the most common ANN and has been used in many different image processing applications. The purpose of using artificial neural networks as a detect method is so that an intelligent way for image and signal analysis can be used. A software that implements CNN will be developed so that users in medical settings can utilize this software to detect Alzheimer’s in patients. The input for this software will be the patient’s MRI scans. …

An Efficient Deep Learning Architecture For Turkish Lira Recognition And Counterfeit Detection, Burak İyi̇kesi̇ci̇, Ergun Erçelebi̇

Turkish Journal of Electrical Engineering and Computer Sciences

Banknote counterfeiting is a common practice worldwide. Due to the recent developments in technology, banknote imitation has become easier than before. There are different kinds of algorithms developed for the detection of counterfeit banknotes for different countries in the literature. The earlier algorithms utilized classical image processing techniques where the implementations of machine learning and deep learning algorithms appeared with the developments in the artificial intelligence field as well as the computer hardware. In this study, a novel convolutional neural networks-based deep learning algorithm has been developed that detects counterfeit Turkish Lira banknotes and their denominations using the banknote images …

Nipuna: A Novel Optimizer Activation Function For Deep Neural Networks, Golla Madhu, Sandeep Kautish, Khalid Abdulaziz Alnowibet, Hossam Zawbaa, Ali Wagdy Mohamed

Articles

In recent years, various deep neural networks with different learning paradigms have been widely employed in various applications, including medical diagnosis, image analysis, self-driving vehicles and others. The activation functions employed in deep neural networks have a huge impact on the training model and the reliability of the model. The Rectified Linear Unit (ReLU) has recently emerged as the most popular and extensively utilized activation function. ReLU has some flaws, such as the fact that it is only active when the units are positive during back-propagation and zero otherwise. This causes neurons to die (dying ReLU) and a shift in …

Setransformer: A Transformer-Based Code Semantic Parser For Code Comment Generation, Zheng Li, Yonghao Wu, Bin Peng, Xiang Chen, Zeyu Sun, Yong Liu, Paul Doyle

Conference Papers

Automated code comment generation technologies can help developers understand code intent, which can significantly reduce the cost of software maintenance and revision. The latest studies in this field mainly depend on deep neural networks, such as convolutional neural networks and recurrent neural network. However, these methods may not generate high-quality and readable code comments due to the long-term dependence problem, which means that the code blocks used to summarize information are far from each other. Owing to the long-term dependence problem, these methods forget the previous input data’s feature information during the training process. In this article, to solve the …

Light Auditor: Power Measurement Can Tell Private Data Leakage Through Iot Covert Channels, Woosub Jung, Kailai Cui, Kenneth Koltermann, Junjie Wang, Chunsheng Xin, Gang Zhou

Electrical & Computer Engineering Faculty Publications

Despite many conveniences of using IoT devices, they have suffered from various attacks due to their weak security. Besides well-known botnet attacks, IoT devices are vulnerable to recent covert-channel attacks. However, no study to date has considered these IoT covert-channel attacks. Among these attacks, researchers have demonstrated exfiltrating users' private data by exploiting the smart bulb's capability of infrared emission.

In this paper, we propose a power-auditing-based system that defends the data exfiltration attack on the smart bulb as a case study. We first implement this infrared-based attack in a lab environment. With a newly-collected power consumption dataset, we pre-process …

Gated Deep Reinforcement Learning With Red Deer Optimization For Medical Image Classification, Narayanan Ganesh, Sambandan Jayalakshmi, Rama Chandran Narayanan, Miroslav Mahdal, Hossam Zawbaa, Ali Wagdy Mohamed

Articles

The brain is one of the most important and complex organs in the body, consisting of billions of individual cells. Uncontrolled growth and expansion of aberrant cell populations within or around the brain are the main causes of brain tumors. These cells have the potential to harm healthy cells and impair brain function [1]. Tumors can be detected using medical imaging techniques, which are considered the most popular and accurate way to classify different types of cancer, and this procedure is even more crucial as it is noninvasive [2]. Magnetic resonance imaging (MRI) is one such medical imaging technique that …

Natural Language Processing For Novel Writing, Leqing Qu, Okan Ersoy

Department of Electrical and Computer Engineering Technical Reports

No abstract provided.

Digital Image Forensics Via Meta-Learning And Few-Shot Learning, Yuxi Shi

Dissertations

Digital images are a substantial portion of the information conveyed by social media, the Internet, and television in our daily life. In recent years, digital images have become not only one of the public information carriers, but also a crucial piece of evidence. The widespread availability of low-cost, user-friendly, and potent image editing software and mobile phone applications facilitates altering images without professional expertise. Consequently, safeguarding the originality and integrity of digital images has become a difficulty. Forgers commonly use digital image manipulation to transmit misleading information. Digital image forensics investigates the irregular patterns that might result from image alteration. …

A New Automatic Bearing Fault Size Diagnosis Using Time-Frequency Images Of Cwt And Deep Transfer Learning Methods, Yilmaz Kaya, Fatma Kuncan, Hüseyi̇n Meti̇n Ertunç

Turkish Journal of Electrical Engineering and Computer Sciences

Bearings are generally used as bearings or turning elements. Bearings are subjected to high loads and rapid speeds. Furthermore, metal-to-metal contact within the bearing makes it sensitive. In today?s machines, bearing failures disrupt the operation of the system or completely stop the system. Bearing failures that can occur can cause enormous damage to the entire system. Therefore, it is necessary to anticipate bearing failures and to carry out a regular diagnostic examination. Various systems have been developed for fault diagnosis. In recent years, deep transfer learning (DTL) methods are often preferred in current bearing diagnosis models, as they provide time …

Plant Identification In A Combined-Imbalanced Leaf Dataset, Viraj K. Gajjar, Anand K. Nambisan, Kurt Louis Kosbar

Electrical and Computer Engineering Faculty Research & Creative Works

Plant identification has applications in ethnopharmacology and agriculture. Since leaves are one of a distinguishable feature of a plant, they are routinely used for identification. Recent developments in deep learning have made it possible to accurately identify the majority of samples in five publicly available leaf datasets. However, each dataset captures the images in a highly controlled environment. This paper evaluates the performance of EfficientNet and several other convolutional neural network (CNN) architectures when applied to a combination of the LeafSnap, Middle European Woody Plants 2014, Flavia, Swedish, and Folio datasets. To normalize the impact of imbalance resulting from combining …

Malware Binary Image Classification Using Convolutional Neural Networks, John Kiger, Shen-Shyang Ho, Vahid Heydari

Faculty Scholarship for the College of Science & Mathematics

The persistent shortage of cybersecurity professionals combined with enterprise networks tasked with processing more data than ever before has led many cybersecurity experts to consider automating some of the most common and time-consuming security tasks using machine learning. One of these cybersecurity tasks where machine learning may prove advantageous is malware analysis and classification. To evade traditional detection techniques, malware developers are creating more complex malware. This is achieved through more advanced methods of code obfuscation and conducting more sophisticated attacks. This can make the manual process of analyzing malware an infinitely more complex task. Furthermore, the proliferation of malicious …

Performance Prediction Of Underwater Acoustic Communications Based On Channel Impulse Responses, Evan Lucas, Zhaohui Wang

Michigan Tech Publications

Featured Application: Convolutional neural networks are used on the channel impulse response data to predict the performance of underwater acoustic communications. Abstract: Predicting the channel quality for an underwater acoustic communication link is not a straightforward task. Previous approaches have focused on either physical observations of weather or engineered signal features, some of which require substantial processing to obtain. This work applies a convolutional neural network to the channel impulse responses, allowing the network to learn the features that are useful in predicting the channel quality. Results obtained are comparable or better than conventional supervised learning models, depending on the …

Application Of Deep Neural Networks To Distribution System State Estimation And Forecasting, James P. Carmichael, Yuan Liao

Electrical and Computer Engineering Faculty Publications

Classical neural networks such as feedforward multi-layer perceptron models (MLPs) are well established as universal approximators and as such, show promise in applications such as static state estimation in power transmission systems. The dynamic nature of distributed generation (i.e. solar and wind), vehicle to grid technology (V2G) and false data injection attacks (FDIAs), may pose significant challenges to the application of classical MLPs to state estimation (SE) and state forecasting (SF) in power distribution systems. This paper investigates the application of conventional neural networks (MLPs) and deep learning based models such as convolutional neural networks (CNNs) and long-short term networks …

A Moment In The Sun: Solar Nowcasting From Multispectral Satellite Data Using Self-Supervised Learning, Akansha Singh Bansal, Trapit Bansal, David Irwin

Publications

ABSTRACT

Solar energy is now the cheapest form of electricity in history. Unfortunately,

signi.cantly increasing the electric grid’s fraction of

solar energy remains challenging due to its variability, which makes

balancing electricity’s supply and demand more di.cult. While

thermal generators’ ramp rate—the maximum rate at which they

can change their energy generation—is .nite, solar energy’s ramp

rate is essentially in.nite. Thus, accurate near-term solar forecasting,

or nowcasting, is important to provide advance warnings to

adjust thermal generator output in response to variations in solar

generation to ensure a balanced supply and demand. To address the

problem, this paper develops a …

Cnn Based Sensor Fusion Method For Real-Time Autonomous Robotics Systems, Berat Yildiz, Aki̇f Durdu, Ahmet Kayabaşi, Mehmet Duramaz

Turkish Journal of Electrical Engineering and Computer Sciences

Autonomous robotic systems (ARS) serve in many areas of daily life. The sensors have critical importance for these systems. The sensor data obtained from the environment should be as accurate and reliable as possible and correctly interpreted by the autonomous robot. Since sensors have advantages and disadvantages over each other they should be used together to reduce errors. In this study, Convolutional Neural Network (CNN) based sensor fusion was applied to ARS to contribute the autonomous driving. In a real-time application, a camera and LIDAR sensor were tested with these networks. The novelty of this work is that the uniquely …

Deep Learning Based Superconducting Radio-Frequency Cavity Fault Classification At Jefferson Laboratory, Lasitha Vidyaratne, Adam Carpenter, Tom Powers, Chris Tennant, Khan M. Iftekharuddin, Md. Monibor Rahman, Anna S. Shabalina

Electrical & Computer Engineering Faculty Publications

This work investigates the efficacy of deep learning (DL) for classifying C100 superconducting radio-frequency (SRF) cavity faults in the Continuous Electron Beam Accelerator Facility (CEBAF) at Jefferson Lab. CEBAF is a large, high-power continuous wave recirculating linac that utilizes 418 SRF cavities to accelerate electrons up to 12 GeV. Recent upgrades to CEBAF include installation of 11 new cryomodules (88 cavities) equipped with a low-level RF system that records RF time-series data from each cavity at the onset of an RF failure. Typically, subject matter experts (SME) analyze this data to determine the fault type and identify the cavity of …

Facial Landmark Feature Fusion In Transfer Learning Of Child Facial Expressions, Megan A. Witherow, Manar D. Samad, Norou Diawara, Khan M. Iftekharuddin

Electrical & Computer Engineering Faculty Publications

Automatic classification of child facial expressions is challenging due to the scarcity of image samples with annotations. Transfer learning of deep convolutional neural networks (CNNs), pretrained on adult facial expressions, can be effectively finetuned for child facial expression classification using limited facial images of children. Recent work inspired by facial age estimation and age-invariant face recognition proposes a fusion of facial landmark features with deep representation learning to augment facial expression classification performance. We hypothesize that deep transfer learning of child facial expressions may also benefit from fusing facial landmark features. Our proposed model architecture integrates two input branches: a …

Computer-Aided Diagnosis Of Low Grade Endometrial Stromal Sarcoma (Lgess), Xinxin Yang, Mark Stamp

Faculty Research, Scholarly, and Creative Activity

Low grade endometrial stromal sarcoma (LGESS) accounts for about 0.2% of all uterine cancer cases. Approximately 75% of LGESS patients are initially misdiagnosed with leiomyoma, which is a type of benign tumor, also known as fibroids. In this research, uterine tissue biopsy images of potential LGESS patients are preprocessed using segmentation and stain normalization algorithms. We then apply a variety of classic machine learning and advanced deep learning models to classify tissue images as either benign or cancerous. For the classic techniques considered, the highest classification accuracy we attain is about 0.85, while our best deep learning model achieves an …

Application Of Artificial Neural Networks To Power System State Estimation, James P. Carmichael, Yuan Liao

Electrical and Computer Engineering Presentations

State estimation function is essential for effective and timely execution of power system automation and control systems, especially in modern active distribution systems where more intermittent renewable energy systems are integrated into the grid. Distribution system state estimation faces a lot of challenges including lack of monitoring devices and possible incorrect topology information. Developing efficient state estimation for distribution systems is thus of great interest. This paper presents results on utilizing artificial neural networks for this purpose.

Artificial neural networks have been used in power distribution system state estimation. However, there is a lack of systematic analysis and study of …

Model-Based And Model-Free Approaches For Power System Security Assessment, Mariana Magdy Mounir Kamel

Doctoral Dissertations

Continuous security assessment of a power system is necessary to insure a reliable, stable, and continuous supply of electrical power to customers. To this end, this dissertation identifies and explores some of the various challenges encountered in the field of power system security assessment. Accordingly, several model-based and/or model-free approaches were developed to overcome these challenges.

First, a voltage stability index, named TAVSI, is proposed. This index has three important features: TAVSI applies to general load models including ZIP, exponential, and induction motor loads; TAVSI can be used for both measurement-based and model-based voltage stability assessment; and finally, TAVSI is …

Learning Discriminative And Efficient Attention For Person Re-Identification Using Agglomerative Clustering Frameworks, Kshitij Nikhal

Department of Electrical and Computer Engineering: Dissertations, Theses, and Student Research

Recent advancements like multiple contextual analysis, attention mechanisms, distance-aware optimization, and multi-task guidance have been widely used for supervised person re-identification (ReID), but the implementation and effects of such methods in unsupervised person ReID frameworks are non-trivial and unclear, respectively. Moreover, with increasing size and complexity of image- and video-based ReID datasets, manual or semi-automated annotation procedures for supervised ReID are becoming labor intensive and cost prohibitive, which is undesirable especially considering the likelihood of annotation errors increase with scale/complexity of data collections. Therefore, this thesis proposes a new iterative clustering framework that incorporates (a) two attention architectures that learn …

Indoor Navigation Using Convolutional Neural Networks And Floor Plans, Ricky D. Anderson

Theses and Dissertations

The goal of this thesis is to evaluate a new indoor navigation technique by incorporating floor plans along with monocular camera images into a CNN as a potential means for identifying camera position. Building floor plans are widely available and provide potential information for localizing within the building. This work sets out to determine if a CNN can learn the architectural features of a floor plan and use that information to determine a location. In this work, a simulated indoor data set is created and used to train two CNNs. A classification CNN, which breaks up the floor plan into …

Ensemble Learning Of Multiview Cnn Models For Survival Time Prediction Of Braintumor Patients Using Multimodal Mri Scans, Abdela Ahmed Mossa, Ulus Çevi̇k

Turkish Journal of Electrical Engineering and Computer Sciences

Brain tumors have been one of the most common life-threatening diseases for all mankind. There have beenhuge efforts dedicated to the development of medical imaging techniques and radiomics to diagnose tumor patients quicklyand e?iciently. One of the main aims is to ensure that preoperative overall survival time (OS) prediction is accurate.Recently, deep learning (DL) algorithms, and particularly convolutional neural networks (CNNs) achieved promisingperformances in almost all computer vision fields. CNNs demand large training datasets and high computational costs.However, curating large annotated medical datasets are difficult and resource-intensive. The performances of singlelearners are also unsatisfactory for small datasets. Thus, this study …

Medical Image Fusion With Convolutional Neural Network In Multiscaletransform Domain, Asan Abas, Hasan Erdi̇nç Koçer, Nurdan Baykan

Turkish Journal of Electrical Engineering and Computer Sciences

Multimodal medical image fusion approaches have been commonly used to diagnose diseases and involve merging multiple images of different modes to achieve superior image quality and to reduce uncertainty and redundancy in order to increase the clinical applicability. In this paper, we proposed a new medical image fusion algorithm based on a convolutional neural network (CNN) to obtain a weight map for multiscale transform (curvelet/ non-subsampled shearlet transform) domains that enhance the textual and edge property. The aim of the method is achieving the best visualization and highest details in a single fused image without losing spectral and anatomical details. …

Improved Cell Segmentation Using Deep Learning In Label-Free Optical Microscopyimages, Aydin Ayanzadeh, Özden Yalçin Özuysal, Devri̇m Pesen Okvur, Sevgi̇ Önal, Behçet Uğur Töreyi̇n, Devri̇m Ünay

Turkish Journal of Electrical Engineering and Computer Sciences

The recently popular deep neural networks (DNNs) have a significant effect on the improvement of segmentation accuracy from various perspectives, including robustness and completeness in comparison to conventional methods. We determined that the naive U-Net has some lacks in specific perspectives and there is high potential for further enhancements on the model. Therefore, we employed some modifications in different folds of the U-Net to overcome this problem. Based on the probable opportunity for improvement, we develop a novel architecture by using an alternative feature extractor in the encoder of U-Net and replacing the plain blocks with residual blocks in the …

Diagnosis Of Paroxysmal Atrial Fibrillation From Thirty-Minute Heart Ratevariability Data Using Convolutional Neural Networks, Murat Sürücü, Yalçin İşler, Resul Kara

Turkish Journal of Electrical Engineering and Computer Sciences

Paroxysmal atrial fibrillation (PAF) is the initial stage of atrial fibrillation, one of the most common arrhythmia types. PAF worsens with time and affects the patient?s life quality negatively. In this study, we aimed to diagnose PAF early, so patients can start taking precautions before this disease gets worse. We used the atrial fibrillation prediction database, an open data from Physionet and constructed our approach using convolutional neural networks. Heart rate variability (HRV) features are calculated from time-domain measures, frequency-domain measures using power spectral density estimations (fast Fourier transform, Lomb-Scargle, and Welch periodogram), time-frequencydomain measures using wavelet transform, and nonlinear …