Engineering Commons^™

An Analysis Of Precision: Occlusion And Perspective Geometry’S Role In 6d Pose Estimation, Jeffrey Choate, Derek Worth, Scott Nykl, Clark N. Taylor, Brett J. Borghetti, Christine M. Schubert Kabban

Faculty Publications

Achieving precise 6 degrees of freedom (6D) pose estimation of rigid objects from color images is a critical challenge with wide-ranging applications in robotics and close-contact aircraft operations. This study investigates key techniques in the application of YOLOv5 object detection convolutional neural network (CNN) for 6D pose localization of aircraft using only color imagery. Traditional object detection labeling methods suffer from inaccuracies due to perspective geometry and being limited to visible key points. This research demonstrates that with precise labeling, a CNN can predict object features with near-pixel accuracy, effectively learning the distinct appearance of the object due to perspective …

Prediction Of Drilling Fluid Lost-Circulation Zone Based On Deep Learning, Yili Kang, Chenglin Ma, Chengyuan Xu, Lijun You, Zhenjiang You

Research outputs 2022 to 2026

Lost circulation has become a crucial technical problem that restricts the quality and efficiency improvement of the drilling operation in deep oil and gas wells. The lost-circulation zone prediction has always been a hot and difficult research topic on the prevention and control of lost circulation. This study applied machine learning and statistical methods to deeply mine 105 groups and 29 features of loss data from typical loss block M. After removing 10 sets of noise data, the methods of mean removal, range scaling and normalization were used to pre-treat the 95 sets of the loss data. The multi-factor analysis …

Enhanced Two-Step Deep-Learning Approach For Electromagnetic-Inverse-Scattering Problems: Frequency Extrapolation And Scatterer Reconstruction, Huan Huan Zhang, He Ming Yao, Lijun Jiang, Michael Ng

Electrical and Computer Engineering Faculty Research & Creative Works

The electromagnetic-inverse-scattering (EMIS) problem is solved by a novel two-step deep-learning (DL) approach in this article. The newly proposed two-step DL approach not only predicts the multifrequency EM scattered field, but also overcomes the limitation of the conventional methods for solving EMIS problems, such as expensive computational cost, strong ill-conditions, and invalidity on high contrast. In the first step, the complex-valued deep residual convolutional neural network (DRCNN) is utilized to predict multifrequency EM scattered fields only using single-frequency EM scattered field information. Based on a new complex-valued deep convolutional encoder-decoder (DCED) structure, the second step utilizes the obtained multifrequency EM …

Implementing The Fast Full-Wave Electromagnetic Forward Solver Using The Deep Convolutional Encoder-Decoder Architecture, He Ming Yao, Lijun Jiang, Michael Ng

Electrical and Computer Engineering Faculty Research & Creative Works

In this communication, a novel deep learning (DL)-based solver is proposed for the electromagnetic forward (EMF) process. It is based on the complex-valued deep convolutional neural networks (DConvNets) comprising an encoder network and a corresponding decoder network with pixel-wise regression layer. The encoder network takes the incident EM wave and the contrast (permittivity) distribution of the object as the input. It channels the processed data into the corresponding decoder network to predict the total EM field due to the scatter of the input incident EM wave. The training of the proposed DConvNets is done using the simple synthetic dataset. Due …

Enhanced Supervised Descent Learning Technique For Electromagnetic Inverse Scattering Problems By The Deep Convolutional Neural Networks, He Ming Yao, Rui Guo, Maokun Li, Lijun Jiang, Michael Kwok Po Ng

Electrical and Computer Engineering Faculty Research & Creative Works

This work proposes a novel deep learning (DL) framework to solve the electromagnetic inverse scattering (EMIS) problems. The proposed framework integrates the complex-valued deep convolutional neural network (DConvNet) into the supervised descent method (SDM) to realize both off-line training and on-line 'imaging' prediction for EMIS. The offline training consists of two parts: 1) DConvNet training: the training dataset is created, and the proposed DConvNet is trained to realize the EM forward process and 2) SDM training: the trained DConvNet is integrated into the SDM framework, and the average descent directions between the initial prediction and the true label of SDM …

Classification Of Teleseismic Shear Wave Splitting Measurements: A Convolutional Neural Network Approach, Yanwei Zhang, Stephen S. Gao

Geosciences and Geological and Petroleum Engineering Faculty Research & Creative Works

Shear wave splitting (SWS) analysis is widely used to provide critical constraints on crustal and mantle structure and dynamic models. In order to obtain reliable splitting measurements, an essential step is to visually verify all the measurements to reject problematic measurements, a task that is increasingly time consuming due to the exponential increase in the amount of data. In this study, we utilized a convolutional neural network (CNN) based method to automatically select reliable SWS measurements. The CNN was trained by human-verified teleseismic SWS measurements and tested using synthetic SWS measurements. Application of the trained CNN to broadband seismic data …

Ad-Corre: Adaptive Correlation-Based Loss For Facial Expression Recognition In The Wild, Ali Pourramezan Fard, Mohammad H. Mahoor

Electrical and Computer Engineering: Faculty Scholarship

Automated Facial Expression Recognition (FER) in the wild using deep neural networks is still challenging due to intra-class variations and inter-class similarities in facial images. Deep Metric Learning (DML) is among the widely used methods to deal with these issues by improving the discriminative power of the learned embedded features. This paper proposes an Adaptive Correlation (Ad-Corre) Loss to guide the network towards generating embedded feature vectors with high correlation for within-class samples and less correlation for between-class samples. Ad-Corre consists of 3 components called Feature Discriminator, Mean Discriminator, and Embedding Discriminator. We design the Feature Discriminator component to guide …

Heuristic-Based Automatic Pruning Of Deep Neural Networks, Tejalal Choudhary, Vipul Mishra, Anurag Goswami, Jagannathan Sarangapani

Electrical and Computer Engineering Faculty Research & Creative Works

The performance of a deep neural network (deep NN) is dependent upon a significant number of weight parameters that need to be trained which is a computational bottleneck. The growing trend of deeper architectures poses a restriction on the training and inference scheme on resource-constrained devices. Pruning is an important method for removing the deep NN's unimportant parameters and making their deployment easier on resource-constrained devices for practical applications. In this paper, we proposed a heuristics-based novel filter pruning method to automatically identify and prune the unimportant filters and make the inference process faster on devices with limited resource availability. …

An Ensemble Approach For Patient Prognosis Of Head And Neck Tumor Using Multimodal Data, Numan Saeed, Roba Al Majzoub, Ikboljon Sobirov, Mohammad Yaqub

Computer Vision Faculty Publications

Accurate prognosis of a tumor can help doctors provide a proper course of treatment and, therefore, save the lives of many. Tradi-tional machine learning algorithms have been eminently useful in crafting prognostic models in the last few decades. Recently, deep learning algorithms have shown significant improvement when developing diag-nosis and prognosis solutions to different healthcare problems. However, most of these solutions rely solely on either imaging or clinical data. Utilizing patient tabular data such as demographics and patient med-ical history alongside imaging data in a multimodal approach to solve a prognosis task has started to gain more interest recently and …

Automatic Segmentation Of Head And Neck Tumor: How Powerful Transformers Are?, Ikboljon Sobirov, Otabek Nazarov, Hussain Alasmawi, Mohammad Yaqub

Computer Vision Faculty Publications

Cancer is one of the leading causes of death worldwide, and head and neck (H&N) cancer is amongst the most prevalent types. Positron emission tomography and computed tomography are used to detect and segment the tumor region. Clinically, tumor segmentation is extensively time-consuming and prone to error. Machine learning, and deep learning in particular, can assist to automate this process, yielding results as accurate as the results of a clinician. In this research study, we develop a vision transformers-based method to automatically delineate H&N tumor, and compare its results to leading convolutional neural network (CNN)-based models. We use multi-modal data …

Modeling Cognitive Load As A Self-Supervised Brain Rate With Electroencephalography And Deep Learning, Luca Longo

Articles

The principal reason for measuring mental workload is to quantify the cognitive cost of performing tasks to predict human performance. Unfortunately, a method for assessing mental workload that has general applicability does not exist yet. This is due to the abundance of intuitions and several operational definitions from various fields that disagree about the sources or workload, its attributes, the mechanisms to aggregate these into a general model and their impact on human performance. This research built upon these issues and presents a novel method for mental workload modelling from EEG data employing deep learning. This method is self-supervised, employing …

Resampling And Super-Resolution Of Hexagonally Sampled Images Using Deep Learning, Dylan Flaute, Russell C. Hardie, Hamed Elwarfalli

Electrical and Computer Engineering Faculty Publications

Super-resolution (SR) aims to increase the resolution of imagery. Applications include security, medical imaging, and object recognition. We propose a deep learning-based SR system that takes a hexagonally sampled low-resolution image as an input and generates a rectangularly sampled SR image as an output. For training and testing, we use a realistic observation model that includes optical degradation from diffraction and sensor degradation from detector integration. Our SR approach first uses non-uniform interpolation to partially upsample the observed hexagonal imagery and convert it to a rectangular grid. We then leverage a state-of-the-art convolutional neural network (CNN) architecture designed for SR …

Artificial Image Objects For Classification Of Breast Cancer Biomarkers With Transcriptome Sequencing Data And Convolutional Neural Network Algorithms, Xiangning Chen, Daniel G. Chen, Zhongming Zhao, Justin M. Balko, Jingchun Chen

School of Medicine Faculty Publications

Background: Transcriptome sequencing has been broadly available in clinical studies. However, it remains a challenge to utilize these data effectively for clinical applications due to the high dimension of the data and the highly correlated expression between individual genes. Methods: We proposed a method to transform RNA sequencing data into artificial image objects (AIOs) and applied convolutional neural network (CNN) algorithms to classify these AIOs. With the AIO technique, we considered each gene as a pixel in an image and its expression level as pixel intensity. Using the GSE96058 (n = 2976), GSE81538 (n = 405), and GSE163882 (n = …

Deep Learning For Anisoplanatic Optical Turbulence Mitigation In Long-Range Imaging, Matthew A. Hoffmire, Russell C. Hardie, Michael A. Rucci, Richard Van Hook, Barry K. Karch

Electrical and Computer Engineering Faculty Publications

We present a deep learning approach for restoring images degraded by atmospheric optical turbulence. We consider the case of terrestrial imaging over long ranges with a wide field-of-view. This produces an anisoplanatic imaging scenario where turbulence warping and blurring vary spatially across the image. The proposed turbulence mitigation (TM) method assumes that a sequence of short-exposure images is acquired. A block matching (BM) registration algorithm is applied to the observed frames for dewarping, and the resulting images are averaged. A convolutional neural network (CNN) is then employed to perform spatially adaptive restoration. We refer to the proposed TM algorithm as …

Stellar Classification Of Folded Spectra Using The Mk Classification Scheme And Convolutional Neural Networks, John Magee

Dissertations

The year 1943 saw the introduction of the Morgan-Keenan (MK) classification scheme and this replaced the existing Harvard Classification scheme. Both stellar classification scheme are fundamentally grounded in the field of spectroscopy. The Harvard Classification scheme classified stars based on stellar surface temperature. The MK Classification scheme introduced the concept of a luminosity class that is intrinsically linked to the surface gravity of a star. Temperature and luminosity class values are estimated directly from the stellar spectrum.

Machine learning is a well-established technique in astronomy. Traditionally, a spectrum is treated as a one-dimensional sequence of data. Techniques such as artificial …

Fifnet: A Convolutional Neural Network For Motion-Based Multiframe Super-Resolution Using Fusion Of Interpolated Frames, Hamed Elwarfalli, Russell C. Hardie

Electrical and Computer Engineering Faculty Publications

We present a novel motion-based multiframe image super-resolution (SR) algorithm using a convolutional neural network (CNN) that fuses multiple interpolated input frames to produce an SR output. We refer to the proposed CNN and associated preprocessing as the Fusion of Interpolated Frames Network (FIFNET). We believe this is the first such CNN approach in the literature to perform motion-based multiframe SR by fusing multiple input frames in a single network. We study the FIFNET using translational interframe motion with both fixed and random frame shifts. The input to the network is a sequence of interpolated and aligned frames. One key …

An Efficient Deep-Learning-Based Detection And Classification System For Cyber-Attacks In Iot Communication Networks, Qasem Abu Al-Haija, Saleh Zein-Sabatto

Electrical and Computer Engineering Faculty Research

With the rapid expansion of intelligent resource-constrained devices and high-speed communication technologies, the Internet of Things (IoT) has earned wide recognition as the primary standard for low-power lossy networks (LLNs). Nevertheless, IoT infrastructures are vulnerable to cyber-attacks due to the constraints in computation, storage, and communication capacity of the endpoint devices. From one side, the majority of newly developed cyber-attacks are formed by slightly mutating formerly established cyber-attacks to produce a new attack that tends to be treated as normal traffic through the IoT network. From the other side, the influence of coupling the deep learning techniques with the cybersecurity …

Predicting Residential Energy Consumption Using Wavelet Decomposition With Deep Neural Network, Dagimawi Eneyew, Miriam A M Capretz, Girma Bitsuamlak, London Hydro

Electrical and Computer Engineering Publications

Electricity consumption is accelerating due to economic and population growth. Hence, energy consumption prediction is becoming vital for overall consumption management and infrastructure planning. Recent advances in smart electric meter technology are making high-resolution energy consumption data available. However, many parameters influencing energy consumption are not typically monitored for residential buildings. Therefore, this study’s main objective is to develop a data-driven energy consumption forecasting model (next-hour consumption) for residential houses solely based on analyzing electricity consumption data. This research proposes a deep neural network architecture that combines stationary wavelet transform features and convolutional neural networks. The proposed approach utilizes automatically …

Enhanced Deep Learning Approach Based On The Deep Convolutional Encoder-Decoder Architecture For Electromagnetic Inverse Scattering Problems, He Ming Yao, Lijun Jiang, Wei E.I. Sha

Electrical and Computer Engineering Faculty Research & Creative Works

This letter proposes a novel deep learning (DL) approach to resolve the electromagnetic inverse scattering (EMIS) problems. The conventional approaches of resolving EMIS problems encounter assorted difficulties, such as high contrast, high computational cost, inevitable intrinsic nonlinearity, and strong ill-posedness. To surmount these difficulties, a novel DL approach is proposed based on a novel complex-valued deep fully convolutional neural network structure. The proposed complex-valued deep learning model for solving EMIS problems composes of an encoder network and its corresponding decoder network, followed by a final pixel-wise regression layer. The complex-valued encoder network extracts feature fragments from received scattered field data, …

Evaluation Of Bridge Decks With Overlays Using Impact Echo, A Deep Learning Approach, Sattar Dorafshan, Hoda Azari

Civil Engineering Faculty Publications

In this paper, the feasibility of using deep learning models (DLMs) for evaluation of bridges with overlay systems is investigated. Several laboratory-made concrete specimens with artificial subsurface defects and overlay systems (bonded and debonded) made of cement and asphalt overlay materials were tested using impact echo (IE). One-dimensional (1D) and two-dimensional (2D) convolutional neural networks (CNNs) were developed, trained, and tested on the IE data. The proposed 1D CNN was the most successful in detecting debonding and subsurface defects; it achieved an average accuracy of 0.68 on the cement overlay specimens and 0.58 for asphalt overlay specimens. Maps of the …

Optimization Study Of An Image Classification Deep Neural Network, Rose Ault

Honors Projects

Machine Learning is an important and growing field within Artificial Intelligence. It is particularly useful in situations where developing an algorithm to perform the task in a conventional way would be extremely difficult. Instead of being programmed specifically to complete a task, a program embodies a trained model that can recognize patterns present in given example data, and is able use that model to make predictions on future data. Neural networks are a prominent example of machine learning models used for this purpose. Neural networks are models that are based on how brains work, with massive numbers of connected processing …

Automated Assessment Of Cardiothoracic Ratios On Chest Radiographs Using Deep Learning, Varun Danda, Paras Lakhani, Md

Phase 1

Introduction: The cardiothoracic ratio (CTR) is a quantitative measure of cardiac size that can measured from chest radiography (CXR). Although radiologists using digital workstations possess the ability to calculate CTR, clinical demands prevent calculation for every case. In this study, the efficacy of a deep convolutional neural network (dCNN) to assess CTR was evaluated.

Methods: 611 HIPAA-compliant de-identified CXRs were obtained from [institution blinded] and public databases. Using ImageJ, a board-certified radiologist (reader #1) and a medical student (reader #2), measured the CTR by marking four pixels on all CXRs: the right- and left-most chest wall, the right- and left-most …

Deep Learning With Context Encoding For Semantic Brain Tumor Segmentation And Patient Survival Prediction, Linmin Pei, Lasitha Vidyaratne, Md Monibor Rahman, Khan M. Iftekharuddin

Electrical & Computer Engineering Faculty Publications

One of the most challenging problems encountered in deep learning-based brain tumor segmentation models is the misclassification of tumor tissue classes due to the inherent imbalance in the class representation. Consequently, strong regularization methods are typically considered when training large-scale deep learning models for brain tumor segmentation to overcome undue bias towards representative tissue types. However, these regularization methods tend to be computationally exhaustive, and may not guarantee the learning of features representing all tumor tissue types that exist in the input MRI examples. Recent work in context encoding with deep CNN models have shown promise for semantic segmentation of …

Rapeseed Stand Count Estimation At Leaf Development Stages With Uav Imagery And Convolutional Neural Networks, Biquan Zhao, Chenghai Yang, Yeyin Shi, Qingxi Liao, Guangsheng Zhou, Chufeng Wang, Tianjin Xie, Zhao Jiang, Dongyan Zhang, Wanneng Yang, Chenglong Huang, Jing Xie, Jian Zhang

Biological Systems Engineering: Papers and Publications

Rapeseed is an important oil crop in China. Timely estimation of rapeseed stand count at early growth stages provides useful information for precision fertilization, irrigation, and yield prediction. Based on the nature of rapeseed, the number of tillering leaves is strongly related to its growth stages. However, no field study has been reported on estimating rapeseed stand count by the number of leaves recognized with convolutional neural networks (CNNs) in unmanned aerial vehicle (UAV) imagery. The objectives of this study were to provide a case for rapeseed stand counting with reference to the existing knowledge of the number of leaves …

Two-Step Enhanced Deep Learning Approach For Electromagnetic Inverse Scattering Problems, He Ming Yao, Wei E.I. Sha, Lijun Jiang

Electrical and Computer Engineering Faculty Research & Creative Works

In this letter, a new deep learning (DL) approach is proposed to solve the electromagnetic inverse scattering (EMIS) problems. The conventional methods for solving inverse problems face various challenges including strong ill-conditions, high contrast, expensive computation cost, and unavoidable intrinsic nonlinearity. To overcome these issues, we propose a new two-step machine learning based approach. In the first step, a complex-valued deep convolutional neural network is employed to retrieve initial contrasts (permittivity's) of dielectric scatterers from measured scattering data. In the second step, the previously obtained contrasts are input into a complex-valued deep residual convolutional neural network to refine the reconstruction …

Source Reconstruction Method Based On Machine Learning Algorithms, He Ming Yao, Lijun Jiang, Wei E.I. Sha

Electrical and Computer Engineering Faculty Research & Creative Works

This paper proposes a new source reconstruction method (SRM) based on deep learning. The conventional SRM usually requires oversampled measurements data to ensure higher accuracy. Thus, conventional SRM numerical system is usually highly singular. A deep convolutional neural network (ConvNet) is proposed to reconstruct the equivalent sources of the target to overcome difficulty. The deep ConvNet allows us to employ less data samples. Besides, the ill-conditioned numerical system can be effectively avoided. Numerical examples are presented to demonstrate the feasibility and accuracy of the proposed method. Its performance is also compared with the traditional neural network and interpolation method. Moreover, …

Deep Autoencoder Neural Networks For Short-Term Traffic Congestion Prediction Of Transportation Networks, Sen Zhang, Yong Yao, Jie Hu, Yong Zhao, Shaobo Li, Jianjun Hu

Faculty Publications

Traffic congestion prediction is critical for implementing intelligent transportation systems for improving the efficiency and capacity of transportation networks. However, despite its importance, traffic congestion prediction is severely less investigated compared to traffic flow prediction, which is partially due to the severe lack of large-scale high-quality traffic congestion data and advanced algorithms. This paper proposes an accessible and general workflow to acquire large-scale traffic congestion data and to create traffic congestion datasets based on image analysis. With this workflow we create a dataset named Seattle Area Traffic Congestion Status (SATCS) based on traffic congestion map snapshots from a publicly available …

Deep Autoencoder Neural Networks For Short-Term Traffic Congestion Prediction Of Transportation Networks, Sen Zhang, Yong Yao, Jie Hu, Yong Zhao, Shaobo Li, Jianjun Hu

Faculty Publications

Traffic congestion prediction is critical for implementing intelligent transportation systems for improving the efficiency and capacity of transportation networks. However, despite its importance, traffic congestion prediction is severely less investigated compared to traffic flow prediction, which is partially due to the severe lack of large-scale high-quality traffic congestion data and advanced algorithms. This paper proposes an accessible and general workflow to acquire large-scale traffic congestion data and to create traffic congestion datasets based on image analysis. With this workflow we create a dataset named Seattle Area Traffic Congestion Status (SATCS) based on traffic congestion map snapshots from a publicly available …

Deep Autoencoder Neural Networks For Short-Term Traffic Congestion Prediction Of Transportation Networks, Sen Zhang, Yong Yao, Jie Hu, Yong Zhao, Shaobo Li, Jianjun Hu

Faculty Publications

Traffic congestion prediction is critical for implementing intelligent transportation systems for improving the efficiency and capacity of transportation networks. However, despite its importance, traffic congestion prediction is severely less investigated compared to traffic flow prediction, which is partially due to the severe lack of large-scale high-quality traffic congestion data and advanced algorithms. This paper proposes an accessible and general workflow to acquire large-scale traffic congestion data and to create traffic congestion datasets based on image analysis. With this workflow we create a dataset named Seattle Area Traffic Congestion Status (SATCS) based on traffic congestion map snapshots from a publicly available …

Vision Sensor Based Action Recognition For Improving Efficiency And Quality Under The Environment Of Industry 4.0, Zipeng Wang, Ruwen Qin, Jihong Yan, Chaozhong Guo

Engineering Management and Systems Engineering Faculty Research & Creative Works

In the environment of industry 4.0, human beings are still an important influencing factor of efficiency and quality which are the core of product life cycle management. Hence, monitoring and analyzing humans' actions are essential. This paper proposes a vision sensor based method to evaluate the accuracy of operators' actions. Each action of operators is recognized in real time by a Convolutional Neural Network (CNN) based classification model in which hierarchical clustering is introduced to minimize the effects of action uncertainty. Warnings are triggered when incorrect actions occur in real time and applications of action analysis of workers on a …