Engineering Commons^™

Deep Learning Model For Integrated Estimation Of Wheelchair And Human Poses Using Camera Images, Shimpei Aihara, Takara Sakai, Ryusei Shibata, Toshiaki Matsubara, Ryosuke Mizukami, Yudai Yoshida, Akira Shionoya

International Sports Engineering Association – Engineering of Sport

No abstract provided.

Coevolution Of Machine Learning And Process-Based Modelling To Revolutionize Earth And Environmental Sciences: A Perspective, Mojtaba Sadegh

Civil Engineering Faculty Publications and Presentations

Machine learning (ML) applications in Earth and environmental sciences (EES) have gained incredible momentum in recent years. However, these ML applications have largely evolved in ‘isolation’ from the mechanistic, process-based modelling (PBM) paradigms, which have historically been the cornerstone of scientific discovery and policy support. In this perspective, we assert that the cultural barriers between the ML and PBM communities limit the potential of ML, and even its ‘hybridization’ with PBM, for EES applications. Fundamental, but often ignored, differences between ML and PBM are discussed as well as their strengths and weaknesses in light of three overarching modelling objectives in …

Integrating Deep Learning And Hydrodynamic Modeling To Improve The Great Lakes Forecast, Pengfei Xue, Aditya Wagh, Gangfeng Ma, Yilin Wang, Yongchao Yang, Tao Liu, Chenfu Huang

Michigan Tech Publications, Part 1

The Laurentian Great Lakes, one of the world’s largest surface freshwater systems, pose a modeling challenge in seasonal forecast and climate projection. While physics-based hydrodynamic modeling is a fundamental approach, improving the forecast accuracy remains critical. In recent years, machine learning (ML) has quickly emerged in geoscience applications, but its application to the Great Lakes hydrodynamic prediction is still in its early stages. This work is the first one to explore a deep learning approach to predicting spatiotemporal distributions of the lake surface temperature (LST) in the Great Lakes. Our study shows that the Long Short-Term Memory (LSTM) neural network, …

Meta-Algorithms In Machine Learning, Vishnu Pendyala

Open Educational Resources

This presentation explores how to make the best of models impacted by bias and variance. Meta-learning minimizes loss. Ensemble methods, including Bagging, Adaboost, Random Forest, Gradient Boosting, and Stacking, are discussed. These methods perturb data (X or Y) using techniques like bootstrap sampling, k-fold sampling, weighted sampling, and random subspaces. Models are generated in parallel or sequentially, with aggregation strategies such as mean, mode, weighted response, and metamodel. The presentation also touches upon deep learning and one-shot learning, and explains how distances become less meaningful in high dimensions.

More details: https://events.vtools.ieee.org/m/315184

Video Recording: https://ieeetv.ieee.org/video/meta-algorithms-in-machine-learning

Exploring Deep Learning In Finance, Abhijit Anand Anand Deshpande

Industrial, Manufacturing, and Systems Theses - Archive

Financial market analysis is process of analyzing market closely and predict the next move of market whether it will go up or down using historical data. Financial market is stochastic and has rapid changes over time, therefore it is very difficult to predict. The main goal of this work is to understand novel approaches of machine learning in finance, data parsing techniques, labelling the financial data. Furthermore, understand state of art Transformer model and implement and compare results with other traditional machine learning algorithms. Experiment carried out in python along with pytorch.

Deep Learning Object-Based Detection Of Manufacturing Defects In X-Ray Inspection Imaging, Juan C. Parducci

Mechanical & Aerospace Engineering Theses & Dissertations

Current analysis of manufacturing defects in the production of rims and tires via x-ray inspection at an industry partner’s manufacturing plant requires that a quality control specialist visually inspect radiographic images for defects of varying sizes. For each sample, twelve radiographs are taken within 35 seconds. Some defects are very small in size and difficult to see (e.g., pinholes) whereas others are large and easily identifiable. Implementing this quality control practice across all products in its human-effort driven state is not feasible given the time constraint present for analysis.

This study aims to identify and develop an object detector capable …

Anomaly Detection In Rotating Machinery Using Autoencoders Based On Bidirectional Lstm And Gru Neural Networks, Krishna Patra, Rabi Narayan Sethi, Dhiren Kkumar Behera

Turkish Journal of Electrical Engineering and Computer Sciences

A time series anomaly is a form of anomalous subsequence that indicates future faults will occur. The development of novel techniques for detecting this type of anomaly is significant for real-time system monitoring. Several algorithms have been used to classify anomalies successfully. However, the time series anomaly detection algorithm was not studied well. We use a new bidirectional LSTM and GRU neural networks-based hybrid autoencoder to detect if a machine is operating normally in this research. An autoencoder is trained on a set of 12 features taken from healthy operating data gathered promptly after a planned maintenance period using vibration …

Utilizing Shockwave Theory And Deep Learning To Estimate Intersection Traffic Flow And Queue Length Based On Connected Vehicle Data., Abdulmaged Algomaiah

Electronic Theses and Dissertations

The development of Connected Vehicles (CV) facilitates the use of trajectory data to estimate queue length and traffic volume at signalized intersections. The previously proposed models involved additional information that may require conducting different types of data collection. Also, most models need higher market penetration rate or more than a vehicle per cycle to provide adequate estimation. This is mainly because a significant number of the estimation models utilized only queued vehicles. However, the state of motion in non-queued vehicles, particularly slowed-down vehicles, provides much information about the traffic characteristics. There is a lack of exploiting the information from slowed-down …

Forecasting Salinity In The Laguna Madre Using Deep Learning, Martin J. Flores Jr.

Theses and Dissertations

Salinity is an important metric in the Laguna Madre for establishing the long term health of the local ecological population. By utilizing Deep Learning (DL) techniques, the predicted and forecasted salinity in the Laguna Madre is generated from data provided by the Moderate Resolution Imaging Spectroradiometer (MODIS)-Aqua satellite.

Currently, only one other DL model has been used to forecast Sea Surface Salinity (SSS), being a Recurrent Neural Network (RNN). However, the RNN model requires the prediction of a full area of salinity to function.

As such, several model architectures were tested, with the best one, being a Multi-input MPNN, utilized …

Digitalization Of Construction Project Requirements Using Natural Language Processing (Nlp) Techniques, Fahad Ul Hassan

All Dissertations

Contract documents are a critical legal component of a construction project that specify all wishes and expectations of the owner toward the design, construction, and handover of a project. A single contract package, especially of a design-build (DB) project, comprises hundreds of documents including thousands of requirements. Precise comprehension and management of the requirements are critical to ensure that all important explicit and implicit requirements of the project scope are captured, managed, and completed. Since requirements are mainly written in a natural human language, the current manual methods impose a significant burden on practitioners to process and restructure them into …

Machine Learning Based Surrogate Model For Hurricane Storm Surge Forecasting In The Laguna Madre, Cesar E. Davila Hernandez

Theses and Dissertations

Texas coastal communities are at constant risk of hurricane impacts every storm season. It is especially important to model and predict storm surge variations during hurricane and storm events. Traditionally, hurricane storm surge predictions have been the result of numerical hydrodynamics based simulations. This type of simulations often requires high amounts of computational resources and complex ocean modelling efforts. Recently, machine learning techniques are being explored and are gaining popularity in hydrologic and ocean engineering modelling fields based on their performance to model nonlinear relationships and low computational requirements for prediction. Advances in machine learning and artificial intelligence (A.I.) demand …

Modeling And Analysis Of Subcellular Protein Localization In Hyper-Dimensional Fluorescent Microscopy Images Using Deep Learning Methods, Yang Jiao

UNLV Theses, Dissertations, Professional Papers, and Capstones

Hyper-dimensional images are informative and become increasingly common in biomedical research. However, the machine learning methods of studying and processing the hyper-dimensional images are underdeveloped. Most of the methods only model the mapping functions between input and output by focusing on the spatial relationship, whereas neglect the temporal and causal relationships. In many cases, the spatial, temporal, and causal relationships are correlated and become a relationship complex. Therefore, only modeling the spatial relationship may result in inaccurate mapping function modeling and lead to undesired output. Despite the importance, there are multiple challenges on modeling the relationship complex, including the model …

Estimating Animal Pose Using Deep Learning A Trained Deep Learning Model Outperforms Morphological Analysis, Sanghoon Lee, Jarod Banzon, Kevin Le, Dal Hyung Kim

Computer Sciences and Electrical Engineering Faculty Research

INTRODUCTION: Analyzing animal behavior helps researchers understand their decision-making process and helper tools are rapidly becoming an indispensable part of many interdisciplinary studies. However, researchers are often challenged to estimate animal pose because of the limitation of the tools and its vulnerability to a specific environment. Over the years, deep learning has been introduced as an alternative solution to overcome these challenges.

OBJECTIVES: This study investigates how deep learning models can be applied for the accurate prediction of animal behavior, comparing with traditional morphological analysis based on image pixels.

METHODS: Transparent Omnidirectional Locomotion Compensator (TOLC), a tracking device, is used …

Radar Remote Sensing Data Augmentation Method Based On Generative Adversarial Network, Xu Kang, Xiaofeng Zhang

Journal of System Simulation

Abstract: In the research field of radar remote sensing, both the completeness and diversity of radar data samples cannot meet the requirement of effective training of deep learning models, and the models are prone to over-fitting, which significantly limits the wide application of deep learning techniques in this field. Targeting on the needs of intelligent application in radar remote sensing, a microwave imaging radar suited data augmentation method is proposed to solve the issue of insufficient radar data samples by leveraging the general framework of generative adversarial network. Aiming at the features of radar samples being not obvious, the label …

A Deep Reinforcement Learning Approach With Prioritized Experience Replay And Importance Factor For Makespan Minimization In Manufacturing, Jose Napoleon Martinez

LSU Doctoral Dissertations

In this research, we investigated the application of deep reinforcement learning (DRL) to a common manufacturing scheduling optimization problem, max makespan minimization. In this application, tasks are scheduled to undergo processing in identical processing units (for instance, identical machines, machining centers, or cells). The optimization goal is to assign the jobs to be scheduled to units to minimize the maximum processing time (i.e., makespan) on any unit.

Machine learning methods have the potential to "learn" structures in the distribution of job times that could lead to improved optimization performance and time over traditional optimization methods, as well as to adapt …

Intra-Hour Solar Forecasting Using Cloud Dynamics Features Extracted From Ground-Based Infrared Sky Images, Guillermo Terrén-Serrano

Electrical and Computer Engineering ETDs

Due to the increasing use of photovoltaic systems, power grids are vulnerable to the projection of shadows from moving clouds. An intra-hour solar forecast provides power grids with the capability of automatically controlling the dispatch of energy, reducing the additional cost for a guaranteed, reliable supply of energy (i.e., energy storage). This dissertation introduces a novel sky imager consisting of a long-wave radiometric infrared camera and a visible light camera with a fisheye lens. The imager is mounted on a solar tracker to maintain the Sun in the center of the images throughout the day, reducing the scattering effect produced …

Toward Suicidal Ideation Detection With Lexical Network Features And Machine Learning, Ulya Bayram, William Lee, Daniel Santel, Ali Minai, Peggy Clark, Tracy Glauser, John Pestian

Northeast Journal of Complex Systems (NEJCS)

In this study, we introduce a new network feature for detecting suicidal ideation from clinical texts and conduct various additional experiments to enrich the state of knowledge. We evaluate statistical features with and without stopwords, use lexical networks for feature extraction and classification, and compare the results with standard machine learning methods using a logistic classifier, a neural network, and a deep learning method. We utilize three text collections. The first two contain transcriptions of interviews conducted by experts with suicidal (n=161 patients that experienced severe ideation) and control subjects (n=153). The third collection consists of interviews conducted by experts …

A Deep Learning-Based Approach To Extraction Of Filler Morphology In Sem Images With The Application Of Automated Quality Inspection, Md. Fashiar Rahman, Tzu-Liang Bill Tseng, Jianguo Wu, Yuxin Wen, Yirong Lin

Engineering Faculty Articles and Research

Automatic extraction of filler morphology (size, orientation, and spatial distribution) in Scanning Electron Microscopic (SEM) images is essential in many applications such as automatic quality inspection in composite manufacturing. Extraction of filler morphology greatly depends on accurate segmentation of fillers (fibers and particles), which is a challenging task due to the overlap of fibers and particles and their obscure presence in SEM images. Convolution Neural Networks (CNNs) have been shown to be very effective at object recognition in digital images. This paper proposes an automatic filler detection system in SEM images, utilizing a Mask Region-based CNN architecture. The proposed system …

Considerations For Radio Frequency Fingerprinting Across Multiple Frequency Channels, Jose A. Gutierrez Del Arroyo, Brett J. Borghetti, Michael A. Temple

Faculty Publications

Radio Frequency Fingerprinting (RFF) is often proposed as an authentication mechanism for wireless device security, but application of existing techniques in multi-channel scenarios is limited because prior models were created and evaluated using bursts from a single frequency channel without considering the effects of multi-channel operation. Our research evaluated the multi-channel performance of four single-channel models with increasing complexity, to include a simple discriminant analysis model and three neural networks. Performance characterization using the multi-class Matthews Correlation Coefficient (MCC) revealed that using frequency channels other than those used to train the models can lead to a deterioration in performance from …

Malware Binary Image Classification Using Convolutional Neural Networks, John Kiger, Shen-Shyang Ho, Vahid Heydari

College of Science & Mathematics Departmental Research

The persistent shortage of cybersecurity professionals combined with enterprise networks tasked with processing more data than ever before has led many cybersecurity experts to consider automating some of the most common and time-consuming security tasks using machine learning. One of these cybersecurity tasks where machine learning may prove advantageous is malware analysis and classification. To evade traditional detection techniques, malware developers are creating more complex malware. This is achieved through more advanced methods of code obfuscation and conducting more sophisticated attacks. This can make the manual process of analyzing malware an infinitely more complex task. Furthermore, the proliferation of malicious …

Fast Impedance Prediction For Power Distribution Network Using Deep Learning, Ling Zhang, Jack Juang, Zurab Kiguradze, Bo Pu, Shuai Jin, Songping Wu, Zhiping Yang, Jun Fan, Chulsoon Hwang

Electrical and Computer Engineering Faculty Research & Creative Works

Modeling and simulating a power distribution network (PDN) for printed circuit boards with irregular board shapes and multi-layer stackup is computationally inefficient using full-wave simulations. This paper presents a new concept of using deep learning for PDN impedance prediction. A boundary element method (BEM) is applied to efficiently calculate the impedance for arbitrary board shape and stackup. Then over one million boards with different shapes, stackup, integrated circuits (IC) location, and decap placement are randomly generated to train a deep neural network (DNN). The trained DNN can predict the impedance accurately for new board configurations that have not been used …

Deep Learning Approach To Multi-Phenomenological Nuclear Fuel Cycle Signals For Nonproliferation Applications, Preston J. Dicks

Theses and Dissertations

In order to reduce the time required for data analysis and decision-making relevant to nuclear proliferation detection, Artificial Intelligence (AI) techniques are applied to multi-phenomenological signals emitted from nuclear fuel cycle facilities to identify non-human readable characteristic signatures of operations for use in detecting proliferation activities. Seismic and magnetic emanations were collected in the vicinity of the High Flux Isotope Reactor (HFIR) and the McClellan Nuclear Research Center (MNRC). A novel bi-phenomenology DL network is designed to test the viability of transfer learning between nuclear reactor facilities. It is found that the network produces an 84.1% accuracy (99.4% without transient …

Performance Analysis And Feature Selection For Network-Based Intrusion Detectionwith Deep Learning, Serhat Caner, Nesli̇ Erdoğmuş, Yusuf Murat Erten

Turkish Journal of Electrical Engineering and Computer Sciences

An intrusion detection system is an automated monitoring tool that analyzes network traffic and detects malicious activities by looking out either for known patterns of attacks or for an anomaly. In this study, intrusion detection and classification performances of different deep learning based systems are examined. For this purpose, 24 deep neural networks with four different architectures are trained and evaluated on CICIDS2017 dataset. Furthermore, the best performing model is utilized to inspect raw network traffic features and rank them with respect to their contributions to success rates. By selecting features with respect to their ranks, sets of varying size …

Biometric Identification Using Panoramic Dental Radiographic Images Withfew-Shot Learning, Musa Ataş, Cüneyt Özdemi̇r, İsa Ataş, Burak Ak, Esma Özeroğlu

Turkish Journal of Electrical Engineering and Computer Sciences

Determining identity is a crucial task especially in the cases of mass disasters such as tsunamis, earthquakes, fires, epidemics, and in forensics. Although there are various studies in the literature on biometric identification from radiographic dental images, more research is still required. In this study, a panoramic dental radiographic (PDR) imagebased human identification system was developed using a customized deep convolutional neural network model in a few-shot learning scheme. The proposed model (PDR-net) was trained on 600 PDR images obtained from a total of 300 patients. As the PDR images of the patients were very different in terms of pose …

An Ensemble Approach For Patient Prognosis Of Head And Neck Tumor Using Multimodal Data, Numan Saeed, Roba Al Majzoub, Ikboljon Sobirov, Mohammad Yaqub

Computer Vision Faculty Publications

Accurate prognosis of a tumor can help doctors provide a proper course of treatment and, therefore, save the lives of many. Tradi-tional machine learning algorithms have been eminently useful in crafting prognostic models in the last few decades. Recently, deep learning algorithms have shown significant improvement when developing diag-nosis and prognosis solutions to different healthcare problems. However, most of these solutions rely solely on either imaging or clinical data. Utilizing patient tabular data such as demographics and patient med-ical history alongside imaging data in a multimodal approach to solve a prognosis task has started to gain more interest recently and …

Deep-Precognitive Diagnosis: Preventing Future Pandemics By Novel Disease Detection With Biologically-Inspired Conv-Fuzzy Network, Aviral Chharia, Rahul Upadhyay, Vinay Kumar, Chao Cheng, Jing Zhang, Tianyang Wang, Min Xu

Computer Vision Faculty Publications

Deep learning-based Computer-Aided Diagnosis has gained immense attention in recent years due to its capability to enhance diagnostic performance and elucidate complex clinical tasks. However, conventional supervised deep learning models are incapable of recognizing novel diseases that do not exist in the training dataset. Automated early-stage detection of novel infectious diseases can be vital in controlling their rapid spread. Moreover, the development of a conventional CAD model is only possible after disease outbreaks and datasets become available for training (viz. COVID-19 outbreak). Since novel diseases are unknown and cannot be included in training data, it is challenging to recognize them …

A Survey Of Blind Modulation Classification Techniques For Ofdm Signals, Anand Kumar, Sudhan Majhi, Guan Gui, Hsiao-Chun Wu, Chau Yuen

Faculty Publications

Blind modulation classification (MC) is an integral part of designing an adaptive or intelligent transceiver for future wireless communications. Blind MC has several applications in the adaptive and automated systems of sixth generation (6G) communications to improve spectral efficiency and power efficiency, and reduce latency. It will become a integral part of intelligent software-defined radios (SDR) for future communication. In this paper, we provide various MC techniques for orthogonal frequency division multiplexing (OFDM) signals in a systematic way. We focus on the most widely used statistical and machine learning (ML) models and emphasize their advantages and limitations. The statistical-based blind …

Extractive Text Summarization On Single Documents Using Deep Learning, Shehab Mostafa Abdel-Salam Mohamed

Theses and Dissertations

The task of summarization can be categorized into two methods, extractive and abstractive summarization. Extractive approach selects highly meaningful sentences to form a summary while the abstractive approach interprets the original document and generates the summary in its own words. The task of generating a summary, whether extractive or abstractive, has been studied with different approaches such as statistical-based, graph-based, and deep-learning based approaches. Deep learning has achieved promising performance in comparison with the classical approaches and with the evolution of neural networks such as the attention network or commonly known as the Transformer architecture, there are potential areas for …

Long Short-Term Memory Based Subsurface Drainage Control For Rainfall-Induced Landslide Prevention, Aynaz Biniyaz, Behnam Azmoon, Ye Sun, Zhen Liu

Michigan Tech Publications, Part 1

Subsurface drainage has been widely accepted to mitigate the hazard of landslides in areas prone to flooding. Specifically, the use of drainage wells with pumping systems has been recognized as an effective short-term solution to lower the groundwater table. However, this method has not been well considered for long-term purposes due to potentially high labor costs. This study aims to investigate the idea of an autonomous pumping system for subsurface drainage by leveraging con-ventional geotechnical engineering solutions and a deep learning technique—Long-Short Term Memory (LSTM)—to establish a geotechnical cyber-physical system for rainfall-induced landslide prevention. For this purpose, a typical soil …

Performance Prediction Of Underwater Acoustic Communications Based On Channel Impulse Responses, Evan Lucas, Zhaohui Wang

Michigan Tech Publications, Part 1

Featured Application: Convolutional neural networks are used on the channel impulse response data to predict the performance of underwater acoustic communications. Abstract: Predicting the channel quality for an underwater acoustic communication link is not a straightforward task. Previous approaches have focused on either physical observations of weather or engineered signal features, some of which require substantial processing to obtain. This work applies a convolutional neural network to the channel impulse responses, allowing the network to learn the features that are useful in predicting the channel quality. Results obtained are comparable or better than conventional supervised learning models, depending on the …