Engineering Commons^™

Use Of Machine Learning And Natural Language Processing To Enhance Traffic Safety Analysis, Md Abu Sayed

Theses and Dissertations

Despite significant advances in vehicle technologies, safety data collection and analysis, and engineering advancements, tens of thousands of Americans die every year in motor vehicle crashes. Alarmingly, the trend of fatal and serious injury crashes appears to be heading in the wrong direction. In 2021, the actual rate of fatalities exceeded the predicted rate. This worrisome trend prompts and necessitates the development of advanced and holistic approaches to determining the causes of a crash (particularly fatal and major injuries). These approaches range from analyzing problems from multiple perspectives, utilizing available data sources, and employing the most suitable tools and technologies …

Deep Learning Of Microstructures, Amir Abbas Kazemzadeh Farizhandi

Boise State University Theses and Dissertations

The internal structure of materials also called the microstructure plays a critical role in the properties and performance of materials. The chemical element composition is one of the most critical factors in changing the structure of materials. However, the chemical composition alone is not the determining factor, and a change in the production process can also significantly alter the materials' structure. Therefore, many efforts have been made to discover and improve production methods to optimize the functional properties of materials. The most critical challenge in finding materials with enhanced properties is to understand and define the salient features of the …

The Role Of Generative Adversarial Networks In Bioimage Analysis And Computational Diagnostics., Ahmed Naglah

Electronic Theses and Dissertations

Computational technologies can contribute to the modeling and simulation of the biological environments and activities towards achieving better interpretations, analysis, and understanding. With the emergence of digital pathology, we can observe an increasing demand for more innovative, effective, and efficient computational models. Under the umbrella of artificial intelligence, deep learning mimics the brain’s way in learn complex relationships through data and experiences. In the field of bioimage analysis, models usually comprise discriminative approaches such as classification and segmentation tasks. In this thesis, we study how we can use generative AI models to improve bioimage analysis tasks using Generative Adversarial Networks …

Data-Driven Deep Learning-Based Analysis On Thz Imaging, Haoyan Liu

Graduate Theses and Dissertations

Breast cancer affects about 12.5% of women population in the United States. Surgical operations are often needed post diagnosis. Breast conserving surgery can help remove malignant tumors while maximizing the remaining healthy tissues. Due to lacking effective real-time tumor analysis tools and a unified operation standard, re-excision rate could be higher than 30% among breast conserving surgery patients. This results in significant physical, physiological, and financial burdens to those patients. This work designs deep learning-based segmentation algorithms that detect tissue type in excised tissues using pulsed THz technology. This work evaluates the algorithms for tissue type classification task among freshly …

A Wind Turbine Fault Diagnosis Method Based On Siamese Deep Neural Network, Jiarui Liu, Guotian Yang, Xiaowei Wang

Journal of System Simulation

Abstract: In order to effectively extract the fault features of time series data in supervisory control and data acquisition (SCADA), considering the advantages of one-dimensional convolutional neural network (1-D CNN) for extracting local time series features and the advantages of long-term memory (LSTM) which can extract long-term dependent features, a method for fault diagnosis of wind turbines based on 1-D CNN-LSTM is proposed. To solve the problem of the scarcity of fault samples of wind turbines based on the siamese network architecture, a wind fault diagnosis method based on siamese 1-D CNN-LSTM is proposed. The proposed siamese 1-D CNN-LSTM …

Load2load: Day-Ahead Load Forecasting At Aggregated Level, Mustafa Berkay Yilmaz

Turkish Journal of Electrical Engineering and Computer Sciences

A reliable and accurate short-term load forecasting (STLF) helps utilities and energy providers deal with the challenges posed by supply and demand balance, higher penetration of renewable energies and the development of electricity markets with increasingly complex pricing strategies in future smart grids. Recent advances in deep learning have been successively utilized to STLF. However, there is no certain study that evaluates the performances of different STLF methods at an aggregated level on different datasets with different numbers of daily measurements.In this study, a deep learning STLF architecture called Load2Load is proposed for day-ahead forecasting. Different forecasting methods have been …

Fatigue Detection Method Based On Facial Features And Head Posture, Rongxiu Lu, Bihao Zhang, Zhenlong Mo

Journal of System Simulation

Abstract: Aiming at the of the single fatigue characteristics, low robustness and inability to customize fatigue thresholds for different drivers of fatigue detection methods, a method based on facial features and head posture is proposed. In face detection and face key point positioning HOG feature operator and regression tree algorithm are used. In head posture estimation, head posture Euler angle is estimated by combining the face key points with the coordinate system transformation. In fatigue feature extraction, a deep residual neural network model is established to extract the eye fatigue features, which the eye, mouth aspect ratio and head posture …

Electrical Resistance Tomography And Flow Pattern Identification Method Based On Deep Residual Neural Network, Weiguo Tong, Shichao Zeng, Lifeng Zhang, Zhe Hou, Jiayue Guo

Journal of System Simulation

Abstract: Aiming at the low accuracy of inverse problem imaging and flow pattern recognition in electrical resistance tomography (ERT), a two-phase flow electrical resistance tomography and flow pattern recognition method based on the deep residual neural network is proposed. The finite element method is used to model the ERT forward problem to construct the "boundary voltage-conductivity distribution-flow pattern category" dataset of various gas-liquid two-phase flow distributions. The residual neural network for ERT image reconstruction and flow pattern identification of gas-liquid two-phase flow is built and trained. The two outputs of the residual neural network are processed respectively to obtain …

Segmentation Of Diatoms Using Edge Detection And Deep Learning, Hüseyi̇n Gündüz, Cüneyd Nadi̇r Solak, Serkan Günal

Turkish Journal of Electrical Engineering and Computer Sciences

Diatoms are photosynthesizing algae found in almost every aquatic environment. Detecting the number and diversity of diatoms is very important to analyze water quality appropriately. Accurate segmentation of diatoms is therefore crucial for this detection process. In this study, a new and effective model for the automatic segmentation of diatoms based on image processing and deep learning algorithms is proposed. In the proposed model, edge segments of a given image containing diatoms and nondiatom particles are first obtained. These edge segments are then combined, resulting in closed contours representing diatom candidates. In the final step, the diatom candidates are classified …

Comparison Of Deep Learning And Regression-Based Mppt Algorithms In Pv Systems, Murat Sali̇m Karabi̇naoğlu, Beki̇r Çakir, Mustafa Engi̇n Başoğlu, Abdülvehhab Kazdaloğlu, Azi̇z Güneroğlu

Turkish Journal of Electrical Engineering and Computer Sciences

Solar energy systems (SES) and photovoltaic (PV) modules should be operated at the maximum power point (MPP) to achieve the highest efficiency in the energy generation processes. Maximum power point tracking (MPPT) applications using conventional methods may not be able to follow the global MPP (GMPP) of the PV system under changing atmospheric conditions and they could oscillate around the local MPP. In this study, a machine learning and deep learning (DL) based long short-term memory (LSTM) model is proposed as an innovative solution for MPPT. Contrary to the traditional MPPT applications using current and voltage sensors, the output resistance …

Analysis Of Patch And Sample Size Effects For 2d-3d Cnn Models Using Multiplatform Dataset: Hyperspectral Image Classification Of Rosis And Jilin-1 Gp01 Imagery, Taşkin Kavzoğlu, Eli̇f Özlem Yilmaz

Turkish Journal of Electrical Engineering and Computer Sciences

Modern hyperspectral sensors provide a huge volume of data at spectral and spatial domains with high redundancy, which requires robust methods for analysis. In this study, 2D and 3D CNN models were applied to hyperspectral image datasets (ROSIS and Jilin-1 GP01) using varying patch and sample sizes to determine their combined impacts on the performance of deep learning models. Differences in classification performances in relation to particle and sample sizes were statistically analysed using McNemar?s test. According to the findings, raising the patch and sample size enhances the performance of the 2D/3D CNN model and produces more accurate results in …

Data-Driven Research On Engineering Design Thinking And Behaviors In Computer-Aided Systems Design: Analysis, Modeling, And Prediction, Molla Hafizur Rahman

Graduate Theses and Dissertations

Research on design thinking and design decision-making is vital for discovering and utilizing beneficial design patterns, strategies, and heuristics of human designers in solving engineering design problems. It is also essential for the development of new algorithms embedded with human intelligence and can facilitate human-computer interactions. However, modeling design thinking is challenging because it takes place in the designer’s mind, which is intricate, implicit, and tacit. For an in-depth understanding of design thinking, fine-grained design behavioral data are important because they are the critical link in studying the relationship between design thinking, design decisions, design actions, and design performance. Therefore, …

Computer Aided Diagnosis System For Breast Cancer Using Deep Learning., Asma Baccouche

Electronic Theses and Dissertations

The recent rise of big data technology surrounding the electronic systems and developed toolkits gave birth to new promises for Artificial Intelligence (AI). With the continuous use of data-centric systems and machines in our lives, such as social media, surveys, emails, reports, etc., there is no doubt that data has gained the center of attention by scientists and motivated them to provide more decision-making and operational support systems across multiple domains. With the recent breakthroughs in artificial intelligence, the use of machine learning and deep learning models have achieved remarkable advances in computer vision, ecommerce, cybersecurity, and healthcare. Particularly, numerous …

Deep Learning Applications In Industrial And Systems Engineering, Winthrop Harvey

Graduate Theses and Dissertations

Deep learning - the use of large neural networks to perform machine learning - has transformed the world. As the capabilities of deep models continue to grow, deep learning is becoming an increasingly valuable and practical tool for industrial engineering. With its wide applicability, deep learning can be turned to many industrial engineering tasks, including optimization, heuristic search, and functional approximation. In this dissertation, the major concepts and paradigms of deep learning are reviewed, and three industrial engineering projects applying these methods are described. The first applies a deep convolutional network to the task of absolute aerial geolocalization - the …

Role Of Deep Learning Techniques In Non-Invasive Diagnosis Of Human Diseases., Hisham Abouelseoud Elsayem Abdeltawab

Electronic Theses and Dissertations

Machine learning, a sub-discipline in the domain of artificial intelligence, concentrates on algorithms able to learn and/or adapt their structure (e.g., parameters) based on a set of observed data. The adaptation is performed by optimizing over a cost function. Machine learning obtained a great attention in the biomedical community because it offers a promise for improving sensitivity and/or specificity of detection and diagnosis of diseases. It also can increase objectivity of the decision making, decrease the time and effort on health care professionals during the process of disease detection and diagnosis. The potential impact of machine learning is greater than …

Aerial Target Threat Assessment Method Based On Deep Learning, Huimin Chai, Yong Zhang, Xinyue Li, Yanan Song

Journal of System Simulation

Abstract: Due to many factors of aerial target threat assessment and the lack of self-learning ability of current assessment methods, a deep neural network model for aerial target threat assessment is established using deep learning theory. In order to improve the fitting effect of the model training, a symmetric pre-training method is given. The hidden layers of the model are pre-trained layer by layer, and finally the whole model is trained. Sample data and air to air simulation scene experiments are carried out respectively. The experiments results show that the accuracy of the model using the symmetric pre-training method is …

Generating Ad Creatives Using Deep Learning For Search Advertising, Kevser Nur Çoğalmiş, Ahmet Bulut

Turkish Journal of Electrical Engineering and Computer Sciences

We generated advertisement creatives programmatically using deep neural networks. A landing page contains relevant text data, which can be used for generating advertisement creatives, i.e. ads. We treated the ad generation task as a text summarization problem and built a sequence to sequence model. In order to assess the validity of our approach, we conducted experiments on four datasets. Our empirical results showed that our model generated relevant ads on a template-based dataset with moderate hyperparameters. Training the model with more content increased the performance of the model, which we attributed to rigorous hyperparameter tune-up. The choice of word embedding …

Image Restoration Under Adverse Illumination For Various Applications, Lan Fu

Theses and Dissertations

Many images are captured in sub-optimal environment, resulting in various kinds of degradations, such as noise, blur, and shadow. Adverse illumination is one of the most important factors resulting in image degradation with color and illumination distortion or even unidentified image content. Degradation caused by the adverse illumination makes the images suffer from worse visual quality, which might also lead to negative effects on high-level perception tasks, e.g., object detection.

Image restoration under adverse illumination is an effective way to remove such kind of degradations to obtain visual pleasing images. Existing state-of-the-art deep neural networks (DNNs) based image restoration …

Identifying And Discovering Curve Pattern Designs From Fragments Of Pottery, Jun Zhou

Theses and Dissertations

The surface of many cultural heritage objects, such as pottery sherds found in the Southeastern Woodlands, were embellished with curve patterns. The original full designs of these patterns reflect rich historical and cultural information. However, in practice, most objects are fragmentary, making the complete underlying designs unknowable at the scale of the sherd fragment. The challenge to reconstruct and study complete designs is stymied because 1) most pottery sherds contain only a small portion of the underlying full design, 2) curve patterns detected on a sherd are usually incomplete and noisy, and 3) in the case of a stamping application, …

Integrating Deep Learning And Hydrodynamic Modeling To Improve The Great Lakes Forecast, Pengfei Xue, Aditya Wagh, Gangfeng Ma, Yilin Wang, Yongchao Yang, Tao Liu, Chenfu Huang

Michigan Tech Publications

The Laurentian Great Lakes, one of the world’s largest surface freshwater systems, pose a modeling challenge in seasonal forecast and climate projection. While physics-based hydrodynamic modeling is a fundamental approach, improving the forecast accuracy remains critical. In recent years, machine learning (ML) has quickly emerged in geoscience applications, but its application to the Great Lakes hydrodynamic prediction is still in its early stages. This work is the first one to explore a deep learning approach to predicting spatiotemporal distributions of the lake surface temperature (LST) in the Great Lakes. Our study shows that the Long Short-Term Memory (LSTM) neural network, …

Anomaly Detection In Rotating Machinery Using Autoencoders Based On Bidirectional Lstm And Gru Neural Networks, Krishna Patra, Rabi Narayan Sethi, Dhiren Kkumar Behera

Turkish Journal of Electrical Engineering and Computer Sciences

A time series anomaly is a form of anomalous subsequence that indicates future faults will occur. The development of novel techniques for detecting this type of anomaly is significant for real-time system monitoring. Several algorithms have been used to classify anomalies successfully. However, the time series anomaly detection algorithm was not studied well. We use a new bidirectional LSTM and GRU neural networks-based hybrid autoencoder to detect if a machine is operating normally in this research. An autoencoder is trained on a set of 12 features taken from healthy operating data gathered promptly after a planned maintenance period using vibration …

Deep Learning Object-Based Detection Of Manufacturing Defects In X-Ray Inspection Imaging, Juan C. Parducci

Mechanical & Aerospace Engineering Theses & Dissertations

Current analysis of manufacturing defects in the production of rims and tires via x-ray inspection at an industry partner’s manufacturing plant requires that a quality control specialist visually inspect radiographic images for defects of varying sizes. For each sample, twelve radiographs are taken within 35 seconds. Some defects are very small in size and difficult to see (e.g., pinholes) whereas others are large and easily identifiable. Implementing this quality control practice across all products in its human-effort driven state is not feasible given the time constraint present for analysis.

This study aims to identify and develop an object detector capable …

Radar Remote Sensing Data Augmentation Method Based On Generative Adversarial Network, Xu Kang, Xiaofeng Zhang

Journal of System Simulation

Abstract: In the research field of radar remote sensing, both the completeness and diversity of radar data samples cannot meet the requirement of effective training of deep learning models, and the models are prone to over-fitting, which significantly limits the wide application of deep learning techniques in this field. Targeting on the needs of intelligent application in radar remote sensing, a microwave imaging radar suited data augmentation method is proposed to solve the issue of insufficient radar data samples by leveraging the general framework of generative adversarial network. Aiming at the features of radar samples being not obvious, the label …

Intra-Hour Solar Forecasting Using Cloud Dynamics Features Extracted From Ground-Based Infrared Sky Images, Guillermo Terrén-Serrano

Electrical and Computer Engineering ETDs

Due to the increasing use of photovoltaic systems, power grids are vulnerable to the projection of shadows from moving clouds. An intra-hour solar forecast provides power grids with the capability of automatically controlling the dispatch of energy, reducing the additional cost for a guaranteed, reliable supply of energy (i.e., energy storage). This dissertation introduces a novel sky imager consisting of a long-wave radiometric infrared camera and a visible light camera with a fisheye lens. The imager is mounted on a solar tracker to maintain the Sun in the center of the images throughout the day, reducing the scattering effect produced …

Toward Suicidal Ideation Detection With Lexical Network Features And Machine Learning, Ulya Bayram, William Lee, Daniel Santel, Ali Minai, Peggy Clark, Tracy Glauser, John Pestian

Northeast Journal of Complex Systems (NEJCS)

In this study, we introduce a new network feature for detecting suicidal ideation from clinical texts and conduct various additional experiments to enrich the state of knowledge. We evaluate statistical features with and without stopwords, use lexical networks for feature extraction and classification, and compare the results with standard machine learning methods using a logistic classifier, a neural network, and a deep learning method. We utilize three text collections. The first two contain transcriptions of interviews conducted by experts with suicidal (n=161 patients that experienced severe ideation) and control subjects (n=153). The third collection consists of interviews conducted by experts …

A Deep Learning-Based Approach To Extraction Of Filler Morphology In Sem Images With The Application Of Automated Quality Inspection, Md. Fashiar Rahman, Tzu-Liang Bill Tseng, Jianguo Wu, Yuxin Wen, Yirong Lin

Engineering Faculty Articles and Research

Automatic extraction of filler morphology (size, orientation, and spatial distribution) in Scanning Electron Microscopic (SEM) images is essential in many applications such as automatic quality inspection in composite manufacturing. Extraction of filler morphology greatly depends on accurate segmentation of fillers (fibers and particles), which is a challenging task due to the overlap of fibers and particles and their obscure presence in SEM images. Convolution Neural Networks (CNNs) have been shown to be very effective at object recognition in digital images. This paper proposes an automatic filler detection system in SEM images, utilizing a Mask Region-based CNN architecture. The proposed system …

Considerations For Radio Frequency Fingerprinting Across Multiple Frequency Channels, Jose A. Gutierrez Del Arroyo, Brett J. Borghetti, Michael A. Temple

Faculty Publications

Radio Frequency Fingerprinting (RFF) is often proposed as an authentication mechanism for wireless device security, but application of existing techniques in multi-channel scenarios is limited because prior models were created and evaluated using bursts from a single frequency channel without considering the effects of multi-channel operation. Our research evaluated the multi-channel performance of four single-channel models with increasing complexity, to include a simple discriminant analysis model and three neural networks. Performance characterization using the multi-class Matthews Correlation Coefficient (MCC) revealed that using frequency channels other than those used to train the models can lead to a deterioration in performance from …

Performance Analysis And Feature Selection For Network-Based Intrusion Detectionwith Deep Learning, Serhat Caner, Nesli̇ Erdoğmuş, Yusuf Murat Erten

Turkish Journal of Electrical Engineering and Computer Sciences

An intrusion detection system is an automated monitoring tool that analyzes network traffic and detects malicious activities by looking out either for known patterns of attacks or for an anomaly. In this study, intrusion detection and classification performances of different deep learning based systems are examined. For this purpose, 24 deep neural networks with four different architectures are trained and evaluated on CICIDS2017 dataset. Furthermore, the best performing model is utilized to inspect raw network traffic features and rank them with respect to their contributions to success rates. By selecting features with respect to their ranks, sets of varying size …

Biometric Identification Using Panoramic Dental Radiographic Images Withfew-Shot Learning, Musa Ataş, Cüneyt Özdemi̇r, İsa Ataş, Burak Ak, Esma Özeroğlu

Turkish Journal of Electrical Engineering and Computer Sciences

Determining identity is a crucial task especially in the cases of mass disasters such as tsunamis, earthquakes, fires, epidemics, and in forensics. Although there are various studies in the literature on biometric identification from radiographic dental images, more research is still required. In this study, a panoramic dental radiographic (PDR) imagebased human identification system was developed using a customized deep convolutional neural network model in a few-shot learning scheme. The proposed model (PDR-net) was trained on 600 PDR images obtained from a total of 300 patients. As the PDR images of the patients were very different in terms of pose …

Malware Binary Image Classification Using Convolutional Neural Networks, John Kiger, Shen-Shyang Ho, Vahid Heydari

Faculty Scholarship for the College of Science & Mathematics

The persistent shortage of cybersecurity professionals combined with enterprise networks tasked with processing more data than ever before has led many cybersecurity experts to consider automating some of the most common and time-consuming security tasks using machine learning. One of these cybersecurity tasks where machine learning may prove advantageous is malware analysis and classification. To evade traditional detection techniques, malware developers are creating more complex malware. This is achieved through more advanced methods of code obfuscation and conducting more sophisticated attacks. This can make the manual process of analyzing malware an infinitely more complex task. Furthermore, the proliferation of malicious …