Physical Sciences and Mathematics Commons^™

Dual-Channel Side Channel Attack: Improved Aes Key Decryption By Combining Power And Electromagnetic Side Channels With Convolutional Neural Networks, Sean P. O'Neill

Theses and Dissertations

This research introduces a novel DL approach for SCA that combines power consumption and EM signals to enhance encryption key deduction by leveraging a dual-channel CNN architecture. A new dataset, consisting of simultaneous power and EM signal collections during 128-bitAES encryption, was developed to train and evaluate the model’s effectiveness. The combined approach achieved an 88% reduction in traces needed, from 50 traces to 6, for encryption key classification, outperforming traditional methods such as random forest, DPA, DEMA,and individual side channel CNN models. These findings highlight the potential of integrating multiple side channels in SCA to improve performance without the …

Developing Linguistic Patterns To Mitigate Inherent Human Bias In Offensive Language Detection, Toygar Tanyel, Besher Alkurdi, Serkan Ayvaz

Turkish Journal of Electrical Engineering and Computer Sciences

With the proliferation of social media, there has been a sharp increase in offensive content, particularly targeting vulnerable groups, exacerbating social problems such as hatred, racism, and sexism. Detecting offensive language use is crucial to prevent offensive language from being widely shared on social media. However, the accurate detection of irony, implication, and various forms of hate speech on social media remains a challenge. Natural language-based deep learning models require extensive training with large, comprehensive, and labeled datasets. Unfortunately, manually creating such datasets is both costly and error-prone. Additionally, the presence of human-bias in offensive language datasets is a major …

Fine And Intelligent Interpretation Of Key Geological Structures In The Metal Metallogenesis Of Coal Measures, Yang Yi, Zhao Jingtao, Li Wenyu, Shi Suzhen

Coal Geology & Exploration

Objective In order to identify the key geological structures in the metallogenic process of coal measures metal deposits, the Linxing block of Ordos Basin was taken as the research object. Based on the previous research results, geological data of the block, seismic and logging data, a geological model including tectonic volcanic activities and other events was constructed to analyze the key geological factors of deposit formation. Methods Firstly, based on the post-stack seismic data, the diffraction wave separation and imaging are realized by using the plane wave destruction filter technology, and the small-scale key geological information is extracted. Secondly, the …

Acoustic Velocity Inversion Based On Convolutional Autoencoder Embedded With Fourier Neural Operator, Li Chen, Zhao Haixia, Bai Zhaowei, Hao Yufan

Coal Geology & Exploration

Background Seismic wave inversion serves as an effective method for obtaining the characteristics of structures, lithology, and physical properties of subsurface media using the arrival times, amplitude, and waveforms of seismic waves. Seismic inversion methods based on wave equations iteratively update model parameters using forward modeling. This generally involves extensive numerical simulations and optimization calculations, requiring large quantities of computational resources and time. In recent years, neural operators for deep learning, represented by the Fourier neural operator (FNO), have gained widespread attention. However, the original FNO structure fails to effectively learn the wavefield information with sharp changes in geological structures …

Intelligent Noise Suppression For 3d Post-Stack Seismic Data Of The Junggar Basin, Mao Haibo, Zhou Xin, Li Xiaofeng, Pan Long, Lin Juan, Liu Dawei, Wang Xiaokai

Coal Geology & Exploration

Objective The Junggar Basin is recognized as a significant petroliferous basin in China, and its hydrocarbon exploration targets have shifted to deeper strata. However, the 3D seismic data of this basin suffer from low signal-to-noise ratios (SNRs) and high data volumes due to the basin's complex near-surface conditions, the great depths of exploration targets, and seismic data acquisition methods characterized by wide azimuths, broadbands, and high density. This complicates the identification of hydrocarbon exploration targets, rendering the improvement in the quality of the 3D seismic data by noise suppression vitally important. Methods The progress in the deep learning theory and …

Transient Electromagnetic Numerical Simulation Based On The Transformer Neural Network, Wang Yunhong

Coal Geology & Exploration

Objective The deep learning-based transient electromagnetic (TEM) forward and inverse modeling methods are data-driven, requiring considerable numerical simulation results as supervisory data to train and assess neural networks. The conventional finite-difference time-domain (FDTD) method for TEM numerical simulation necessitates an iterative solution of time-domain Maxwell's equations. Therefore, this method is time-consuming and computationally intensive, failing to meet the data demand of deep learning-based TEM inversion. Methods This study introduced deep learning for TEM numerical simulation. Based on the transformer neural network architecture, a neural network for deep learning-based TEM numerical simulation was designed using an encoder-decoder structure. This neural network …

An Intelligent Identifying-While-Drilling Method For Geological Features Of Roof Strata In Coal Roadways Based On A 1dcnn-Bilstm-Cbam Model, Lei Zhiyong, Wang Jiawen, Fan Dong, Lu Feifei, Chen Weiming

Coal Geology & Exploration

Objective Most roof accidents in coal roadways occur in potential caving zones such as primary fissure-bearing zones and rock fracture zones. A significant approach to preventing roof accidents is to understand the geological features of roof strata in an accurate and timely manner and optimize support schemes and parameters of roofs. However, current methods for identifying the geological features of roof strata in roadways suffer from issues such as slow identification speeds, low efficiency, and high costs, thus failing to meet the demand for safe, efficient, and intelligent coal mining. Methods This study proposed a neural network model based on …

Designing Customized Loss Functions For Training Deep Neural Networks, Ali Pourramezan Fard

Electronic Theses and Dissertations

This dissertation explores the critical role of loss functions in enhancing the predictive performance of deep machine learning models. Loss functions are an integral element of all the ongoing advances we witness daily in this domain. I design custom loss functions and their impacts on various machine learning tasks, particularly in computer vision.

In the first stage of my research, I aim to improve the prediction performance of deep learning models by providing them with more precise feedback associated with task requirements. This led me to create the concept of assistive loss functions. My first proposed loss function, inspired by …

Strategies To Alleviate Flickering: Bayesian And Smoothing Methods For Deep Learning Classification In Video, Noah Miller, Glen Ryan Drumm, Lance Champagne, Bruce A. Cox, Trevor Bihl

Faculty Publications

Excerpt: Increasing reliance on autonomous systems requires confidence in the accuracies produced from computer vision classification algorithms. Computer vision (CV) for video classification provides phenomenal abilities, but it often suffers from “flickering” of results. Flickering occurs when the CV algorithm switches between declared classes over successive frames. Such behavior causes a loss of trust and confidence in their operations.

Predicting And Monitoring Immune Checkpoint Inhibitor Therapy Using Artificial Intelligence In Pancreatic Cancer, Guangbo Yu, Zigeng Zhang, Aydin Eresen, Qiaoming Hou, Farideh Amirrad, Sha Webster, Surya M. Nauli, Vahid Yaghmai, Zhuoli Zhang

Pharmacy Faculty Articles and Research

Pancreatic cancer remains one of the most lethal cancers, primarily due to its late diagnosis and limited treatment options. This review examines the challenges and potential of using immunotherapy to treat pancreatic cancer, highlighting the role of artificial intelligence (AI) as a promising tool to enhance early detection and monitor the effectiveness of these therapies. By synthesizing recent advancements and identifying gaps in the current research, this review aims to provide a comprehensive overview of how AI and immunotherapy can be integrated to develop more personalized and effective treatment strategies. The insights from this review may guide future research efforts …

Collectively Advancing Deep Learning For Animal Detection In Drone Imagery: Successes, Challenges, And Research Gaps, Daniel Axford, Ferdous Sohel, Mathew A. Vanderklift, Amanda J. Hodgson

Research outputs 2022 to 2026

Drones have emerged as a powerful tool in animal detection, significantly advancing wildlife monitoring, conservation, and management by capturing high-resolution, real-time imagery over areas often inaccessible or challenging for human observers to reach. However, manual analysis of drone imagery for animal detection is labour-intensive and time-consuming. The application of deep learning methods, particularly convolutional neural networks, in automating animal detection from drone imagery has the potential to revolutionise wildlife monitoring, conservation, and management protocols. This review provides a comprehensive overview of the increasing use and prospects of deep learning in animal detection using drone imagery. It explores successful applications of …

Early Detection And Categorization Of Cervical Cancer Cells Using Smoothing Cross Entropy-Based Multi-Deep Transfer Learning, Rania Ahmed, Nadia Dahmani, Ghada Dahy, Ashraf Darwish, Aboul Ella Hassanien

All Works

Cervical cancer is one of the leading causes of death in women worldwide. Prompt and accurate diagnosis is imperative for the treatment of cervical cancer through the utilization of pap smear slides, albeit it is a multifaceted and time-intensive process. An automatic diagnosis model based on deep learning models, particularly a convolutional neural network (CNN), can enhance cervical cancer's accuracy and rapid identification. This paper proposes a cross entropy-based multi-deep transfer learning model for the early detection and categorization of cervical cancer cells. The proposed model consists of four phases: the pre-processing phase, the feature extraction and fusion phase, the …

Search Technology For Aircraft Debris Integrating Data Augmentation And Deep Learning Algorithm, Zhe Yang, Yinghan Cui, Lingxi Guo, Jiaxin Li, Xusheng Wu

Journal of System Simulation

Abstract: The reliable recovery of aircraft debris is of great significance for the complete acquisition of flight test data and the subsequent research and development of models. To ensure the safety of flight tests,the landing area of aircraft experiments is generally an unmanned area,and the actual landing point of the aircraft often deviates from the theoretical landing point. The characteristics of the debris target are complex and the dispersion area is large, making it difficult to search for aircraft debris solely by manpower. Aiming at the difficult problem of aircraft debris recovery in the landing area, through on UAV platforms …

M3t-Lm: A Multi-Modal Multi-Task Learning Model For Jointly Predicting Patient Length Of Stay And Mortality, Junde Chen, Qing Li, Feng Liu, Yuxin Wen

Engineering Faculty Articles and Research

Ensuring accurate predictions of inpatient length of stay (LoS) and mortality rates is essential for enhancing hospital service efficiency, particularly in light of the constraints posed by limited healthcare resources. Integrative analysis of heterogeneous clinic record data from different sources can hold great promise for improving the prognosis and diagnosis level of LoS and mortality. Currently, most existing studies solely focus on single data modality or tend to single-task learning, i.e., training LoS and mortality tasks separately. This limits the utilization of available multi-modal data and prevents the sharing of feature representations that could capture correlations between different tasks, ultimately …

Risurconv : Rotation Invariant Surface Attention-Augmented Convolutions For 3d Point Cloud Classification And Segmentation, Zhiyuan Zhang, Licheng Yang, Xiang Zhiyu

Research Collection School Of Computing and Information Systems

Despite the progress on 3D point cloud deep learning, most prior works focus on learning features that are invariant to translation and point permutation, and very limited efforts have been devoted for rotation invariant property. Several recent studies achieve rotation invariance at the cost of lower accuracies. In this work, we close this gap by proposing a novel yet effective rotation invariant architecture for 3D point cloud classification and segmentation. Instead of traditional pointwise operations, we construct local triangle surfaces to capture more detailed surface structure, based on which we can extract highly expressive rotation invariant surface properties which are …

Using Machine Learning And Deep Learning Algorithms To Improve Low Birthweight Prediction, Yang Ren

Theses and Dissertations

Low birthweight (LBW) is a major public health issue resulting in increased neonatal mortality and long-term health complications. Traditional LBW analysis methods, focusing on incidence rates and risk factors through statistical models, often struggle with complex unseen data, and thus, their effectiveness is limited in early prevention of LBW, requiring more advanced LBW prediction models. Therefore, this dissertation delves into this important research area by proposing and examining novel machine learning (ML) and deep learning (DL) algorithms, aiming to predict LBW more accurately during the early stage of pregnancy. This dissertation consists of three studies, strategically designed to build upon …

A Neural Network-Based Method For Analyzing Diffracted Wave Velocity, Tao Junhong, Zhao Jingtao, Sheng Tongjie

Coal Geology & Exploration

Background In seismic imaging, accurate velocity models are crucial for characterizing subsurface structures in a fine-scale manner. Notably, in coal mining, small-scale geological structures like faults and collapse columns are closely associated with mining accidents. These structures typically occur as diffracted waves in seismograms.Objective and Methods To effectively image these small-scale geological bodies, fine-scale velocity modeling using diffracted wave information is particularly important. Hence, this study proposed a neural network-based method for analyzing diffracted-wave velocity. First, diffracted-wave velocity spectra were generated using the gathers of diffracted waves that were separated in the common virtual source domain. Second, a gamma-ray …

Attention-Based Load Forecasting With Bidirectional Finetuning, Firuz Kamalov, Inga Zicmane, Murodbek Safaraliev, Linda Smail, Mihail Senyuk, Pavel Matrenin

All Works

Accurate load forecasting is essential for the efficient and reliable operation of power systems. Traditional models primarily utilize unidirectional data reading, capturing dependencies from past to future. This paper proposes a novel approach that enhances load forecasting accuracy by fine tuning an attention-based model with a bidirectional reading of time-series data. By incorporating both forward and backward temporal dependencies, the model gains a more comprehensive understanding of consumption patterns, leading to improved performance. We present a mathematical framework supporting this approach, demonstrating its potential to reduce forecasting errors and improve robustness. Experimental results on real-world load datasets indicate that our …

A Multimodal Residual Spatial-Temporal Fusion Model Based On Automatic Sleep Classification, Yecai Guo, Shuang Tong

Journal of System Simulation

Abstract: Highly accurate sleep staging plays a crucial role in correctly assessing sleep conditions. Aiming at the problem that the existing convolutional network cannot obtain the topological characteristics of physiological signals, a sleep staging algorithm based on multi-modal residual spatio-temporal fusion is proposed. Time-frequency images and spatio-temporal images are obtained using short-time Fourier transform and adaptive map convolution, which are converted into high-dimensional feature vectors; lightweight interaction of feature information flow is realized through time-frequency feature and spatiotemporal feature extraction modules; the feature enhancement fusion module fuses feature information to outputs sleep staging results. The results show that the model …

Interoperability In Deep Learning: A User Survey And Failure Analysis Of Onnx Model Converters, Purvish Jajal, Wenxin Jiang, Arav Tewari, Erik Kocinare, Joseph Woo, Anusha Sarraf, Yung-Hsiang Lu, George Thiruvathukal, James C. Davis

Computer Science: Faculty Publications and Other Works

Software engineers develop, fine-tune, and deploy deep learning (DL) models using a variety of development frameworks and runtime environments. DL model converters move models between frameworks and to runtime environments. Conversion errors compromise model quality and disrupt deployment. However, the failure characteristics of DL model converters are unknown, adding risk when using DL interoperability technologies. This paper analyzes failures in DL model converters. We survey software engineers about DL interoperability tools, use cases, and pain points (N=92). Then, we characterize failures in model converters associated with the main interoperability tool, ONNX (N=200 issues in PyTorch and TensorFlow). Finally, we formulate …

Two-Dimensional Quantum Material Identification Via Self-Attention And Soft-Labeling In Deep Learning, Xuan Bac Nguyen, Apoorva Bisht, Benjamin Thompson, Hugh O.H. Churchill, Khoa Luu, Samee U. Khan

Electrical Engineering and Computer Science Faculty Publications and Presentations

Detecting two-dimensional (2D) materials in silicon chips presents a significant challenge in the field of quantum machines due to the difficulty of data collection. Specifically, among thousands of flakes, not all flakes are useful or well-annotated, resulting in noisy and hard samples within the dataset, which challenges the deep neural network (DNN) to learn. To address this problem, we propose a novel method for identifying quantum 2D flakes even when there is a high rate of missing annotations in the input images. In particular, we first propose a new mechanism for automatically detecting false negative flakes that are missing annotations. …

Seismic Data Denoising Based On The Convolutional Neural Network With An Attention Mechanism In The Curvelet Domain, Bao Qianzong, Zhou Mei, Qiu Yi

Coal Geology & Exploration

[Objective] Noise in seismic data significantly affects the accurate interpretation of subsurface stratigraphic information. Given that effective signals with pronounced lateral correlations in seismic data are distributed in specific coefficients but random noise typically spreads uniformly over all coefficients in the curvelet domain, more effective separation of signals can be achieved. [Methods] The convolutional neural network based on the attention mechanism can adaptively extract key information by focusing on important features of images. Hence, this study proposed a noise attenuation method for seismic data using a convolutional neural network based on the curvelet transform and attention mechanism (Curvelet-AU-Net). First, the …

A Non-Uniform Interpolation Method For Seismic Data Based On A Diffusion Probabilistic Model, Chen Yao, Yu Siwei, Lin Rongzhi

Coal Geology & Exploration

Objective The non-uniform interpolation of seismic data is identified as a prolonged challenge in energy exploration. Since geophones cannot be precisely placed at positions corresponding to theoretical grid points, current uniform interpolation techniques frequently suffer deviations and detail distortion. Methods This study proposed a novel non-uniform interpolation method based on a diffusion probabilistic model, which is an emerging generative model in deep learning that involves the diffusion and generation processes. In the diffusion process, noise is added to the complete seismic data iteratively to train the denoising capability of the neural network. In the generation process, the neural network is …

A Petrophysical Modeling-Guided Method For Predicting Parameters Of Low-Permeability Reservoirs, Wang Rui, Li Fang, Liu Shiyou, Sun Wanyuan, Li Songling, Huang Sheng

Coal Geology & Exploration

Backgroud Accurately predicting reservoir parameters is significant for characterizing subsurface reservoirs, establishing gas accumulation patterns, releasing production capacity, and understanding fluid migration. The traditional approaches based on core measurement or mathematical-petrophysical modeling are limited by the strong multiplicity of solutions and low accuracy of elastic parameters inversion results, making it difficult to meet the demands of modern exploration.Objective and Methods To more effectively predict reservoir parameters, this study proposed a petrophysical modeling-guided method for predicting parameters of low-permeability reservoirs. With the convolutional neural network (CNN) as a deep learning framework, the proposed method can predict water saturation, clay content, …

Challenges And Practices Of Deep Learning Model Reengineering: A Case Study On Computer Vision, Wenxin Jiang, Vishnu Banna, Naveen Vivek, Abhinav Goel, Nicholas Synovic, George K. Thiruvathukal, James C. Davis

Computer Science: Faculty Publications and Other Works

Many engineering organizations are reimplementing and extending deep neural networks from the research community. We describe this process as deep learning model reengineering. Deep learning model reengineering — reusing, replicating, adapting, and enhancing state-of-the-art deep learning approaches — is challenging for reasons including under-documented reference models, changing requirements, and the cost of implementation and testing.

Deep Learning For Source Localization In A Laboratory Tank, Corey Emerson Dobbs

Theses and Dissertations

Deep learning has been applied to underwater acoustics problems in many forms. One difficulty in applying deep learning techniques to ocean acoustics is the spatially and temporally varying environmental properties. Another challenge is the lack of labeled data for training large networks. The overall goal of this work is to develop deep learning approaches for source localization that can be adaptable to different conditions. In this work, a convolutional neural network was trained on acoustic data measured in a water tank, while the water was at room temperature, to predict source-receiver range. Tests were done to ascertain ideal quantities of …

Malivhu: A Comprehensive Bioinformatics Resource For Filtering Sars And Mers Virus Proteins By Their Classification, Family And Species, And Prediction Of Their Interactions Against Human Proteins, David Guevara-Barrientos, Rakesh Kaundal

Computer Science Student Research

COVID 19 pandemic is still ongoing, having taken more than 6 million human lives with it, and it seems that the world will have to learn how to live with the virus around. In consequence, there is a need to develop different treatments against it, not only with vaccines, but also new medicines. To do this, human-virus protein-protein interactions (PPIs) play a key part in drug-target discovery, but finding them experimentally can be either costly or sometimes unreliable. Therefore, computational methods arose as a powerful alternative to predict these interactions, reducing costs and helping researchers confirm only certain interactions instead …

Groundwater Modeling Of The Ogallala Aquifer: Use Of Machine Learning For Model Parameterization And Sustainability Assessment, Tewodros Aboret Tilahun

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

Addressing groundwater depletion problems in heterogeneous aquifer systems is a challenge. The heterogeneous Ogallala Aquifer, a critical source of groundwater in the central United States, has undergone decades of decline in water levels due to pumping. This project aims to build a robust groundwater model to evaluate optimal scenarios for sustainable use of the groundwater resource within a section of the Ogallala aquifer located in the Middle Republican Natural Resources District (MRNRD). This study follows a comprehensive approach involving parameterization, construction, and optimization. The model is parametrized using hydraulic conductivity and recharge values obtained from a random forest-based machine learning …

Ai-Based Methods For Detecting And Classifying Age-Related Macular Degeneration: A Comprehensive Review, Niveen Nasr El-Den, Mohamed Elsharkawy, Ibrahim Saleh, Mohammed Ghazal, Ashraf Khalil, Mohammad Z. Haq, Ashraf Sewelam, Hani Mahdi, Ayman El-Baz

All Works

This paper explores the advancements and achievements of artificial intelligence (AI) in computer vision (CV), particularly in the context of diagnosing and grading age-related macular degeneration (AMD), one of the most common leading causes of blindness and low vision that impact millions of patients globally. Integrating AI in biomedical engineering and healthcare has significantly enhanced the understanding and development of the CV application to mimic human problem-solving abilities. By leveraging AI-based models, ophthalmologists can improve the accuracy and speed of disease diagnosis, enabling early treatment and mitigating the severity of the conditions. This paper presents a comprehensive analysis of many …

Deep Representation Learning For Time Series Forecasting, Gerald Woo

Dissertations and Theses Collection (Open Access)

Time series forecasting has critical applications across business and scien- tific domains, such as demand forecasting, capacity planning and management, and anomaly detection. Being able to predict the future yields immense value, allowing us to make downstream decisions with more confidence. Deep learning for time series forecasting is a burgeoning area of research, moving away from simple linear models found in classical time series analysis literature, towards more expressive, data hungry neural network architectures.

In this thesis, we develop methods leveraging deep representation learning for time series forecasting, from exploring neural network architecture designs which encode inductive biases specific to …