Physical Sciences and Mathematics Commons^™

Securing The Internet Of Wetland Things (Iowt) Using Machine And Deep Learning Methods: A Survey, Guma Ali, Wamusi Robert, Maad M. Mijwil, Malik Sallam, Jenan Ayad

Mesopotamian Journal of Computer Science

Wetlands are essential ecosystems that provide ecological, hydrological, and economic benefits. However, human activities and climate change are degrading their health and jeopardizing their long-term sustainability. To address these challenges, the Internet of Wetland Things (IoWT) has emerged as an innovative framework integrating advanced sensing, data collection, and communication technologies to monitor and manage wetland ecosystems. Despite its potential, the IoWT faces substantial security and privacy risks, compromising its effectiveness and hindering adoption. This survey explores integrating machine learning (ML) and deep learning (DL) techniques as solutions to address the security threats, vulnerabilities, and challenges inherent in IoWT ecosystems. The …

Don’T Complete It! Preventing Unhelpful Code Completion For Productive And Sustainable Neural Code Completion Systems, Zhensu Sun, Xiaoning Du, Fu Song, Shangwen Wang, Mingze Ni, Li Li, David Lo

Research Collection School Of Computing and Information Systems

Currently, large pre-trained language models are widely applied in neural code completion systems. Though large code models significantly outperform their smaller counterparts, around 70% of displayed code completions from Github Copilot are not accepted by developers. Being reviewed but not accepted, their help to developer productivity is considerably limited and may conversely aggravate the workload of developers, as the code completions are automatically and actively generated in state-of-the-art code completion systems as developers type out once the service is enabled. Even worse, considering the high cost of the large code models, it is a huge waste of computing resources and …

Predicting Real Estate Prices Using Deep Learning Regression Models On Socio Spatial Data, Gentle Engworo

Graduate Theses/Dissertations

ABSTRACT

Cities keep their own kind of ledger. Every block, bus stop, corner store, and year that slips by leaves a small entry about what homes are worth. That ledger is what we call socio-spatial data: simple facts about what a home is (its age), where it sits (latitude/longitude), how easy it is to get around (distance to the nearest MRT station), what’s nearby (number of convenience stores), and when it sold (transaction date). This thesis asks a practical question in that everyday language: given these common clues, can we predict home prices more accurately and explain why? Using 414 …

An Integrated Machine Learning Approach For Identifying Emergency Rescue Messages On Social Media During Natural Disasters, Wael Khallouli, Jiang Li, Jingwei Huang, Ghaith Rabadi, Samuel Kovacic

School of Cybersecurity Faculty Publications

During large-scale disasters, emergency call centers are often overwhelmed by the large volume of rescue requests and calls for help. Consequently, people are turning to social media platforms to seek assistance. Rescue information posted on these platforms is extremely valuable for first responders to make informed rescue decisions. Therefore, the automatic identification of these requests from the vast amount of data posted on social media during crises is critical yet challenging. This work presents our ongoing research on applying deep learning techniques to extract actionable rescue information from social media during crises. We proposed a novel deep learning model that …

Optimizing Ai Language Models: A Study Of Chatgpt-4 Vs. Chatgpt-4o, Md Nurul Absar Siddiky, Muhammad Enayetur Rahman, Md Fayaz Bin Hossen, Muhammad Rezaur Rahman, Md. Shahadat Jaman

Electrical & Computer Engineering Faculty Publications

This paper presents a comparative analysis of OpenAI's GPT-4 and its optimized variant, GPT-4o, focusing on their architectural differences, performance, and real-world applications. GPT-4, built upon the Transformer architecture, has set new standards in natural language processing (NLP) with its capacity to generate coherent and contextually relevant text across a wide range of tasks. However, its computational demands, requiring substantial hardware resources, make it less accessible for smaller organizations and real-time applications. In contrast, GPT-4o addresses these challenges by incorporating optimizations such as model compression, parameter pruning, and memory-efficient computation, allowing it to deliver similar performance with significantly lower computational …

A Fast Framework For Generating Radioactive Mixture Spectra And Its Application To Remote High-Performance Mixture Identification, Chiman Kwan, Bulent Ayhan, Adam Stavola, Kazi Aminul Islam, Hongfang Zhang, Jiang Li

Electrical & Computer Engineering Faculty Publications

Remote detection of radioactive materials in mixtures using handheld or portal detectors remains a challenge because of factors such as low concentration, environmental interference, sensor noise, and other complications. This work introduces a fast framework for generating realistic mixture spectra. Moreover, we present mixture isotope identification using data generated by the fast framework. Researchers have examined a range of conventional and recent algorithms within the fields of machine learning and deep learning. An application to uranium enrichment-level prediction has been included. Extensive simulation experiments validated the efficacy of the proposed framework.

Land Target Detection Algorithm In Remote Sensing Images Based On Deep Learning, Wenyi Hu, Xiaomeng Jiang, Jiawei Tian, Shitong Ye, Shan Liu

Electrical & Computer Engineering Faculty Publications

Remote sensing technology plays a crucial role across various sectors, such as meteorological monitoring, city planning, and natural resource exploration. A critical aspect of remote sensing image analysis is land target detection, which involves identifying and classifying land-based objects within satellite or aerial imagery. However, despite advancements in both traditional detection methods and deep-learning-based approaches, detecting land targets remains challenging, especially when dealing with small and rotated objects that are difficult to distinguish. To address these challenges, this study introduces an enhanced model, YOLOv5s-CACSD, which builds upon the YOLOv5s framework. Our model integrates the channel attention (CA) mechanism, CARAFE, and …

Adaptive Fusion Neural Networks For Sparse-Angle X-Ray 3d Reconstruction, Shaoyong Hong, Bo Yang, Yan Chen, Hao Quan, Shan Liu, Minyi Tang, Jiawei Tian

Electrical & Computer Engineering Faculty Publications

3D medical image reconstruction has significantly enhanced diagnostic accuracy, yet the reliance on densely sampled projection data remains a major limitation in clinical practice. Sparse-angle X-ray imaging, though safer and faster, poses challenges for accurate volumetric reconstruction due to limited spatial information. This study proposes a 3D reconstruction neural network based on adaptive weight fusion (AdapFusionNet) to achieve high-quality 3D medical image reconstruction from sparse-angle X-ray images. To address the issue of spatial inconsistency in multi-angle image reconstruction, an innovative adaptive fusion module was designed to score initial reconstruction results during the inference stage and perform weighted fusion, thereby improving …

Ai-Based Steganography Method To Enhance The Information Security Of Hidden Messages In Digital Images, Nhi Do Ngoc Huynh, Jiajun Jiang, Chung-Hao Chen, Wen-Chao Yang

Electrical & Computer Engineering Faculty Publications

With the increasing sophistication of Artificial Intelligence (AI), traditional digital steganography methods face a growing risk of being detected and compromised. Adversarial attacks, in particular, pose a significant threat to the security and robustness of hidden information. To address these challenges, this paper proposes a novel AI-based steganography framework designed to enhance the security of concealed messages within digital images. Our approach introduces a multi-stage embedding process that utilizes a sequence of encoder models, including a base encoder, a residual encoder, and a dense encoder, to create a more complex and secure hiding environment. To further improve robustness, we integrate …

Symbol-Temporal Consistency Self-Supervised Learning For Robust Time Series Classification, Kevin Garcia, Cassandra Garza, Brooklyn Berry, Yifeng Gao

Computer Science Faculty Publications

The surge in the significance of time series in digital health domains necessitates advanced methodologies for extracting meaningful patterns and representations. Self-supervised contrastive learning has emerged as a promising approach for learning directly from raw data. However, time series data in digital health is known to be highly noisy, inherently involves concept drifting, and poses a challenge for training a generalizable deep learning model. In this paper, we specifically focus on data distribution shift caused by different human behaviors and propose a self-supervised learning framework that is aware of the bag-of-symbol representation. The bag-of-symbol representation is known for its insensitivity …

Machine Learning For Computer-Aided Diagnostics From Complex Medical Images, Afsah Saleem

Theses: Doctorates and Masters

Machine learning has significantly transformed medical image analysis in the current age of artificial intelligence offering vast potential in improving disease diagnosis and management. Cardiovascular diseases (CVDs) are among the leading cause of global mortality, emphasizing the need for early detection for effective intervention and prevention. Abdominal Aortic Calcification (AAC) is an early indicator and contributor to Atherosclerotic Cardiovascular Diseases (ASCVDs) and is commonly assessed through imaging modalities such as computed tomography (CT), X-rays, and Dual-energy X-ray Absorptiometry (DXA). Among these, lateral spine DXA scans, commonly used for osteoporosis screening, offer a cost-effective and low-radiation opportunity for opportunistic CVD risk …

Pushing The Boundaries Of Large Language Models: Innovations And Limitations In Nlp, Finance, And Mathematics, A M Muntasir Rahman

Dissertations

Large Language Models (LLMs) have emerged as transformative tools across a spectrum of domains, yet their practical deployment reveals a blend of remarkable potential and notable limitations. This research explores innovative methodologies to extend the capabilities of LLMs while addressing critical challenges in their evaluation and application. By leveraging rule-based approaches, the in-context learning capabilities of LLMs, and human-in-the-loop validation across three focused studies, this research introduces robust strategies for dataset synthesis, model enhancement, and model assessment in three distinct domains: natural language processing, financial sentiment analysis, and mathematical reasoning

The first study proposes an efficient data augmentation framework, EASE, …

Machine Learning Methods For Pattern Recognition Analysis Of Genomic And Molecular Data, Kuang Du

Dissertations

While immune therapies achieve remarkable success in treating various cancers, only a subset of patients achieves a durable clinical response, and many exhibit innate or acquired resistance. Precision medicine aims to tailor treatments to individual patients based on specific biological markers, ensuring that each patient receives the therapy most likely to be effective. Predictive biomarkers and gene signatures offer potential for more personalized treatment strategies by identifying patients likely to benefit. Recent studies suggest that gene signatures, comprising sets of genes, hold predictive value for certain clinical variables. Typically derived from biological expert knowledge, these signatures demonstrate substantial predictive potential, …

Automated Segmentation Of The Ulnar Nerve In Mri Using Deep Learning Techniques, Akhil Nagulapalli

Theses

Cubital Tunnel Syndrome (CuTS), a condition caused by compression of the ulnar nerve, results in numbness, tingling, pain, and even muscle atrophy, affecting fine motor skills and diminishing patient quality of life. Accurate diagnosis of CuTS is challenging, as current diagnostic methods—including clinical exams, nerve conduction studies, and unaided MRI—often lack the precision to reliably identify the nerve and detect compression in its early stages. Deep learning-based segmentation offers a promising solution, enabling precise and automated identification of nerve structures in MRI images, which could significantly improve diagnostic accuracy and support timely intervention.

A novel deep learning model for segmenting …

Predicted Water Yield Of Open-Pit Metal Mines Based On A Bi-Rnn And Gms Coupling Model, Zhao Yuxing, Li Xiangwen

Coal Geology & Exploration

Objective Accurately predicting water yield of mine before mining can provide directive guidance for preventing potential water hazards and ensuring safe production. Methods To enhance the prediction accuracy and stability of water yield of open-pit metal mines, for which atmospheric precipitation acts as the primary recharge source of water, this study developed a prediction model that coupled a bidirectional recurrent neural network (Bi-RNN) and the Groundwater Modeling System (GMS) software. Specifically, based on historical forecasted precipitation data provided by the Global Forecast System (GFS), the fluctuation pattern of differences between predicted forecasted and actual precipitation was analyzed. After being corrected …

Not All Samples Are Created Equal: Task-Aware Informative Sampling And Adaptive Inference For Efficient Edge Ai, Rebati Gaire

School of Computing: Dissertations, Theses, and Student Research

The rapid proliferation of Internet of Things (IoT) devices has resulted in an unprecedented influx of data generated at the edge by billions of sensors. Traditional approaches relying on cloud-based processing are increasingly inadequate due to constraints in bandwidth, latency, and privacy. Edge computing has emerged as a transformative paradigm, enabling real-time data processing and decision-making by decentralizing computation to the edge. While the integration of deep learning into edge environments—termed edge intelligence—promises autonomous and personalized operations, it is hindered by challenges such as limited computational resources, energy constraints, and data redundancies.

This thesis addresses these challenges by presenting three …

Variable Selection In Distance Metric Learning And Triplet Constraints For Deep Learning Based Ordinal Classification, James D. Clothier

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

The purpose of this research is to augment linear and kernelized ordinal distance metric learning (L/KODML) techniques with a proposed variable selection methodology that integrates the Sequential Multi-Response Feature Selection (SMuRFS) algorithm. Additionally, we aim to embed ordinal triplet constraints into a deep learning architecture, and to propose a general framework for deep learning-based ordinal classification. A variety of simulation studies and real data experiments were conducted to evaluate the various methodologies. For the distance metric learning and variable selection, results showed that the integration of SMuRFS performed effective variable selection and improved prediction accuracy. For the triplet constraints, incorporating …

Adan: Adaptive Nesterov Momentum Algorithm For Faster Optimizing Deep Models, Xingyu Xie, Pan Zhou, Huan Li, Zhouchen Lin, Shuicheng Yan

Research Collection School Of Computing and Information Systems

In deep learning, different kinds of deep networks typically need different optimizers, which have to be chosen after multiple trials, making the training process inefficient. To relieve this issue and consistently improve the model training speed across deep networks, we propose the ADAptive Nesterov momentum algorithm, Adan for short. Adan first reformulates the vanilla Nesterov acceleration to develop a new Nesterov momentum estimation (NME) method, which avoids the extra overhead of computing gradient at the extrapolation point. Then Adan adopts NME to estimate the gradient's first- and second-order moments in adaptive gradient algorithms for convergence acceleration. Besides, we prove that …

Sustainable Energysense: A Predictive Machine Learning Framework For Optimizing Residential Electricity Consumption, Murad Al-Rajab, Samia Loucif

All Works

In a world where electricity is often taken for granted, the surge in consumption poses significant challenges, including elevated CO2 emissions and rising prices. These issues not only impact consumers but also have broader implications for the global environment. This paper endeavors to propose a smart application dedicated to optimizing the electricity consumption of household appliances. It employs Augmented Reality (AR) technology along with YOLO to detect electrical appliances and provide detailed electricity consumption insights, such as displaying the appliance consumption rate and computing the total electricity consumption based on the number of hours the appliance was used. The application …

Dual-Channel Side Channel Attack: Improved Aes Key Decryption By Combining Power And Electromagnetic Side Channels With Convolutional Neural Networks, Sean P. O'Neill

Theses and Dissertations

This research introduces a novel DL approach for SCA that combines power consumption and EM signals to enhance encryption key deduction by leveraging a dual-channel CNN architecture. A new dataset, consisting of simultaneous power and EM signal collections during 128-bitAES encryption, was developed to train and evaluate the model’s effectiveness. The combined approach achieved an 88% reduction in traces needed, from 50 traces to 6, for encryption key classification, outperforming traditional methods such as random forest, DPA, DEMA,and individual side channel CNN models. These findings highlight the potential of integrating multiple side channels in SCA to improve performance without the …

Decoding Neural Networks: An Information-Theoretic Guide To Interpretability, Error Analysis And Efficiency, Mackenzie J. Meni

Theses and Dissertations

This dissertation addresses critical challenges in neural network design by leveraging entropy-based techniques to improve model efficiency, interpretability, and bias reduction. Focusing on the unique demands of computer vision applications, particularly object detection and classification for real-time systems, this work introduces a series of innovative methods centered on information theory. At the core of these methods is the Probabilistic Explanations of Entropic Knowledge (PEEK) framework, a tool developed to analyze and visualize entropy distributions across feature maps. PEEK offers insights into information flow within neural networks, making it possible to pinpoint layers that contribute meaningfully to decision-making or identify those …

Domain-Specific Machine Learning Approaches For Geospatial Problems, Shine Bedi

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

This dissertation explores novel algorithms for complex geospatial problems at the intersection of environmental, social, and computational sciences. Emphasizing the unique challenges of the geospatial domain, particularly the deviation from the independent and identical distribution (IID) assumption, the research spans various methodologies across different domains, demonstrating the benefits of specialized approaches in spatial analysis.

First, we show that machine learning techniques can be effectively used in environmental modeling, which often has severe class imbalance challenges. Using artificial neural networks (ANN), support vector machines (SVM), and extreme gradient boosting (XGB) and techniques to address class imbalance provides insights into groundwater quality …

Developing Linguistic Patterns To Mitigate Inherent Human Bias In Offensive Language Detection, Toygar Tanyel, Besher Alkurdi, Serkan Ayvaz

Turkish Journal of Electrical Engineering and Computer Sciences

With the proliferation of social media, there has been a sharp increase in offensive content, particularly targeting vulnerable groups, exacerbating social problems such as hatred, racism, and sexism. Detecting offensive language use is crucial to prevent offensive language from being widely shared on social media. However, the accurate detection of irony, implication, and various forms of hate speech on social media remains a challenge. Natural language-based deep learning models require extensive training with large, comprehensive, and labeled datasets. Unfortunately, manually creating such datasets is both costly and error-prone. Additionally, the presence of human-bias in offensive language datasets is a major …

Fine And Intelligent Interpretation Of Key Geological Structures In The Metal Metallogenesis Of Coal Measures, Yang Yi, Zhao Jingtao, Li Wenyu, Shi Suzhen

Coal Geology & Exploration

Objective In order to identify the key geological structures in the metallogenic process of coal measures metal deposits, the Linxing block of Ordos Basin was taken as the research object. Based on the previous research results, geological data of the block, seismic and logging data, a geological model including tectonic volcanic activities and other events was constructed to analyze the key geological factors of deposit formation. Methods Firstly, based on the post-stack seismic data, the diffraction wave separation and imaging are realized by using the plane wave destruction filter technology, and the small-scale key geological information is extracted. Secondly, the …

Acoustic Velocity Inversion Based On Convolutional Autoencoder Embedded With Fourier Neural Operator, Li Chen, Zhao Haixia, Bai Zhaowei, Hao Yufan

Coal Geology & Exploration

Background Seismic wave inversion serves as an effective method for obtaining the characteristics of structures, lithology, and physical properties of subsurface media using the arrival times, amplitude, and waveforms of seismic waves. Seismic inversion methods based on wave equations iteratively update model parameters using forward modeling. This generally involves extensive numerical simulations and optimization calculations, requiring large quantities of computational resources and time. In recent years, neural operators for deep learning, represented by the Fourier neural operator (FNO), have gained widespread attention. However, the original FNO structure fails to effectively learn the wavefield information with sharp changes in geological structures …

Intelligent Noise Suppression For 3d Post-Stack Seismic Data Of The Junggar Basin, Mao Haibo, Zhou Xin, Li Xiaofeng, Pan Long, Lin Juan, Liu Dawei, Wang Xiaokai

Coal Geology & Exploration

Objective The Junggar Basin is recognized as a significant petroliferous basin in China, and its hydrocarbon exploration targets have shifted to deeper strata. However, the 3D seismic data of this basin suffer from low signal-to-noise ratios (SNRs) and high data volumes due to the basin's complex near-surface conditions, the great depths of exploration targets, and seismic data acquisition methods characterized by wide azimuths, broadbands, and high density. This complicates the identification of hydrocarbon exploration targets, rendering the improvement in the quality of the 3D seismic data by noise suppression vitally important. Methods The progress in the deep learning theory and …

Transient Electromagnetic Numerical Simulation Based On The Transformer Neural Network, Wang Yunhong

Coal Geology & Exploration

Objective The deep learning-based transient electromagnetic (TEM) forward and inverse modeling methods are data-driven, requiring considerable numerical simulation results as supervisory data to train and assess neural networks. The conventional finite-difference time-domain (FDTD) method for TEM numerical simulation necessitates an iterative solution of time-domain Maxwell's equations. Therefore, this method is time-consuming and computationally intensive, failing to meet the data demand of deep learning-based TEM inversion. Methods This study introduced deep learning for TEM numerical simulation. Based on the transformer neural network architecture, a neural network for deep learning-based TEM numerical simulation was designed using an encoder-decoder structure. This neural network …

An Intelligent Identifying-While-Drilling Method For Geological Features Of Roof Strata In Coal Roadways Based On A 1dcnn-Bilstm-Cbam Model, Lei Zhiyong, Wang Jiawen, Fan Dong, Lu Feifei, Chen Weiming

Coal Geology & Exploration

Objective Most roof accidents in coal roadways occur in potential caving zones such as primary fissure-bearing zones and rock fracture zones. A significant approach to preventing roof accidents is to understand the geological features of roof strata in an accurate and timely manner and optimize support schemes and parameters of roofs. However, current methods for identifying the geological features of roof strata in roadways suffer from issues such as slow identification speeds, low efficiency, and high costs, thus failing to meet the demand for safe, efficient, and intelligent coal mining. Methods This study proposed a neural network model based on …

Designing Customized Loss Functions For Training Deep Neural Networks, Ali Pourramezan Fard

Electronic Theses and Dissertations

This dissertation explores the critical role of loss functions in enhancing the predictive performance of deep machine learning models. Loss functions are an integral element of all the ongoing advances we witness daily in this domain. I design custom loss functions and their impacts on various machine learning tasks, particularly in computer vision.

In the first stage of my research, I aim to improve the prediction performance of deep learning models by providing them with more precise feedback associated with task requirements. This led me to create the concept of assistive loss functions. My first proposed loss function, inspired by …

Strategies To Alleviate Flickering: Bayesian And Smoothing Methods For Deep Learning Classification In Video, Noah Miller, Glen Ryan Drumm, Lance Champagne, Bruce A. Cox, Trevor Bihl

Faculty Publications

Excerpt: Increasing reliance on autonomous systems requires confidence in the accuracies produced from computer vision classification algorithms. Computer vision (CV) for video classification provides phenomenal abilities, but it often suffers from “flickering” of results. Flickering occurs when the CV algorithm switches between declared classes over successive frames. Such behavior causes a loss of trust and confidence in their operations.