Computer Sciences Commons^™

Ai-Based Steganography Method To Enhance The Information Security Of Hidden Messages In Digital Images, Nhi Do Ngoc Huynh, Jiajun Jiang, Chung-Hao Chen, Wen-Chao Yang

Electrical & Computer Engineering Faculty Publications

With the increasing sophistication of Artificial Intelligence (AI), traditional digital steganography methods face a growing risk of being detected and compromised. Adversarial attacks, in particular, pose a significant threat to the security and robustness of hidden information. To address these challenges, this paper proposes a novel AI-based steganography framework designed to enhance the security of concealed messages within digital images. Our approach introduces a multi-stage embedding process that utilizes a sequence of encoder models, including a base encoder, a residual encoder, and a dense encoder, to create a more complex and secure hiding environment. To further improve robustness, we integrate …

Don’T Complete It! Preventing Unhelpful Code Completion For Productive And Sustainable Neural Code Completion Systems, Zhensu Sun, Xiaoning Du, Fu Song, Shangwen Wang, Mingze Ni, Li Li, David Lo

Research Collection School Of Computing and Information Systems

Currently, large pre-trained language models are widely applied in neural code completion systems. Though large code models significantly outperform their smaller counterparts, around 70% of displayed code completions from Github Copilot are not accepted by developers. Being reviewed but not accepted, their help to developer productivity is considerably limited and may conversely aggravate the workload of developers, as the code completions are automatically and actively generated in state-of-the-art code completion systems as developers type out once the service is enabled. Even worse, considering the high cost of the large code models, it is a huge waste of computing resources and …

Land Target Detection Algorithm In Remote Sensing Images Based On Deep Learning, Wenyi Hu, Xiaomeng Jiang, Jiawei Tian, Shitong Ye, Shan Liu

Electrical & Computer Engineering Faculty Publications

Remote sensing technology plays a crucial role across various sectors, such as meteorological monitoring, city planning, and natural resource exploration. A critical aspect of remote sensing image analysis is land target detection, which involves identifying and classifying land-based objects within satellite or aerial imagery. However, despite advancements in both traditional detection methods and deep-learning-based approaches, detecting land targets remains challenging, especially when dealing with small and rotated objects that are difficult to distinguish. To address these challenges, this study introduces an enhanced model, YOLOv5s-CACSD, which builds upon the YOLOv5s framework. Our model integrates the channel attention (CA) mechanism, CARAFE, and …

Gramseq-Dta: A Grammar-Based Drug-Target Affinity Prediction Approach Fusing Gene Expression Information, Kasul Debnath, Pratip Rana, Preetam Ghosh

Computer Science Faculty Publications

Drug–target affinity (DTA) prediction is a critical aspect of drug discovery. The meaningful representation of drugs and targets is crucial for accurate prediction. Using 1D string-based representations for drugs and targets is a common approach that has demonstrated good results in drug–target affinity prediction. However, these approach lacks information on the relative position of the atoms and bonds. To address this limitation, graph-based representations have been used to some extent. However, solely considering the structural aspect of drugs and targets may be insufficient for accurate DTA prediction. Integrating the functional aspect of these drugs at the genetic level can enhance …

Multi-Modal Mri Based Segmentation Of Brain Metastases Using Adaptive Self-Attention, Evan Savaria

Computer Science Faculty Publications

Brain metastases (BMs) are the most common adult central nervous system malignancy, affecting 20–40% of cancer patients. Accurate segmentation of metastatic lesions in multi-modal MRI is essential for treatment planning and prognosis however, manual delineation is time consuming and prone to variability. Traditional deep learning models such as U-Net, have improved segmentation accuracy but capture limited long-range dependencies and struggle with variations in metastasis size, shape, and distribution. This study introduces the Adaptive Integrated Multi-modal Segmentation (AIMS) model, an adaptive self-attention framework within a hybrid U-Net and Transformer architecture to enhance BM segmentation by leveraging multi-modal MRI integration. The proposed …

A Survey On Deep Learning For Drug-Target Binding Prediction: Models, Benchmarks, Evaluation, And Case Studies, Kusal Debnath, Pratip Rana, Preetam Ghosh

Computer Science Faculty Publications

Conventional drug discovery is expensive, time-consuming, and prone to failure. Artificial intelligence has become a potent substitute over the last decade, providing strong answers to challenging biological issues in this field. Among these difficulties, drug-target binding (DTB) is a key component of drug discovery techniques. In this context, drug-target affinity and drug–target interaction are complementary and essential frameworks that work together to improve our comprehension of DTB dynamics. In this work, we thoroughly analyze the most recent deep learning models, popular benchmark datasets, and assessment metrics for DTB prediction. We look at the paradigm shift in the development of drug …

Benchmarking And Improving Foundation Model Dietary Estimates From Meal Images, Yongcheng Mu, Jiangwen Sun, Jing He

Computer Science Faculty Publications

Accurate quantifying dietary contents, such as calories, proteins, carbohydrates, and fats, from an image of a meal plate is vital for managing diabetes. Recently, Large Multimodal Models (LMMs) have excelled in complex vision-language tasks due to their use of very large, highly diverse data. This study benchmarked the use of seven LMMs that include full and lightweight models of GPT, Gemini, and Llama for nutrition estimation based on Google's Nutrition5k dataset and our own phone-collected DonateAndLearn dataset. We analyzed the performance of LMMs and the RGB-D fusion model, in which the RGB-D model was specifically trained using Nutrition5k data. On …

Deepssetracer 2.0: Improved Deep Learning Model Performance For Protein Secondary Structure Segmentation From Cryo-Em Maps, Bryan Hawickhorst, Thu Nguyen, Willy Wriggers, Jiangwen Sun, Jing He

Computer Science Faculty Publications

DeepSSETracer is a method for segmenting protein secondary structure from medium-resolution (5-10Å) cryogenic electron microscopy (cryo-EM) density maps. We conducted experiments and ablation studies to examine the effects of normalization methods, max-pooling, activation functions, and loss calculation region on DeepSSETracer. By combining multiple technical improvements, the performance of the new version, DeepSSETracer 2.0, was significantly enhanced compared to DeepSSETracer 1.1. On a set of 77 test cases, the weighted average per-voxel F1 score increased from 62.1% to 70.3% for helix detection, and from 47.8% to 62.5% for β-sheet detection. While each of the five modifications in the network enhanced the …

Pushing The Boundaries Of Large Language Models: Innovations And Limitations In Nlp, Finance, And Mathematics, A M Muntasir Rahman

Dissertations

Large Language Models (LLMs) have emerged as transformative tools across a spectrum of domains, yet their practical deployment reveals a blend of remarkable potential and notable limitations. This research explores innovative methodologies to extend the capabilities of LLMs while addressing critical challenges in their evaluation and application. By leveraging rule-based approaches, the in-context learning capabilities of LLMs, and human-in-the-loop validation across three focused studies, this research introduces robust strategies for dataset synthesis, model enhancement, and model assessment in three distinct domains: natural language processing, financial sentiment analysis, and mathematical reasoning

The first study proposes an efficient data augmentation framework, EASE, …

Machine Learning Methods For Pattern Recognition Analysis Of Genomic And Molecular Data, Kuang Du

Dissertations

While immune therapies achieve remarkable success in treating various cancers, only a subset of patients achieves a durable clinical response, and many exhibit innate or acquired resistance. Precision medicine aims to tailor treatments to individual patients based on specific biological markers, ensuring that each patient receives the therapy most likely to be effective. Predictive biomarkers and gene signatures offer potential for more personalized treatment strategies by identifying patients likely to benefit. Recent studies suggest that gene signatures, comprising sets of genes, hold predictive value for certain clinical variables. Typically derived from biological expert knowledge, these signatures demonstrate substantial predictive potential, …

Automated Segmentation Of The Ulnar Nerve In Mri Using Deep Learning Techniques, Akhil Nagulapalli

Theses

Cubital Tunnel Syndrome (CuTS), a condition caused by compression of the ulnar nerve, results in numbness, tingling, pain, and even muscle atrophy, affecting fine motor skills and diminishing patient quality of life. Accurate diagnosis of CuTS is challenging, as current diagnostic methods—including clinical exams, nerve conduction studies, and unaided MRI—often lack the precision to reliably identify the nerve and detect compression in its early stages. Deep learning-based segmentation offers a promising solution, enabling precise and automated identification of nerve structures in MRI images, which could significantly improve diagnostic accuracy and support timely intervention.

A novel deep learning model for segmenting …

Artificial Intelligence In Fetal And Pediatric Echocardiography, Alan Wang, Tam T Doan, Charitha Reddy, Pei-Ni Jone

Faculty, Staff and Students Publications

Echocardiography is the main modality in diagnosing acquired and congenital heart disease (CHD) in fetal and pediatric patients. However, operator variability, complex image interpretation, and lack of experienced sonographers and cardiologists in certain regions are the main limitations existing in fetal and pediatric echocardiography. Advances in artificial intelligence (AI), including machine learning (ML) and deep learning (DL), offer significant potential to overcome these challenges by automating image acquisition, image segmentation, CHD detection, and measurements. Despite these promising advancements, challenges such as small number of datasets, algorithm transparency, physician comfort with AI, and accessibility must be addressed to fully integrate AI …

Dual-Channel Side Channel Attack: Improved Aes Key Decryption By Combining Power And Electromagnetic Side Channels With Convolutional Neural Networks, Sean P. O'Neill

Theses and Dissertations

This research introduces a novel DL approach for SCA that combines power consumption and EM signals to enhance encryption key deduction by leveraging a dual-channel CNN architecture. A new dataset, consisting of simultaneous power and EM signal collections during 128-bitAES encryption, was developed to train and evaluate the model’s effectiveness. The combined approach achieved an 88% reduction in traces needed, from 50 traces to 6, for encryption key classification, outperforming traditional methods such as random forest, DPA, DEMA,and individual side channel CNN models. These findings highlight the potential of integrating multiple side channels in SCA to improve performance without the …

Not All Samples Are Created Equal: Task-Aware Informative Sampling And Adaptive Inference For Efficient Edge Ai, Rebati Gaire

School of Computing: Dissertations, Theses, and Student Research

The rapid proliferation of Internet of Things (IoT) devices has resulted in an unprecedented influx of data generated at the edge by billions of sensors. Traditional approaches relying on cloud-based processing are increasingly inadequate due to constraints in bandwidth, latency, and privacy. Edge computing has emerged as a transformative paradigm, enabling real-time data processing and decision-making by decentralizing computation to the edge. While the integration of deep learning into edge environments—termed edge intelligence—promises autonomous and personalized operations, it is hindered by challenges such as limited computational resources, energy constraints, and data redundancies.

This thesis addresses these challenges by presenting three …

Adan: Adaptive Nesterov Momentum Algorithm For Faster Optimizing Deep Models, Xingyu Xie, Pan Zhou, Huan Li, Zhouchen Lin, Shuicheng Yan

Research Collection School Of Computing and Information Systems

In deep learning, different kinds of deep networks typically need different optimizers, which have to be chosen after multiple trials, making the training process inefficient. To relieve this issue and consistently improve the model training speed across deep networks, we propose the ADAptive Nesterov momentum algorithm, Adan for short. Adan first reformulates the vanilla Nesterov acceleration to develop a new Nesterov momentum estimation (NME) method, which avoids the extra overhead of computing gradient at the extrapolation point. Then Adan adopts NME to estimate the gradient's first- and second-order moments in adaptive gradient algorithms for convergence acceleration. Besides, we prove that …

Domain-Specific Machine Learning Approaches For Geospatial Problems, Shine Bedi

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

This dissertation explores novel algorithms for complex geospatial problems at the intersection of environmental, social, and computational sciences. Emphasizing the unique challenges of the geospatial domain, particularly the deviation from the independent and identical distribution (IID) assumption, the research spans various methodologies across different domains, demonstrating the benefits of specialized approaches in spatial analysis.

First, we show that machine learning techniques can be effectively used in environmental modeling, which often has severe class imbalance challenges. Using artificial neural networks (ANN), support vector machines (SVM), and extreme gradient boosting (XGB) and techniques to address class imbalance provides insights into groundwater quality …

Sustainable Energysense: A Predictive Machine Learning Framework For Optimizing Residential Electricity Consumption, Murad Al-Rajab, Samia Loucif

All Works

In a world where electricity is often taken for granted, the surge in consumption poses significant challenges, including elevated CO2 emissions and rising prices. These issues not only impact consumers but also have broader implications for the global environment. This paper endeavors to propose a smart application dedicated to optimizing the electricity consumption of household appliances. It employs Augmented Reality (AR) technology along with YOLO to detect electrical appliances and provide detailed electricity consumption insights, such as displaying the appliance consumption rate and computing the total electricity consumption based on the number of hours the appliance was used. The application …

Decoding Neural Networks: An Information-Theoretic Guide To Interpretability, Error Analysis And Efficiency, Mackenzie J. Meni

Theses and Dissertations

This dissertation addresses critical challenges in neural network design by leveraging entropy-based techniques to improve model efficiency, interpretability, and bias reduction. Focusing on the unique demands of computer vision applications, particularly object detection and classification for real-time systems, this work introduces a series of innovative methods centered on information theory. At the core of these methods is the Probabilistic Explanations of Entropic Knowledge (PEEK) framework, a tool developed to analyze and visualize entropy distributions across feature maps. PEEK offers insights into information flow within neural networks, making it possible to pinpoint layers that contribute meaningfully to decision-making or identify those …

Developing Linguistic Patterns To Mitigate Inherent Human Bias In Offensive Language Detection, Toygar Tanyel, Besher Alkurdi, Serkan Ayvaz

Turkish Journal of Electrical Engineering and Computer Sciences

With the proliferation of social media, there has been a sharp increase in offensive content, particularly targeting vulnerable groups, exacerbating social problems such as hatred, racism, and sexism. Detecting offensive language use is crucial to prevent offensive language from being widely shared on social media. However, the accurate detection of irony, implication, and various forms of hate speech on social media remains a challenge. Natural language-based deep learning models require extensive training with large, comprehensive, and labeled datasets. Unfortunately, manually creating such datasets is both costly and error-prone. Additionally, the presence of human-bias in offensive language datasets is a major …

Designing Customized Loss Functions For Training Deep Neural Networks, Ali Pourramezan Fard

Electronic Theses and Dissertations

This dissertation explores the critical role of loss functions in enhancing the predictive performance of deep machine learning models. Loss functions are an integral element of all the ongoing advances we witness daily in this domain. I design custom loss functions and their impacts on various machine learning tasks, particularly in computer vision.

In the first stage of my research, I aim to improve the prediction performance of deep learning models by providing them with more precise feedback associated with task requirements. This led me to create the concept of assistive loss functions. My first proposed loss function, inspired by …

Strategies To Alleviate Flickering: Bayesian And Smoothing Methods For Deep Learning Classification In Video, Noah Miller, Glen Ryan Drumm, Lance Champagne, Bruce A. Cox, Trevor Bihl

Faculty Publications

Excerpt: Increasing reliance on autonomous systems requires confidence in the accuracies produced from computer vision classification algorithms. Computer vision (CV) for video classification provides phenomenal abilities, but it often suffers from “flickering” of results. Flickering occurs when the CV algorithm switches between declared classes over successive frames. Such behavior causes a loss of trust and confidence in their operations.

Predicting And Monitoring Immune Checkpoint Inhibitor Therapy Using Artificial Intelligence In Pancreatic Cancer, Guangbo Yu, Zigeng Zhang, Aydin Eresen, Qiaoming Hou, Farideh Amirrad, Sha Webster, Surya M. Nauli, Vahid Yaghmai, Zhuoli Zhang

Pharmacy Faculty Articles and Research

Pancreatic cancer remains one of the most lethal cancers, primarily due to its late diagnosis and limited treatment options. This review examines the challenges and potential of using immunotherapy to treat pancreatic cancer, highlighting the role of artificial intelligence (AI) as a promising tool to enhance early detection and monitor the effectiveness of these therapies. By synthesizing recent advancements and identifying gaps in the current research, this review aims to provide a comprehensive overview of how AI and immunotherapy can be integrated to develop more personalized and effective treatment strategies. The insights from this review may guide future research efforts …

Collectively Advancing Deep Learning For Animal Detection In Drone Imagery: Successes, Challenges, And Research Gaps, Daniel Axford, Ferdous Sohel, Mathew A. Vanderklift, Amanda J. Hodgson

Research outputs 2022 to 2026

Drones have emerged as a powerful tool in animal detection, significantly advancing wildlife monitoring, conservation, and management by capturing high-resolution, real-time imagery over areas often inaccessible or challenging for human observers to reach. However, manual analysis of drone imagery for animal detection is labour-intensive and time-consuming. The application of deep learning methods, particularly convolutional neural networks, in automating animal detection from drone imagery has the potential to revolutionise wildlife monitoring, conservation, and management protocols. This review provides a comprehensive overview of the increasing use and prospects of deep learning in animal detection using drone imagery. It explores successful applications of …

Early Detection And Categorization Of Cervical Cancer Cells Using Smoothing Cross Entropy-Based Multi-Deep Transfer Learning, Rania Ahmed, Nadia Dahmani, Ghada Dahy, Ashraf Darwish, Aboul Ella Hassanien

All Works

Cervical cancer is one of the leading causes of death in women worldwide. Prompt and accurate diagnosis is imperative for the treatment of cervical cancer through the utilization of pap smear slides, albeit it is a multifaceted and time-intensive process. An automatic diagnosis model based on deep learning models, particularly a convolutional neural network (CNN), can enhance cervical cancer's accuracy and rapid identification. This paper proposes a cross entropy-based multi-deep transfer learning model for the early detection and categorization of cervical cancer cells. The proposed model consists of four phases: the pre-processing phase, the feature extraction and fusion phase, the …

Search Technology For Aircraft Debris Integrating Data Augmentation And Deep Learning Algorithm, Zhe Yang, Yinghan Cui, Lingxi Guo, Jiaxin Li, Xusheng Wu

Journal of System Simulation

Abstract: The reliable recovery of aircraft debris is of great significance for the complete acquisition of flight test data and the subsequent research and development of models. To ensure the safety of flight tests,the landing area of aircraft experiments is generally an unmanned area,and the actual landing point of the aircraft often deviates from the theoretical landing point. The characteristics of the debris target are complex and the dispersion area is large, making it difficult to search for aircraft debris solely by manpower. Aiming at the difficult problem of aircraft debris recovery in the landing area, through on UAV platforms …

Using Machine Learning And Deep Learning Algorithms To Improve Low Birthweight Prediction, Yang Ren

Theses and Dissertations

Low birthweight (LBW) is a major public health issue resulting in increased neonatal mortality and long-term health complications. Traditional LBW analysis methods, focusing on incidence rates and risk factors through statistical models, often struggle with complex unseen data, and thus, their effectiveness is limited in early prevention of LBW, requiring more advanced LBW prediction models. Therefore, this dissertation delves into this important research area by proposing and examining novel machine learning (ML) and deep learning (DL) algorithms, aiming to predict LBW more accurately during the early stage of pregnancy. This dissertation consists of three studies, strategically designed to build upon …

Risurconv : Rotation Invariant Surface Attention-Augmented Convolutions For 3d Point Cloud Classification And Segmentation, Zhiyuan Zhang, Licheng Yang, Xiang Zhiyu

Research Collection School Of Computing and Information Systems

Despite the progress on 3D point cloud deep learning, most prior works focus on learning features that are invariant to translation and point permutation, and very limited efforts have been devoted for rotation invariant property. Several recent studies achieve rotation invariance at the cost of lower accuracies. In this work, we close this gap by proposing a novel yet effective rotation invariant architecture for 3D point cloud classification and segmentation. Instead of traditional pointwise operations, we construct local triangle surfaces to capture more detailed surface structure, based on which we can extract highly expressive rotation invariant surface properties which are …

Attention-Based Load Forecasting With Bidirectional Finetuning, Firuz Kamalov, Inga Zicmane, Murodbek Safaraliev, Linda Smail, Mihail Senyuk, Pavel Matrenin

All Works

Accurate load forecasting is essential for the efficient and reliable operation of power systems. Traditional models primarily utilize unidirectional data reading, capturing dependencies from past to future. This paper proposes a novel approach that enhances load forecasting accuracy by fine tuning an attention-based model with a bidirectional reading of time-series data. By incorporating both forward and backward temporal dependencies, the model gains a more comprehensive understanding of consumption patterns, leading to improved performance. We present a mathematical framework supporting this approach, demonstrating its potential to reduce forecasting errors and improve robustness. Experimental results on real-world load datasets indicate that our …

A Multimodal Residual Spatial-Temporal Fusion Model Based On Automatic Sleep Classification, Yecai Guo, Shuang Tong

Journal of System Simulation

Abstract: Highly accurate sleep staging plays a crucial role in correctly assessing sleep conditions. Aiming at the problem that the existing convolutional network cannot obtain the topological characteristics of physiological signals, a sleep staging algorithm based on multi-modal residual spatio-temporal fusion is proposed. Time-frequency images and spatio-temporal images are obtained using short-time Fourier transform and adaptive map convolution, which are converted into high-dimensional feature vectors; lightweight interaction of feature information flow is realized through time-frequency feature and spatiotemporal feature extraction modules; the feature enhancement fusion module fuses feature information to outputs sleep staging results. The results show that the model …

Interoperability In Deep Learning: A User Survey And Failure Analysis Of Onnx Model Converters, Purvish Jajal, Wenxin Jiang, Arav Tewari, Erik Kocinare, Joseph Woo, Anusha Sarraf, Yung-Hsiang Lu, George Thiruvathukal, James C. Davis

Computer Science: Faculty Publications and Other Works

Software engineers develop, fine-tune, and deploy deep learning (DL) models using a variety of development frameworks and runtime environments. DL model converters move models between frameworks and to runtime environments. Conversion errors compromise model quality and disrupt deployment. However, the failure characteristics of DL model converters are unknown, adding risk when using DL interoperability technologies. This paper analyzes failures in DL model converters. We survey software engineers about DL interoperability tools, use cases, and pain points (N=92). Then, we characterize failures in model converters associated with the main interoperability tool, ONNX (N=200 issues in PyTorch and TensorFlow). Finally, we formulate …