Artificial Intelligence and Robotics Commons^™

Keyframe Selection From Motion Capture Data With Dual-Agent Reinforcement Learning, Kun Hu, Wang, Clinton Mo, Mingyang Ma, Shaohui Mei, Zebin Chen, Zhiyong Wang

Research outputs 2022 to 2026

Animation production workflows centered around motion capture techniques require animators to edit motions based on a set of keyframes. However, most existing keyframe selection methods are optimization-based, which suffer from the issues of flexibility and efficiency. In this paper, a novel deep reinforcement learning method with dual agents are proposed for unsupervised keyframe selection. First, an S-Agent and an R-Agent evaluate the actions of selection and refinement, respectively. A deep spatio-temporal network, namely graph keyframe evaluation network (GKEN), is proposed for the agents. Then, an animation specified reward is devised based on reconstruction, which fulfills three important properties of the …

Deep Learning For Video Anomaly Detection: A Review, Peng Wu, Chengyu Pan, Yuting Yan, Guansong Pang, Qingsen Yan, Peng Wang, Yanning Zhang

Research Collection School Of Computing and Information Systems

Video anomaly detection (VAD) aims to discover behaviors or events deviating from the normality in videos. As a long-standing task in the field of computer vision, VAD has witnessed much good progress. In the era of deep learning, with the explosion of architectures of continuously growing capability and capacity, a great variety of deep learning-based methods are constantly emerging for the VAD task, greatly improving the generalization ability of detection algorithms and broadening the application scenarios. Therefore, such a multitude of methods and a large body of literature make a comprehensive survey a pressing necessity. In this article, we present …

Survey On Learning-Based Dynamic Fault Localization: From Traditional Machine Learning To Large Language Models, Chunyan Liu, Yan Lei, Huan Xie, Jinping Wang, Yue Yu, David Lo

Research Collection School Of Computing and Information Systems

Learning-based dynamic fault localization techniques play a crucial role in the field of software engineering. These techniques dynamically execute test cases to meticulously extract useful knowledge from the execution information in the program, with the aim of identifying fault locations by leveraging machine learning, deep learning, and large language models. Currently, there is already a flourishing body of research that is intensely focused on learning-based dynamic fault localization. Research literature can be categorized into two main aspects for learning-based dynamic fault localization: data-based enhancements (i.e., the datasets) and model-based enhancements (i.e., the suspiciousness algorithms). Thus, we conduct an extensive literature …

What Makes A Modern Attention Implementation?, Brian H. Slonim

Master's Theses

Since the seminal assertion by Vaswani et al. in 2017 that “Attention Is All You Need,” transformer models have risen to ubiquity due to their ability to learn extremely complex patterns from sequence data, culminating in the unprecedented generative capabilities of large language models. These models’ strength lies in their scale: hundreds of millions (e.g., BERT-LARGE) to billions or trillions of learned parameters. Running inference with these models, let alone training them, would be intractable without significant innovations in the hardware and software that support them. This need has driven an enormous demand for GPU compute and associated software ecosystems, …

Principles Of Privacy And Security In Artificial Intelligence And Applications, Khang Tran

Dissertations

Modern artificial intelligence (AI) systems have transformed critical domains such as healthcare, software engineering, finance, and the legal system. Despite their broad impact, concerns about trustworthiness, especially regarding privacy and security, remain major obstacles to wider adoption. Addressing these concerns requires both a systematic understanding of the privacy and security risks inherent in AI systems and the development of principled foundations for trustworthy AI that safeguard client privacy and security. This goal is particularly challenging because of the complexity of modern large-scale AI systems, the trade-offs between privacy and model utility, and the need to simultaneously ensure other important properties …

Toward Learning-Based Reconstruction And Part Decomposition Of Man-Made 3d Geometry: Neural Implicit Representations And Scalable Supervision, Shen Fan

Dissertations

Digital three-dimensional (3D) models are central to engineering design, analysis, and manufacturing, but learning pipelines for man-made geometry often operate on sampled carriers that do not preserve all of the structure present in exact CAD representations. This dissertation studies learning-based reconstruction and part decomposition for structured man-made 3D geometry, from general object benchmarks to CAD-derived datasets, with a focus on neural implicit representations trained from signed-distance samples, point clouds, and tessellated meshes. The goal is to make these models more accurate, more part-aware, and more consistently supervised.

First, signed distance function (SDF) reconstruction with implicit neural representations is improved through …

Mri-Based Deep Learning Radiomics Model For Automated Classification Of Disc Degeneration In The Lumbar Spine, Shiv Patil, Om Gandhi, Mert Karabacak, Matthew Carr, Konstantinos Margetis

Student Papers, Posters & Projects

Disc degeneration in the lumbar spine is a major cause of low back pain (LBP). The accurate grading of disc degeneration on magnetic resonance imaging (MRI) is critical for clinical management and patient selection for spine surgery. This study aims to develop and evaluate machine learning (ML) models that combine features from deep learning (DL) and radiomics for the automated prediction of Pfirrmann grade (PG), a measure of disc degeneration, using multi-parametric lumbar spine MRI. Sagittal T1, T2, and T2 SPACE MRIs of 218 patients with LBP were acquired from the SPIDER dataset. For each intervertebral disc and available sequence, …

From Sparse To Precise: Modeling Beam Profiles Using Wavelet-Based Implicit Neural Network (Winn) For Linear Accelerator Commissioning And Quality Assurance, Maryam Ali Albuainin

Computer Science ETDs

Commissioning and routine quality assurance (QA) in radiotherapy require extensive measurements using bulky water tank systems, making the process time-consuming and costly. This research proposes an efficient framework for radiotherapy commissioning and QA by generating complete LINAC physics data from sparse measurements and developing a portable solid-water detector with embedded diodes for high-resolution dosimetry.

At the core of the framework is a Wavelet-based Implicit Neural Network (WINN) that reconstructs full measurement datasets from limited inputs while maintaining clinical accuracy. The model achieves gamma passing rates above 95% (1%/1 mm) and mean absolute errors below 0.5%, while reducing parameters by 99.46% …

A Deep Learning-Based Approach For Bot Detection In Trending Hashtags On X, Mehboob Hussain, Muhammad Rizwan Rashid Rana, Muhammad Imran, Muhammad Shoaib, Muhammad Hasaan Mujtaba

Makara Journal of Technology

The widespread presence of bots on social media platforms, such as X (formerly Twitter), poses a significant threat to the integrity of online information by facilitating the dissemination of misinformation and manipulating public discourse. This study proposes a robust deep learning-based framework, DeepBot, to detect bot participation in trending hashtags and discussions on X. The approach uses a dataset sourced from Kaggle, comprising user profile metadata, including follower count, tweet frequency, account verification status, and engagement metrics. The data were subjected to comprehensive preprocessing, including noise removal, part-of-speech (POS) tagging, and word embedding using the pre-trained GloVe model. RoBERTa is …

Modelling Method Of Unmanned Vehicle Dynamics Based On Neural Network, Jun Wang, Min Liu, Xiaochuan Zhang, Yishan Ding, Juhui Feng, Ye Zhuang

Journal of System Simulation

Abstract: To address the challenges of high data acquisition costs of test data on dynamic characteristics between tires and soft terrain and low speed of numerical calculation for unmanned vehicles in complex terrestrial environments, a modeling method of unmanned vehicle dynamics based on a neural network was proposed. Tire-terrain contact dynamics models were built by using discrete element method (DEM) simulations for tire-terrain contact and experimental data, thereby creating a dataset of tire contact forces for various tire materials in terrestrial environments. The neural network was applied to regressively learn the dataset, and a nonlinear neural network tire model was …

Deep Learning Based Approaches For Low Cost Defense Detection, Adele J. Noel-Rickert

All NMU Master's Theses

Pulmonary fibrosis is a progressive interstitial lung disease characterized by the accumulation of fibrotic tissue within the lungs, leading to impaired respiratory function and reduced quality of life. Early detection is important for disease management; however, accurate diagnosis often relies on high-resolution computed tomography (CT), which may not be accessible in all clinical settings. Chest radiography provides a lower-cost and widely available imaging modality, but interpretation of chest X-rays for fibrotic disease can be challenging due to subtle radiographic patterns and overlapping anatomical structures. This thesis investigates the use of multimodal deep learning techniques to assist in pul- monary fibrosis …

Comparative Analysis Of Mlp And Cnn Models For Cardiac Arrhythmia Classification, Veltman Okey-Ejowhor, Vahid Emamian

Posters - 2026

Electrocardiogram (ECG) is a record of the electric activity of the heart over time. ECG analysis plays a pivotal role in diagnosing critical heart conditions. Significant developments have been made in the realm of deep learning and applied artificial intelligence. These deep learning models have been utilized heavily because of their ability to analyze deep morphological features of each signal. The model architecture used in this study is a convolutional neural network (CNN) combined with a multi-layered perceptron (MLP). The MLP acts as an input filter that classifies normal heartbeat signals from abnormal. The CNN is the second filter in …

Multi-Modal Tensor Fusion For Alzheimer’S Disease Recognition, Mason Li, Tiffany Le, Jiajing Huang, Yuxin Wen

Engineering Faculty Articles and Research

Accurate and early diagnosis of Alzheimer’s disease (AD) is critical for effective intervention, disease monitoring, and patient care. Traditional diagnostic approaches rely on a single modality, such as clinical assessments, neuroimaging, or genetic markers, which may fail to capture the complex, multifaceted nature of AD. Multimodal learning has therefore been explored to integrate complementary information across data sources. However, conventional fusion strategies, including early feature concatenation and late decision-level fusion, often model modalities independently and fail to capture high-order cross-modal interactions. To address these limitations, we propose a multimodal tensor fusion network (MTFN) that integrates heterogeneous data sources, including visual …

Large-Scale File Fragment Classification Via Multi-View Learning, Samuel Hildebrand

LSU Master's Theses

File reassembly is one of the most fundamental tasks in digital forensics, enabling recovery of data from potentially damaged storage media even when file system metadata is unavailable. This thesis reviews more than two decades of work in the realm of file carving, with a particular focus on fragmented file carving, which remains a focus of research, and file fragment classification, a principal component of fragmented file carving. This thesis serves a literature review of both file carving and fragmented file carving, surveys the massive amounts of data needed for the task of fragment classification and the datasets that serve …

Simulation And Multi-Perspective Recognition Algorithm For Typical Trajectory Shapes, Xuejian Feng, Han Ding, Yiqi Tong, Chaoying Huo, Yanjin Zhang

Journal of System Simulation

Abstract: Current trajectory simulation methods inadequately address geometric shape features and kinematic properties of the target trajectory. To bridge this gap, a target trajectory shape simulation algorithm based on kinematic laws was proposed. The polar coordinate equations and curvature equations of multiple trajectories were integrated. The aircraft state parameters were solved by combining kinematic equations. Angular Gaussian noise was introduced to enhance trajectory diversity and authenticity. Additionally, a multi-perspective trajectory shape recognition algorithm was designed, which could effectively integrate image and sequential multi-modal features by adopting a multilayer perceptron, enabling precise trajectory shape recognition. Experimental results demonstrate that the proposed …

Research On Visual Place Recognition Algorithms For Complex Urban Environments, Peijin Liu, Minxin Zhang, Lin He, Yige Sun, Tingqi Su

Journal of System Simulation

Abstract: Dynamic factors such as traffic flow and crowd density in complex urban environments reduce the accuracy of visual place recognition (VPR) algorithms. To solve these problems, a semantic-guided visual place recognition (SG-VPR) algorithm was proposed. A semantic-guided feature suppression module was designed. A semantic-guided module and feature suppression layer were constructed to reduce the dynamic object interference and more accurately extract the key static features. An adaptive triplet margin loss function (ATML) was proposed by improving the traditional triplet margin loss. The margins were adaptively adjusted according to the sample distribution, solving the problem of suboptimal solution convergence …

Hybrid Deep Learning For Anti-Money Laundering: Unsupervised Detection Of Emerging Schemes Via Feature Fusion And Explainable Artificial Intelligence, Cosmas Ochieng Kungu, Kennedy Senagi, Evans Omondi

All Peer-Reviewed Publications

Traditional rule-based anti-money laundering (AML) transaction monitoring systems suffer from high false-positive rates and rigidity in detecting complex emerging risk. This limitation has prompted changes to the Financial Action Task Force (FATF) recommendation 16, mandating the use of advanced systems for detecting money laundering schemes in cross-border payments. This study developed a hybrid framework integrating VAE-learned behavioural latent factors, GNN-captured relational network signals, and rule-based heuristics for enhanced anomaly detection. The model was evaluated on 54,258 real-world cross-border transaction records from an East African commercial bank. The One-Class SVM, optimised via a rigorous grid search proved superior compared to Isolation …

Deep Learning Approaches For Anti-Money Laundering On Mobile Transactions: Review, Framework, And Directions, Jiani Fan, Lwin Khin Shar, Ruichen Zhang, Ziyao Liu, Wenzhuo Yang, Dusit Niyato, Kwok-Yan Lam

Research Collection School Of Computing and Information Systems

Money laundering is a financial crime that obscures the origin of illicit funds, necessitating the development and enforcement of anti-money laundering (AML) policies by governments and organizations. The proliferation of mobile payment platforms and smart IoT devices has significantly complicated AML investigations. As payment networks become more interconnected, there is an increasing need for efficient real-time detection to process large volumes of transaction data on heterogeneous payment systems by different operators such as digital currencies, cryptocurrencies, and account-based payments. Most of these mobile payment networks are supported by connected devices, many of which are considered loT devices in the FinTech …

Machine Learning In Peak Demand Forecasting: Foundations, Trends, And Insights, Shuang Dai, Fanlin Meng, Hongsheng Dai, Qian Wang, Xizhong Chen, Wenlei Bai, Peizhi Shi, Richard Allmendinger, Yuchen Zhang, Jian Liu

Electrical and Computer Engineering Faculty Research & Creative Works

Peak demand forecasting involves predicting the maximum electricity demand within a specific period, which plays a key role in maintaining the efficiency and stability of power systems. The rapid evolution of power systems, driven by advanced metering infrastructure, local energy applications such as electric vehicles, and the increasing adoption of intermittent renewable energy, has introduced greater randomness and reduced predictability in peak demand. Given the pressing need to address more diverse implementation requirements across different contexts, accurate and reliable peak demand forecasting has become increasingly important. To the best of our knowledge, this study is the first to provide a …

Deep Learning Style Transfer For Enhanced Smoke Plume Visibility: A Standardized False Color Composite (Sfcc) In Gems Satellite Imagery, Yemin Jeong, Seung Hee Kim, Menas Kafatos, Jeong-Ah Yu, Kyoung-Hee Sung, Seung-Yeon Kim, Goo Kim, Jae-Jin Kim, Yangwon Lee

Institute for ECHO Articles and Research

Wildfire smoke visualization using geostationary satellite imagery is essential for real-time monitoring and atmospheric analysis; however, inconsistencies in color tone across Geostationary Environment Monitoring Spectrometer (GEMS) images hinder reliable interpretation and model training. This study proposes a Standardized False Color Composite (SFCC) framework based on deep learning style transfer to enhance the visual consistency and interpretability of wildfire smoke scenes. Four tone-standardization methods were compared: the statistical Empirical Cumulative Distribution Function (ECDF) correction and three neural approaches—ReHistoGAN, StyTr2, and Style Injection Diffusion Model (SI-DM). Each model was evaluated visually and quantitatively using six metrics (SSIM, LPIPS, FID, histogram similarity, ArtFID, …

Obstructive Sleep Apnea Prediction: A Comprehensive Review And Comparative Study, Thi Khanh Chi Huynh, Amonae Dabbs-Brown, Anna Jurek-Loughrey, James Mulhall, Tuan Dung Pham, Ngoc Phu Doan, Viet Hung Tran, Zichi Zhang, Xuan Hoang Nguyen, Yimeng An, Peixin Li, Phi Hung Nguyen, Thi Linh Hoang, Xinming Shi, Hans Vandierendonck, Sebastien Bailly, Jean-Louis Pépin, Thai Son Mai

Research Collection School Of Computing and Information Systems

Obstructive Sleep Apnea (OSA) is a highly prevalent sleep disorder linked to considerable public health burdens and comorbidities. However, its heterogeneous presentation and the limited accessibility of traditional diagnostic tools such as polysomnography (PSG) lead to widespread underdiagnosis. As a result, artificial intelligence (AI) approaches, including machine learning (ML) and deep learning (DL) models, have attracted attention as an alternative pathway to detection. This paper first provides a comprehensive review of AI-driven OSA diagnosis, covering different diagnosis problems, input-data types, data biases, pre-processing techniques, and model performance. We then leverage the largest clinical dataset used in OSA prediction to date, …

Spatio-Temporal Swin Transformer-Based Flow-Solid Coupling Interaction Sequence Image Prediction Network, Changjun Zou, Zhiyu Ge, Chenxi Zhong

Journal of System Simulation

Abstract: To address limitations in modeling long-term dependencies and multi-scale features in fluidstructure interaction scenarios, a spatiotemporal deep learning model (SwinLSTM) integrating ConvLSTM and Swin Transformer is proposed. The model employs a gated spatiotemporal attention mechanism that dynamically embeds Swin Transformer's window-based multi-head self-attention into ConvLSTM's output gate, enabling adaptive temporal-spatial feature coupling, and designs a multi-level ConvLSTM framework to hierarchically capture complex spatiotemporal correlations. Experiments on a self-built fluid-interaction dataset show that our method achieves the highest PSNR and leading SSIM scores, with superior performance in preserving vortex details and boundary consistency. This work provides an efficient solution …

A Robust Deep Learning Ensemble Framework For Waterbody Detection Using High-Resolution X-Band Sar Under Data-Constrained Conditions, Soyeon Choi, Seung Hee Kim, Son V. Nghiem, Menas Kafatos, Minha Choi, Jinsoo Kim, Yangwon Lee

Institute for ECHO Articles and Research

Accurate delineation of inland waterbodies is critical for applications such as hydrological monitoring, disaster response preparedness and response, and environmental management. While optical satellite imagery is hindered by cloud cover or low-light conditions, Synthetic Aperture Radar (SAR) provides consistent surface observations regardless of weather or illumination. This study introduces a deep learning-based ensemble framework for precise inland waterbody detection using high-resolution X-band Capella SAR imagery. To improve the discrimination of water from spectrally similar non-water surfaces (e.g., roads and urban structures), an 8-channel input configuration was developed by incorporating auxiliary geospatial features such as height above nearest drainage (HAND), slope, …

A Hybrid Cnn-Lstm Surrogate Model For Hyper-Resolution Spatiotemporal Flood Forecasting In Norfolk, Virginia, Yidi Wang, Jonathan L. Goodall, Chetan Kumar, Diana Mcspadden, Sergio A. Barbosa, Binata Roy, Ali Shahabi, Navid Tahvildari

Data Science Faculty Publications

Study region

Norfolk, Virginia, United States

Study focus

Accurate and timely flood forecasting is essential for enhancing resilience in coastal urban areas in the context of increasing frequency and intensity of rainfall, sea level rise and urbanization. This study presents a hybrid deep learning-based surrogate model that integrates Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) networks to enable real-time spatiotemporal flood forecasting. The model leverages CNN to capture spatial features from inputs such as elevation and Topographic Wetness Index (TWI), while LSTM processes time-series inputs of rainfall and tide data to capture temporal features.

New hydrologic insights for …

Srgan-Based Deep Learning Framework For Wind Turbine Damage Detection From Sentinel-2 Imagery, Kübra Çakir, Onur Elma, Murat Kuzlu

Engineering Technology Faculty Publications

The operational reliability of wind turbines is critical for sustainable energy production in smart grids. This study proposes a remote monitoring approach using perceptually enhanced satellite imagery. Sentinel-2 multispectral data (10 m resolution) has been processed with a Super-Resolution Generative Adversarial Network (SRGAN) to improve visual quality to a perceptual resolution of 30 cm. Although true spatial refinement is not achieved, the sharper structural details enhance classification accuracy. The data set comprises 15,000 images—10,000 SRGAN-enhanced and 5000 augmented through rotation, zoom in, increasing brightness, noise addition, and blurring. A custom Convolutional Neural Network (CNN) has been trained to classify turbines …

Multi-Grade Deep Learning, Yuesheng Xu

Mathematics & Statistics Faculty Publications

Deep learning requires solving a nonconvex optimization problem of a large size to learn a deep neural network (DNN). The current deep learning model is of a single-grade, that is, it trains a DNN end-to-end, by solving a single nonconvex optimization problem. When the layer number of the neural network is large, it is computationally challenging to carry out such a task efficiently. The complexity of the task comes from learning all weight matrices and bias vectors from one single nonconvex optimization problem of a large size. Inspired by the human education process which arranges learning in grades, we …

Adaptive Self-Attention For Enhanced Segmentation Of Adult Gliomas In Multi-Modal Mri, Evan P. Savaria, Jiangwen Sun

Computer Science Faculty Publications

Every year there are an estimated 80,000–90,000 new glioma cases, highlighting the need for reliable imaging-based decision support. Although deep learning has improved tumor sub-region segmentation, many state-of-the-art models fail to fully capture complementary information across T1, T1Gd, T2, and FLAIR MRI modalities and often operate as “black boxes,” limiting physician trust when precise delineation is critical for surgical planning, radiation targeting, and treatment monitoring. To address these limitations, we propose AIMS, an Adaptive Integrated Multi-Modal Segmentation framework that maintains modality-specific feature streams and employs adaptive self-attention within a hierarchical CNN-Transformer architecture to prioritize and fuse multi-modal MRI features. We …

Attention-Based Multi-Omics Fusion For Drug Synergy Prediction, Kusal Debnath, Pratip Rana, Preetam Ghosh

Computer Science Faculty Publications

Drug combination therapy in disease management gained popularity in the last few decades. Computational modeling of such combinations is an active area of research in the drug discovery domain. While earlier approaches solely emphasized on the structural features of participating drugs for designing synergistic models, they lack other crucial factors directly linked with drug administration - omics expressions. As differential omics expression is a downstream consequence of the administered drug combinations, utilizing such expressions while designing synergistic models promises robust and dynamic modeling. In this work, we propose SynergyLM that fuses multi-omics features with drug embeddings to build an omics-aware …

Physics-Informed Temperature Prediction Of Lithium-Ion Batteries Using Decomposition-Enhanced Lstm And Bilstm Models, Seyed Saeed Madani, Yasmin Shabeer, Michael Fowler, Satyam Panchal, Carlos Ziebert, Hicham Chaoui, François Allard

Electrical & Computer Engineering Faculty Publications

Accurately forecasting the operating temperature of lithium-ion batteries (LIBs) is essential for preventing thermal runaway, extending service life, and ensuring the safe operation of electric vehicles and stationary energy-storage systems. This work introduces a unified, physics-informed, and data-driven temperature-prediction framework that integrates mathematically governed preprocessing, electrothermal decomposition, and sequential deep learning architectures. The methodology systematically applies the governing relations to convert raw temperature measurements into trend, seasonal, and residual components, thereby isolating long-term thermal accumulation, reversible entropy-driven oscillations, and irreversible resistive heating. These physically interpretable signatures serve as structured inputs to machine learning and deep learning models trained on temporally …

Digital Twin Technologies For Battery Systems: Advancements, Applications, And Future Directions, Seyed Saeed Madani, Yasmin Shabeer, Michael Fowler, Satyam Panchal, Carlos Ziebert, Hicham Chaoui, François Allard

Electrical & Computer Engineering Faculty Publications

The relationships among deep learning, edge computing, artificial intelligence (AI), and the most recent advancements in digital twin (DT) technology for battery energy storage systems are discussed in this paper. The study highlights the need for improved cloud-edge coordination, AI model development, and stronger cybersecurity features by demonstrating real-world applications of digital twin technology in electric vehicles (EVs), aircraft, and grid storage. It also described DT-based structures for fault detection, real-time monitoring, and optimization through standardization and battery management system (BMS) fusion. Because DT-based solutions for distributed energy resources (DERs) offer improved energy management systems, various studies have been conducted …