Computer Sciences Commons^™

Ms-Yolo: Infrared Object Detection For Edge Deployment Via Mobilenetv4 And Slideloss, Jiali Zhang, Thomas S. White, Haoliang Zhang, Wenqing Hu, Donald C. Wunsch, Jian Liu

Mathematics and Statistics Faculty Research & Creative Works

Infrared imaging has emerged as a robust solution for urban object detection under low-light and adverse weather conditions, offering significant advantages over traditional visible-light cameras. However, challenges such as class imbalance, thermal noise, and computational constraints can significantly hinder model performance in practical settings. To address these issues, we evaluate multiple YOLO variants on the FLIR ADAS V2 dataset, ultimately selecting YOLOv8 as our baseline due to its balanced accuracy and efficiency. Building on this foundation, we present MS-YOLO (MobileNetv4 and SlideLoss based on YOLO), which replaces YOLOv8's CSPDarknet backbone with the more efficient MobileNetV4, reducing computational overhead by 1.5% …

Revealing Spatiotemporal Neural Activation Patterns In Electrocorticography Recordings Of Human Speech Production By Mutual Information, Julio Kovacs, Dean Krusienski, Minu Maninder, Willy Wriggers

Mechanical & Aerospace Engineering Faculty Publications

Background

Spatiotemporal mapping of neural activity during continuous speech production has been traditionally approached using correlation coefficient (CC) analysis between cortical signals and speech recordings. A prior study employed this approach using electrocorticography (ECoG) data from participants who underwent invasive intracranial monitoring for epilepsy. However, CC cannot detect nonlinear relationships and is dominated by the correspondence between periods of silence and of non-silence.

New Method

We introduce the mutual information (MI) measure, which can capture both linear and nonlinear dependencies. We validated CC and MI on the sub-second spatiotemporal brain activity recorded during continuous speech tasks. To refine the results, …

Optimal Manipulation Motion Action Planner Enabled By Physics Informed Neural Networks, Jonathon E. Slightam, Logan E. Beaver

Mechanical & Aerospace Engineering Faculty Publications

Autonomous robotic manipulation in unstructured environments faces many challenges and is hindered by capabilities that bridge the gap between perception and acting on the world. Action plans that are centric to object motion rather than end-of-arm tooling behavior may aid this. This paper presents an autonomous action planner for a feedback linearizeable system comprised of three base motions that can be leveraged on their own or in combination to give custom motion plans. The optimization routine for the three different types of motion are presented, which are integrated into physics informed neural networks. A component of this is the autonomy …

Optimal Control Of Queueing Systems With Error-Prone Servers, Junqi Hu, Sigrún Andradóttir, Hayriye Ayhan

Information Technology & Decision Sciences Faculty Publications

Consider a Markovian tandem line with finite intermediate buffers and an equal number of stations and servers. Servers are flexible but noncollaborative, so that a job can be processed by at most one server at any time. When a job is being processed, it can be damaged and wasted depending on the proficiency of the server. We identify the dynamic server assignment policy that maximizes the long-run average throughput of the system with two stations and two servers. We find that the optimal policy is either a single or a double threshold policy on the number of jobs in the …

Computation-Efficient Deep Learning Models For Computer Vision And Multimodal Vision-Language Tasks Via Network Pruning, Abir Mohammad Hadi

Electronic Theses and Dissertations

With the rapid evolution of deep neural networks over the past decade, the demand for efficient, generalizable, and task-adaptable models, especially in computer vision, has increased significantly. To address the computational and deployment challenges posed by overparameterized models, the research community has extensively explored model compression techniques such as pruning, quantization, and distillation. These approaches aim to enhance model efficiency without compromising performance, particularly when adapting to domain-specific tasks under limited resources. This dissertation investigates several underexplored yet critical aspects of task-aware deep learning model compression, spanning both convolutional and vision-language architectures. In the early part of this work, we …

Video Comprehension Score (Vcs): A Metric For Long-Form Video Description Evaluation, Harsh Dubey

Electronic Theses and Dissertations

Existing video description evaluation metrics fail to capture the long-range chronology and semantic alignment essential for long-form descriptions. An effective evaluation metric for long-form descriptions must (i) assess global thematic alignment, (ii) measure local semantic alignment, and (iii) evaluate chronological alignment while detecting corrupted content. We introduce Video Comprehension Score (VCS), a reference-based metric, which directly addresses these evaluation requirements through three components: Global Alignment Score for thematic alignment, Local Alignment Score for local semantic alignment, and Narrative Alignment Score for chronological alignment with adjustable tolerance. We evaluate VCS on two large-scale synthetic datasets designed to test corruption detection and …

Sogar: Self-Supervised Spatiotemporal Attention-Based Social Group Activity Recognition, Naga Venkata Sai Raviteja Chappa, Pha Nguyen, Alexander H. Nelson, Han-Seok Seo, Xin Li, Page Daniels Dobbs, Khoa Luu

Electrical Engineering and Computer Science Faculty Publications and Presentations

Social group activity recognition is crucial for various applications including surveillance, human-robot interaction, and behavioral analysis. Current approaches often require extensive manual annotations and rely heavily on pre-trained detectors, limiting their practical applications. Additionally, existing methods struggle to effectively model long-term spatiotemporal relationships in group activities. This paper introduces a novel approach to Social Group Activity Recognition (SoGAR) using Self-supervised Transformers network that can effectively utilize unlabeled video data. To extract spatio-temporal information, we create local and global views with varying frame rates. Our self-supervised objective ensures that features extracted from contrasting views of the same video are consistent across …

Are We Ready For Synchronous Conceptual Modeling In Augmented Reality? A Usability Study On Causal Maps With Hololens 2, Anish Shrestha, Philippe J. Giabbanelli

VMASC Publications

(1) Background: Participatory modeling requires combining individual views to create a shared conceptual model. While remote collaboration tools have enabled synchronous online modeling, they are limited to desktop settings. Augmented reality (AR) offers a new approach by potentially providing the sense of presence found in physical collaboration, which may better support participants in achieving the sense of presence found in physical locations, thus supporting them in negotiating meaning and building a shared model. (2) Methods: Building on prior works that developed technology, we performed a usability study with pairs of modelers to examine their ability at performing key conceptual modeling …

Ai-Generated Messaging For Life Events Using Structured Prompts: A Comparative Study Of Gpt With Human Experts And Machine Learning, Christopher Lynch, Erik Jensen, Ross Gore, Virginia Zamponi, Kevin O'Brien, Brandon Feldhaus, Katherine Smith, Joseph Martínez, Madison H. Munro, Timur E. Ozkose, Tugce B. Gundogdu, Ann Marie Reinhold, Hamdi Kavak, Barry Ezell

VMASC Publications

Large Language Models (LLMs) play an increasingly integrated and pivotal role in generating diverse types of texts, such as social media messages, emails, narratives, and technical reports, among other textual communication forms. As AI-generated messaging filters into human communication, a systematic exploration of their effectiveness for mimicking human-like communication of life events is needed. In this study, we employ a zero-shot structured narrative prompt to generate 24,000 life event messages for birth, death, hiring, and firing events using OpenAI's GPT-4. From this dataset, we manually classify 2880 messages and evaluate their validity in conveying these life events through the form …

Age Of Information-Based Optimal Scheduling With Energy Cost Trade-Off For Smart Warehouse: A Deep Reinforcement Learning-Based Approach, Sandip Roy, Abhishek Bisht, Ashok Kumar Das, Sachin Shetty

VMASC Publications

Recent advances in the integration of high-speed mobile networks and real-time IoT devices have facilitated in building of smart warehouses, where a set of beacons and Internet of Things (IoT) devices (or source nodes) can monitor the status of various physical processes in a time-critical way. In real-time status monitoring systems, like smart warehouses, quantifying the freshness of the Internet of Things (IoT) data based on the age of information (AoI) metrics becomes quite crucial. As source nodes are battery-constrained, a balanced trade-off between AoI minimization and preservation of source node battery energy is essential. In this paper, in a …

Faithful Narratives From Complex Conceptual Models: Should Modelers Or Large Language Models Simplify Causal Maps, Tyler J. Gandee, Philippe J. Giabbanelli

VMASC Publications

(1) Background: Comprehensive conceptual models can result in complex artifacts, consisting of many concepts that interact through multiple mechanisms. This complexity can be acceptable and even expected when generating rich models, for instance to support ensuing analyses that find central concepts or decompose models into parts that can be managed by different actors. However, complexity can become a barrier when the conceptual model is used directly by individuals. A ‘transparent’ model can support learning among stakeholders (e.g., in group model building) and it can motivate the adoption of specific interventions (i.e., using a model as evidence base). Although advances in …

A Novel Intelligent Thermal Feedback Framework For Electric Motor Protection In Embedded Robotic Systems, Mohamed Shili, Salah Hammedi, Hicham Chaoui, Khaled Nouri

Electrical & Computer Engineering Faculty Publications

As robotic systems advance in autonomy and sophistication while being used in uncertain environments, the challenge of building reliable and robust electric motors that are embedded into robotic systems has never been a more important engineering problem. Thermal distress caused by extended operation or excessive loading can negatively affect a motor’s performance and efficiency and lead to catastrophic hardware failure. This paper proposes a novel intelligent control framework that includes real-time thermal feedback for hybrid electric motors that are embedded into robotic systems. The framework relies on adaptive control techniques and lightweight machine learning techniques to estimate internal motor temperatures …

Improving System-Level Outcomes Via Artificial Intelligence Decision Support In Kidney Utilization, Casey I. Canfield, Cihan H. Dagli, Daniel Burton Shank, Krista Lentine, Mark Schnitzler, Henry Randall, V. Sriram Siddhardh Nadendla, Brendon Cummiskey

Engineering Management and Systems Engineering Faculty Research & Creative Works

Transplantation provides patients suffering from end-stage kidney disease a better quality of life and long-term survival. However, over 20% of deceased donor kidneys are not utilized and never transplanted. While this is sometimes medically appropriate, this also reflects missed opportunities. We are designing Artificial Intelligence decision support for the kidney offer process to support both demand at the transplant center and supply at the organ procurement organization. This includes (1) developing deep learning models, (2) evaluating the effect of explainable interfaces, (3) improving fairness in the model output, (4) identifying factors that influence adoption decisions, and (5) conducting a randomized …

Prescribed-Time Nash Equilibrium Seeking For Pursuit-Evasion Game Under Intermittent Control With Undirected/Directed Graph, Lei Xue, Jianfeng Ye, Yongbao Wu, Jian Liu, D. C. Wunsch

Electrical and Computer Engineering Faculty Research & Creative Works

This paper studies the prescribed-time Nash equilibrium (PTNE) seeking problem of the pursuit-evasion game (PEG) with second-order dynamics under the intermittent control (IC) strategy. To achieve Nash equilibrium (NE) in a user-defined prescribed-time, a time-varying high-gain function is incorporated into the design. The core challenge lies in applying IC to NE seeking, which complicates the convergence analysis and control design. To address this sticking point, we construct an auxiliary function and propose a Lyapunov function considering second-order dynamics to solve the PTNE seeking problem of PEG. Building upon the results for undirected graphs, we further extend our findings to directed …

Deep Learning For Uav Classification: Impact Of Noise And Multipath Fading In Rf Signals, Prajoy Podder, Maciej Jan Zawodniok, Sanjay Kumar Madria

Electrical and Computer Engineering Faculty Research & Creative Works

The increasing presence of unmanned aerial vehicles (UAVs) raises serious security concerns, particularly regarding unauthorized drone operations. Recent U.S. security statistics report a sharp rise in unauthorized UAV activities, with the Federal Aviation Administration (FAA) receiving over 100 monthly reports of illegal drone operations near airports. In 2024 alone, Dedrone records 1.19 million unauthorized drone flights across major U.S. cities, highlighting the need for robust UAV detection and classification systems. In this work, a lightweight Convolutional Neural Network (CNN) model is proposed for RF-based UAV classification under noisy and multipath fading conditions. The proposed CNN consists of multiple convolutional blocks, …

Ethics Vs.. Regulation: Converging Frameworks For Trustworthy Human-Centered Ai In Biomedical Research, Tayo Obafemi-Ajayi, Tiffani J. Bright, Emily F. Wong, Donald Wunsch, Joan Peckham, Jason H. Moore

Electrical and Computer Engineering Faculty Research & Creative Works

The accelerating impact of AI in biomedical research is driving significant advances in precision medicine. As these systems increasingly shape health outcomes, the imperative to develop trustworthy, reliable, and ethically grounded AI becomes more pressing, particularly in addressing concerns related to data integrity, patient safety, and equitable outcomes. While the potential of AI to transform biomedical research is clear, its responsible integration depends on more than technological capability. Ensuring that these systems are aligned with societal values requires a dual commitment: the operationalization of ethical principles throughout the AI life cycle and the establishment of robust regulatory mechanisms. Ethics provides …

Sift Feature-Based Relative Altitude Estimation Enhanced With Siamese Network, Shirin Nasr-Esfahani, S. Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

In GPS-denied environments or when GPS signals are unreliable or unavailable, alternative methods of accurate localization with coordinate generation become critical. To address localization, the scale-invariant feature transform (SIFT) algorithm, along with its numerous adaptations, is extensively utilized in computer vision and remote sensing for matching image features to identify objects and perform localization. This article presents a novel approach for estimating the relative altitude of unmanned aerial vehicles (UAVs) using SIFT features' scale (size), omitting the need for additional data like camera intrinsic parameters, as well as extensive image datasets are also required for training. Furthermore, the approach enhances …

Safe Optimal Control Of Quadrotor Formations Using Multilayer Neural Networks And Continual Learning, Ehsan Soleimani, Irfan Ahmad Ganie, S. Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

This article presents an integral reinforcement learning-based optimal formation tracking scheme for multiple quadrotors unmanned aerial vehicles (QUAVs) experiencing nonlinear coupled dynamics and subject to constraints. We use multilayer neural networks (MNN) within an actor-critic framework where the MNN weights are tuned using singular value decomposition (SVD) of the activation function gradient to approximate optimal control policy via backstepping. Additionally, barrier Lyapunov functions (BLF) are introduced to ensure set invariance, thereby maintaining the quadrotors within a defined safety space due to constraints. A novel weight update law for each layer is derived using the HJB approximation error and control input …

Explainable And Safety Aware Deep Reinforcement Learning-Based Control Of Nonlinear Discrete-Time Systems Using Neural Network Gradient Decomposition, Behzad Farzanegan, S. Jagannathan

Electrical and Computer Engineering Faculty Research & Creative Works

This paper presents an explainable deep-reinforcement learning (DRL)-based safety-aware optimal adaptive tracking (SOAT) scheme for a class of nonlinear discrete-time (DT) affine systems subject to state inequality constraints. The DRL-based SOAT utilizes a multilayer neural network (MNN)-based actor-critic to estimate the cost function and optimal policy while the MNN update laws are tuned both using the singular value decomposition (SVD) of activation function gradient in order to mitigate the vanishing gradient issue and safety-aware Bellman error at each layer. An approximate safety-aware optimal policy is developed using Karush–Kuhn–Tucker (KKT) conditions by incorporating the higher-order control barrier function (HOCBF) into the …

Adaptive Nussbaum Design For Nonholonomic Systems With Asymptotic Stabilization Against False Data Injection, Guilong Liu, Yongliang Yang, Weinan Gao, Donald C. Wunsch

Electrical and Computer Engineering Faculty Research & Creative Works

This article addresses the stabilization challenges of nonholonomic systems under the threat of false data injection (FDI) attacks, which compromise the integrity of state information. A novel adaptive control strategy using Nussbaum-type gains is proposed to ensure the asymptotic stability of the closed-loop system while maintaining signal boundedness. The approach extends conventional Nussbaum designs to handle multiple unknown control directions. It integrates online learning mechanisms to mitigate the impact of FDI attacks. Additionally, adaptive backstepping and fuzzy-logic systems are utilized to approximate and compensate for unknown nonlinear dynamics. The methodology transforms nonholonomic systems into equivalent cascade structures to address inherent …

An Extensive Analysis Of Match-Tracking Methods For Artmap, Niklas M. Melton, Leonardo Enzo Brito Da Silva, Donald C. Wunsch

Electrical and Computer Engineering Faculty Research & Creative Works

This paper identifies and studies five match-tracking (MT) methods in the adaptive resonance theory (ART) literature and conducts a detailed comparative analysis of these in ARTMAP applications. We focus on model performance for each MT method with respect to time and space efficiency as well as classification accuracy. Experimental results indicate that one MT variant, used in ARTMAP applications for the first time in this work, provides significant improvements in computational efficiency: depending on the ARTMAP variant, it was able to achieve up to one order of magnitude reduction in both time and space requirements, albeit with a compromise in …

Training Neural Networks With A Self-Adaptive Ant Colony Algorithm, Ashraf M. Abdelbar, Donald C. Wunsch

Electrical and Computer Engineering Faculty Research & Creative Works

ACOR is a well-established ant colony optimization algorithm that has been applied to neural network training. We present an approach for the dynamic adaptation of the ACOR algorithm's search intensification/diversification parameter q, based on using several pre-specified parameter configurations, which we call personalities. Before an ant begins to generate a candidate solution, it stochastically adopts a personality based on the relative past success of the different personalities. The success of a personality is measured, in turn, by the relative quality of previous solutions generated by ants adopting that personality. The premise of our approach is that some personalities will be …

Autonomous Landscape Exploration Rover Using Imaging Surface Navigation (Alexis), Noah Jones, Dominic Salupo

Williams Honors College, Honors Research Projects

The objective is to develop a small-form-factor rover prototype that can be used to prove out a novel traversal method for use on extraterrestrial surfaces. The novel traversal method being proposed is LIDAR/CV-enhanced navigation, provided by a detachable flight vehicle that can communicate with the rover. On planets with thin atmospheres, cold gas thrusters or similar may be needed, but for the scope of this project more traditional flight/propulsion methods will be used.

Multitec: A Data-Driven Multimodal Short Video Detection Framework For Healthcare Misinformation On Tiktok, Lanyu Shang, Yang Zhang, Yawen Deng, Dong Wang

Computer Science Faculty Works

With the prevalence of social media and short video sharing platforms (e.g., TikTok, YouTube Shorts), the proliferation of healthcare misinformation has become a widespread and concerning issue that threatens public health and undermines trust in mass media. This paper focuses on an important problem of detecting multimodal healthcare misinformation in short videos on TikTok. Our objective is to accurately identify misleading healthcare information that is jointly conveyed by the visual, audio, and textual content within the TikTok short videos. Three critical challenges exist in solving our problem: i) how to effectively extract information from distractive and manipulated visual content in …

A Comprehensive Academic And Industrial Survey Of Blockchain Technology For The Energy Sector Using Fuzzy Einstein Decision-Making, Umit Cali, Annabelle Lee, Barry Hayes, Claudio Lima, D. Jonathan Sebastian-Cardenas, David Flynn, Emre Kantar, Farrokh Rahimi, Kaung Si Thu, Marco Pasetti, Marthe Fogstad Dynge, Merlinda Andoni, Muhammet Deveci, Murat Kuzlu, Raquel Alanso, Kim-Kwang Raymond Choo, Sambeet Mishra, Shammya Shananda Saha, Sonam Norbu, Srinikhil Gourisetti, Ugur Halden, Vahid Hosseinezhad, Valentin Robu

Engineering Technology Faculty Publications

The global energy sector is undergoing a significant transformation driven by decarbonization and digitalization, leading to the emergence of Distributed Ledger Technology (DLT) — particularly blockchain — as a promising tool for enhancing transparency, security, and efficiency in modern power systems. This study aims to provide a comprehensive academic and industrial survey of blockchain applications in the energy sector and develop a robust decision-making framework to identify and prioritize the most promising real-world use cases based on multidisciplinary criteria. A three-stage methodology was adopted: (i) a literature and market review encompassing over 300 academic publications and commercial blockchain initiatives in …

A Comprehensive Exploration Of 6g Wireless Communication Technologies, Md Nurul Absar Siddiky, Muhammad Enayetur Rahman, Md. Shahriar Uzzal, H. M. Dipu Kabir

Electrical & Computer Engineering Faculty Publications

As the telecommunications landscape braces for the post-5G era, this paper embarks on delineating the foundational pillars and pioneering visions that define the trajectory toward 6G wireless communication systems. Recognizing the insatiable demand for higher data rates, enhanced connectivity, and broader network coverage, we unravel the evolution from the existing 5G infrastructure to the nascent 6G framework, setting the stage for transformative advancements anticipated in the 2030s. Our discourse navigates through the intricate architecture of 6G, highlighting the paradigm shifts toward superconvergence, non-IP-based networking protocols, and information-centric networks, all underpinned by a robust 360-degree cybersecurity and privacy-by-engineering design. Delving into …

Optimizing Ai Language Models: A Study Of Chatgpt-4 Vs. Chatgpt-4o, Md Nurul Absar Siddiky, Muhammad Enayetur Rahman, Md Fayaz Bin Hossen, Muhammad Rezaur Rahman, Md. Shahadat Jaman

Electrical & Computer Engineering Faculty Publications

This paper presents a comparative analysis of OpenAI's GPT-4 and its optimized variant, GPT-4o, focusing on their architectural differences, performance, and real-world applications. GPT-4, built upon the Transformer architecture, has set new standards in natural language processing (NLP) with its capacity to generate coherent and contextually relevant text across a wide range of tasks. However, its computational demands, requiring substantial hardware resources, make it less accessible for smaller organizations and real-time applications. In contrast, GPT-4o addresses these challenges by incorporating optimizations such as model compression, parameter pruning, and memory-efficient computation, allowing it to deliver similar performance with significantly lower computational …

Detecting Anomalous Srf Cavity Behavior With Unsupervised Learning, Hal Ferguson, Jiang Li, Adam Carpenter, Chris Tennant, Dillon Thomas, Dennis Turner

Electrical & Computer Engineering Faculty Publications

We present an unsupervised learning framework for detecting anomalous superconducting radio-frequency (SRF) cavity behavior at the Continuous Electron Beam Accelerator Facility (CEBAF), emphasizing its initial performance and effectiveness. Key to the system’s success was the development of data acquisition systems (DAQs) that capture fast-sampled, information-rich signals, essential for detecting transient effects. The approach involves creating daily cavity-specific models using principal component analysis to handle variations in rf signal behavior and mitigate performance degradation from data drift. This unsupervised method eliminates the need for expensive labeling by continuously updating models with recent data. Deployed and operational for 3 months before a …

Data-Driven Gradient Optimization For Field Emission Management In A Superconducting Radio-Frequency Linac, S. Goldenberg, K. Ahammed, A. Carpenter, J. Li, R. Suleiman, C. Tennant

Electrical & Computer Engineering Faculty Publications

Field emission can cause significant problems in superconducting radio-frequency linear accelerators (linacs). When cavity gradients are pushed higher, radiation levels within the linacs may rise exponentially, causing degradation of many nearby systems. This research aims to utilize machine learning with uncertainty quantification to predict radiation levels at multiple locations throughout the linacs and ultimately optimize cavity gradients to reduce field emission-induced radiation while maintaining the total linac energy gain necessary for the experimental physics program. The optimized solutions show over 40% reductions for both neutron and gamma radiation from the standard operational settings.

Detecting Sars-Cov-2 In Ct Scans Using Vision Transformer And Graph Neural Network, Kamorudeen Amuda, Almustapha Wakili, Tomilade Amoo, Lukman Agbetu, Qianlong Wang, Jinjuan Feng

Electrical & Computer Engineering Faculty Publications

The COVID-19 pandemic has presented significant challenges to global healthcare, bringing out the urgent need for reliable diagnostic tools. Computed Tomography (CT) scans have proven instrumental in detecting COVID-19-induced lung abnormalities. This study introduces Convolutional Neural Network, Graph Neural Network, and Vision Transformer (ViTGNN), an advanced hybrid model designed to enhance SARS-CoV-2 detection by combining Graph Neural Networks (GNNs) for feature extraction with Vision Transformers (ViTs) for classification. Using the strength of CNN and GNN to capture complex relational structures and the ViT capacity to classify global contexts, ViTGNN achieves a comprehensive representation of CT scan data. The model was …