Artificial Intelligence and Robotics Commons^™

Time Series Decomposition Of Land Surface Temperature For Long-Term Trend Forecasting And Impact On Nesting Sea Turtle Habitats In The Arabian Gulf, Sachi Perera, Rommel H. Maneja, Mohamed Allali, Cyril Rakovski, Erik Linstead, Daniele Struppa, Ali Qasem, Hesham El-Askary

Mathematics, Physics, and Computer Science Faculty Articles and Research

Improving land surface temperature (LST) modeling is vital for mitigating climate change effects on various ecosystems and marine habitats such as important sea turtle habitats. Over the past decade, extreme temperatures have likely significantly affected nesting sea turtle habitats in the Arabian Gulf, with predominantly female hatchlings creating an imbalance in the sex ratio. Such shifts have profound implications for these habitats’ long-term survival and conservation management. This study leverages statistical machine learning models to measure ongoing temporal variations in LST. We break down the LST time series into trend, seasonal, and noise components using classical decomposition methods like X11, …

Robust Learning With Probabilistic Relaxation Using Hypothesis-Test-Based Sampling, Zilin Wang

Dissertations and Theses Collection (Open Access)

In recent years, deep learning has been a vital tool in various tasks. The performance of a neural network is usually evaluated by empirical risk minimization. However, robustness issues have gained great concern which can be fatal in safety-critical applications. Adversarial training can mitigate the issue by minimizing the loss of worst-case perturbations of data. It is effective in improving the robustness of the model, but it is too conservative, and the plain performance of the model can be unsatisfying. Probabilistic Robust Learning (PRL) empirically balances the average- and worst-case performance while the robustness of the model is not provable …

Reference Dependence In Queue Design And Pricing Strategies, Jian Liu, Yongpin Zhou, Jian Chen, Peng Li

Electrical and Computer Engineering Faculty Research & Creative Works

This research investigates the effect of reference dependence on waiting times in service systems which formerly used a first-in-first-out (FIFO) service but have introduced a priority line with a fee. Our model combines reference-dependent gain-loss utility with standard customer utility, and we posit that customers are pleased with shorter-than-expected waiting times, whereas longer-than-expected times lead to dissatisfaction and an increased likelihood of balking. The study explores two scenarios: a captive customer system (CCS) and a noncaptive customer system (NCCS), with a focus on optimal pricing and segmentation strategies for revenue and social welfare maximization. The results reveal that, in a …

Towards Comprehensive And Interpretable Video Understanding, Khoa Vo

Graduate Theses and Dissertations

Video understanding is a critical domain in computer vision, focusing on analysis of sequential visual data to extract meaningful spatiotemporal information for tasks such as action recognition, video captioning, video retrieval, and temporal action localization, etc. Despite significant advancements with spatio-temporal convolutional neural networks and attention-based video models, current methods face limitations, including inadequate representation of main actors, lack of fine-grained modeling of relevant objects, and limited interpretability.
This thesis addresses these challenges by proposing novel approaches that enhance video understanding through modeling interactions among entities (actors and objects) and between entities and the environment, while improving interpretability in the …

3d Snapshot: Invertible Embedding Of 3d Neural Representations In A Single Image, Yuqin Lu, Bailin Deng, Zhixuan Zhong, Tianle Zhang, Yuhui Quan, Hongmin Cai, Shengfeng He

Research Collection School Of Computing and Information Systems

3D neural rendering enables photo-realistic reconstruction of a specific scene by encoding discontinuous inputs into a neural representation. Despite the remarkable rendering results, the storage of network parameters is not transmission-friendly and not extendable to metaverse applications. In this paper, we propose an invertible neural rendering approach that enables generating an interactive 3D model from a single image (i.e., 3D Snapshot). Our idea is to distill a pre-trained neural rendering model (e.g., NeRF) into a visualizable image form that can then be easily inverted back to a neural network. To this end, we first present a neural image distillation method …

Mimicking To Dominate: Imitation Learning Strategies For Success In Multiagent Competitive Games, The Viet Bui, Tien Mai, Hong Thanh Nguyen

Research Collection School Of Computing and Information Systems

Training agents in multi-agent games presents significant challenges due to their intricate nature. These challenges are exacerbated by dynamics influenced not only by the environment but also by strategies of opponents. Existing methods often struggle with slow convergence and instability. To address these challenges, we harness the potential of imitation learning (IL) to comprehend and anticipate actions of the opponents, aiming to mitigate uncertainties with respect to the game dynamics. Our key contributions include: (i) a new multi-agent IL model for predicting next moves of the opponents --- our model works with hidden actions of opponents and local observations; (ii) …

Learning To Handle Complex Constraints For Vehicle Routing Problems, Jieyi Bi, Yining Ma, Jianan Zhou, Wen Song, Zhiguang Cao, Yaoxin Wu, Jie Zhang

Research Collection School Of Computing and Information Systems

Vehicle Routing Problems (VRPs) can model many real-world scenarios and often involve complex constraints. While recent neural methods excel in constructing solutions based on feasibility masking, they struggle with handling complex constraints, especially when obtaining the masking itself is NP-hard. In this paper, we propose a novel Proactive Infeasibility Prevention (PIP) framework to advance the capabilities of neural methods towards more complex VRPs. Our PIP integrates the Lagrangian multiplier as a basis to enhance constraint awareness and introduces preventative infeasibility masking to proactively steer the solution construction process. Moreover, we present PIP-D, which employs an auxiliary decoder and two adaptive …

Self-Supervised Fine-Tuning For Neural Expert Finding, Budhitama Subagdja, Dan Sanchari, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

Expert finding systems allow ones to find individuals who have expertise in specific fields or domains. Traditional expert finding are mostly based on topic modeling or keyword search methods that are limited in their capability to encode contextual knowledge from natural language. To address the limitation, this paper presents Neural Expert Finder (NEF), a novel method that takes a transfer learning approach based on transformer encoder networks to leverage the rich seman-tic and syntactic patterns of language encoded in pre-trained language models (PLMs). We propose a self-supervised learning approach utilizing contrastive training using both positive and automatically generated negative samples …

Exploring The Cognitive Sense Of Self In Ai: Ethical Frameworks And Technological Advances For Enhanced Decision-Making, Emily Barnes, James Hutson

Faculty Scholarship

The burgeoning field of Artificial Intelligence (AI) increasingly focuses on developing systems capable of self-awareness, merging technological innovation with deep ethical and philosophical considerations. This article explores the cognitive sense of self within AI, examining mechanisms through which AI systems may mirror human-like consciousness and self-perception. Despite significant advances, substantial gaps remain in the understanding and practical implementation of self-aware characteristics in AI, particularly in applying theoretical models and ethical frameworks to real-world scenarios. There is a pressing need for comprehensive research to explore these theoretical underpinnings and translate them into operational systems capable of ethical and adaptable behaviors. This …

Learning To Represent Temporal Dynamics And Generative Factors For Intelligent Visual Navigation, Sahand Khoshdel

All Theses

Visual navigation systems are crucial in various applications, including autonomous driving, unmanned aerial systems (UAS), and industrial automation. For these systems to operate efficiently in dynamic environments, they must not only interpret complex surroundings but also anticipate changes over time. Temporal prediction—forecasting environmental changes like moving obstacles or shifting lighting conditions—enables navigation systems to act proactively, enhancing both safety and performance. This dissertation investigates representation learning methods both as a backbone feature extractor for RL agents as well as a proxy for systems oriented for Explainable AI (XAI). Two main projects are presented as case studies to achieve the aforementioned …

Efficient Anomaly Detection Driven By Different Machine Learning Architectures And Models, William Marfo

Open Access Theses & Dissertations

The rapid growth and ubiquitous adoption of the internet and cyber-physical systems (CPS) have fundamentally transformed modern communication, work, and human-system interactions. While networks now form the backbone of critical digital ecosystems, enabling seamless data transmission across diverse, interconnected systems, this increased connectivity also expands the attack surface, making real-time detection of network intrusions and anomalies a pressing challenge. Detecting unusual activities within network infrastructure requires advanced data traffic analysis to differentiate between legitimate and malicious interactions. Traditional approaches to network anomaly detectionâ??such as rule-based and signature-based systemsâ??often depend on predefined patterns to identify known anomalies, limiting their effectiveness against …

Decoding Neural Networks: An Information-Theoretic Guide To Interpretability, Error Analysis And Efficiency, Mackenzie J. Meni

Theses and Dissertations

This dissertation addresses critical challenges in neural network design by leveraging entropy-based techniques to improve model efficiency, interpretability, and bias reduction. Focusing on the unique demands of computer vision applications, particularly object detection and classification for real-time systems, this work introduces a series of innovative methods centered on information theory. At the core of these methods is the Probabilistic Explanations of Entropic Knowledge (PEEK) framework, a tool developed to analyze and visualize entropy distributions across feature maps. PEEK offers insights into information flow within neural networks, making it possible to pinpoint layers that contribute meaningfully to decision-making or identify those …

Neural Network Architecture Search Enabled Wide-Deep Learning (Nas-Wd) For Spatially Heterogenous Property Awared Chicken Woody Breast Classification And Hardness Regression, Chaitanya Pallerla, Yihong Feng, Casey M. Owens, Ramesh Bahadur Bist, Siavash Mahmoudi, Pouya Sohrabipour, Amirreza Davar, Dongyi Wang

Poultry Science Faculty Publications and Presentations

Due to intensive genetic selection for rapid growth rates and high broiler yields in recent years, the global poultry industry has faced a challenging problem in the form of woody breast (WB) conditions. This condition has caused significant economic losses as high as $200 million annually, and the root cause of WB has yet to be identified. Human palpation is the most common method of distinguishing a WB from others. However, this method is time-consuming and subjective. Hyperspectral imaging (HSI) combined with machine learning algorithms can evaluate the WB conditions of fillets in a non-invasive, objective, and high-throughput manner. In …

Artificial Intelligence And Machine Learning In Cancer Pain: A Systematic Review, Vivian Salama, Brandon Godinich, Yimin Geng, Laia Humbert-Vidan, Laura Maule, Mohamed A Naser, Abdallah S R Mohamed, Clifton D Fuller, Amy C Moreno

Faculty, Staff and Student Publications

Background/objectives: Pain is a challenging multifaceted symptom reported by most cancer patients. This systematic review aims to explore applications of artificial intelligence/machine learning (AI/ML) in predicting pain-related outcomes and pain management in cancer.

Methods: A comprehensive search of Ovid MEDLINE, EMBASE and Web of Science databases was conducted using terms: "Cancer," "Pain," "Pain Management," "Analgesics," "Artificial Intelligence," "Machine Learning," and "Neural Networks" published up to September 7, 2023. AI/ML models, their validation and performance were summarized. Quality assessment was conducted using PROBAST risk-of-bias andadherence to TRIPOD guidelines.

Results: Forty four studies from 2006 to 2023 were included. Nineteen studies used …

Modeling And Regulating A Ride-Sourcing Market Integrated With Vehicle Rental Services, Dong Mo, Hai Wang, Zeen Cai, W. Y. Szeto, Xiqun (Michael) Chen

Research Collection School Of Computing and Information Systems

With the popularity of on-demand ride services worldwide, ride-sourcing platforms must maintain an adequate fleet size and cope with growing travel demand. Recently, platforms have attempted to provide vehicle rental services to drivers who do not own cars, then recruited them to provide on demand ride services. This helps lower the entry barrier for drivers and offers another profitable business for platforms. From the government's perspective, however, it is challenging to coordinately regulate a ride-sourcing business and vehicle rental business. This paper proposes a bi-level optimization model to investigate how the government regulates the ride-sourcing market integrated with vehicle rental …

Reinforcement Learning Based Online Request Scheduling Framework For Workload-Adaptive Edge Deep Learning Inference, Xinrui Tan, Hongjia Li, Xiaofei Xie, Lu Guo, Nirwan Ansari, Xueqing Huang, Liming Wang, Zhen Xu, Yang Liu

Research Collection School Of Computing and Information Systems

The recent advances of deep learning in various mobile and Internet-of-Things applications, coupled with the emergence of edge computing, have led to a strong trend of performing deep learning inference on the edge servers located physically close to the end devices. This trend presents the challenge of how to meet the quality-of-service requirements of inference tasks at the resource-constrained network edge, especially under variable or even bursty inference workloads. Solutions to this challenge have not yet been reported in the related literature. In the present paper, we tackle this challenge by means of workload-adaptive inference request scheduling: in different workload …

Mvgamba : Unify 3d Content Generation As State Space Sequence Modeling, Xuanyu Yi, Zike Wu, Qiuhong Shen, Qingshan Xu, Pan Zhou, Joo-Hwee Lim, Shuicheng Yan, Xinchao Wang, Hanwang Zhang

Research Collection School Of Computing and Information Systems

Recent 3D large reconstruction models (LRMs) can generate high-quality 3D content in sub-seconds by integrating multi-view diffusion models with scalable multi-view reconstructors. Current works further leverage 3D Gaussian Splatting as 3D representation for improved visual quality and rendering efficiency. However, we observe that existing Gaussian reconstruction models often suffer from multi-view inconsistency and blurred textures. We attribute this to the compromise of multi-view information propagation in favor of adopting powerful yet computationally intensive architectures (e.g., Transformers). To address this issue, we introduce MVGamba, a general and lightweight Gaussian reconstruction model featuring a multi-view Gaussian reconstructor based on the RNN-like State …

Lova3 : Learning To Visual Question Answering, Asking And Assessment, Henry Hengyuan Zhao, Pan Zhou, Difei Gao, Bai Shou, Mike Zheng Shou

Research Collection School Of Computing and Information Systems

Question answering, asking, and assessment are three innate human traits crucial for understanding the world and acquiring knowledge. By enhancing these capabilities, humans can more effectively utilize data, leading to better comprehension and learning outcomes. Current Multimodal Large Language Models (MLLMs) primarily focus on question answering, often neglecting the full potential of questioning and assessment skills. Inspired by the human learning mechanism, we introduce LOVA3 , an innovative framework named “Learning tO Visual question Answering, Asking and Assessment,” designed to equip MLLMs with these additional capabilities. Our approach involves the creation of two supplementary training tasks GenQA and EvalQA, aiming …

Unified Generative And Discriminative Training For Multi-Modal Large Language Models, Wei Chow, Juncheng Li, Kaihang Pan, Qifan Yu, Hao Fei, Zhiqi Ge, Shuai Yang, Siliang Teng, Hanwang Zhang, Qianru Sun

Research Collection School Of Computing and Information Systems

In recent times, Vision-Language Models (VLMs) have been trained under two predominant paradigms. Generative training has enabled Multimodal Large Language Models (MLLMs) to tackle various complex tasks, yet issues such as hallucinations and weak object discrimination persist. Discriminative training, exemplified by models like CLIP, excels in zero-shot image-text classification and retrieval, yet struggles with complex scenarios requiring fine-grained semantic differentiation. This paper addresses these challenges by proposing a unified approach that integrates the strengths of both paradigms. Considering interleaved image-text sequences as the general format of input samples, we introduce a structure-induced training strategy that imposes semantic relationships between input …

Collaboration! Towards Robust Neural Methods For Routing Problems, Jianan Zhou, Yaoxin Wu, Zhiguang Cao, Wen Song, Jie Zhang, Zhiqi Shen

Research Collection School Of Computing and Information Systems

Despite enjoying desirable efficiency and reduced reliance on domain expertise, existing neural methods for vehicle routing problems (VRPs) suffer from severe robustness issues – their performance significantly deteriorates on clean instances with crafted perturbations. To enhance robustness, we propose an ensemble-based Collaborative Neural Framework (CNF) w.r.t. the defense of neural VRP methods, which is crucial yet underexplored in the literature. Given a neural VRP method, we adversarially train multiple models in a collaborative manner to synergistically promote robustness against attacks, while boosting standard generalization on clean instances. A neural router is designed to adeptly distribute training instances among models, enhancing …