Artificial Intelligence and Robotics Commons^™

The Human Side Of Adaptive Autonomy: Design Considerations For Adaptive Autonomous Teammates, Allyson Hauptman

All Dissertations

Ground-breaking advances in artificial intelligence (AI) have led to the possibility of AI agents operating not just as useful tools for teams, but also as full-fledged team members with unique, interdependent roles. This possibility is fueled by the human desire to create more and more autonomous systems that possess computational powers beyond human capability and the promise of increasing the productivity and efficiency of human teams dramatically. Yet, for all the promise and potential of these human-AI teams, the inclusion of AI teammates presents several challenges and concerns for both teaming and human-centered AI.

An important part of teaming is …

Artificial Intelligence's Ability To Detect Online Predators, Olatilewa Osifeso

Electronic Theses, Projects, and Dissertations

Online child predators pose a danger to children who use the Internet. Children fall victim to online predators at an alarming rate, based on the data from the National Center of Missing and Exploited Children. When making online profiles and joining websites, you only need a name, an email and a password without identity verification. Studies have shown that online predators use a variety of methods and tools to manipulate and exploit children, such as blackmail, coercion, flattery, and deception. These issues have created an opportunity for skilled online predators to have fewer obstacles when it comes to contacting and …

An Empirical Study On The Efficacy Of Llm-Powered Chatbots In Basic Information Retrieval Tasks, Naja Faysal

Electronic Theses, Projects, and Dissertations

The rise of conversational user interfaces (CUIs) powered by large language models (LLMs) is transforming human-computer interaction. This study evaluates the efficacy of LLM-powered chatbots, trained on website data, compared to browsing websites for finding information about organizations across diverse sectors. A within-subjects experiment with 165 participants was conducted, involving similar information retrieval (IR) tasks using both websites (GUIs) and chatbots (CUIs). The research questions are: (Q1) Which interface helps users find information faster: LLM chatbots or websites? (Q2) Which interface helps users find more accurate information: LLM chatbots or websites?. The findings are: (Q1) Participants found information significantly faster …

Code For Care: Hypertension Prediction In Women Aged 18-39 Years, Kruti Sheth

Electronic Theses, Projects, and Dissertations

The longstanding prevalence of hypertension, often undiagnosed, poses significant risks of severe chronic and cardiovascular complications if left untreated. This study investigated the causes and underlying risks of hypertension in females aged between 18-39 years. The research questions were: (Q1.) What factors affect the occurrence of hypertension in females aged 18-39 years? (Q2.) What machine learning algorithms are suited for effectively predicting hypertension? (Q3.) How can SHAP values be leveraged to analyze the factors from model outputs? The findings are: (Q1.) Performing Feature selection using binary classification Logistic regression algorithm reveals an array of 30 most influential factors at an …

Sliding Markov Decision Processes For Dynamic Task Planning On Uncrewed Aerial Vehicles, Trent Wiens

Department of Mechanical and Materials Engineering: Dissertations, Theses, and Student Research

Mission and flight planning problems for uncrewed aircraft systems (UASs) are typically large and complex in space and computational requirements. With enough time and computing resources, some of these problems may be solvable offline and then executed during flight. In dynamic or uncertain environments, however, the mission may require online adaptation and replanning. In this work, we will discuss methods of creating MDPs for online applications, and a method of using a sliding resolution and receding horizon approach to build and solve Markov Decision Processes (MDPs) in practical planing applications for UASs. In this strategy, called a Sliding Markov Decision …

Artificial Intelligence-Powered Assessment Of Pathologic Response To Neoadjuvant Atezolizumab In Patients With Nsclc: Results From The Lcmc3 Study, Sanja Dacic, William D Travis, Jennifer M Giltnane, Filip Kos, John Abel, Stephanie Hilz, Junya Fujimoto, Lynette Sholl, Jon Ritter, Farah Khalil, Yi Liu, Amaro Taylor-Weiner, Murray Resnick, Hui Yu, Fred R Hirsch, Paul A Bunn, David P Carbone, Valerie Rusch, David J Kwiatkowski, Bruce E Johnson, Jay M Lee, Stephanie R Hennek, Ilan Wapinski, Alan Nicholas, Ann Johnson, Katja Schulze, Mark G Kris, Ignacio I Wistuba

Faculty, Staff and Student Publications

Introduction: Pathologic response (PathR) by histopathologic assessment of resected specimens may be an early clinical end point associated with long-term outcomes with neoadjuvant therapy. Digital pathology may improve the efficiency and precision of PathR assessment. LCMC3 (NCT02927301) evaluated neoadjuvant atezolizumab in patients with resectable NSCLC and reported a 20% major PathR rate.

Methods: We determined PathR in primary tumor resection specimens using guidelines-based visual techniques and developed a convolutional neural network model using the same criteria to digitally measure the percent viable tumor on whole-slide images. Concordance was evaluated between visual determination of percent viable tumor (n = …

Q-Learning Based Framework For Solving The Stochastic E-Waste Collection Problem, Dang Viet Anh Nguyen, Aldy Gunawan, Mustafa Misir, Pieter Vansteenwegen

Research Collection School Of Computing and Information Systems

Electrical and Electronic Equipment (EEE) has evolved into a gateway for accessing technological innovations. However, EEE imposes substantial pressure on the environment due to the shortened life cycles. E-waste encompasses discarded EEE and its components which are no longer in use. This study focuses on the e-waste collection problem and models it as a Vehicle Routing Problem with a heterogeneous fleet and a multi-period planning problem with time windows as well as stochastic travel times. Two different Q-learning-based methods are designed to enhance the search procedure for finding solutions. The first method involves utilizing the state-action value to determine the …

Benchmarking Marl On Long Horizon Sequential Multi-Objective Tasks, Minghong Geng, Shubham Pateria, Budhitama Subagdja, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

Current MARL benchmarks fall short in simulating realistic scenarios, particularly those involving long action sequences with sequential tasks and multiple conflicting objectives. Addressing this gap, we introduce Multi-Objective SMAC (MOSMAC), a novel MARL benchmark tailored to assess MARL methods on tasks with varying time horizons and multiple objectives. Each MOSMAC task contains one or multiple sequential subtasks. Agents are required to simultaneously balance between two objectives - combat and navigation - to successfully complete each subtask. Our evaluation of nine state-of-the-art MARL algorithms reveals that MOSMAC presents substantial challenges to many state-of-the-art MARL methods and effectively fills a critical gap …

Learning Nighttime Semantic Segmentation The Hard Way, Wenxi Liu, Jiaxin Cai, Qi Li, Chenyang Liao, Jingjing Cao, Shengfeng He, Yuanlong Yu

Research Collection School Of Computing and Information Systems

Nighttime semantic segmentation is an important but challenging research problem for autonomous driving. The major challenges lie in the small objects or regions from the under-/over-exposed areas or suffer from motion blur caused by the camera deployed on moving vehicles. To resolve this, we propose a novel hard- class-aware module that bridges the main network for full-class segmentation and the hard-class network for segmenting aforementioned hard-class objects. In specific, it exploits the shared focus of hard-class objects from the dual-stream network, enabling the contextual information flow to guide the model to concentrate on the pixels that are hard to classify. …

Text-Attributed Graph Representation Learning : Methods, Applications, And Challenges, Ce Zhang, Menglin Yang, Rex Ying, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Text documents are usually connected in a graph structure, resulting in an important class of data named text-attributed graph, e.g., paper citation graph and Web page hyperlink graph. On the one hand, Graph Neural Networks (GNNs) consider text in each document as general vertex attribute and do not specifically deal with text data. On the other hand, Pre-trained Language Models (PLMs) and Topic Models (TMs) learn effective document embeddings. However, most models focus on text content in each single document only, ignoring link adjacency across documents. The above two challenges motivate the development of text-attributed graph representation learning, combining GNNs …

Cornac-Ab : An Open-Source Recommendation Framework With Native A/B Testing Integration, Rong Sheng Ong, Quoc Tuan Truong, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Recommender systems significantly impact user experience across diverse domains, yet existing frameworks often prioritize offline evaluation metrics, neglecting the crucial integration of A/B testing for forward-looking assessments. In response, this paper introduces a new framework seamlessly incorporating A/B testing into the Cornac recommendation library. Leveraging a diverse collection of model implementations in Cornac, our framework enables effortless A/B testing experiment setup from offline trained models. We introduce a carefully designed dashboard and a robust backend for efficient logging and analysis of user feedback. This not only streamlines the A/B testing process but also enhances the evaluation of recommendation models in …

Term Importance For Transformer-Based Qa Retrieval : A Case Study Of Stackexchange, Bryan Zhi Yang Tan, Hady W. Lauw

Research Collection School Of Computing and Information Systems

Question-answering (QA) retrieval is the task of retrieving the most relevant answer to a given question from a collection of answers. Various approaches to QA retrieval have been developed recently. One successful and popular model is Contextualized Late Interaction over BERT (ColBERT), a transformer-based approach that adopts a query-document scoring mechanism that retains the granularity of transformer matching, whilst improving on efficiency. However, one key limitation is that it requires further fine-tuning for new query or collection types. In this work, we explore and propose several non-parametric retrieval augmentation methods based on explicit signals of term importance that improve over …

Online Control Of Adaptive Large Neighborhood Search Using Deep Reinforcement Learning, Reijnen Reijnen, Yingqian Zhang, Hoong Chuin Lau, Zaharah Bukhsh

Research Collection School Of Computing and Information Systems

The Adaptive Large Neighborhood Search (ALNS) algorithm has shown considerable success in solving combinatorial optimization problems (COPs). Nonetheless, the performance of ALNS relies on the proper configuration of its selection and acceptance parameters, which is known to be a complex and resource-intensive task. To address this, we introduce a Deep Reinforcement Learning (DRL) based approach called DR-ALNS that selects operators, adjusts parameters, and controls the acceptance criterion throughout the search. The proposed method aims to learn, based on the state of the search, to configure ALNS for the next iteration to yield more effective solutions for the given optimization problem. …

Difference Of Convex Functions Programming For Policy Optimization In Reinforcement Learning, Akshat Kumar

Research Collection School Of Computing and Information Systems

We formulate the problem of optimizing an agent's policy within the Markov decision process (MDP) model as a difference-of-convex functions (DC) program. The DC perspective enables optimizing the policy iteratively where each iteration constructs an easier-to-optimize lower bound on the value function using the well known concave-convex procedure. We show that several popular policy gradient based deep RL algorithms (both for discrete and continuous state, action spaces, and stochastic/deterministic policies) such as actor-critic, deterministic policy gradient (DPG), and soft actor critic (SAC) can be derived from the DC perspective. Additionally, the DC formulation enables more sample efficient learning approaches by …

Escaping Saddle Points In Heterogeneous Federated Learning Via Distributed Sgd With Communication Compression, Sijin Chen, Zhize Li, Yuejie Chi

Research Collection School Of Computing and Information Systems

We consider the problem of finding second-order stationary points in the optimization of heterogeneous federated learning (FL). Previous works in FL mostly focus on first-order convergence guarantees, which do not rule out the scenario of unstable saddle points. Meanwhile, it is a key bottleneck of FL to achieve communication efficiency without compensating the learning accuracy, especially when local data are highly heterogeneous across different clients. Given this, we propose a novel algorithm PowerEF-SGD that only communicates compressed information via a novel error-feedback scheme. To our knowledge, PowerEF-SGD is the first distributed and compressed SGD algorithm that provably escapes saddle points …

Navigating Real-World Challenges: A Quadruped Robot Guiding System For Visually Impaired People In Diverse Environments, Shaojun Cai, Ashwin Ram, Zhengtai Gou, Mohd Alqama Wasim Shaikh, Yu-An Chen, Yingjia Wan, Kotaro Hara, Shengdong Zhao, David Hsu

Research Collection School Of Computing and Information Systems

Blind and Visually Impaired (BVI) people find challenges in navigating unfamiliar environments, even using assistive tools such as white canes or smart devices. Increasingly affordable quadruped robots offer us opportunities to design autonomous guides that could improve how BVI people find ways around unfamiliar environments and maneuver therein. In this work, we designed RDog, a quadruped robot guiding system that supports BVI individuals’ navigation and obstacle avoidance in indoor and outdoor environments. RDog combines an advanced mapping and navigation system to guide users with force feedback and preemptive voice feedback. Using this robot as an evaluation apparatus, we conducted experiments …

Learning To Generate Explainable Stock Predictions Using Self‑Reflective Large Language Models, Kelvin J.L. Koa, Yunshan Ma, Ritchie Ng, Tat‑Seng Chua

Research Collection School Of Computing and Information Systems

Explaining stock predictions is generally a difficult task for traditional non-generative deep learning models, where explanations are limited to visualizing the attention weights on important texts. Today, Large Language Models (LLMs) present a solution to this problem, given their known capabilities to generate human-readable explanations for their decision-making process. However, the task of stock prediction remains challenging for LLMs, as it requires the ability to weigh the varying impacts of chaotic social texts on stock prices. The problem gets progressively harder with the introduction of the explanation component, which requires LLMs to explain verbally why certain factors are more important …

Fashionregen: Llm‑Empowered Fashion Report Generation, Yujuan Ding, Yunshan Ma, Wenqi Fan, Yige Yao, Tat‑Seng Chua, Qing Li

Research Collection School Of Computing and Information Systems

Fashion analysis refers to the process of examining and evaluating trends, styles, and elements within the fashion industry to understand and interpret its current state, generating fashion reports. It is traditionally performed by fashion professionals based on their expertise and experience, which requires high labour cost and may also produce biased results for relying heavily on a small group of people. In this paper, to tackle the Fashion Report Generation (FashionReGen) task, we propose an intelligent Fashion Analyzing and Reporting system based the advanced Large Language Models (LLMs), debbed as GPT-FAR. Specifically, it tries to deliver FashionReGen based on effective …

Reinforcement Retrieval Leveraging Fine-Grained Feedback For Fact Checking News Claims With Black-Box Llm, Xuan Zhang, Wei Gao

Research Collection School Of Computing and Information Systems

Retrieval-augmented language models have exhibited promising performance across various areas of natural language processing (NLP), including fact-critical tasks. However, due to the black-box nature of advanced large language models (LLMs) and the non-retrieval-oriented supervision signal of specific tasks, the training of retrieval model faces significant challenges under the setting of black-box LLM. We propose an approach leveraging Fine-grained Feedback with Reinforcement Retrieval (FFRR) to enhance fact-checking on news claims by using black-box LLM. FFRR adopts a two-level strategy to gather fine-grained feedback from the LLM, which serves as a reward for optimizing the retrieval policy, by rating the retrieved documents …

Towards Explainable Harmful Meme Detection Through Multimodal Debate Between Large Language Models, Hongzhan Lin, Ziyang Luo, Wei Gao, Jing Ma, Bo Wang, Ruichao Yang

Research Collection School Of Computing and Information Systems

The age of social media is flooded with Internet memes, necessitating a clear grasp and effective identification of harmful ones. This task presents a significant challenge due to the implicit meaning embedded in memes, which is not explicitly conveyed through the surface text and image. However, existing harmful meme detection methods do not present readable explanations that unveil such implicit meaning to support their detection decisions. In this paper, we propose an explainable approach to detect harmful memes, achieved through reasoning over conflicting rationales from both harmless and harmful positions. Specifically, inspired by the powerful capacity of Large Language Models …

Collaborative Deep Reinforcement Learning For Solving Multi-Objective Vehicle Routing Problems, Yaoxin Wu, Mingfeng Fan, Zhiguang Cao, Ruobin Gao, Yaqing Hou, Guillaume Sartoretti

Research Collection School Of Computing and Information Systems

Existing deep reinforcement learning (DRL) methods for multi-objective vehicle routing problems (MOVRPs) typically decompose an MOVRP into subproblems with respective preferences and then train policies to solve corresponding subproblems. However, such a paradigm is still less effective in tackling the intricate interactions among subproblems, thus holding back the quality of the Pareto solutions. To counteract this limitation, we introduce a collaborative deep reinforcement learning method. We first propose a preference-based attention network (PAN) that allows the DRL agents to reason out solutions to subproblems in parallel, where a shared encoder learns the instance embedding and a decoder is tailored for …

Rule-Guided Counterfactual Explainable Recommendation, Yinwei Wei, Xiaoyang Qu, Xiang Wang, Yunshan Ma, Liqiang Nie, Tat‑Seng Chua

Research Collection School Of Computing and Information Systems

To empower the trust of current recommender systems, the counterfactual explanation (CE) method is adopted to generate the counterfactual instance for each input and take their changes causing the different outcomes as the explanation. Although promising results have been achieved by existing CE-based methods, we propose to generate the attribute-oriented counterfactual explanation. Different from them, we aim to generate the counterfactual instance by performing the intervention on the attributes, and then build an attribute-oriented counterfactual explainable recommender system. Considering the correlation and categorical values of attributes, how to efficiently generate the reliable counterfactual instances on the attributes challenges us. To …

Identifying Temporomandibular Disorder Morphological Risk Factors Via Explainable Deep Learning And Multiscale Biomechanical Modeling, Shuchun Sun

All Dissertations

Clarifying multifactorial musculoskeletal disorder etiologies supports risk analysis and development of targeted prevention and treatment modalities. Deep learning enables comprehensive risk factor identification through systematic analysis of disease datasets but does not provide sufficient context for mechanistic understanding, limiting clinical applicability for etiological investigations. Conversely, multiscale biomechanical modeling can evaluate mechanistic etiology within the relevant biomechanical and physiological context. We propose a hybrid approach combining 3D explainable deep learning and multiscale biomechanical modeling; we applied this approach to investigate temporomandibular joint (TMJ) disorder etiology by systematically identifying risk factors and elucidating mechanistic relationships between risk factors and TMJ biomechanics and …

Robust And Trustworthy Deep Learning: Attacks, Defenses And Designs, Bingyin Zhao

All Dissertations

Deep neural networks (DNNs) have achieved unprecedented success in many fields. However, robustness and trustworthiness have become emerging concerns since DNNs are vulnerable to various attacks and susceptible to data distributional shifts. Attacks such as data poisoning and out-of-distribution scenarios such as natural corruption significantly undermine the performance and robustness of DNNs in model training and inference and impose uncertainty and insecurity on the deployment in real-world applications. Thus, it is crucial to investigate threats and challenges against deep neural networks, develop corresponding countermeasures, and dig into design tactics to secure their safety and reliability. The works investigated in this …

Representation Learning For Generative Models With Applications To Healthcare, Astronautics, And Aviation, Van Minh Nguyen

Theses and Dissertations

This dissertation explores applications of representation learning and generative models to challenges in healthcare, astronautics, and aviation.

The first part investigates the use of Generative Adversarial Networks (GANs) to synthesize realistic electronic health record (EHR) data. An initial attempt at training a GAN on the MIMIC-IV dataset encountered stability and convergence issues, motivating a deeper study of 1-Lipschitz regularization techniques for Auxiliary Classifier GANs (AC-GANs). An extensive ablation study on the CIFAR-10 dataset found that Spectral Normalization is key for AC-GAN stability and performance, while Weight Clipping fails to converge without Spectral Normalization. Analysis of the training dynamics provided further …

Deep Learning In Indus Valley Script Digitization, Deva Munikanta Reddy Atturu

Theses and Dissertations

This research introduces ASR-net(Ancient Script Recognition), a groundbreaking system that automatically digitizes ancient Indus seals by converting them into coded text, similar to Optical Character Recognition for modern languages. ASR-net, with an 95% success rate in identifying individual symbols, aims to address the crucial need for automated techniques in deciphering the enigmatic Indus script. Initially Yolov3 is utilized to create the bounding boxes around each graphemes present in the Indus Valley Seal. In addition to that we created M-net(Mahadevan) model to encode the graphemes. Beyond digitization, the paper proposes a new research challenge called the Motif Identification Problem (MIP) related …

Satellite Image Analysis And Sidewalk Classification Using Deep Learning Models, Subeksha Khanal

Master's Theses

Lack of sidewalk pavement can contribute to pedestrian fatalities and injuries in the USA. Although many researchers have conducted research on sidewalk detection, there are not many publicly available datasets that we would work on for sidewalk classification. In this study, I conducted classification tasks using pretrained CNN models including VGG16 and ResNet50. I extended these models by adding custom layers at the top of pretrained layers, employing various techniques to improve the classification accuracy.

The dataset comprises 4,731 images of sidewalk based on occlusion levels, including images where the sidewalk is visible from overhead and instances where sidewalk is …

Denoising Diffusion Probabilistic Models Based Accelerated Mri, Alexander Francis Bugielski

Theses and Dissertations

Magnetic Resonance Imaging (MRI) is a cornerstone in obtaining intricate visualizations of anatomy and physiological processes within the human body. However, its extensive scan duration not only causes patient discomfort but also increases the likelihood of motion-induced artifacts in the images. To address such a challenge, this study investigates deep neural network models for reconstructing high-resolution MRI images from noisy and significantly undersampled data in a supervised learning manner. Specifically, it compares three models: a conventional U-Net, a self-attentive U-Net, and an innovative probabilistic diffusion model that builds upon the self-attentive U-Net architecture. These models are evaluated on their ability …

Optimization Pump As Turbine Coupled To A Self-Excited Induction Generator Using Multi-Objective Genetic Algorithm, Emanuel J. Nyirenda

Tanzania Journal of Engineering and Technology (TJET)

As a way of accelerating the deployment of affordable and clean renewable energy generation technologies, applying a pump working as a turbine coupled to a self-excited induction generator is gaining popularity in various areas including energy recovery and micro hydro systems. However, it is currently challenging to predict the performance of the PAT-SEIG system and there is no agreed-upon rule on the selection of the appropriate system to be installed at a particular site. This paper has presented multi-objective optimization to select the best operating point of the PAT-SEIG system. The results show that the peak efficiencies for the PAT …

Assessment Of Risk Factors Related To Body Pain Complaints In Tanzania Construction Industry, Fatma K. Mohamed

Tanzania Journal of Engineering and Technology (TJET)

The construction industry is associated with risks that can result in musculoskeletal diseases. Although young male workers who are presumed to be healthy dominate the industry in Tanzania, body pain complaints have been widely reported. The aim of this study is to assess the prevalence and causes of body pains in workers. A cross-sectional study involving 396 workers was conducted. A chi square test was used for testing association of independent categorical variables and binary logistic regression analysis was used to determine predictors for body pain complaints. The results show that all study participants complained of at least one form …