Artificial Intelligence and Robotics Commons^™

Unsupervised Recognition Of Unknown Objects For Open-World Object Detection, Ruohuan Fang, Guansong Pang, Wenjun Miao, Xiao Bai, Jin Zheng, Xin Ning

Research Collection School Of Computing and Information Systems

Open-world object detection (OWOD) extends object detection problem to a realistic and dynamic scenario, where a detection model is required to be capable of detecting both known and unknown objects and incrementally learning newly introduced knowledge. Current OWOD models detect the unknowns that exhibit similar features to the known objects, but they suffer from a severe label bias problem, i.e., they tend to detect all regions (including unknown object regions) that are dissimilar to the known objects as part of the background. To eliminate the label bias, this article proposes a novel module, namely reconstruction error-based Weibull (REW) model, that …

Large Language Model For Vulnerability Detection And Repair: Literature Review And The Road Ahead, Xin Zhou, Sicong Cao, Xiaobing Sun, David Lo

Research Collection School Of Computing and Information Systems

The significant advancements in Large Language Models (LLMs) have resulted in their widespread adoption across various tasks within Software Engineering (SE), including vulnerability detection and repair. Numerous studies have investigated the application of LLMs to enhance vulnerability detection and repair tasks. Despite the increasing research interest, there is currently no existing survey that focuses on the utilization of LLMs for vulnerability detection and repair. In this paper, we aim to bridge this gap by offering a systematic literature review of approaches aimed at improving vulnerability detection and repair through the utilization of LLMs. The review encompasses research work from leading …

Collaborative Tree Search For Enhancing Embodied Multi-Agent Collaboration, Lizheng Zu, Lin Lin, Song Fu, Na Zhao, Pan Zhou

Research Collection School Of Computing and Information Systems

Embodied agents based on large language models (LLMs) face significant challenges in collaborative tasks, requiring effective communication and reasonable division of labor to ensure efficient and correct task completion. Previous approaches with simple communication patterns carry erroneous or incoherent agent actions, which can lead to additional risks. To address these problems, we propose Cooperative Tree Search (CoTS), a framework designed to significantly improve collaborative planning and task execution efficiency among embodied agents. CoTS guides multi-agents to discuss long-term strategic plans within a modified Monte Carlo tree, searching along LLMdriven reward functions to provide a more thoughtful and promising approach to …

Keep The Balance: A Parameter-Efficient Symmetrical Framework For Rgb+X Semantic Segmentation, Jiaxin Cai, Jingze Su, Qi Li, Wenjie Yang, Shu Wang, Tiesong Zhao, Shengfeng He, Wenxi Liu

Research Collection School Of Computing and Information Systems

Multimodal semantic segmentation is a critical challenge in computer vision, with early methods suffering from high computational costs and limited transferability due to full fine-tuning of RGB-based pre-trained parameters. Recent studies, while leveraging additional modalities as supplementary prompts to RGB, still predominantly rely on RGB, which restricts the full potential of other modalities. To address these issues, we propose a novel symmetric parameter-efficient fine-tuning framework for multimodal segmentation, featuring with a modality-aware prompting and adaptation scheme, to simultaneously adapt the capabilities of a powerful pre-trained model to both RGB and X modalities. Furthermore, prevalent approaches use the global cross-modality correlations …

Group-And-Match Vs. Route-Then-Insert: Order Dispatching In Vehicle-Based Dual Services (Vedus), Yue Lin, Hai Yang, Hai Wang

Research Collection School Of Computing and Information Systems

Rapid urban transportation and delivery demand and relevant resource constraints have driven the need for more efficient vehicle utilization. An innovative concept, “Vehicle-based MultiServices” (VeMuS), is a service model in which a single vehicle offers multiple services simultaneously in an urban mobility system. Similarly, “Vehicle-based Dual Services” (VeDuS) refers to a vehicle that provides two services simultaneously (Sun et al., 2023).

Predicting Consumers’ Purchase Intention Of Browsed Products: A Study Based On Eye‑Tracking, Feiyan Jia, Choon Ling Sia, Yani Shi, Fiona Fui-Hoon Nah, Keng Siau

Research Collection School Of Computing and Information Systems

Predicting consumers’ purchase intention of browsed products enables sellers to implement nuanced promotion strategies to stimulate purchase. But how can we predict consumers’ purchase intention of browsed products? Our research demonstrates that consumers’ eye movement data collected when they browse products can serve this aim. We train and test the prediction model using logistic regression and random forest algorithms. Using data collected in a laboratory experiment, our empirical results show that both algorithms perform much better than a random guess, and the logistic regression performs slightly better than the random forest. Our findings imply that eye movement data enable sellers …

A Knowledge Enhanced Large Language Model For Bug Localization, Yue Li, Bohan Liu, Ting Zhang, Zhiqi Wang, David Lo, Lanxin Yang, Jun Lyu, He Zhang

Research Collection School Of Computing and Information Systems

A significant number of bug reports are generated every day as software systems continue to develop. Large Language Models (LLMs) have been used to correlate bug reports with source code to locate bugs automatically. The existing research has shown that LLMs are effective for bug localization and can increase software development efficiency. However, these studies still have two limitations. First, these models fail to capture context information about bug reports and source code. Second, these models are unable to understand the domain-specific expertise inherent to particular projects, such as version information in projects that are composed of alphanumeric characters without …

Human-Computer Interaction And Artificial Intelligence For Ageing Population, Keng Siau, Hailiang Wang, Fiona Fui-Hoon Nah, Runyu Wang, Ruitong Che, Can Liu

Research Collection School Of Computing and Information Systems

As the global population ages rapidly, the field of human-computer interaction (HCI) is in urgent need of innovation, redesign, and reengineering to meet the evolving needs of older adults. The older demographic faces a range of challenges—including physical limitations, cognitive decline, reduced social in-tegration, and varying levels of technological literacy—that can hinder effective engagement with digital technologies. In response to these challenges, research-ers and designers are using inclusive and adaptive approaches to enhance acces-sibility, usability, and emotional well-being. This paper reviews key design prin-ciples in HCI for the ageing population and discusses how artificial intelligence (AI) tools, such as voice …

Machine Learning And Optimization For Intelligent Decision-Making, Elson Cibaku

Dissertations

This dissertation presents a series of innovative machine learning and optimization model designs that address complex operational challenges across logistics and power systems. By integrating advanced neural architectures with robust optimization techniques, the work delivers scalable solutions designed to improve efficiency, reliability, and decision-making in dynamic and real-world environments. The first study introduces a two-stage approach to effective vaccine distribution. This framework tackles the capacitated vehicle routing problem by combining adaptive clustering techniques with reinforcement learning and a simulated annealing pickup policy. Through extensive computational experiments, the approach demonstrates substantial improvements in routing efficiency, reducing both computational time and logistical …

Model-Based Reinforcement Learning And Deep Learning For Power Converter Circuit Design Automation, Shaoze Fan

Dissertations

This dissertation presents a comprehensive automated framework for power converter design, leveraging reinforcement learning (RL) and graph-transformer networks (GTN) to address critical inefficiencies in traditional manual topology optimization. Motivated by the combinatorial increase of circuit design spaces and the computational cost of iterative simulations, this work develops a robust framework for generating energy-efficient topologies requiring rapid and reliable circuit design.

The framework integrates three key components: (1) an upper-confidence-bound-tree-based (UCT-based) RL model for circuit topology space exploration, (2) parallelized UCT algorithms to accelerate exploration processes, (3) a Graph-Transformer-based Network enabling fast circuit performance evaluation. Experimental validation demonstrates the whole framework …

Adversarial Robustness In Advanced Machine Learning Models Integrating Graph Neural Networks And Large Language Models, Mahmoud Nazzal

Dissertations

Artificial intelligence (AI) has achieved remarkable performances across various domains. In most real-world applications, data often takes relational forms, such as graphs and networks, or sequential forms, such as text and time series. As AI evolves, specialized models have emerged to handle these structures; Graph Neural Networks (GNNs) for relational mining and Large Language Models (LLMs) for sequential understanding. Despite their success, these models face challenges in security, robustness, and interpretability. GNNs excel in relational reasoning but are vulnerable to adversarial manipulation and lack interpretability, while LLMs are strong in linguistic reasoning and generalization yet struggle with relational data and …

Enriching Vision Representation By Deep Neural Networks And Self-Supervised Learning, Yucong Shen

Dissertations

Nowadays, more and more interesting computer vision tasks are tackled by deep learning approaches. However, the increasing model complexity imposes significant computational and storage costs. To address this challenge, this dissertation explores efficient deep learning techniques, proposing morphological layer, an efficient feature extraction layer. It achieves competitive image classification accuracy with significantly decreased model parameters. Another attempt at efficient deep learning is a proposed channel pruning approach that compresses deep neural networks by identifying and removing redundant channels using optimal transport theory. This approach achieves significant reductions in model size and computational cost while maintaining or even improving performance across …

From Neural Networks To Large Language Models: Innovations In Financial Ai, Mathematical Reasoning, And Structured Data Representation, Junyi Ye

Dissertations

This dissertation explores the evolution and application of artificial intelligence techniques across three critical domains: financial modeling, mathematical reasoning, and structured data analysis. The dissertation presents seven research projects that chart a progression from specialized neural architectures to sophisticated large language models (LLMs), contributing novel methodologies and frameworks at each stage.

In the financial domain, the research first introduces TS-Mixer, a MLP-based architecture for time-series forecasting that captures both feature relationships and temporal dependencies through a simple yet effective design, outperforming more complex models in S&P500 index prediction. The dissertation then presents DySTAGE, a dynamic graph representation learning framework that …

Gamified Gait Rehabilitation Via Real-Time Biofeedback And Adaptive Hip-Exoskeleton Control, Mariya Huzaifa Tohfafarosh

Theses

Gait impairments arise from systemic diseases, age-related degeneration, musculoskeletal dysfunctions, or neurological conditions. While traditional rehabilitation can be effective, they often face challenges such as high costs, inaccessibility, and low patient engagement. To address these challenges, my work introduces a virtual reality-based rehabilitation (VRBR) system, integrating real-time motion and electromyographic (EMG) muscle activation feedback with a gamified virtual environment for enhanced adaptability and engagement. The system includes a custom-designed hip-exoskeleton that provides adaptive spring-like assistance or resistance, supporting both mobility-impaired users and strength training. Assistance levels can be tuned to match the user's progress. Additionally, a custom pressure insole was …

Quantum-Enhanced Training Of Large Language Models: A Hybrid Approach, Nan Wu, Fangmin Song, Xiangdong Li

Publications and Research

The training of large language models (LLMs) presents significant computational challenges, particularly regarding efficient convergence. This paper presents a hybrid quantum-classical framework designed to address the significant computational challenges associated with training large language models (LLMs). By integrating quantum computing principles superposition, entanglement, and tunneling with classical deep learning methods, we propose an approach to accelerate convergence, enhance optimization efficiency, and improve model generalization. Specifically, quantum feature mapping is employed to project classical data into high-dimensional Hilbert spaces, facilitating more expressive data representations. Quantum-assisted optimization algorithms, such as Quantum Approximate Optimization Algorithm (QAOA) and Variational Quantum Eigensolver (VQE), efficiently navigate …

Artificial Intelligence Use In Medical Education: Best Practices And Future Directions, Rasheed A. M. Thompson, Yash B. Shah, Francisco Aguirre, Courtney Stewart, Costas D. Lallas, Mihir S. Shah

Department of Urology Faculty Papers

PURPOSEOF REVIEW: This review examines the various ways artificial intelligence (AI) has been utilized in medical education (MedEd)and presents ideas that will ethically and effectively leverage AI in enhancing the learning experience of medical trainees.

RECENT FINDINGS: AI has improved accessibility to learning material in a manner that engages the wider population. It has utility as a reference tool and can assist academic writing by generating outlines, summaries and identifying relevant reference articles. As AI is increasingly integrated into MedEd and practice, its regulation should become a priority to prevent drawbacks to the education of trainees. By involving physicians in …

Who Should Take Responsibility For Artificial Intelligence Actions And Outcomes? Perception Of Auditors As Users Of Ai Systems, Hanh Hoang Le

Doctoral Dissertations

As artificial intelligence (AI) systems become increasingly embedded in auditing processes, questions arise regarding how professional auditors perceive and allocate responsibility for AI-assisted decisions. This study investigates the effects of AI explainability and auditors’ perceived autonomy on perceived responsibility in the context of audit decision-making. Drawing on theories of moral responsibility and professional judgment, the study employs a 2x2 experimental design using hypothetical audit scenarios to manipulate levels of AI explainability and auditors’ autonomy. Hierarchical regression analysis reveals that perceived autonomy statistically significantly increases auditors’ perception of responsibility for AI-assisted decisionmaking, whereas AI explainability is not a significant predictor. Additionally, …

Characterization Of Sars-Cov-2 Replication And Transcription Complexes Via Structural And Evolutionary Approaches, Amelie Ghirardo, Ben Shabatian, Avishai Aghelian, Kyle Tau, Eleonora Gianti

Undergraduate Research

Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) caused around 700M cases and over 7M COVID-19-related deaths recorded worldwide (World Health Organization, March 2025). Aiming to effectively combat this and other disease-causing Coronaviruses (CoV), unprecedented research efforts led to the development of new vaccines and antiviral therapies. Due to emergence of variants of concern (VOCs) with increased transmissibility, immune evasion from vaccination, and potential to resist the available treatments, SARS-CoV-2 continues to represent a major threat to global health. Hence, there is a pressing need to discover new antivirals with broad-spectrum efficacy against multiple SARS-CoV-2 variants and related CoVs. This project …

Selected Artificial Intelligence Provisions In U.S. Fiscal Year 2025 National Defense Authorization Act, Bert Chapman

Libraries Faculty and Staff Presentations

The 2025 Fiscal Year National Defense Authorization Act contains multiple provisions relating to artificial intelligence (AI). These congressionally mandated provisions direct various sections of the Department of Defense (DOD) and individual U.S. armed service branches to execute congressional intent for AI policymaking. Examples of such intent include identifying and planning DOD's AI workforce, demonstrating AI biotechnology applications for national security, improving the human usability of AI systems, and establishing an AI security center. This presentation will note that reports on these initiatives must be prepared for relevant congressional oversight committees, and, in many cases, are in many cases, publicly released …

Ai And Ethical Use Implication For Research, Kelley Plass, Sierra Campbell

May Institute

Artificial intelligence (AI) is becoming increasingly integrated into our daily lives, especially for students. While there are valid debates about the advantages and disadvantages of students using AI for their assignments, such as comparing tools like Grammarly and ChatGPT, one aspect that often goes unexamined is the information sources that AI relies on. AI is now integrated into search engines like Google and Bing, making it accessible to everyone. Additionally, with the emergence of AI research tools like ResearchRabbit, AI's role in everyday activities continues to expand beyond easily accessible resources such as subscription databases. AI is now an optional …

Research On Grey-Box Modeling Method Of Digital Twins For Cantilever Structure, Wenjia Zhang, Heming Zhang

Journal of System Simulation

Abstract: The construction of accurate and highly real-time digital twin models in complex industrial setting presents several challenges. Traditional model construction approaches based only on mechanism or data show certain limitations. Therefore, this study is based on the idea of grey-box modeling, taking the cantilever structure within a boom-type roadheader as the object, and proposes a novel modeling approach that combines the characteristics of the mechanism model and introduces a self-attention mechanism. This method performs grayscale transformation on the original input and splices it with physical features to achieve organic fusion of mechanism information, which not only enhances the expressiveness …

An Extended Image Features Based Uncalibrated Visual Servoing Method, Shuzhen Zhang, Yukun Cheng, Yangbo Liu, Fusheng Zha

Journal of System Simulation

Abstract: Aiming at the traditional uncalibrated visual servo relying on the estimation of image Jacobi matrix and the coupling of the motion of each degree of freedom of the camera, on the basis of imagebased uncalibrated visual servo, an extended image features based uncalibrated visual servo method is proposed. By analyzing the relationship between image features and camera frames change in the visual servoing process, the visual servoing process in the image space is decomposed into four basic processes: translation, stretching, rotation and scaling; by analyzing the changing of image features in the visual servoing process, extended image features are …

A Modeling And Simulation Method For Firepower Intelligent Decision-Making Of Directed Energy System Basedon Joint Dqn, Changhong Qu, Junjie Wang, Kun Wang, Qingyong Cui, Jiangyang Chen, Xinpeng Wang

Journal of System Simulation

Abstract: In order to solve the problem of dynamically addressing firepower intelligent decision-making in anti-UAV cluster combat using a directed energy system, a deep reinforcement learning model is established. Based on the high multi-agent state and action space dimensions of this model, a modeling and simulation method of firepower intelligent decision-making of directed energy system based on joint deep Q network (DQN) is proposed. The state space is constructed from the state of directed energy system, UAV cluster and the directed energy system deployment area. The joint mechanism is used to share the state information of each equipment and the …

Research On Modeling, Optimization And Application Of Aeroengine Oil System, Shijie Huang, Zhensheng Zhang, Jing Cai, Rui Zhang

Journal of System Simulation

Abstract: In response to the high cost and long cycle of using experimental methods for monitoring, diagnosing, and predicting lubricating oil system, a simulation model for oil system is constructed and optimized, and the application of the model in health management of oil system is proposed. Based on the physical characteristics of the components in the oil system, subsystem models for ventilation, oil supply, thermodynamics, and oil return are constructed using a certain engine oil system as an example, and the whole oil system model is constructed and solved iteratively. The model is optimized by combining particle swarm optimization and …

Why Commencement Will Be The One Ritual Ai Will Never Replace, Essraa Nawar

Library Articles and Research

"We are entering an era of unimaginable change.

Artificial Intelligence is transforming how we work, learn, create, and think. It’s reshaping higher education—and pushing many to ask: Is college still worth it? Are degrees still necessary?

Those questions are real. And I welcome them.

But I also know this: no machine can replace the moment a family claps through tears when their loved one walks the stage."

Adaptive Multi-Scale Feature Pyramid Network For Occlusion Pedestrian Detection, Huaping Zhou, Tao Wu, Kelei Sun

Journal of System Simulation

Abstract: To address the issue of current pedestrian detectors, which struggle to extract complete features in occlusion-heavy environments and consequently have low detection accuracy. A novel adaptive multiscale feature pyramid network is proposed. A multi-scale feature enhancement module (MFEM) is developed. It captures the visible area of pedestrians at different scales through a multi-branch network with different receptive fields. An AFM (adaptive fusion module) is proposed. It calculates the importance of different pixels by optimizing the mean variance at the spatial and feature levels. It enhances the texture and semantic features of pedestrians and fuses the features of different scales …

Design And Realization Of Integrated Energy System Dynamic Stability Simulation And Steady-State Simulation System, Guixiong He, Xiaoqiang Jia, Shufeng Dong, Yonglu Han, Yonghua Chen, Yiming Zheng

Journal of System Simulation

Abstract: Aiming for“carbon peak”and“carbon neutrality”, the energy sector is undergoing significant reform. To address energy flow and planning optimization in integrated energy systems, a comprehensive simulation platform is developed. This platform combines physical and digital simulations with real-world validation and is modular in design, It includes an integrated energy model library, energy flow optimization, modeling management, real-time simulation, and energy monitoring. The platform enhances system safety, stability, and economic efficiency, While also improving planning and energy management. The paper analyzes the platform′s functional and physical architecture, introduces key modules, establishes dynamic and steady-state model libraries, and optimizes energy flow using …

Research On Modeling Methods For Industrial Core Capability Architecture Based On The Dodaf Framework, Xiaoqiang Dou, Yan Liu, Zhilong Zhao, Chao Fu, Fulin Zhang, Shanshan Zou

Journal of System Simulation

Abstract: Against the backdrop of the industrial sector actively pursuing digital capability building, this paper describes the necessity and current status of architecture theory methods guiding industrial core capability construction. It proposes the conceptual connotation of industrial core capability architecture and four key modeling elements. Based on DoDAF, it conducts the overall design of industrial core capability architecture. By integrating systems engineering principles, it establishes a five-stage process model for capability-building activities, embedding critical elements such as capability/business/ application/data/technology architecture viewpoint, and explains data model design, and logical compositions of various viewpoints. By selecting a capability building project in a …

Leveraging Artificial Intelligence In Education To Drive Cross-Sector Innovation, Brent Terwilliger, John Faraca

Publications

As artificial intelligence (AI) reshapes educational practices, particularly in technical fields such as uncrewed systems, robotics, and aviation/ aerospace, its integration raises promise and complexity. This exploratory study features an investigation of the impact AI tools adoption has on instruction, curriculum support, and workforce preparation, with a focus on online learning environments. Drawing from pilot survey data across aviation and aerospace education stakeholders and hands-on evaluation of AI video production platforms, findings reveal diverse applications, perceived benefits, and critical concerns, including ethical, pedagogical, and institutional challenges. Additionally, the analysis explored how AI-enabled education intersects with broader industry and government innovation …

Survey On Large Language Agent Technologies For Intelligent Game Theoretic Decision-Making, Xueqiang Gu, Junren Luo, Yanzhong Zhou, Wanpeng Zhang

Journal of System Simulation

Abstract: The development of artificial intelligence technology has greatly promoted the transformation of the solving paradigm of intelligent game decision problems. From optimal solution, equilibrium solution to adaptive variable solution, how to build an intelligent game adaptive decision agent based on generative large model is full of challenges. The force distribution and multi-entity coordination in the game strong confrontation environment are the core issues in the study of troop deployment and operational coordination. Based on the methods of strategy reinforcement learning, strategy game tree search and strategy preference voting based on skill, ranking and preference meta-game model construction, a large …