Artificial Intelligence and Robotics Commons^™

An Aspect Performance-Aware Hypergraph Neural Network For Review-Based Recommendation, Junrui Liu, Tong Li, Di Wu, Zifang Tang, Yuan Fang, Zhen Yang

Research Collection School Of Computing and Information Systems

Online reviews allow consumers to provide detailed feedback on various aspects of items. Existing methods utilize these aspects to model users' fine-grained preferences for specific item features through graph neural networks. We argue that the performance of items on different aspects is important for making precise recommendations, which has not been taken into account by existing approaches, due to lack of data. In this paper, we propose an aspect performance-aware hypergraph neural network (APH) for the review-based recommendation, which learns the performance of items from the conflicting sentiment polarity of user reviews. Specifically, APH comprehensively models the relationships among users, …

Marginal Benefit Driven Rl Teacher For Unsupervised Environment Design, Dexun Li, Wenjun Li, Pradeep Varakantham

Research Collection School Of Computing and Information Systems

Training generally capable agents in complex environments is a challenging task that involves identifying the “right” environments at the training stage. Recent research has highlighted the potential of the Unsupervised Environment Design framework, which generates environment instances/levels adaptively at the frontier of the agent’s capabilities using regret measures. While regret approaches have shown promise in generating feasible environments, they can produce difficult environments that are challenging for an RL agent to learn from. This is because regret represents the best-case (upper bound) learning potential and not the actual learning potential of an environment. To address this, we propose an alternative …

Simulation-Free Hierarchical Latent Policy Planning For Proactive Dialogues, Tao He, Lizi Liao, Yixin Cao, Yuanxing Liu, Yiheng Sun, Zerui Chen, Ming Liu, Bing Qin

Research Collection School Of Computing and Information Systems

Recent advancements in proactive dialogues have garnered significant attention, particularly for more complex objectives (e.g. emotion support and persuasion). Unlike traditional task-oriented dialogues, proactive dialogues demand advanced policy planning and adaptability, requiring rich scenarios and comprehensive policy repositories to develop such systems. However, existing approaches tend to rely on Large Language Models (LLMs) for user simulation and online learning, leading to biases that diverge from realistic scenarios and result in suboptimal efficiency. Moreover, these methods depend on manually defined, context-independent, coarse-grained policies, which not only incur high expert costs but also raise concerns regarding their completeness. In our work, we …

Adapting Knowledge Prompt Tuning For Enhanced Automated Program Repair, Xuemeng Cai, Lingxiao Jiang

Research Collection School Of Computing and Information Systems

Automated Program Repair (APR) aims to enhance software reliability by automatically generating bug-fixing patches. Recent work has improved the state-of-the-art of APR by fine-tuning pre-trained large language models (LLMs), such as CodeT5, for APR. However, the effectiveness of fine-tuning be-comes weakened in data scarcity scenarios, and data scarcity can be a common issue in practice, limiting fine-tuning performance. To alleviate this limitation, this paper adapts prompt tuning for enhanced APR and conducts a comprehensive study to evaluate its effectiveness in data scarcity scenarios, using three LLMs of different sizes and six diverse datasets across four programming languages. Prompt tuning rewrites …

Evaluating Software Development Agents: Patch Patterns, Code Quality, And Issue Complexity In Real-World Github Scenarios, Zhi Chen, Lingxiao Jiang

Research Collection School Of Computing and Information Systems

In recent years, AI-based software engineering has progressed from pre-trained models to advanced agentic workflows, with Software Development Agents representing the next major leap. These agents, capable of reasoning, planning, and interacting with external environments, offer promising solutions to complex software engineering tasks. However, while much research has evaluated code generated by large language models (LLMs), comprehensive studies on agent-generated patches, particularly in real-world settings, are lacking. This study addresses that gap by evaluating 4,892 patches from 10 top-ranked agents on 500 real-world GitHub issues from SWE-Bench Verified, focusing on their impact on code quality. Our analysis shows no single …

Drone Delivery Network Design With Uncertainties, Wenjia Zeng, Jiang Ruiwei, Hai Yang, Hai Wang

Research Collection School Of Computing and Information Systems

Unmanned aerial vehicles (UAVs), also called drones, are gaining popularity as an alternative delivery mode due to their faster delivery speed and reduced labor costs. Several companies, especially e-commerce giants, are conducting pilot projects that use drones to deliver fast food and groceries. In 2021, for example, Walmart partnered with Zipline in the United States to provide delivery services for areas near Walmart stores in Arkansas. In China, Meituan drone delivery services have been launched in Shenzhen and have conducted trial food delivery that cover more than 8,000 households.

Unlocking The Potential Of Black-Box Pre-Trained Gnns For Graph Few-Shot Learning, Qiannan Zhang, Shichao Pei, Yuan Fang, Xiangliang Zhang

Research Collection School Of Computing and Information Systems

Few-shot learning has emerged as an important problem on graphs to combat label scarcity, which can be approached by current trends in pre-trained graph neural networks (GNNs) and meta-learning. Recent efforts integrate both paradigms in a white-box setting, leaving the more realistic black-box setting largely underexplored, where the parameters and gradients in the pre-trained GNNs are inaccessible. In this paper, we study the critical problem: Leveraging black-box pre-trained GNNs for graph few-shot learning. Despite its appeal, two key issues hinder the unlocking of its potential: the inherent task gap between pre-training and downstream stages, which can introduce irrelevant knowledge and …

Learning To Identify Seen, Unseen And Unknown In The Open World: A Practical Setting For Zero-Shot Learning, Sethupathy Parameswaran, Yuan Fang, Chandan Gautam, Savitha Ramasamy, Xiaoli Li

Research Collection School Of Computing and Information Systems

As vision-language models advance, addressing the Zero-Shot Learning (ZSL) problem in the open world becomes increasingly crucial. Specifically, a robust model must handle three types of samples during inference: seen classes with visual and semantic information provided in training, unseen classes with only the semantic information in training, and unknown samples with no prior information from training. Existing methods either handle seen and unseen classes together (ZSL) or seen and unknown classes (known as Open-Set Recognition, OSR). However, none addresses the simultaneous handling of all three, which we term Open-Set Zero-Shot Learning (OZSL). To address this problem, we propose a …

Dr. Tongue: Sign-Oriented Multi-Label Detection For Remote Tongue Diagnosis, Yiliang Chen, Steven S. C. Ho, Cheng Xu, Yao Jie Xie, Wing Fai Yeung, Shengfeng He, Jing Qin

Research Collection School Of Computing and Information Systems

Tongue diagnosis is a vital tool in Western and Traditional Chinese Medicine, providing key insights into a patient's health by analyzing tongue attributes. The COVID-19 pandemic has heightened the need for accurate remote medical assessments, emphasizing the importance of precise tongue attribute recognition via telehealth. To address this, we propose a Sign-Oriented multi-label Attributes Detection framework. Our approach begins with an adaptive tongue feature extraction module that standardizes tongue images and mitigates environmental factors. This is followed by a Sign-oriented Network (SignNet) that identifies specific tongue attributes, emulating the diagnostic process of experienced practitioners and enabling comprehensive health evaluations. To …

Quantifying The Role Of Active Listening And Reassurance In Virtual Health Coach Interactions, Ghulam Hussain, Brian Keegan, Robert Ross

Conference papers

Conversational Agents have the potential to support healthcare through coaching exercise routines, but are still lacking in demonstrating authentic social behaviours to support engagement. To this end, we present a series of experiments that we conducted in order to investigate how automated health care coaches can be more effective when their interaction style is tailored to demonstrate qualities associated with a good bedside manner, namely active listening and reassurance. To test this, we first developed a dataset of 135 dialogue excerpts from three distinct sources, i.e., original, handcrafted and LLMs, the latter two of which were tuned to demonstrate specific …

Smart Highway Construction Site Monitoring Using Artificial Intelligence, Mehran Mazari, Yahaira Nava-Gonzalez, Ly Jacky N. Nhiayi, Mohamad H. Saleh

Mineta Transportation Institute

Construction is a large sector of the economy and plays a significant role in creating economic growth and national development,and construction of transportation infrastructure is critical. This project developed a method to detect, classify, monitor, and track objects during the construction, maintenance, and rehabilitation of transportation infrastructure by using artificial intelligence and a deep learning approach. This study evaluated the performance of AI and deep learning algorithms to compare their performance in detecting and classifying the equipment in various construction scenes. Our goal was to find the optimized balance between the model capabilities in object detection and memory processing requirements. …

Patient Consent And The Right To Notice And Explanation Of Ai Systems Used In Health Care, Meghan E Hurley, Benjamin H Lang, Kristin Marie Kostick-Quenet, Jared N Smith, Jennifer Blumenthal-Barby

Center for Medical Ethics and Health Policy Staff Publications

Given the need for enforceable guardrails for artificial intelligence (AI) that protect the public and allow for innovation, the U.S. Government recently issued a Blueprint for an AI Bill of Rights which outlines five principles of safe AI design, use, and implementation. One in particular, the right to notice and explanation, requires accurately informing the public about the use of AI that impacts them in ways that are easy to understand. Yet, in the healthcare setting, it is unclear what goal the right to notice and explanation serves, and the moral importance of patient-level disclosure. We propose three normative functions …

Enhancing Virtual Reality Usability With A Ml Based Dynamic Adaptive System, Ananth Ramaseri-Chandra, Hassan Reza

Computer Science Posters and Presentations

Virtual reality (VR) holds tremendous potential, but cybersickness degrades the user experience. Since individuals vary, a one-size-fits-all design is insufficient. Our work introduces a dynamic adaptive system that personalizes VR experiences by learning individual cybersickness profiles from head-tracking data and sickness questionnaires while adjusting settings such as field of view and foveated rendering strength. Early results show that our system reduces post-exposure sickness scores, enhancing the user experience and highlighting the importance of personalizing VR.

What's The Art In Artificial Intelligence?, Emily Verla Bovino

Open Educational Resources

This workbook learns from Black and Indigenous artists working with Artificial Intelligence to confront issues of ethics and aesthetics in its technologies. It features guided learning activities with links to publicly available video lectures and online articles, and includes options for experiential learning through both a tutorial in Midjourney and a visit to the public art collection at York College in Jamaica, Queens. Featured artists include: American Artist, Rizvana Bradley, Beth Coleman, Denise Ferreira da Silva, Suzanne Kite, Sondra Perry, Mimi Onuoha and Alisha B. Wormsley. Works by Martin Puryear and Maren Hassinger are explored in the Midjourney exercise.

About …

Human-Ai Collaboration In Writing: A Multidimensional Framework For Creative And Intellectual Authorship, James Hutson

Faculty Scholarship

The integration of AI technologies into the writing process has significantly altered traditional notions of authorship, creativity, and intellectual labor. Historically, writing was seen as a human-driven cognitive and creative exercise, but with the rise of generative AI tools such as ChatGPT and Claude, the line between human and AI contributions has become increasingly ambiguous. This paper addresses the limitations of the current sliding scale model, which views AI involvement as ranging from “none” to “complete”. In its place, we propose a new multidimensional framework that more accurately reflects the complexity of human-AI collaboration in writing. The model includes axes …

Beyond The Blue Skies: A Comprehensive Guide For Risk Assessment In Aviation, Leila Halawi, Mark Miller, Sam Holley

Publications

Risk assessment in aviation is a critical process that safeguards the safety and reliability of operations. Aviation operations encompass inherent risks, from mechanical failures to human errors and environmental factors. The significance of these risks may be severe, leading to accidents, injuries, and loss of life. Recognizing and mitigating risks is supreme in this dynamic environment, where emerging technologies and innovation constantly reshape this industry. This chapter includes an in-depth explanation of risk management and analysis, leading to the core elements of risk assessment specifically for aviation operations. We will describe the process and explore some of the applications and …

Using Ai To Make Accessible Accessible Content, Melinda Turner

Faculty Other Scholarly Works

This professional development session will explore how to leverage AI tools, specifically Google’s NotebookLM, to create accessible learning materials for college students. Participants will learn how to use NotebookLM to transform existing content into more accessible formats. The session will cover practical strategies for implementing AI to improve readability and comprehension for all learners including students with disabilities, non-native English speakers, and students with varying learning preferences. We will discuss how to create transcripts for audio/video files and ensure content is well-organized and easy to navigate. This session will also highlight the importance of evidence-based practices in content creation and …

A Review Of Racial Differences And Disparities In Ecg, Jianwei Zheng, Chizobam Ani, Islam Abudayyeh, Yunfan Zheng, Cyril Rakovski, Ehsan Yaghmaei, Omolola Ogunyemi

Mathematics, Physics, and Computer Science Faculty Articles and Research

The electrocardiogram (ECG) is a widely used, non-invasive tool for diagnosing a range of cardiovascular conditions, including arrhythmia and heart disease-related structural changes. Despite its critical role in clinical care, racial and ethnic differences in ECG readings are often underexplored or inadequately addressed in research. Variations in key ECG parameters, such as PR interval, QRS duration, QT interval, and T-wave morphology, have been noted across different racial groups. However, the limited research in this area has hindered the development of diagnostic criteria that account for these differences, potentially contributing to healthcare disparities, as ECG interpretation algorithms largely developed from major …

Bloom: Behavioral Learning And Outcome Observation In Microbes, Sean Sarwar Haque, Luke Compton Wharton, Ming Lin, Razvan Voicu

Symposium of Student Scholars

Understanding how pathogens respond to physical changes in their environment is crucial for developing effective treatments and preventative measures. Current research often relies on static models or experimental data that either fail to capture the dynamic interactions within cellular environments or are not generalizable to other types of pathogens. This project aims to address this gap by creating a comprehensive cell simulation that models pathogens and their response to chemical, physical, and physiological changes. The proposed solution is a simulation that integrates biological data and computational modeling to replicate the behavior of pathogens in real time as they are affected …

Quantifying The Role Of Active Listening And Reassurance In Virtual Health Coach Interactions, Ghulam Hussain, Brian Keegan, Robert Ross

Articles

Conversational Agents have the potential to support healthcare through coaching exercise routines, but are still lacking in demonstrating authentic social behaviours to support engagement. To this end, we present a series of experiments that we conducted in order to investigate how automated health care coaches can be more effective when their interaction style is tailored to demonstrate qualities associated with a good bedside manner, namely active listening and reassurance. To test this, we first developed a dataset of 135 dialogue excerpts from three distinct sources, i.e., original, handcrafted and LLMs, the latter two of which were tuned to demonstrate specific …

Ai Culture ‘Profiling’ And Anti-Money Laundering: Efficacy Vs Ethics, John W. Goodell, Cal B. Muckley, Parvati Neelakantan, Darragh Ryan

University Research

Using extensive transaction and money laundering detection data, at a globally important financial institution, we investigate the efficacy of including facets of national culture in formulating anti-money laundering predictions. For corporate and individual accounts, Hofstede individualism scores of the country in which a customer is resident, or from which a wire is sent/received, are of first-order importance in the detection of money laundering. When combined with account and transaction data; as well as even a proprietary institutional algorithm, individualism scores continue to determine the models’ predictive performances. The efficacy of cultural profiling in money laundering detection underscores the need for …

Limitations In Speech Recognition For Young Adults With Down Syndrome, Franceli L. Cibrian, Yingying 'Yuki' Chen, Kayla Anderson, Cecilia Marie Abrahamsson, Vivian Genaro Motti

Engineering Faculty Articles and Research

Speech recognition has the potential to make technology more accessible to users. However, the accuracy of speech recognition remains limited for users with disabilities, including those with Down Syndrome, and the types and frequencies of recognition errors are poorly understood. This paper characterizes these problems, focusing on errors occurring when recognizing Down Syndrome speech. We analyze the transcripts from six speech recognition algorithms (Google, IBM, Otter.ai, Microsoft, AssemblyAI, OpenAI) using the audio content of 15 individuals with Down Syndrome (331 dialogues; 3428 words). Our analysis shows: (1) significant difference in speech recognition accuracy for people with Down Syndrome compared to …

Self Supervised Artificial Intelligence Predicts Poor Outcome From Primary Cutaneous Squamous Cell Carcinoma At Diagnosis, Nicolas Coudray, Michelle C. Juarez, Maressa C. Criscito, Adalberto Claudio Quiros, Reason Wilken, Stephanie R. Jackson Cullison, Mary L. Stevenson, Nicole A. Doudican, Ke Yuan, Jamie D. Aquino, Daniel M. Klufas, Jeffrey P. North, Siegrid S. Yu, Fadi Murad, Emily Ruiz, Chrysalyne D. Schmults, Cristian D. Cardona Machado, Javier Cañueto, Anirudh Choudhary, Alysia N. Hughes, Alyssa Stockard, Zachary Leibovit-Reiben, Aaron R. Mangold, Aristotelis Tsirigos, John A. Carucci

Department of Dermatology and Cutaneous Biology Faculty Papers

Primary cutaneous squamous cell carcinoma (cSCC) is responsible for ~10,000 deaths annually in the United States. Stratification of risk of poor outcome at initial biopsy would significantly impact clinical decision-making during the initial post operative period where intervention has been shown to be most effective. Using whole-slide images (WSI) from 163 patients from 3 institutions, we developed a self supervised deep-learning model to predict poor outcomes in cSCC patients from histopathological features at initial diagnosis, and validated it using WSI from 563 patients, collected from two other academic institutions. For disease-free survival prediction, the model attained a concordance index of …

Improved Bidirectional A* Quadratic Path Planning Algorithm For Mobile Robots, Jiongyi Li, Qiang Li, Xinwen Zhang, Myo Htet Zin, Yongbin Cai

Journal of System Simulation

Abstract: Aiming at the problems of the traditional A* algorithm, such as the unhoped intersection between the planned path and the obstacles, the planned path has many inflection points and the search time is long, an improved bidirectional A* quadratic path planning algorithm for the indoor environments is proposed. Through the expansion of the map, the intersection between the planned path and the obstacle is solved. By new heuristic functions and bidirectional expansion methods, the search speed and accuracy of the bidirectional A* algorithm are improved. Turning cost function and adaptive weight are introduced to reduce the number of turning …

Collaborative Optimization Problem Of Dynamic Pre-Maintenance And Green Scheduling, Yuyan Jiang, Ning Ma, Yan Li, Rumeijiang Gan, Fuyu Wang

Journal of System Simulation

Abstract: For the traditional flexible job shop scheduling problem, a joint optimization of machine dynamic pre-maintenance and green scheduling is considered to establish an integrated optimization model with the optimization objectives of minimizing maximum completion time, total carbon emissions, and total cost. An improved NSGA-II algorithm is proposed to solve the model. A three-layer encoding method based on process, machine, and pre maintenance is adopted to design a one-step decoding scheme that considers process allocation, machine selection, and machine pre-maintenance strategies. The algorithm improves the elitist retention strategy, designs an adaptive crossover mutation function with algebraic changes, and a mutation …

Trajectory Optimization Of Robotic Arm Based On Improved Simulated Annealing Genetic Algorithm, Qiang Xu, Jianlei Xu, Yanhai Hu, Haihui Chen, Xing Zhang, Zhaohui Xing

Journal of System Simulation

Abstract: To optimize the working trajectory of the robotic arm, a modified simulated annealing genetic algorithm is proposed. Comprehensively considering the operating requirements and performance characteristics of the robotic arm, the five-order polynomial interpolation method is used to plan a smooth motion trajectory in the joint space. The penalty function method is used to handle the individuals that do not meet the constraint conditions, and the fitness function is recalibrated by the dynamic linear calibration method. An adaptive adjustment mechanism for crossover probability and variation probability is set to modify the genetic algorithm. The cooling idea of the simulated annealing …

An Algorithm For Cloud-Based Web Service Combination Optimization Through Plant Growth Simulation, Qiang Li, Huawei Qin, Bingqin Qiao, Ruifang Wu

Journal of System Simulation

Abstract: In order to improve the efficiency of cloud-based web services, an improved plant growth simulation algorithm scheduling model. This model first used mathematical methods to describe the relationships between cloud-based web services and the constraints of system resources. Then, a lightinduced plant growth simulation algorithm was established. The performance of the algorithm was compared through several plant types, and the best plant model was selected as the setting for the system. Experimental results show that when the number of test cloud-based web services reaches 2 048, the model being 2.14 times faster than PSO, 2.8 times faster than the …

Research On Flexible Integrated Scheduling Under Stochastic Processing Times Based On Improved D3qn Algorithm, Xiang Li, Xiaoyu Ren, Yongbing Zhou, Jian Zhang

Journal of System Simulation

Abstract: Aiming at the problem of time uncertainty in discrete manufacturing workshops, we construct an integrated scheduling mathematical model with the optimization objective of minimizing the maximum completion time based on the consideration of equipment and process constraints, and propose an improved dual-competitive deep Q-network algorithm (ID3QN) to solve the flexible integrated scheduling problem under stochastic working hours. The levels of process, machine, and overall scheduling are designed as features. Eight composite scheduling rules are formed as the action space by combining process rules based on processing times, processing sequences, and process structure tree, along with machine rules relevant to …

Research On The Target Allocation Method For Air Defense And Anti-Missile Defense Of Naval Ships, Shuaidi Fei, Changlong Cai, Fei Liu, Minghui Chen, Xiaoming Liu

Journal of System Simulation

Abstract: To solve the problems of multiple types of state information and correlation of time-series state information encountered in the dynamic weapon target assignment problem, a dynamic weapon target assignment method based on an improved deep reinforcement learning algorithm is proposed. A multiinput assignment model of target missile-interceptor unit, interceptor unit, and defense unit under multiwave target and multi-phase is constructed. A multi-input state space is designed, and a Markov decision process is established in conjunction with the problem model. A feature extraction network combining multi-input information processing and gated recurrent network is designed, which improves the ability to extract …

Combat Effectiveness Evaluation Of Air Defense Missile Weapon System Based On Rbf Neural Network, Peng Zhang, Ke Feng, Jiancheng Gong, Xiaoqiang Yang, Jinxing Shen

Journal of System Simulation

Abstract: A combat effectiveness evaluation method based on RBF neural network is proposed to address the problems of high dimensionality, high complexity, and subjective evaluation methods in current air defense missile weapon systems. A combat effectiveness index system for air defense missile weapon systems has been constructed by analyzing the OODA environmental combat theory. The RBF neural network model simulation is implemented using MATLAB, and several methods such as BP, PCABP, and Elman neural network are compared and verified through simulation. The simulation results show that the predicted evaluation results of the RBF neural network model are closer to the …