Digital Commons Network^™

Explainable Neural Networks With Guarantees: A Sparse Estimation Approach, Antoine Ledent, Peng Liu

Research Collection School Of Computing and Information Systems

Balancing predictive power and interpretability has long been a challenging research area, particularly in powerful yet complex models like neural networks, where nonlinearity obstructs direct interpretation. This paper introduces a novel approach to constructing an explainable neural network that harmonizes predictiveness and explainability. Our model is designed as a linear combination of a sparse set of jointly learned features, each derived from a different trainable function applied to a single 1-dimensional input feature. Leveraging the ability to learn arbitrarily complex relationships, our neural network architecture enables automatic selection of a sparse set of important features, with the final prediction being …

Multi-Uav Reconnaissance Mission Planning Via Deep Reinforcement Learning With Simulated Annealing, Mingfeng Fan, Huan Liu, Guohua Wu, Aldy Gunawan, Guillaume Sartoretti

Research Collection School Of Computing and Information Systems

Unmanned aerial vehicles (UAVs) are widely used in reconnaissance missions due to their autonomy and flexibility. Efficient mission planning for multiple UAVs is crucial for tasks such as traffic monitoring and data collection. However, existing approaches to multi-UAV reconnaissance mission planning problem (MURMPP) often struggle with high computational demands, leading to suboptimal solutions. To overcome this challenge, we introduce a divide-and-conquer framework that splits the problem into two phases: target allocation and UAV routing, effectively reducing computational complexity. Specifically, we propose a hybrid method, SA-NNO-DRL, which combines the nearest neighbor optima-based deep reinforcement learning (NNO-DRL) approach with simulated annealing (SA). …

Multisfl: Towards Accurate Split Federated Learning Via Multi-Model Aggregation And Knowledge Replay, Zeke Xia, Ming Hu, Dengke Yan, Ruixuan Liu, Anran Li, Xiaofei Xie, Mingsong Chen

Research Collection School Of Computing and Information Systems

Although Split Federated Learning (SFL) effectively enables knowledge sharing among resource-constrained clients, it suffers from low training performance due to the neglect of data heterogeneity and catastrophic forgetting problems. To address these issues, we propose a novel SFL approach named MultiSFL, which adopts i) an effective multimodel aggregation mechanism to alleviate gradient divergence caused by heterogeneous data and ii) a novel knowledge replay strategy to deal with the catastrophic forgetting problem. MultiSFL adopts two servers (i.e., the fed server and main server) to maintain multiple branch models for local training and an aggregated master model for knowledge sharing among branch …

Dualopt: A Dual Divide-And-Optimize Algorithm For The Large-Scale Traveling Salesman Problem, Shipei Zhou, Yuandong Ding, Chi Zhang, Zhiguang Cao, Yan Jin

Research Collection School Of Computing and Information Systems

This paper proposes a dual divide-and-optimize algorithm (DualOpt) for solving the large-scale traveling salesman problem (TSP). DualOpt combines two complementary strategies to improve both solution quality and computational efficiency. The first strategy is a grid-based divide-and-conquer procedure that partitions the TSP into smaller subproblems, solving them in parallel and iteratively refining the solution by merging nodes and partial routes. The process continues until only one grid remains, yielding a high-quality initial solution. The second strategy involves a path-based divide-and-optimize procedure that further optimizes the solution by dividing it into sub-paths, optimizing each using a neural solver, and merging them back …

Divide-And-Conquer: Confluent Triple-Flow Network For Rgb-T Salient Object Detection, Hao Tang, Zechao Li, Dong Zhang, Shengfeng He, Jinhui Tang

Research Collection School Of Computing and Information Systems

RGB-Thermal Salient Object Detection (RGB-T SOD) aims to pinpoint prominent objects within aligned pairs of visible and thermal infrared images. A key challenge lies in bridging the inherent disparities between RGB and Thermal modalities for effective saliency map prediction. Traditional encoder-decoder architectures, while designed for cross-modality feature interactions, may not have adequately considered the robustness against noise originating from defective modalities, thereby leading to suboptimal performance in complex scenarios. Inspired by hierarchical human visual systems, we propose the ConTriNet, a robust Confluent Triple-Flow Network employing a "Divide-and-Conquer"strategy. This framework utilizes a unified encoder with specialized decoders, each addressing different subtasks …

Enhancing Item‑Level Bundle Representation For Bundle Recommendation, Xiaoyu Du, Kun Qian, Yunshan Ma, Xinguang Xiang

Research Collection School Of Computing and Information Systems

Bundle recommendation approaches offer users a set of related items on a particular topic. The current state-of-the-art (SOTA) method utilizes contrastive learning to learn representations at both the bundle and item levels. However, due to the inherent difference between the bundle-level and item-level preferences, the item-level representations may not receive sufficient information from the bundle affiliations to make accurate predictions. In this article, we propose a novel approach, Enhanced Bundle Recommendation (EBRec), which incorporates two enhanced modules to explore inherent item-level bundle representations. First, we propose to incorporate the bundle-user-item (B-U-I) high-order correlations to explore more collaborative information, thus to …

Attackg+: Boosting Attack Graph Construction With Large Language Models, Yongheng Zhang, Tingwen Du, Yunshan Ma, Xiang Wang, Yi Xie, Guozheng Yang, Yuliang Lu, Ee‑Chien Chang

Research Collection School Of Computing and Information Systems

Attack graph construction seeks to convert textual cyber threat intelligence (CTI) reports into structuredrepresentations, portraying the evolutionary traces of cyber attacks. Even though previous research hasproposed various methods to construct attack graphs, they generally suffer from limited generalizationcapability to diverse knowledge types as well as requirement of expertise in model design and tuning.Addressing these limitations, we seek to utilize Large Language Models (LLMs), which have achieved enormoussuccess in a broad range of tasks given exceptional capabilities in both language understanding and zeroshot task fulfillment. Thus, we propose a fully automatic LLM-based framework to construct attack graphsnamed: AttacKG+. Our framework consists …

Enhanced Sample Selection With Confidence Tracking: Identifying Correctly Labeled Yet Hard-To-Learn Samples In Noisy Data, Weiran Pan, Wei Wei, Feida Zhu, Yong Deng

Research Collection School Of Computing and Information Systems

We propose a novel sample selection method for image classification in the presence of noisy labels. Existing methods typically consider small-loss samples as correctly labeled. However, some correctly labeled samples are inherently difficult for the model to learn and can exhibit high loss similar to mislabeled samples in the early stages of training. Consequently, setting a threshold on per-sample loss to select correct labels results in a trade-off between precision and recall in sample selection: a lower threshold may miss many correctly labeled hard-to-learn samples (low recall), while a higher threshold may include many mislabeled samples (low precision). To address …

Adversarial Attacks On Event-Based Pedestrian Detectors: A Physical Approach, Guixu Lin, Muyao Niu, Qingtian Zhu, Zhengwei Yin, Zhuoxiao Li, Shengfeng He, Yinqiang Zheng

Research Collection School Of Computing and Information Systems

Event cameras, known for their low latency and high dynamic range, show great potential in pedestrian detection applications. However, while recent research has primarily focused on improving detection accuracy, the robustness of event-based visual models against physical adversarial attacks has received limited attention. For example, adversarial physical objects, such as specific clothing patterns or accessories, can exploit inherent vulnerabilities in these systems, leading to misdetections or misclassifications. This study is the first to explore physical adversarial attacks on event-driven pedestrian detectors, specifically investigating whether certain clothing patterns worn by pedestrians can cause these detectors to fail, effectively rendering them unable …

Simulation-Free Hierarchical Latent Policy Planning For Proactive Dialogues, Tao He, Lizi Liao, Yixin Cao, Yuanxing Liu, Yiheng Sun, Zerui Chen, Ming Liu, Bing Qin

Research Collection School Of Computing and Information Systems

Recent advancements in proactive dialogues have garnered significant attention, particularly for more complex objectives (e.g. emotion support and persuasion). Unlike traditional task-oriented dialogues, proactive dialogues demand advanced policy planning and adaptability, requiring rich scenarios and comprehensive policy repositories to develop such systems. However, existing approaches tend to rely on Large Language Models (LLMs) for user simulation and online learning, leading to biases that diverge from realistic scenarios and result in suboptimal efficiency. Moreover, these methods depend on manually defined, context-independent, coarse-grained policies, which not only incur high expert costs but also raise concerns regarding their completeness. In our work, we …

Evaluating Software Development Agents: Patch Patterns, Code Quality, And Issue Complexity In Real-World Github Scenarios, Zhi Chen, Lingxiao Jiang

Research Collection School Of Computing and Information Systems

In recent years, AI-based software engineering has progressed from pre-trained models to advanced agentic workflows, with Software Development Agents representing the next major leap. These agents, capable of reasoning, planning, and interacting with external environments, offer promising solutions to complex software engineering tasks. However, while much research has evaluated code generated by large language models (LLMs), comprehensive studies on agent-generated patches, particularly in real-world settings, are lacking. This study addresses that gap by evaluating 4,892 patches from 10 top-ranked agents on 500 real-world GitHub issues from SWE-Bench Verified, focusing on their impact on code quality. Our analysis shows no single …

Drone Delivery Network Design With Uncertainties, Wenjia Zeng, Jiang Ruiwei, Hai Yang, Hai Wang

Research Collection School Of Computing and Information Systems

Unmanned aerial vehicles (UAVs), also called drones, are gaining popularity as an alternative delivery mode due to their faster delivery speed and reduced labor costs. Several companies, especially e-commerce giants, are conducting pilot projects that use drones to deliver fast food and groceries. In 2021, for example, Walmart partnered with Zipline in the United States to provide delivery services for areas near Walmart stores in Arkansas. In China, Meituan drone delivery services have been launched in Shenzhen and have conducted trial food delivery that cover more than 8,000 households.

Learning To Identify Seen, Unseen And Unknown In The Open World: A Practical Setting For Zero-Shot Learning, Sethupathy Parameswaran, Yuan Fang, Chandan Gautam, Savitha Ramasamy, Xiaoli Li

Research Collection School Of Computing and Information Systems

As vision-language models advance, addressing the Zero-Shot Learning (ZSL) problem in the open world becomes increasingly crucial. Specifically, a robust model must handle three types of samples during inference: seen classes with visual and semantic information provided in training, unseen classes with only the semantic information in training, and unknown samples with no prior information from training. Existing methods either handle seen and unseen classes together (ZSL) or seen and unknown classes (known as Open-Set Recognition, OSR). However, none addresses the simultaneous handling of all three, which we term Open-Set Zero-Shot Learning (OZSL). To address this problem, we propose a …

Dr. Tongue: Sign-Oriented Multi-Label Detection For Remote Tongue Diagnosis, Yiliang Chen, Steven S. C. Ho, Cheng Xu, Yao Jie Xie, Wing Fai Yeung, Shengfeng He, Jing Qin

Research Collection School Of Computing and Information Systems

Tongue diagnosis is a vital tool in Western and Traditional Chinese Medicine, providing key insights into a patient's health by analyzing tongue attributes. The COVID-19 pandemic has heightened the need for accurate remote medical assessments, emphasizing the importance of precise tongue attribute recognition via telehealth. To address this, we propose a Sign-Oriented multi-label Attributes Detection framework. Our approach begins with an adaptive tongue feature extraction module that standardizes tongue images and mitigates environmental factors. This is followed by a Sign-oriented Network (SignNet) that identifies specific tongue attributes, emulating the diagnostic process of experienced practitioners and enabling comprehensive health evaluations. To …

Token Turing Machines Are Efficient Vision Models, Purvish Jajal, Nick Eliopoulos, Benjamin Shiue-Hal Chou, George K. Thiruvathukal, James C. Davis, Yung-Hsiang Lu

Computer Science: Faculty Publications and Other Works

We propose Vision Token Turing Machines (ViTTM), an efficient, low-latency, memory-augmented Vision Transformer (ViT). Our approach builds on Neural Turing Machines (NTM) and Token Turing Machines (TTM), which were applied to NLP and sequential visual understanding tasks. ViTTMs are designed for non-sequential computer vision tasks such as image classification and segmentation. Our model creates two sets of tokens: process tokens and memory tokens; process tokens pass through encoder blocks and read-write from memory tokens at each encoder block in the network, allowing them to store and retrieve information from memory. By ensuring that there are fewer process tokens, we are …

Advances In Natural Fiber Polymer And Pla Composites Through Artificial Intelligence And Machine Learning Integration, Md Helal Uddin, Mohammed Huzaifa Mulla, Tarek Abedin, Abreeza Manap, Boon Kar Yap, Reji Kumar Rajamony, Kiran Shahapurkar, T. M.Yunus Khan, Manzoore Elahi M. Soudagar, Mohammad Nur-E-Alam

Research outputs 2022 to 2026

Natural Fibre Polymer (NFP) and Polylactic Acid (PLA) composites have received a lot of interest in a variety of sectors because they are environmentally friendly, renewable, and sustainable. Over the last decade, researchers have investigated the aspects of NFP/PLA composite development and optimization for a wide range of applications, including packaging materials, automotive components, construction materials, textile and apparel, biomedical devices, agricultural and horticultural applications, electronics, and consumer electronics. Furthermore, using Artificial Intelligence (AI) and Machine Learning (ML) methodologies has increased these polymer materials and associated technologies in their search for new potential ways to further progress in NFP and …

Enhancing Virtual Reality Usability With A Ml Based Dynamic Adaptive System, Ananth Ramaseri-Chandra, Hassan Reza

Computer Science Posters and Presentations

Virtual reality (VR) holds tremendous potential, but cybersickness degrades the user experience. Since individuals vary, a one-size-fits-all design is insufficient. Our work introduces a dynamic adaptive system that personalizes VR experiences by learning individual cybersickness profiles from head-tracking data and sickness questionnaires while adjusting settings such as field of view and foveated rendering strength. Early results show that our system reduces post-exposure sickness scores, enhancing the user experience and highlighting the importance of personalizing VR.

What's The Art In Artificial Intelligence?, Emily Verla Bovino

Open Educational Resources

This workbook learns from Black and Indigenous artists working with Artificial Intelligence to confront issues of ethics and aesthetics in its technologies. It features guided learning activities with links to publicly available video lectures and online articles, and includes options for experiential learning through both a tutorial in Midjourney and a visit to the public art collection at York College in Jamaica, Queens. Featured artists include: American Artist, Rizvana Bradley, Beth Coleman, Denise Ferreira da Silva, Suzanne Kite, Sondra Perry, Mimi Onuoha and Alisha B. Wormsley. Works by Martin Puryear and Maren Hassinger are explored in the Midjourney exercise.

About …

Human-Ai Collaboration In Writing: A Multidimensional Framework For Creative And Intellectual Authorship, James Hutson

Faculty Scholarship

The integration of AI technologies into the writing process has significantly altered traditional notions of authorship, creativity, and intellectual labor. Historically, writing was seen as a human-driven cognitive and creative exercise, but with the rise of generative AI tools such as ChatGPT and Claude, the line between human and AI contributions has become increasingly ambiguous. This paper addresses the limitations of the current sliding scale model, which views AI involvement as ranging from “none” to “complete”. In its place, we propose a new multidimensional framework that more accurately reflects the complexity of human-AI collaboration in writing. The model includes axes …

Beyond The Blue Skies: A Comprehensive Guide For Risk Assessment In Aviation, Leila Halawi, Mark Miller, Sam Holley

Publications

Risk assessment in aviation is a critical process that safeguards the safety and reliability of operations. Aviation operations encompass inherent risks, from mechanical failures to human errors and environmental factors. The significance of these risks may be severe, leading to accidents, injuries, and loss of life. Recognizing and mitigating risks is supreme in this dynamic environment, where emerging technologies and innovation constantly reshape this industry. This chapter includes an in-depth explanation of risk management and analysis, leading to the core elements of risk assessment specifically for aviation operations. We will describe the process and explore some of the applications and …

Using Ai To Make Accessible Accessible Content, Melinda Turner

Faculty Other Scholarly Works

This professional development session will explore how to leverage AI tools, specifically Google’s NotebookLM, to create accessible learning materials for college students. Participants will learn how to use NotebookLM to transform existing content into more accessible formats. The session will cover practical strategies for implementing AI to improve readability and comprehension for all learners including students with disabilities, non-native English speakers, and students with varying learning preferences. We will discuss how to create transcripts for audio/video files and ensure content is well-organized and easy to navigate. This session will also highlight the importance of evidence-based practices in content creation and …

A Review Of Racial Differences And Disparities In Ecg, Jianwei Zheng, Chizobam Ani, Islam Abudayyeh, Yunfan Zheng, Cyril Rakovski, Ehsan Yaghmaei, Omolola Ogunyemi

Mathematics, Physics, and Computer Science Faculty Articles and Research

The electrocardiogram (ECG) is a widely used, non-invasive tool for diagnosing a range of cardiovascular conditions, including arrhythmia and heart disease-related structural changes. Despite its critical role in clinical care, racial and ethnic differences in ECG readings are often underexplored or inadequately addressed in research. Variations in key ECG parameters, such as PR interval, QRS duration, QT interval, and T-wave morphology, have been noted across different racial groups. However, the limited research in this area has hindered the development of diagnostic criteria that account for these differences, potentially contributing to healthcare disparities, as ECG interpretation algorithms largely developed from major …

Bloom: Behavioral Learning And Outcome Observation In Microbes, Sean Sarwar Haque, Luke Compton Wharton, Ming Lin, Razvan Voicu

Symposium of Student Scholars

Understanding how pathogens respond to physical changes in their environment is crucial for developing effective treatments and preventative measures. Current research often relies on static models or experimental data that either fail to capture the dynamic interactions within cellular environments or are not generalizable to other types of pathogens. This project aims to address this gap by creating a comprehensive cell simulation that models pathogens and their response to chemical, physical, and physiological changes. The proposed solution is a simulation that integrates biological data and computational modeling to replicate the behavior of pathogens in real time as they are affected …

Quantifying The Role Of Active Listening And Reassurance In Virtual Health Coach Interactions, Ghulam Hussain, Brian Keegan, Robert Ross

Articles

Conversational Agents have the potential to support healthcare through coaching exercise routines, but are still lacking in demonstrating authentic social behaviours to support engagement. To this end, we present a series of experiments that we conducted in order to investigate how automated health care coaches can be more effective when their interaction style is tailored to demonstrate qualities associated with a good bedside manner, namely active listening and reassurance. To test this, we first developed a dataset of 135 dialogue excerpts from three distinct sources, i.e., original, handcrafted and LLMs, the latter two of which were tuned to demonstrate specific …

Self Supervised Artificial Intelligence Predicts Poor Outcome From Primary Cutaneous Squamous Cell Carcinoma At Diagnosis, Nicolas Coudray, Michelle C. Juarez, Maressa C. Criscito, Adalberto Claudio Quiros, Reason Wilken, Stephanie R. Jackson Cullison, Mary L. Stevenson, Nicole A. Doudican, Ke Yuan, Jamie D. Aquino, Daniel M. Klufas, Jeffrey P. North, Siegrid S. Yu, Fadi Murad, Emily Ruiz, Chrysalyne D. Schmults, Cristian D. Cardona Machado, Javier Cañueto, Anirudh Choudhary, Alysia N. Hughes, Alyssa Stockard, Zachary Leibovit-Reiben, Aaron R. Mangold, Aristotelis Tsirigos, John A. Carucci

Department of Dermatology and Cutaneous Biology Faculty Papers

Primary cutaneous squamous cell carcinoma (cSCC) is responsible for ~10,000 deaths annually in the United States. Stratification of risk of poor outcome at initial biopsy would significantly impact clinical decision-making during the initial post operative period where intervention has been shown to be most effective. Using whole-slide images (WSI) from 163 patients from 3 institutions, we developed a self supervised deep-learning model to predict poor outcomes in cSCC patients from histopathological features at initial diagnosis, and validated it using WSI from 563 patients, collected from two other academic institutions. For disease-free survival prediction, the model attained a concordance index of …

Limitations In Speech Recognition For Young Adults With Down Syndrome, Franceli L. Cibrian, Yingying 'Yuki' Chen, Kayla Anderson, Cecilia Marie Abrahamsson, Vivian Genaro Motti

Engineering Faculty Articles and Research

Speech recognition has the potential to make technology more accessible to users. However, the accuracy of speech recognition remains limited for users with disabilities, including those with Down Syndrome, and the types and frequencies of recognition errors are poorly understood. This paper characterizes these problems, focusing on errors occurring when recognizing Down Syndrome speech. We analyze the transcripts from six speech recognition algorithms (Google, IBM, Otter.ai, Microsoft, AssemblyAI, OpenAI) using the audio content of 15 individuals with Down Syndrome (331 dialogues; 3428 words). Our analysis shows: (1) significant difference in speech recognition accuracy for people with Down Syndrome compared to …

Ai Culture ‘Profiling’ And Anti-Money Laundering: Efficacy Vs Ethics, John W. Goodell, Cal B. Muckley, Parvati Neelakantan, Darragh Ryan

University Research

Using extensive transaction and money laundering detection data, at a globally important financial institution, we investigate the efficacy of including facets of national culture in formulating anti-money laundering predictions. For corporate and individual accounts, Hofstede individualism scores of the country in which a customer is resident, or from which a wire is sent/received, are of first-order importance in the detection of money laundering. When combined with account and transaction data; as well as even a proprietary institutional algorithm, individualism scores continue to determine the models’ predictive performances. The efficacy of cultural profiling in money laundering detection underscores the need for …

Improved Bidirectional A* Quadratic Path Planning Algorithm For Mobile Robots, Jiongyi Li, Qiang Li, Xinwen Zhang, Myo Htet Zin, Yongbin Cai

Journal of System Simulation

Abstract: Aiming at the problems of the traditional A* algorithm, such as the unhoped intersection between the planned path and the obstacles, the planned path has many inflection points and the search time is long, an improved bidirectional A* quadratic path planning algorithm for the indoor environments is proposed. Through the expansion of the map, the intersection between the planned path and the obstacle is solved. By new heuristic functions and bidirectional expansion methods, the search speed and accuracy of the bidirectional A* algorithm are improved. Turning cost function and adaptive weight are introduced to reduce the number of turning …

Research On Task Planning Methods For Space Robot Assisted Operation, Guoqiang Fang, Haitao Chang, Xing Liu, Zhengxiong Liu, Panfeng Huang

Journal of System Simulation

Abstract: In view of the difficulties caused by the complicated task process and numerous task constraints during the space robot assisted operation, a task planning method combining fast forward search algorithm and hierarchical network algorithm is proposed, in which the task planning process is divided into task planning and replanning. Based on the fast forward search task planning method of operation cost, the execution sequence of actions with minimum operation cost is obtained. The task adaptive replanning method based on hierarchical network corrects and compensates the problems according to the priority of compensation for the movement, grab and release actions. …

Design And Simulation Analysis Of Guidance Law For Boost Phase Interceptor Missile, Xu Zhang, Peng Zeng, Xu Li, Xuehe Zheng, Jianheng Xue, Chao Wang

Journal of System Simulation

Abstract: The intercept time window in the boost phase is very short, which requires the missile to have high speed and high acceleration capability, at the same time, because the target ballistic missile is still accelerating in the boost phase, the guidance scheme of the interceptor missile needs to have the ability to cope with the characteristics of the booster phase interceptor missile. The trajectory simulation model is established, and the guidance law of the boost phase interceptor missile in the initial guidance, midguidance and final guidance stage are designed in detail according to the performance of the guidance mechanism …