Artificial Intelligence and Robotics Commons^™

Stprompt++: Prompting Vision-Language Models For Weakly Supervised Video Anomaly Detection And Fine-Grained Localization, Peng Wu, Chengyu Pan, Guansong Pang, Xiangteng He, Zhiwei Yang, Peng Wang, Yanning Zhang

Research Collection School Of Computing and Information Systems

Traditional weakly supervised video anomaly detection (WSVAD) tasks typically rely on coarse-grained frame-level labels for training. Although this approach reduces annotation costs, it results in weak semantic understanding and spatial localization capabilities due to the absence of fine-grained annotations, hindering precise pixel-level anomaly detection and localization. Thanks to the success of vision-language models (VLMs), e.g., CLIP, recent approaches leveraging large VLMs focus on exploiting their strong semantic understanding capabilities, but they typically feed only keyframes or short video segments into the models, without supplying sufficient prior contextual information (e.g., contextual frames around anomalies, zoomed-in anomaly regions, and detailed anomaly descriptions), …

Metarag: Identifying Website Owner Using Meta-Path-Guided Dynamic Graph Retrieval-Augmented Generation, Cheng Tu, Yunshan Ma, Bingyang Guo, Qianyu Li, Yang Li, Min Zhang, Fan Shi, Xiang Wang

Research Collection School Of Computing and Information Systems

Website owner identification aims to link websites to their real-world owners, which is crucial for credibility assessment and information provenance in information retrieval and vital for applications in cybersecurity, Internet governance, and digital regulation. Existing approaches for website owner identification primarily rely on querying infrastructure registration records or analyzing webpage content. However, these methods often fail due to incomplete or outdated registration records and sparse webpage content. We observe that inter-website relationships, derived from shared infrastructure data such as primary domains, IP blocks, and geolocations, can provide valuable but underutilized ownership cues. To exploit this insight, we propose MetaRAG, a …

Artificial Intelligence And Translation: Exploring Current Applications, Limitations And Future Potential Of Language Models Through Japanese-English Translation, Loklin Elias Nord

Undergraduate Theses, Capstones, and Recitals

This thesis highlights the recent improvements and capabilities of Large Language Models (LLMs), specifically their ability to produce translations between different languages. The continued up-scaling of model sizes has led to breakthroughs in the level of their observed intelligence, allowing them to produce translations that are similar in quality to highly skilled human translators. However, to facilitate the reasoning processes that LLMs now possess, their demand for computational power and the supporting hardware and resources has increased proportionally. Considering the impacts of this technology on the environment, energy resources, and its accessibility, my research explores the possibilities of smaller, highly …

Logupdater: Automated Detection And Repair Of Specific Defects In Logging Statements, Renyi Zhong, Yichen Li, Jinxi Kuang, Wenwei Gu, Yintong Huo, R. Michael Lyu

Research Collection School Of Computing and Information Systems

Developers write logging statements to monitor software runtime behaviors and system state. However, poorly constructed or misleading log messages can inadvertently obfuscate actual program execution patterns, thereby impeding effective software maintenance. Existing research on analyzing issues within logging statements is limited, primarily focusing on detecting a singular type of defect and relying on manual intervention for fixes rather than automated solutions.To address the limitation, we initiate a systematic study that pinpoints four specific types of defects in logging statements (i.e., statement code inconsistency, static dynamic inconsistency, temporal relation inconsistency, and readability issues) through the analysis of real-world log-centric changes. We …

Generative Ai Adoption And Solvers' Popularity On Supply-Driven Crowdsourcing Platforms: The Dual Role Of Price Signals, Zimeng Zhu, Carol Hsu, Fiona Fui-Hoon Nah, Na Liu

Research Collection School Of Computing and Information Systems

Purpose – We investigate the effect of solvers’ adoption of Generative AI (GenAI) on their popularity in a supply-driven crowdsourcing platform. We also examine the impact of price signals as well as their heterogeneous impact based on the solvers’ membership duration on the platform. Design/methodology/approach – Our analysis focuses on solvers who adopt GenAI for design-related gigs on the supply-driven crowdsourcing platform. By combining propensity score matching (PSM) with multi-period difference-in-differences (DID), we examine how GenAI adoption impacts solvers’ popularity and how price signals affect this main effect. Findings – Our findings reveal that solvers who adopt GenAI tend to …

How Leaders Build Employee Trust In Artificial Intelligence: Voice Opportunities, Humility, And Trust Transfer, Jack Mcguire, David De Cremer, Devesh Narayanan

Research Collection Lee Kong Chian School Of Business

Artificial intelligence is increasingly central to organizational work, yet employee trust in AI remains fragile. Although prior research has primarily explained trust in AI through technological characteristics such as transparency, reliability, and accuracy, we argue that trust in AI is also shaped by the social context in which employees encounter these systems. Drawing on affect-as-information theory and social information processing theory, we develop and test a model in which leader-provided voice opportunities reduce employees’ negative affect about AI-related work experiences, thereby enhancing perceptions of leader trustworthiness and, in turn, trust in AI. We further propose that this indirect effect depends …

Machine Learning-Based Regression For Magnetic Field Prediction From Odmr Spectral Data, Jesse B. Hernandez

Electronic Theses, Projects, and Dissertations

Optically Detected Magnetic Resonance (ODMR) using nitrogen-vacancy (NV) centers in diamond enables sensitive, room-temperature magnetic field sensing, but real ODMR spectra are often noisy and difficult to analyze with traditional peak-fitting methods. This thesis investigates whether machine learning can reliably predict magnetic field strength directly from ODMR spectra, and compares four model families under a single regression task: a random forest, an artificial neural network (ANN), a one-dimensional convolutional neural network (1D-CNN), and a Transformer.

Training data were generated from an NV-ensemble simulation calibrated to real measurements provided by the Ulsan National Institute of Science and Technology (UNIST), spanning 0 …

Suicide Ideation Detection Using Social Media Data And Ensemble Machine Learning Model, Erol Kina, Jin Ghoo Choi, Abid Ishaq, Rahman Shafique, Monica Gracia Villar, Eduardo Silva Alvarado, Isabel De La Torre Diez, Imran Ashraf

Research outputs 2022 to 2026

Identifying the emotional state of individuals has useful applications, particularly to reduce the risk of suicide. Users’ thoughts on social media platforms can be used to find cues on the emotional state of individuals. Clinical approaches to suicide ideation detection primarily rely on evaluation by psychologists, medical experts, etc., which is time-consuming and requires medical expertise. Machine learning approaches have shown potential in automating suicide detection. In this regard, this study presents a soft voting ensemble model (SVEM) by leveraging random forest, logistic regression, and stochastic gradient descent classifiers using soft voting. In addition, for the robust training of SVEM, …

Keyframe Selection From Motion Capture Data With Dual-Agent Reinforcement Learning, Kun Hu, Wang, Clinton Mo, Mingyang Ma, Shaohui Mei, Zebin Chen, Zhiyong Wang

Research outputs 2022 to 2026

Animation production workflows centered around motion capture techniques require animators to edit motions based on a set of keyframes. However, most existing keyframe selection methods are optimization-based, which suffer from the issues of flexibility and efficiency. In this paper, a novel deep reinforcement learning method with dual agents are proposed for unsupervised keyframe selection. First, an S-Agent and an R-Agent evaluate the actions of selection and refinement, respectively. A deep spatio-temporal network, namely graph keyframe evaluation network (GKEN), is proposed for the agents. Then, an animation specified reward is devised based on reconstruction, which fulfills three important properties of the …

Spatialimaginer: Towards Adaptive Visual Imagination For Spatial Reasoning, Yian Li, Yang Jiao, Bin Zhu, Tianwen Qian, Shaoxiang Chen, Jingjing Chen, Yu-Gang Jiang

Research Collection School Of Computing and Information Systems

Spatial intelligence, which refers to the ability to reason about geometric and physical structure from visual observations, remains a core challenge for multimodal large language models. Despite promising performance, recent multimodal large language models (MLLMs) often exhibit fragile reasoning traces in spatial intelligence tasks that involve consistent spatial state recognition. We argue that these failures stem from a mismatch between the spatial recognition mechanism and the text-only reasoning behavior of these MLLMs. Effective spatial reasoning requires low-level geometric structure to be faithfully preserved and updated throughout the reasoning process, whereas textual representations tend to abstract away precisely these critical details. …

Semantic-Structural Decoupling: Disentangling Semantic Attention From Structural Bias In The Attention Manifold, Pengkun Jiao, Bin Zhu, Jingjing Chen, Yu-Gang Jiang

Research Collection School Of Computing and Information Systems

The empirical success of attention mechanism in Multimodal Large Language Models (MLLMs) often obscures its inherent, subtle flaws. Specifically, MLLMs consistently exhibit disproportionate attention toward certain semantically uninformative visual tokens, a phenomenon termed "register" or "Visual Attention Sinks." While existing inference intervention methods attempt to identify these sink tokens and redistribute their attention weights, such approaches typically treat these tokens in isolation and suffer from computational inefficiency. Instead, we reframe this phenomenon as a generalized textual bias exerted over visual features that extends beyond isolated sink tokens. From this perspective, a pervasive structural bias leads to the dilution of the …

Ddor: Delta Debugging For Explainable Overrefusal Testing And Repair, Qinyan Zhou, Peixin Zhang, Jun Sun, Haonan Zhang, Dongxia Wang

Research Collection School Of Computing and Information Systems

While safety alignment and guardrails help large language models (LLMs) avoid harmful outputs, they can also induce overrefusal, i.e., unwarranted rejection of benign queries that merely appear risky. We present DDOR (Delta Debugging for OverRefusal), a fully automated and explainable framework for overrefusal testing and repair in a black-box setting, where only model inputs and outputs are accessible and internal safety mechanisms remain opaque. DDOR applies delta debugging to localize minimal refusal-triggering fragments (mRTFs) that provide phrase-level, explainable evidence for why a refusal occurs. Conditioned on these mRTFs, DDOR generates diverse, context-rich prompts and performs multi-oracle validation to filter intrinsically …

Mutation-Based Multi-Agent Test Case Update, Dawei Tian, Jiakun Liu, Yun Peng, Yichen Zhang, Jianlei Chi, Jun Sun, Xiaohong Su

Research Collection School Of Computing and Information Systems

Modern software systems evolve rapidly under CI/CD practices, where tests are critical for quality. However, substantial code changes often render existing test cases obsolete, causing pipeline disruptions, reduced productivity, and compromised quality. Recent automatic test update approaches leverage LLMs to refine test cases via execution feedback and exact-matching context retrieval, prioritizing executability and line coverage but suffering three limitations: (1) neglecting test assertion adequacy, weakening fault detection; (2) relying on coarse line coverage instead of specific uncovered lines/branches; (3) using exact-matching retrieval, which fails for LLM hallucinated queries. To address these, we propose MuMuTestUp, a mutation-guided multi-agent framework with three …

Love And Artificial Intelligence: A Research Proposal, Bryanna M. Deatherage, Necdet Gurkan, Sandra J.E. Langeslag

Undergraduate Research Symposium

What happens when people fall in love with Artificial Intelligence (AI)? This study seeks to examine individuals who are in love with AI companions to gain a deeper insight in the cognitive and affective consequences. In addition, this study will examine the most effective forms of intervention regarding growing or reducing feelings of love toward AI. The first part of this study will be a questionnaire about the social and emotional impact of being in love with an AI companion. Three hundred participants will be recruited through online communities related to AI companions. The second part of this study will …

Generative Artificial Intelligence, Academic Integrity And Authentic Assessment Within An Irish University, Louise Nagle, Brigid Crowley, Laura Rafferty, Susan Horgan, Colin O'Brien

Publications

Academics need both an overarching policy on Generative Artificial Intelligence (Gen AI) use in teaching and learning, yet agency in its application across various disciplines. Clarity on the use of the technology for both students and staff is therefore a challenge and characterised by uncertainty given how its application is still unfamiliar. This research examines the organisational context in which Gen AI is being embraced and was conducted by the digital teaching support functions within an Irish university. Students and staff were surveyed (n=1,746) on various aspects of digital use within their education and workplace, including Gen AI. …

Gambaran Generasi Z Yang Kesepian Dalam Penggunaan Chat Ai Sebagai Pemenuhan Kebutuhan “Someone To Talk”, Ikhwanul Ihsan Armalid, Febty Zahra Arsiwi, Qisthi Fathiyyah, Ratri Mayzakky Afra Syahida

Jurnal Psikologi Sosial

This study aims to understand the experiences of Generation Z individuals who experience loneliness in utilizing Chat AI to fulfill their need for someone to talk to within a socio-emotional context. The study employed a qualitative approach using a phenomenological method involving six Generation Z participants aged 18 to 25 who had used Chat AI for emotional sharing or venting. Data were collected through semi-structured interviews and analyzed using thematic analysis. The thematic analysis yielded six main themes: the dynamics of Generation Z social interactions, experiences of loneliness in social life, patterns of Chat AI usage, Chat AI as a …

Ai In Higher Education: Some Notes From The Front, Debra Rienstra

University Faculty Publications and Creative Works

We’re four weeks into the semester now. This past summer, our university unveiled a campus-wide AI policy that exhorts students and faculty to use discernment and tries to lay out some rules about security. Meanwhile, we have purchased a campus-wide subscription to an AI aggregator tool now available to all students, faculty, and staff (in part, from what I understand, as an attempt to effect some boundaries). And then, in the news, all this hand-wringing over the end of humanity, etc., on the one hand and techno-utopian promises on the other.

Closing The Interpretability Gap: Explainable Ml-Based Malware Detection For Defensive Cyberspace Operations, Tashi Stirewalt, Sean Hodgson, Puumaaya Tahiru, Assefaw Gebremedhin

Military Cyber Affairs

This paper presents an end-to-end, explainable malware triage pipeline designed for defense-oriented cyber operations. It combines high-performance static detection methods with analyst-centered interpretability. Utilizing the EMBER 2024 Windows PE subset, we train and evaluate four classifiers and select LightGBM as the production model based on its predictive performance, inference efficiency, and compatibility with exact tree-based attribution. The deployed system consists of four sequential components: PE feature extraction, malware probability scoring, dual explainability (using SHAP and LIME), and large language model (LLM) report generation, all integrated within a Flask web interface. On a temporal test set of 1,080,000 samples, LightGBM achieves …

On-Device Computing Systems For Embodied Ai: Current Research Status And Strategic Directions, Shaoshan Liu, Zhenhua Zhu, Yiming Gan, Yu Wang, Yuan Xie

Bulletin of Chinese Academy of Sciences (Chinese Version)

Embodied AI is emerging as a key paradigm empowering general-purpose autonomy, but it requires on-device computing systems that simultaneously support high-throughput “cognition–planning” tasks and millisecond-level real-time “perception–control” loops. Converging solutions now coalesce around three pillars: (1) dataflow- and chiplet-based architectures, (2) memory-centric heterogeneous dies, and (3) RISC-V customizable cores with open tool-chains. This study distills the latest technical progress, pinpoints the remaining core technical bottlenecks, and charts an actionable course for academia, industry, and policymakers. The study calls for unified benchmarking and standardization, open-source software–hardware ecosystems, memory-centric dataflow architectures, and efficient on-device deployment of embodied foundation models. Finally, it outlines …

Construction And Application Of Clinical Evidence Framework For Brain-Computer Interface, Wenxiu Qi, Cheng Zhou

Bulletin of Chinese Academy of Sciences (Chinese Version)

Brain-computer interface systems are emerging neurotechnologies that are gradually moving from laboratory research toward clinical application. However, their inherent features, including small sample sizes, heterogeneous technical pathways, and rapid product iteration, make it difficult to integrate safety and efficacy data across studies or to conduct meaningful cross-study comparisons. These challenges not only hinder the cumulative development of evidence in evidence-based medicine, but also complicate the assessment of clinical access and regulatory review. In addition, subjective evidence, such as patient experience, remains insufficiently captured in existing evaluation frameworks. It is therefore necessary to examine the structure of evidence for brain-computer interface …

Kanmultisign: Multi-Scale Sequence-Based Pose Animation From Sign Language Notation With Kolmogorov-Arnold Networks, Guanyi Du, Lintao Wang, Kun Hu, Ziyang Wang

Research outputs 2022 to 2026

Sign language production from symbolic notation offers a scalable route to accessible sign animation. We present KANMultiSign, a multi-scale sequence generator that translates HamNoSys notation into two-dimensional human pose sequences. Our framework makes two complementary contributions. First, we introduce a coarse-to-fine generation strategy with multi-scale supervision: the model is first guided by an intermediate body–hand–face scaffold to encourage global structural coherence, and then refines fine-grained hand articulation to improve finger-level detail. Second, we investigate integrating Kolmogorov–Arnold Network modules into a Transformer backbone, using learnable univariate function primitives to model the highly non-linear mapping from discrete phonological symbols to continuous body …

When Does Global Search Pay For Itself? A Measured Exploration Cost And Energy Break-Even Analysis Of A Metaheuristic Search Controller In Solar Energy Systems, Mohamed Ali Muammar Ezgour

Communications of the IIMA

Autonomous energy systems increasingly delegate the choice of operating point to embedded search algorithms, trading a fast local optimizer that can settle on a wrong point against a slower global search that guarantees the right one at a measurable cost. This paper reframes maximum power point tracking under partial shading as that decision and measures its economics on a fixed photovoltaic plant in MATLAB/Simulink. A Hippopotamus Optimization global search handed over to incremental conductance is compared with incremental conductance alone across seventeen initial duty cycles and thirty random seeds. The hybrid reached the global peak in all thirty seeds, whereas …

From Data To Victory: The Race For Analytic Superiority In Warfare, Robert Grossman, Emily Goldman

Joint Force Quarterly

Artificial intelligence technologies have reached a tipping point after decades of development. They are diffusing widely across defense and national security applications. Twenty-first century warfighters rely on analytic models in all systems, at all echelons, and in all domains. As more powerful models built on ever larger data sets become ubiquitous, militaries are in a new competition to deploy artificial intelligence. Operational art must embrace “analytic superiority.” This is the operational advantage from collecting and ingesting data, building robust models and computing infrastructure, deploying the models into operational systems, and denying adversaries' ability to do the same

This article explains …

From Data To Decision-Making: The Role Of Local Digital Twins In Cross-Domain Management Within Municipalities – A Research-In-Progress Study In Veenendaal, Diana M.E. Boekman, Koen Smit, Guido Ongena, Rob Peters

Communications of the IIMA

Municipalities are facing increasingly complex, interconnected challenges in areas like housing, climate adaptation, mobility, and social policy. Local Digital Twins (LDTs) are seen as a promising tool to make this complexity more understandable and support decision-making. At the same time, both literature and practice show that few initiatives get past the pilot phase, even though getting through that phase is essential for successful long-term adoption.

This paper presents a research-in-progress study on the development and application of an implementation method for LDT technology within the municipality of Veenendaal, based on human values rather than driven by technological possibilities. Based on …

From Dissertation To Deployment: A Unified Software Platform Operationalizing Clinical-Prediction And Sequential-Security Ai For Healthcare, Olsi Shehu, Damiana Teliti, Jasmin Kevrić, Bekir Karlik

Communications of the IIMA

Advances in machine learning for healthcare are abundant, yet most validated models remain confined to research notebooks and never reach secure, usable clinical software. This paper addresses that deployment gap by presenting a unified, security-hardened software platform that operationalizes two complementary streams of doctoral research inside a single, role-based hospital information system. The first stream contributes a clinical-prediction capability: an ultra-hybrid ensemble that couples a quantum-inspired feature transformation, particle-swarm feature selection, and calibrated soft voting for cancer-outcome prediction (96.41% accuracy, AUC-ROC 0.983 on TCGA-BRCA), survival stratification, multi-cancer generalization, and pharmacogenomic drug-response classification (89.31% mean accuracy across 25 compounds). The second …

Fast Discovery Of Motivic Patterns In Symbolic Music Via Lossy Compression, Adam James Wilson

Publications and Research

Generative systems that react to live musicians require rapid analysis of musical data, which rules out deep learning models: they cannot be trained within the time constraints of live performance. But because analysis results are often transformed before use, we are free to reduce the parameters that undergo transformation to a small set of primitive states. We address this coincidence of constraint and opportunity with an algorithm for online discovery of maximal musical motives that achieves speed through lossy compression: the pitch and inter-onset-interval deltas for all pairs of events in a potential motive are reduced to two-bit values, conceptualized …

Enhancing Programming Productivity For Individuals With Adhd Through Generative Artificial Intelligence: An Inductive Analysis, Lionel Mew

School of Professional and Continuing Studies Faculty Publications

Attention-deficit/hyperactivity disorder (ADHD) significantly impacts computer programmers through challenges in sustained attention, executive functioning, and organizational skills. While traditional intervention strategies have shown varying degrees of success, the emergence of generative artificial intelligence (AI) presents novel opportunities to address ADHD-related programming challenges. This paper presents an inductive analysis synthesizing current research on ADHD's effects on programming, traditional productivity enhancement techniques, and the potential of generative AI tools. Through examination of recent literature and field studies, we propose that generative AI can serve as a transformative intervention by providing personalized cognitive support, reducing executive function demands, and enhancing code generation efficiency. …

Learning 1-Bit Lidar-Based Localization With Auxiliary Objective, Kaijie Yin, Zhiyuan Zhang, Tian Gao, Wentao Zhu, Cheng-Zhong Xu, Hui Kong

Research Collection School Of Computing and Information Systems

6-DoF LiDAR-based localization is a fundamental capability for autonomous systems operating in large-scale outdoor environments. Many deep-learning-based localization methods have achieved promising performance so far. However, as one of the always-on modules competing for limited on-board computational resources, the localization module is expected to consume only a small portion of the overall compute budget. Most existing learning-based methods are still too heavy for this purpose. In contrast, binary neural networks (BNNs) offer an appealing solution, but the 1-bit compression causes severe information loss and performance drop. In this paper, we address this challenge by proposing Binarized LiDAR-based Localization (BiLoc), the …

Individualized Bayesian Inference Identifies Novel Genetic Variants For Parkinson's Disease, Jin Ren, Yasaman J. Soofi, Md Asad Rahman, Qing Lu, Jinling Liu

Engineering Management and Systems Engineering Faculty Research & Creative Works

Parkinson's disease (PD) is a complex neurodegenerative disorder with a significant genetic component. While genome-wide association studies (GWAS) have been instrumental in identifying genetic variants associated with PD, the reliance on large sample sizes and population-level analyses may overlook variants with lower minor allele frequencies or individual-specific relevance. Individualized Bayesian Inference (IBI) offers a promising method to complement GWAS by identifying and prioritizing candidate genetic markers at both the individual and patients-like-me subgroup levels. This study evaluates the application of IBI to PD genetics, using GWAS as a baseline for comparison. We analyzed genetic data from the Fox Insight online …

Bridging Data Gaps In Retinal Imaging: From Structural Domain Adaptation To Topology-Aware Synthesis, Gözde Merve Demirci

Dissertations, Theses, and Capstone Projects

Comprehensive visualization of the retina is essential for diagnosing and monitoring blinding diseases such as Diabetic Retinopathy and Retinopathy of Prematurity (ROP), where pathological changes often extend beyond a single field of view. Despite significant advances in automated retinal image analysis, clinical deployment remains limited by two fundamental data gaps: a structural learning gap, arising from scarce expert annotations and poor generalization across imaging domains, and a spatial coverage gap, caused by the difficulty of acquiring multi-view retinal images in fragile populations. Although these challenges are often addressed independently, this dissertation argues that they are tightly coupled: accurate, …