What Makes A Modern Attention Implementation?,
2026
California Polytechnic State University, San Luis Obispo
What Makes A Modern Attention Implementation?, Brian H. Slonim
Master's Theses
Since the seminal assertion by Vaswani et al. in 2017 that “Attention Is All You Need,” transformer models have risen to ubiquity due to their ability to learn extremely complex patterns from sequence data, culminating in the unprecedented generative capabilities of large language models. These models’ strength lies in their scale: hundreds of millions (e.g., BERT-LARGE) to billions or trillions of learned parameters. Running inference with these models, let alone training them, would be intractable without significant innovations in the hardware and software that support them. This need has driven an enormous demand for GPU compute and associated software ecosystems, …
Political Inconsistency Detection Across Legislative Speech And Public Communications,
2026
California Polytechnic State University, San Luis Obispo
Political Inconsistency Detection Across Legislative Speech And Public Communications, Scott M. Pramuk
Master's Theses
Political actors communicate about legislation across multiple contexts, including committee hearings, recorded votes, and public-facing press releases. Differences between these forms of communication can provide useful signals for journalists and researchers seeking to understand how legislators present policy positions to different audiences.
This thesis extends the Digital Democracy Project, a legislative transparency initiative that provides access to California state legislative hearing transcripts, voting records, and related legislative data. Specifically, this work incorporates publicly accessible, legislator-authored news releases into the Digital Democracy Database and develops a pipeline for analyzing legislative communication across multiple sources. The system collects news releases from California …
Multimodal Machine Learning For Soil Burn Severity Mapping Across California Wildfires,
2026
California Polytechnic State University, San Luis Obispo
Multimodal Machine Learning For Soil Burn Severity Mapping Across California Wildfires, Sanjana Checker
Master's Theses
Accurate mapping of soil burn severity (SBS) is critical for post-fire watershed management, erosion risk assessment, and ecological recovery planning, yet traditional field-based approaches remain costly, time-intensive, and spatially limited. This thesis presents a machine learning pipeline for wall-to-wall SBS classification across California wildfires using multi-sensor satellite imagery, terrain derivatives, and bioclimatic covariates. Field-collected SBS observations (n = 2,180) from 52 wildfires occur- ring between 2013 and 2025, sourced from the U.S. Forest Service and CAL FIRE, were used to train and evaluate multiple classification architectures within a Google Earth Engine and Google Cloud-based prediction framework. After upsampling the unburned …
Ai, Medicine, And Social Determinants Of Health Data,
2026
University of Michigan Law School
Ai, Medicine, And Social Determinants Of Health Data, Ryan Doyloo, Nicholson Price
Articles
This article examines how medical AI systems are incorporating SDoH data and the governance challenges that follow. The authors show that while SDoH integration can enhance clinical workflows and predictive accuracy — potentially improving outcomes for underserved populations — it also introduces acute risks of proxy discrimination, where facially neutral variables replicate protected characteristics. Surveying U.S., EU, and international frameworks, the authors argue that existing regimes lack clear ex ante guidance to distinguish beneficial from harmful uses of SDoH data. In response, they advance post-market monitoring as a pragmatic and scalable pathway: generating real-world, SDoH-stratified evidence that can support enforcement, …
Georoad-Upernet: Geo-1-Based Weakly Supervised Multispectral Road Extraction Via Role-Aware Context Fusion And Semantic Regularization,
2026
Edith Cowan University
Georoad-Upernet: Geo-1-Based Weakly Supervised Multispectral Road Extraction Via Role-Aware Context Fusion And Semantic Regularization, Shaoqian Chen, Yunliang Chen, Jianxin Li, Ao Yang
Research outputs 2022 to 2026
Extracting roads accurately from remote sensing images is important for map updates, traffic analysis, and infrastructure monitoring. Medium-resolution multispectral images can provide useful surface and background information, but when used alone, the spatial details are limited for retaining narrow roads, intersection structures, and fine road topologies. To address this problem, this paper proposes GeoRoad-UPerNet, a Geo-1-centered weakly supervised multispectral framework for road extraction. In this framework, Geo-1 serves as the primary 16-band multispectral source, Sentinel-2 Level-2A imagery serves as auxiliary contextual support, and OpenStreetMap (OSM) road information is converted into proxy supervision rather than dense manual ground truth. GeoRoad-UPerNet contains …
Rvit-Fusionnet: A Local Cross-Attention Feature Fusion-Based Hybrid Framework For Brain Tumor Classification,
2026
Edith Cowan University
Rvit-Fusionnet: A Local Cross-Attention Feature Fusion-Based Hybrid Framework For Brain Tumor Classification, Naima Islam, Sajeeb Kumar Ray, Md Anwar Hossain, Syed Mohammed Shamsul Islam
Research outputs 2022 to 2026
Accurate brain tumor classification via MRI is essential for diagnosis and treatment. This study introduces RViT-FusionNet, a hybrid deep learning model that integrates convolutional and transformer architectures for enhanced tumor detection. The model utilizes ResNet-50 to capture textural details and a Vision Transformer for extracting global context. A Local Cross-Attention (LCA) module is proposed to align and merge these features, allowing the network to model local structures and long-range dependencies concurrently. To enhance generalization across varied imaging conditions and tumor types, a domain discriminator is included to discern spatial and domain-specific patterns, fostering the learning of domain-invariant representations. The approach …
Emotional Support Through Ai: Venting To Artificial Intelligence Or A Perceived Human May Offer Comparable Emotional Well-Being Benefits,
2026
Singapore Management University
Emotional Support Through Ai: Venting To Artificial Intelligence Or A Perceived Human May Offer Comparable Emotional Well-Being Benefits, Meilan Hu, Jerlyn Q. H. Ho, Claire Ng, Shermaine S. M. Wong, Andree Hartanto
Research Collection School of Social Sciences
Artificial Intelligence (AI) chatbots are increasingly being explored as sources of informal emotional support, with emerging evidence suggesting that venting to these systems can reduce negative affect. Yet, it remains unclear whether such benefits depend on the responder's perceived identity. Given that emotional relief from venting often hinges on perceived authenticity and emotional validation, this study investigates whether the emotional well-being benefits of venting differ when users believe they are interacting with an AI chatbot versus a human, even when responses are content-matched. In a pre-registered experiment ( N = 279), participants were randomly assigned to either an AI-assisted venting …
A Novel Hierarchical Multi-Agent System For Payments Using Llms,
2026
Singapore Management University
A Novel Hierarchical Multi-Agent System For Payments Using Llms, Donghao Huang, Joon Kiat Chua, Zhaoxia Wang
Research Collection School Of Computing and Information Systems
Large language model (LLM) agents, such as OpenAI’s Operator and Claude’s Computer Use, can automate workflows but unable to handle payment tasks. Existing agentic solutions have gained significant attention; however, even the latest approaches face challenges in implementing end-to-end agentic payment workflows. To address this gap, this research proposes the Hierarchical Multi-Agent System for Payments (HMASP), which provides an end-to-end agentic method for completing payment workflows. The proposed HMASP leverages either open-weight or proprietary LLMs and employs a modular architecture consisting of the Conversational Payment Agent (CPA - first agent level), Supervisor agents (second agent level), Routing agents (third agent …
Task Complexity Matters: An Empirical Study Of Reasoning In Llms For Sentiment Analysis,
2026
Singapore Management University
Task Complexity Matters: An Empirical Study Of Reasoning In Llms For Sentiment Analysis, Donghao Huang, Zhaoxia Wang
Research Collection School Of Computing and Information Systems
Large language models (LLMs) with reasoning capabilities have fueled a compelling narrative that reasoning universally improves performance across language tasks. We test this claim through a comprehensive evaluation of 504 configurations across seven model families—including adaptive, conditional, and reinforcement learning-based reasoning architectures—on sentiment analysis datasets of varying granularity (binary, five-class, and 27-class emotion). Our findings reveal that reasoning effectiveness is strongly task-dependent, challenging prevailing assumptions: (1) Reasoning shows task-complexity dependence—binary classification degrades up to -19.9 F1% points (pp), while 27-class emotion recognition gains up to +16.0 pp; (2) Distilled reasoning variants underperform base models by 3–18 pp on simpler tasks, …
Enhancing Pointing Gestures Of Non-Hmd Users In Asymmetric Collocated Mixed Reality Collaboration,
2026
Singapore Management University
Enhancing Pointing Gestures Of Non-Hmd Users In Asymmetric Collocated Mixed Reality Collaboration, Nam-Dang Vo, Van-Vinh Thai, Anthony Tang, Khanh-Duy Le
Research Collection School Of Computing and Information Systems
A common collocated group setting in mixed-reality (MR) collaboration is a person wearing a MR headset (HMD user) and presenting MR contents to audiences who are not provided with such specialized devices (Non-HMD users). In this setting, while Non-HMD users can view the MR environment shown on a large physical display, it still remains challenging for the HMD user to interpret their pointing gesture when they spatially refer to objects in the MR environment. To address this, we designed and evaluated two pointing techniques—SCREEN and SCREEN+SPACE—that support Non-HMD users in referring to MR content. Screen pointing allows users to refer …
Adaptive Outlier Detection Over Data Stream,
2026
Singapore Management University
Adaptive Outlier Detection Over Data Stream, Rui Zhu, Mingyuan Jiang, Xiaochun Yang, Baihua Zheng, Bin Wang, Tao Qiu
Research Collection School Of Computing and Information Systems
Continuous distance-based outlier detection in streaming data poses significant challenges and has a wide range of practical applications. Traditional threshold-based methods perform well under stable streaming conditions, where fixed parameters remain effective. However, they often struggle with dynamic data distributions and high stream speeds, leading to suboptimal performance, limited control over the number of returned outliers, and failure to meet real-time detection requirements. To address these issues, this paper introduces a novel Recall and Proportion-Aware Outlier Detection (RPA-OD) query. In RPA-OD, ρ defines a distance relaxation that enables real-time outlier detection. Specifically, objects with fewer than k neighbors within the …
Navigating Oer Support Without Drowning In Ai,
2026
University of Massachusetts Boston
Navigating Oer Support Without Drowning In Ai, Lydia Burrage-Goodwin, Christine Moynihan
Joseph P. Healey Library Publications
This was a presentation at the June 2026 Boston Library Consortium at Connecticut College.
UMB Healey Librarians Lydia Burrage-Goodwin and Christine Moynihan talk about what experiences they have had with faculty using OER and AI, which led them to develop ethics guidelines to support librarians who work with faculty authors. Attendees learned about creating AI use statements for OERs, using AI transparency logos, and applying open licenses to fully AI generated content as well as OER adaptations.
Deployment-Aware Deep Learning For Computer Vision: Efficient Architectures From 3d Segmentation To Mixed Reality,
2026
Western Michigan University
Deployment-Aware Deep Learning For Computer Vision: Efficient Architectures From 3d Segmentation To Mixed Reality, Bahar Uddin Mahmud
Dissertations
Deep learning has become the dominant approach for solving vision-centric problems; however, its successful deployment in real-world applications remains limited by high computational cost, data dependency, and insufficient integration with practical and human-centered environments. While state-of-the art deep learning models often achieve impressive performance in controlled settings, they frequently fail to generalize or operate efficiently under deployment constraints such as limited resources, complex data modalities, and real-time interaction requirements. These limitations motivate the need for a deployment-oriented deep learning framework that balances accuracy, efficiency, and practical usability.
This dissertation investigates the design and deployment of efficient deep learning architectures for …
Benchmarking Gaslighting Negation Attacks Against Multimodal Large Language Models,
2026
Singapore Management University
Benchmarking Gaslighting Negation Attacks Against Multimodal Large Language Models, Bin Zhu, Yinxuan Gui, Huiyan Qi, Jingjing Chen, Chong-Wah Ngo, Ee-Peng Lim
Research Collection School Of Computing and Information Systems
Multimodal Large Language Models (MLLMs) have exhibited remarkable advancements in integrating different modalities, excelling in complex understanding and generation tasks. Despite their success, MLLMs remain vulnerable to conversational adversarial inputs. In this paper, we systematically study gaslighting negation attacks—a phenomenon where models, despite initially providing correct answers, are persuaded by user-provided negations to reverse their outputs, often fabricating justifications. We conduct extensive evaluations of state-of-the-art MLLMs across diverse benchmarks and observe substantial performance drops when negation is introduced. Notably, we introduce the first benchmark GaslightingBench, specifically designed to evaluate the vulnerability of MLLMs to negation arguments. GaslightingBench consists of multiple-choice …
Language Embeddings Meet Shallow Autoencoders,
2026
Singapore Management University
Language Embeddings Meet Shallow Autoencoders, Rodrigo Alves, Vojtěch Vančura, Pavel Kordík, Antoine Ledent
Research Collection School Of Computing and Information Systems
Shallow autoencoders are appealing recommenders due to their simplicity, scalability, and competitive retrieval quality, but they struggle in strict cold-start settings where new items have no interactions. We propose an inductive shallow autoencoder that leverages item side information (language embeddings) by fixing the decoder to item features and learning only an encoder in the same semantic space. To prevent trivial self-reconstruction without enforcing a hard zero diagonal, we introduce diagonal gating: a leave-one-item-out objective that blocks the self-copy shortcut only for the item being updated while retaining context from the rest of the user history. An alternating-style optimization trains the …
Rc-Nf: Robot-Conditioned Normalizing Flow For Real-Time Anomaly Detection In Robotic Manipulation,
2026
Singapore Management University
Rc-Nf: Robot-Conditioned Normalizing Flow For Real-Time Anomaly Detection In Robotic Manipulation, Shijie Zhou, Bin Zhu, Jiarui Yang, Xiangyu Zhao, Jingjing Chen, Yu-Gang Jiang
Research Collection School Of Computing and Information Systems
Recent advances in Vision-Language-Action (VLA) models have enabled robots to execute increasingly complex tasks. However, VLA models trained through imitation learning struggle to operate reliably in dynamic environments and often fail under Out-of-Distribution (OOD) conditions. To address this issue, we propose Robot-Conditioned Normalizing Flow(RC-NF), a real-time monitoring model for robotic anomaly detection and intervention that ensures the robot's state and the object's motion trajectory align with the task. RC-NF decouples the processing of task-aware robot and object states within the normalizing flow. It requires only positive samples for unsupervised training and calculates accurate robotic anomaly scores during inference through the …
Anatomical Domain Shifts: Test-Time Heterogeneous Adaptation For 3d Human Pose Prediction,
2026
Singapore Management University
Anatomical Domain Shifts: Test-Time Heterogeneous Adaptation For 3d Human Pose Prediction, Qiongjie Cui, Pan Zhou, Jingjing Chen, Na Zhao
Research Collection School Of Computing and Information Systems
The research frontier in human pose prediction (HPP) is advancing toward continual test-time adaptation (TTA), where models must self-adapt to dynamic test distributions. To date, the homeostatic continual TTA remains the sole viable solution, which isolates the model parameters and update domain-sensitive ones. Despite mitigating full-body domain gaps, human anatomical heterogeneity (domain shifts often localize to specific regions) is ignored. This anatomical-agnostic approach forces uniform parameter adaptation across kinematically distinct segments, causing: over-adaptation of stable regions and under-adaptation of shift-prone articulations. To address it, we introduce TT-HA, a novel Test-Time Heterogeneous Adaptation that implicitly estimates domain changes for anatomical segments, …
Ai In Healthcare: Regulatory Guidelines And Judge-Made Negligence Principles For Ai Implementers,
2026
Singapore Management University
Ai In Healthcare: Regulatory Guidelines And Judge-Made Negligence Principles For Ai Implementers, Gary K. Y. Chan
Research Collection Yong Pung How School Of Law
The use of artificial intelligence (AI) in healthcare may, notwithstanding its potential benefits, result in harm to patients from allegedly negligent acts or omissions by hospitals and medical doctors. In such circumstances, how should the principles in the tort of negligence (duty of care, breach, causation, remoteness of damage, and defences) respond to AI innovations in healthcare? In particular, how may the standard of care expected of hospitals and medical doctors be informed by regulatory guidelines? We refer to case law precedents and regulatory guidelines on the roles and responsibilities of doctors and hospitals as AI implementers. Importantly, they prompt …
The Security Of Llm-Generated Code,
2026
CUNY John Jay College
The Security Of Llm-Generated Code, Christopher Brian Gonzalez Ayala
Student Theses
The rapid adoption of Large Language Models (LLMs) in software development has transformed coding practices by enabling automated code generation, completion, and optimization. Despite these advantages, concerns persist regarding the security and reliability of LLM-generated code. This study presents a comprehensive evaluation of both the functional correctness and security of code produced by three prominent LLMs as of early 2026. A total of 4,800 code snippets were generated using 100 security-focused programming prompts derived from the OWASP Top 10:2025, translated across eight natural languages and two phrasing styles (literal and natural developer-oriented prompts). To assess performance, a multi-stage experimental framework …
Quantum And Conventional Informatics Studies Of Synthesis Energetics And Defect Formation In Nitride Crystal Epitaxy,
2026
Western Michigan University
Quantum And Conventional Informatics Studies Of Synthesis Energetics And Defect Formation In Nitride Crystal Epitaxy, Andrew Steven Messecar
Dissertations
Machine learning is a valuable approach for the processing and analysis of complex information. By estimating relationships from recorded data, machine learning methodologies can be effective strategies for pattern recognition, enabling investigations and technological applications based thereon. The potential for improved understanding of high-dimensional data has drawn interest towards machine learning from across the sciences, including the research and development of new and improved material systems. In the context of experimental materials research, much of the reported efforts to incorporate machine learning into conventional practice have been primarily focused on either the enhanced analysis of characterization experiment data or the …
