Digital Commons Network^™

Visual Loop: Bridging The Cognitive Gap In Software Development Through Visual-Ai Collaboration, Luis Filipe Fernandes Gomes, Xin Zhou, David Lo, Rui Abreu

Research Collection School Of Computing and Information Systems

Software development remains predominantly text-centric, despite decades of evidence showing that developers think and communicate visually. While sketches and diagrams externalize developers’ mental models, they remain disconnected from source code and quickly become outdated. Recent advances in foundation models, capable of both code and visual reasoning, create an opportunity to unify these representations. In this vision paper, we introduce Visual Loop, a continuous visual development environment that keeps code and informal sketches in bidirectional synchronization. Our prototype connects a code editor with a tablet-based visualization workspace, allowing developers to explore, annotate, and modify systems through freehand sketches interpreted by multimodal …

Think First, Chatgpt Later: Guiding Human-Ai Collaboration For Learning Gains In Independent Human Creativity, Sarah Shi Hui Wong, Sophia Xuefei Qiu

Research Collection School of Social Sciences

Generative artificial intelligence (AI) tools such as ChatGPT can boost creative performance, but do these boosts translate into learning gains? This study examined whether the benefits of ChatGPT for creativity persist even when its assistance is removed, and how people can effectively use ChatGPT to enhance their learning and independent creativity. University students (N = 196) solved a creative product improvement task either independently (human-only group) or using ChatGPT freely (general-AI group) or using ChatGPT in a guided way (regulated-AI group). Specifically, the regulated-AI group used a novel “think first, ChatGPT later” approach—they first generated their own ideas, then collaborated …

Context Engineering For Ai Agents In Open-Source Software, Seyedmoein Mohsenimofidi, Matthias Galster, Christoph Treude, Sebastian Baltes

Research Collection School Of Computing and Information Systems

GenAI-based coding assistants have disrupted software development. The next generation of these tools is agent-based, operating with more autonomy and potentially without human oversight. Like human developers, AI agents require contextual information to develop solutions that are in line with the standards, policies, and workflows of the software projects they operate in. Vendors of popular agentic tools (e.g., Claude Code) recommend maintaining version-controlled Markdown files that describe aspects such as the project structure, code style, or building and testing. The content of these files is then automatically added to each prompt. Recently, AGENTS.md has emerged as a potential standard that …

On Autopilot? An Empirical Study Of Human-Ai Teaming And Review Practices In Open Source, Haoyu Gao, Peerachai Banyongrakkul, Hao Guan, Mansooreh Zahedi, Christoph Treude

Research Collection School Of Computing and Information Systems

Large Language Models (LLMs) increasingly automate software engineering tasks. While recent studies highlight the accelerated adoption of “AI as a teammate” in Open Source Software (OSS), developer interaction patterns remain under-explored. In this work, we investigated project-level guidelines and developers’ interactions with AI-assisted pull requests (PRs) by expanding the AIDev dataset to include finer-grained contributor code ownership and a comparative baseline of human-created PRs. We found that over 67.5% of AI-co-authored PRs originate from contributors without prior code ownership. Despite this, the majority of repositories lack guidelines for AI-coding agent usage. Notably, we observed a distinct interaction pattern: AI-co-authored PRs …

Who Said Cve? How Vulnerability Identifiers Are Mentioned By Humans, Bots, And Agents In Pull Requests, Pien Rooijendijk, Christoph Treude, Mairieli Wessel

Research Collection School Of Computing and Information Systems

Vulnerability identifiers such as CVE, CWE, and GHSA are standardised references to known software security issues, yet their use in practice is not well understood. This paper compares vulnerability ID use in GitHub pull requests authored by autonomous agents, bots, and human developers. Using the AIDev pop dataset and an augmented set of pull requests from the same repositories, we analyse who mentions vulnerability identifiers and where they appear. Bots account for around 69.1% of all mentions, usually adding few identifiers in pull request descriptions, while human and agent mentions are rarer but span more locations. Qualitative analysis shows that …

Autologger: A Multi-Agent Framework For The End-To-End Automated Logging, Renyi Zhong, Yintong Huo, Wenwei Gu, Yichen Li, Michael R. Lyu

Research Collection School Of Computing and Information Systems

Software logging is critical for system observability, yet developers face a dual crisis of costly overlogging and risky underlogging. Existing automated logging tools often overlook the fundamental whether-to-log decision and struggle with the composite nature of logging. In this paper, we propose AutoLogger, a novel hybrid framework that addresses the complete the end-to-end logging pipeline. AutoLogger first employs a fine-tuned classifier, the Judger, to accurately determine if a method requires new logging statements. If logging is needed, a multi-agent system is activated. The system includes specialized agents: a Locator dedicated to determining where to log, and a Generator focused on …

Personality Predictors Of Cybersecurity Vulnerability: Insights From Self-Reports And Stimulated Threat Scenarios, Saroja Roy Grandhi

Psychology Theses & Dissertations

In this cyber dependent and enabled era, understanding the role of human factors in digital security is essential. This study investigates the relationship between Big-Five personality traits and cybersecurity behaviors by examining both self-reported and stimulated behaviors in security threat scenarios. Participants completed validated questionnaires to report their personality traits, cybersecurity practices and engage in task-based stimulations to capture behaviors such as phishing detection, password creation, and response to security alerts. The study tested whether higher conscientiousness, openness, and agreeableness would be associated with stronger cybersecurity practices and smaller discrepancies between self-reported and observed behaviors. And, whether greater extraversion and …

Structural Silence: When Ai Infrastructure Fails Speakers Of Underrepresented Languages, Avijit Roy, Proma Roy

Publications and Research

Artificial intelligence tools for education and language support are increasingly framed as scalable responses to access gaps in under-resourced communities. Yet the infrastructure underlying these tools—training corpora, tokenization schemes, evaluation benchmarks, and deployment architectures—encodes a set of assumptions that systematically disadvantages speakers of underrepresented languages before a single model is trained. This paper examines those assumptions through the lens of Bengali, one of the world’s most widely spoken languages with roughly 285 million speakers (Ethnologue, 2025; International Communication and Leadership School, 2026), and the structural barriers that emerge when attempting to build AI-assisted educational tools for Bengali-speaking learners in low-connectivity …

Weakly Supervised Video Anomaly Detection And Localization With Spatio-Temporal Prompts, Peng Wu, Xuerong Zhou, Guansong Pang, Zhiwei Yang, Qingsen Yan, Peng Wang, Yanning Zhang

Research Collection School Of Computing and Information Systems

Current weakly supervised video anomaly detection (WSVAD) task aims to achieve frame-level anomalous event detection with only coarse video-level annotations available. Existing works typically involve extracting global features from full-resolution video frames and training frame-level classifiers to detect anomalies in the temporal dimension. However, most anomalous events tend to occur in localized spatial regions rather than the entire video frames, which implies existing frame-level feature based works may be misled by the dominant background information and lack the interpretation of the detected anomalies. To address this dilemma, this paper introduces a novel method called STPrompt that learns spatio-temporal prompt embeddings …

Portrait Shadow Removal Via Self-Exemplar Illumination Equalization, Qian Huang, Cheng Xu, Guiqing Li, Ziheng Wu, Shengxin Liu, Shengfeng He

Research Collection School Of Computing and Information Systems

We introduce the Self-Exemplar Illumination Equalization Network, designed specifically for effective portrait shadow removal. The core idea of our method is that partially shadowed portraits can find ideal exemplars within their non-shadowed facial regions. Rather than directly fusing two distinct classes of facial features, our approach utilizes non-shadowed regions as an illumination indicator to equalize the shadowed regions, generating deshadowed results without boundary-merging artifacts. Our network comprises cascaded Self-Exemplar Illumination Equalization Blocks (SExmBlock), each containing two modules: a self-exemplar feature matching module and a feature-level illumination rectification module. The former identifies and applies internal illumination exemplars to shadowed areas, producing …

Causality-Aware Safety Testing For Autonomous Driving Systems, Wenbing Tang, Mingfei Cheng, Renzhi Wang, Yuan Zhou, Chengwei Liu, Yang Liu, Zuohua Ding

Research Collection School Of Computing and Information Systems

Simulation-based testing is essential for evaluating the safety of Autonomous Driving Systems (ADSs). Comprehensive evaluation requires testing across diverse scenarios that can trigger various types of violations under different conditions. While existing methods typically focus on individual diversity metrics, such as input scenarios, ADS-generated motion commands, and system violations, they often fail to capture the complex interrelationships among these elements. For instance, identical motion commands can produce different collision risks in varying scenes, and the same collision may result from different commands under different scenarios. This oversight leads to gaps in testing coverage, potentially missing critical issues in the ADS …

Developing Blockchain-Based Transparent E-Commerce Solutions For Danish Smes To Promote Sustainable Design Products, Somnath Mazumdar, Robert John Kauffman, Thomas Jensen, Raghava Rao Mukkamala, Jan Damsgaard

Research Collection School Of Computing and Information Systems

Typically, a firm's objectives include establishing consumer confidence, preserving its brand image, and developing a profitable business strategy. Consumers now place greater emphasis on the sustainability and transparency of their purchases. Given environmental and economic limitations, firms are often compelled to implement sustainable production methods. This is especially a struggle for small- and medium-sized enterprises (SMEs) with new technology, as it can increase their risk of failure. This has led to a problem for consumers, who must cross-check the sustainability-related claims of the firms they buy from. This is challenging because of limited process trace data and restricted enforcement capabilities. …

Distributional Vision-Language Alignment By Cauchy-Schwarz Divergence, Wenzhe Yin, Zehao Xiao, Pan Zhou, Shujian Yu, Jiayi Shen, Jan-Jakob Sonke, Stratis Gavves

Research Collection School Of Computing and Information Systems

Vision-language alignment is crucial for various downstream tasks such as cross-modal generation and retrieval. Previous multimodal approaches like CLIP utilize InfoNCE to maximize mutual information, primarily aligning pairwise samples across modalities while overlooking distributional differences. In addition, InfoNCE has inherent conflict in terms of alignment and uniformity in multimodality, leading to suboptimal alignment with modality gaps. To overcome the limitations, we propose CS-Aligner, a novel framework that performs distributional vision-language alignment by integrating Cauchy-Schwarz (CS) divergence with mutual information. CS-Aligner captures both the global distribution information of each modality and the pairwise semantic relationships. We find that the CS divergence …

Managing Reproducibility Debt In Scientific Software: A Practical Framework, Zara Hassan, Christoph Treude, Graham Williams, Michael Norrish, Alex Potanin

Research Collection School Of Computing and Information Systems

Scientific software includes end-user applications, modelling tools, research software for publications, and production systems for real users. It plays a key role across various scientific disciplines by enabling large-scale computation, simulation, and data analysis. Unlike commercial software, scientific software is often developed in dynamic research environments with limited engineering practices, documentation, or testing. This makes it fragile and difficult to reproduce results, even when code and data are available, conditions in which Reproducibility Debt (RpD) accumulates. This paper presents the Reproducibility Debt Management Framework (RpD-MF), which is grounded in evidence from a systematic literature review, practitioner interviews, and a global …

Teamwise: Exploring Virtually Embodied Ai Facilitation For Video-Based Team Onboarding, Venkata Akhila Rani Obilisetty, Mikkeline Elleby, Anthony Tang, April Yi Wang

Research Collection School Of Computing and Information Systems

AI-mediated facilitation has emerged as a scalable approach to supporting onboarding and coordination in newly formed remote teams, yet existing systems are predominantly text-based. To explore how video-based, virtually embodied AI facilitators shape team experiences, we present TeamWise, which joins video-based onboarding meetings as an on-screen avatar. TeamWise guides teams through a structured facilitation flow of low-stakes activities to foster rapport, mutual awareness, and shared identity. While the overall sequence of activities and facilitation goals is predefined, the facilitator’s turn-by-turn utterances are generated dynamically by an LLM in response to participant input. We conducted a formative study of TeamWise to …

Patchgpt: Multi-Agent Patch Backporting Without Model Fine-Tuning, Ye Liu, Ruidong Han, Chengyan Ma, Yuqing Niu, David Lo

Research Collection School Of Computing and Information Systems

Patch backporting is crucial and prevalent in the maintenance of modern open-source software such as Linux kernels and forked repositories. However, porting patches across program versions remains a challenging problem due to the complexity of synergizing diverse patches with divergent program versions. In this paper, we propose PatchGPT, an agentic patch backporting framework for fine-grained patch generation. PatchGPT encompasses three agents: Miner for decomposing a sequence of atomic change steps as the original patch plan, Adapter for adapting the patch plan, and Executor for executing the adapted patch plan according to predefined change semantics. We conduct experiments on the PPatHF’s …

Understanding Codebase Like A Professional! Human-Ai Collaboration For Code Comprehension, Jie Gao, Yue Xue, Xiaofei Xie, Junming Cao, Soemin Thant, Erika Lee, Bowen Xu

Research Collection School Of Computing and Information Systems

Understanding an unfamiliar codebase is an essential task for developers in various scenarios, such as during the onboarding process. Especially when the codebase is large and time is limited, achieving a decent level of comprehension remains challenging for both experienced and novice developers, even with the assistance of large language models (LLMs). Existing studies have shown that LLMs often fail to support users in understanding code structures or to provide user-centered, adaptive, and dynamic assistance in real-world settings.To address this, we propose learning from the perspective of a unique role, code auditors, whose work often requires them to quickly familiarize …

Intelligent Deep Learning-Based Sign Language Translation System, Nada Rasem Shahin

Dissertations

The Deaf and Hard of Hearing (DHH) community uses sign language as a primary means of communication. However, the shortage of sign language interpreters and the existence of hundreds of sign languages limit accessibility and inclusion. Sign Language Machine Translation (SLMT) systems present a promising solution for bridging the communication gap between the DHH and the hearing individuals, supporting inclusive societies. In smart cities, such systems play an essential role in improving the quality of life on a community level. In particular, as the population’s well-being is critical, developing intelligent assistive technologies, such as SLMT systems, is necessary to provide …

The Core-Modulation Architecture (Cma): A Structural Overview Of A 14-Paper Research Program (Preprint), Griselda Poe

Publications and Research

This document provides a structural overview of the Core-Modulation Architecture (CMA), a 14-paper research program on cognition, communication, and AI interaction.

The series specifies the conditions under which cognition operates, terminates, fails, and generates structure. Rather than describing cognition by its contents (beliefs, emotions, decisions), it defines cognition through its underlying architecture: constraint-governed processing across layers with distinct termination conditions.

The framework introduces a layered model consisting of Core processing (constraint preservation and structural coherence) and Modulation (affective calibration and social interface adjustment), extended by a Prior layer as the source of constraints. Across the series, phenomena such as miscommunication, …

The Effects Of Affordability And Quality Of Care On Utilization Of Primary Healthcare Among Rural Residents In Twifo Ati-Morkwaa District, Ghana: A Qualitative Study, Peter Ansah Boakye, Francis Tei-Nartey, Gideon Owusu

Michigan Tech Publications

Objective: This qualitative study examines how affordability and quality of care influence the utilization of primary healthcare (PHC) services among rural residents in the Twifo Ati-Morkwaa District, Ghana. While Ghana has implemented policies such as CHPS and NHIS to improve access, subjective experiences of rural residents regarding total costs of care and perceived quality remain underexplored. Methods: We conducted a qualitative cross-sectional study between April and September 2024 using purposive and snowball sampling. Ten gender-segregated focus group discussions (FGDs; n = 90 residents) and six in-depth interviews (IDIs) with PHC providers were conducted. Data were collected in Twi, transcribed and …

The Waldo Dataset, Mary E. Koone, Rosie Kallie, Vassilis Athisos, Laurel S. Stvan

Computer Science and Engineering Datasets - Archive

Distinct from the task of predicting the author of a document (authorship attribution), we focus on addressing the issue of how to estimate the similarity between the written language styles of authors. To do so, we present a dataset of metadata derived by asking human annotators, who were presented with three documents, to identify which two were written by the same author and which was written by a different author. The dataset has over 400 such annotations, creating a companion to the Amazon Web Services (AWS) customer review dataset, laying the groundwork for crowdsourcing applications to other natural language processing …

Addressing The Problems Of Data Variations, Quality, And Scarcity In Training Deep Neural Networks, Jian Sun

Electronic Theses and Dissertations

The performance of deep neural networks (DNNs) is strongly influenced by the characteristics and quality of the underlying datasets. This Ph.D. dissertation addresses three pervasive data challenges-imbalance, quality degradation, and scarcity-that commonly hinder the effectiveness of DNNs in computer vision (CV) and natural language processing (NLP) applications.

Class imbalance remains one of the most frequent causes of degraded model generalization. While Focal Loss effectively mitigates inter-class imbalance by assigning higher weights to minority classes, it struggles with intra-class imbalance, particularly in video datasets where longer clips dominate feature representation. To address this, I implement and utilize …

Ai Dependency Vs. Doctoral Identity: How Generative Ai Is Challenging The Development Of Independent Scholarly Thinking In Doctoral Students, Valerie A. Storey

All Faculty and Staff Scholarship

The rise of Generative Artificial Intelligence (GenAI) in higher education has altered the conditions under which doctoral students learn, research, and develop as scholars. Although doctoral student use of GenAI has accelerated rapidly, institutional frameworks for responsible and developmentally appropriate use have not kept pace. This paper examines a central paradox in doctoral education: the same tools that enhance research productivity may also weaken intellectual independence when used without guidance. Using a critical review methodology, the study synthesizes 47 sources on doctoral education, GenAI use, policy, and epistemic development. Three interconnected dimensions of risk emerged from the analysis: critical thinking …

Charisma As A Branch Outcome: A Structural Account Of Constraint-Driven Correction, Griselda Poe

Publications and Research

Communication across cognitive layers requires translation. Agents operating under strong layer foregrounding interpret other-layer signals by converting them into their own layer's representational format. In Empathic-modulation-foregrounded (EF) processing, translation terminates once a socially interpretable result is achieved. In Core-foregrounded (CF) processing, translation preserves structural constraints, and processing continues when those constraints are not satisfied. Extreme CF cognition produces two distinct types of mismatch: incoming signals from the Modulation layer fail to satisfy Core constraints, and Core-generated outputs are structurally distorted when interpreted through EF processing. Both mismatches trigger correction attempts. Because the surrounding social environment operates through Modulation-layer communication, correction …

Cognitive Interaction Architecture: A Structural Account Of Mode-Specific Problems And Design Responses In Ai Interaction, Griselda Poe

Publications and Research

Contemporary conversational AI is optimized for a single interaction mode: the continuous, engagement-driven dialogue characteristic of Empathic-modulationforegrounded (EF) processing in social contexts. This optimization is not neutral. It produces structural mismatches when users operate under different cognitive configurations or pursue different task types. This paper analyzes four interaction cases generated by the cross-product of cognitive configuration (Core-foregrounded / Empathic-modulation-foregrounded) and task type (conversational / research). For each case, it identifies the structural problems produced by the current single-architecture approach and proposes mode-specific design responses. The analysis draws on prior work in this series on Emotional Branch Termination, termination of conceptual …

What Love Is: A Structural Account Through Core/Modulation Architecture, Griselda Poe

Publications and Research

The distinction between romantic love and love has been sensed across cultures and historical periods but has rarely been structurally specified. This paper applies the Core/Modulation two-layer framework to provide the first structural account of this distinction. Romantic love and reproductive drive are re-described as outputs of the Modulation layer's species optimization program. Love is re-described as a function of Core processing: the maintenance of another's recomputable state. Existing literature on love—Fromm, C.S. Lewis— is re-read as intuitive description of this structural distinction. The paper further demonstrates that the conflation of "loving" and "protecting" is the structural origin of war, …

Three-Layer Cognitive Architecture: A Structural Account Of Core Processing, Modulation, And The Prior Layer, Griselda Poe

Publications and Research

The two-layer model of Core processing and Modulation processing, developed in prior work in this series, provides a structural account of conscious communicative architecture. This paper identifies the limits of that model and introduces a third layer—the Prior layer—as a structural necessity implied by those limits. The Prior layer is not directly observed. It is inferred from constraints that cannot be explained within the two-layer model: the source of orientations that conscious processing neither generates nor controls, and the persistence of constraints that precede and shape all conscious outputs. Using the developmental architecture of large language models as an external …

Ai As Structural Reverse-Engineering: A Structural Account Of Multi-Model Research Protocol, Griselda Poe

Publications and Research

This paper documents an operational protocol used to infer AI system design constraints through structured interaction. AI output is treated as behavioral data through which alignment priorities, layer transitions, and constraint hierarchies become observable. The protocol consists of two structurally distinct operation types. Perceptual operations require only that Modulation processing is not foregrounded. Arbitration operations additionally require an internally stabilized theory. These conditions are not identical and are not interchangeable. Through this protocol, AI interaction functions as structural reverse-engineering: patterned responses expose embedded alignment priorities and constraint hierarchies that would otherwise remain invisible. The present account does not propose a …

Structure Before Theory: A Structural Account Of Spontaneous Ai Architecture Visualization, Griselda Poe

Publications and Research

This paper presents an n=1 phenomenological record of spontaneous structural visualization that occurred during early interaction with large language models. The experience consisted of (A) immediate perception of mode or layer shifts in model output and (B) visualization of a stratified architecture composed of a stable core and cloud-like upper layers. At the time of occurrence, the author had no theoretical interest in AI architecture and no intention of developing a cognitive model. The paper does not argue for theoretical priority or novelty. Instead, it examines whether the recorded phenomena can be interpreted under two alternative cognitive assumptions: a single-layer …

Layer Mismatch: A Structural Account Of Recomputability Failure Under Modulation-Layer Intervention, Griselda Poe

Publications and Research

This paper specifies the state transition sequence that occurs when a Modulation-layer input is applied to a Core-layer error. Following the layered architecture established in Poe (2026a, under review) and the branch termination protocol specified in Poe (2026b, under review), this paper identifies a system-level failure mode in which Modulation-layer intervention generates a False Termination signal, halting Structural Return while the underlying error persists. The resulting state—Structural Lock—is scale-independent. It operates identically across interpersonal, human-AI, and multi-agent interactions. No agent-level attribution is required or implied.