Digital Commons Network^™

Exploring Educational Affordances Of Interactive Murals, Alyshia Bustos

Computer Science ETDs

Interactive murals are a new technology that blend traditional mural painting and embedded electronics. My work contrasts traditional STEAM projects by introducing youth to programming, building electronics, and interaction design principles within the context of designing and constructing interactive murals. Accordingly my dissertation addresses the following: 1) How can we integrate traditional mural practices and ubiquitous computing in an interactive mural, 2) How do interactive murals support youth in learning how to program and build electronics, and 3) How can we design learning activities that support youth as interaction designers?

To address my research questions, I first conducted technical tests …

Towards Supporting Children's Metacomprehension During Web Search, Christine Dianne Pinney

Boise State University Theses and Dissertations

As children interact online with search engine result pages (SERPs), children’s comprehension monitoring skills are put to work. Children are known to struggle with utilizing online information as the text content can be misaligned with their reading abilities. Comprehension monitoring skills allow people to assess the comprehensibility of text and is measured by how well comprehension predictions align with performance on comprehension tests. Previous research has shown that augmenting standard SERPs with readability visual cues can be helpful for children searching online. While comprehension predictions are traditionally collected after reading, SERP information provides the opportunity to measure children's perceived comprehensibility …

Effects Of Reflective Journaling And Nudges On Academic Motivation And Engagement, Lakshmi Satya Sai Veda Mahita Uppuluri

Theses and Dissertations

This study investigates the effects of reflective journaling and motivational nudges on academic motivation and engagement among college students. Grounded in Self- Determination Theory (SDT), the research examines how different interventions influence intrinsic motivation, and academic behaviors such as class attendance, participation, and preparation. The study employed a between-group experimental design with three conditions: a control group, a journaling group, and a journaling group that also received daily motivational nudges. Results showed that students in the journaling groups—particularly those who received nudges—experienced a significant increase in academic motivation. While changes in academic engagement were not significant, the effect size suggested …

Personality Trait Recognition Through Deep Neural Temporal Modeling Of Non-Verbal Behavior, Kushal Vangara

Theses and Dissertations

Personality research seeks to explain the wide range of human behaviors through stable, measurable traits. Human interactions are inherently rich and multidimensional, and analyzing behavioral data offers a promising path to uncover personality insights. The increasing convergence of psychology, computer science, and machine learning has fueled interest in computational approaches to personality assessment. Advances in sensing technologies have made it possible to capture fine-grained information about individuals’ behaviors and interactions in naturalistic and controlled environments. Automated audio-visual analysis techniques extract relevant behavioral cues, which machine learning models then interpret to infer underlying personality traits. This work provides a comprehensive overview …

Towards Reliable Ml: Data Attribution And Adversarial Robustness, Xiaosen Zheng

Dissertations and Theses Collection (Open Access)

Modern machine learning (ML) models achieve remarkable success, but face critical reliability challenges. This thesis advances two pillars of reliable ML systems: interpretability through data attribution and robustness against adversarial threats.

In the first part, we develop novel data attribution methods to elucidate the data-model relationship. We establish the critical role of memorization in model generalization through token-level influence analysis, extend sample-level attribution to diffusion models with effective approximation techniques, and introduce REGMIX, a group-level approach that predicts data mixture performance using small-scale experiments. These contributions provide practitioners with scalable tools to audit training data impacts across modalities.

The second …

Disentangling User Preferences Towards Self-Interpretable Recommender Systems, Nhu Thuat Tran

Dissertations and Theses Collection (Open Access)

Understanding user preferences remains a central challenge in recommender systems due to their inherently complex, unstructured, and multi-faceted nature, exacerbated by the sparsity of user interaction data. Traditional approaches often compress user interests into a single latent vector, overlooking the fact that user preferences are typically shaped by multiple underlying factors that differ across individuals. These latent drivers are not directly observable and must be discovered through unsupervised modeling, further complicated by limited historical interactions per user.

This dissertation addresses these challenges by introducing a principled framework for multiinterest modeling, which disentangles user behaviors into multiple latent factors to better …

Tailoring Transformer-Based Deep Learning For Code Generation And Translation, Imam Nur Bani Yusuf

Dissertations and Theses Collection (Open Access)

Software is increasingly pervasive in modern society, making the effective translation of human intent into code essential. Novice programmers often struggle with domain-specific code due to limited background knowledge, while experienced developers face challenges in maintaining evolving largescale codebases. Traditional pattern-based approaches address these issues, but such approaches are task-specific and require significant adaptation for different tasks. Transformer-based models offer a more flexible alternative, as the same architecture can be tailored for diverse programming tasks.

This dissertation investigates how Transformer-based models can be customized for various code generation and translation tasks. First, it introduces Transformer-based approaches that assist end-users with …

Multiobjective Linear Ensembles For Robust And Sparse Training Of Few-Bit Neural Networks, Ambrogio Maria Bernardelli, Stefano Gualandi, Simone Milanesi, Hoong Chuin Lau, Neil Yorke-Smith

Research Collection School Of Computing and Information Systems

Training neural networks (NNs) using combinatorial optimization solvers has gained attention in recent years. In low-data settings, the use of state-of-the-art mixed integer linear programming solvers, for instance, has the potential to exactly train an NN while avoiding computing-intensive training and hyperparameter tuning and simultaneously training and sparsifying the network. We study the case of few-bit discrete-valued neural networks, both binarized neural networks (BNNs) whose values are restricted to ±1 and integer-valued neural networks (INNs) whose values lie in the range {−P,…,P}. Few-bit NNs receive increasing recognition because of their lightweight architecture and ability to run on low-power devices: for …

Enriching Automatic Test Case Generation By Extracting Relevant Test Inputs From Bug Reports, Wendkuuni C. Ouedraogo, Laura Plein, Kader Kabore, Andrew Habib, Jacques Klein, David Lo, Tegawende F. Bissyande

Research Collection School Of Computing and Information Systems

The quality of software is closely tied to the effectiveness of the tests it undergoes. Manual test writing, though crucial for bug detection, is time-consuming, which has driven significant research into automated test case generation. However, current methods often struggle to generate relevant inputs, limiting the effectiveness of the tests produced. To address this, we introduce BRMiner, a novel approach that leverages Large Language Models (LLMs) in combination with traditional techniques to extract relevant inputs from bug reports, thereby enhancing automated test generation tools. In this study, we evaluate BRMiner using the Defects4J benchmark and test generation tools such as …

Relation Prediction In Knowledge Graphs: A Self-Organizing Neural Network Approach, Budhitama Subagdja, Shanthoshigaa D, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

Knowledge graphs (KGs) in specialized domains frequently suffer from incomplete information. While current relation prediction methods for KG completion typically rely on neural network-based representation learning, we present KG2ART---a novel self-organizing neural network that employs a fundamentally different approach. Instead of learning distributed representations, KG2ART encodes relation triples of knowledge graphs explicitly and performs parallel inference over the graph structure through bidirectional interactions between bottom-up activations and top-down pattern matching. Our comprehensive evaluation across five diverse KGs (Nations, UMLS, Kinship, CoDEx-M, and a jet engine technical KG) demonstrates that KG2ART consistently outperforms state-of-the-art baselines (TuckER, ComplEX, RESCAL, ConvE, CompGCN) in …

Enhancing Deliberativeness: Evaluating The Impact Of Multimodal Reflection Nudges, Shun Yi Yeo, Zhuoqun Jiang, Anthony Tang, Simon Tangi Perrault

Research Collection School Of Computing and Information Systems

Nudging participants with text-based reflective nudges enhances deliberation quality on online deliberation platforms. The effectiveness of multimodal reflective nudges, however, remains largely unexplored. Given the multi-sensory nature of human perception, incorporating diverse modalities into self-reflection mechanisms has the potential to better support various reflective styles. This paper explores how presenting reflective nudges of different types (direct: persona and indirect: storytelling) in different modalities (text, image, video and audio) affects deliberation quality. We conducted two user studies with 20 and 200 participants respectively. The first study identifies the preferred modality for each type of reflective nudges, revealing that text is most …

Creating Talking Points For Client Advisers At Banks To Promote Sustainable Investing, Wewe Zi Yi, Pradeep Varakantham, Alan Megargel

Research Collection School Of Computing and Information Systems

Environmental, social and governance (ESG) factors have become key nonfinancial factors for investors to evaluate companies with respect to understanding material risks and growth opportunities. While not mandatory, companies are providing ESG reports that outline progress in different ESG metrics (six broad metrics and 15 specific ones). Client advisers (CAs) read these reports to identify key metrics of interest to investors. Given the number of companies and investment products, however, it is not feasible for CAs to read all the reports, which can sometimes run into tens or hundreds of pages). The authors have developed multiple frameworks building on leading …

Prompting An Embodied Ai Agent: How Embodiment And Multimodal Signaling Affects Prompting Behaviour, Tianyi Zhang, Colin Au Yeung, Emily Aurelia, Yuki Onishi, Neil Chulpongsatorn, Jiannan Li, Anthony Tang

Research Collection School Of Computing and Information Systems

Current voice agents wait for a user to complete their verbal instruction before responding; yet, this is misaligned with how humans engage in everyday conversational interaction, where interlocutors use multimodal signaling (e.g. nodding, grunting, or looking at referred to objects) to ensure conversational grounding. We designed an embodied VR agent that exhibits multimodal signaling behaviors in response to situated prompts, by turning its head, or by visually highlighting objects being discussed or referred to. We explore how people prompt this agent to design and manipulate the objects in a VR scene. Through a Wizard of Oz study, we found that …

Quantitative Runtime Monitoring Of Ethereum Transaction Attacks, Xinyao Xu, Ziyu Mao, Jianzhong Su, Xingwei Lin, David Basin, Jun Sun, Jingyi Wang

Research Collection School Of Computing and Information Systems

The rapid growth of decentralized applications, while revolutionizing financial transactions, has created an attractive target for malicious attacks. Existing approaches to detecting attacks often rely on predefined rules or simplistic and overly-specialized models, which lack the flexibility to handle the wide spectrum of diverse and dynamically changing attack types. To address this challenge, we present a general and extensible framework, MoE (Monitoring Ethereum), that leverages runtime verification to detect a wide range of attacks on Ethereum. MoE features an expressive attack modeling language, based on Metric First-order Temporal Logic (MFOTL), that can formalize a wide range of attacks. We integrate …

Integrating Path Selection For Symbolic Execution And Variable Selection For Constraint Solving, Shunkai Zhu, Jun Sun, Jingyi Wang, Zhenbang Chen, Peng Cheng

Research Collection School Of Computing and Information Systems

Symbolic execution is a powerful technique that can accurately synthesize program inputs for program testing through constraint solving. Applying symbolic execution effectively means that we must solve two searching problems efficiently. One is to search through the many program paths and the other is, given a particular path condition, to search through the numerous variable assignments to identify one satisfying solution. With few exceptions, existing symbolic execution engines treat constraint solvers as black boxes. As a result, the two searches are completely separated, which results in much redundancy (i.e., the same variable assignments may be tried for solving many program …

Tensorjsfuzz: Effective Testing Of Web-Based Deep Learning Frameworks Via Input-Constraint Extraction, Lili Quan, Xiaofei Xie, Qianyu Guo, Lingxiao Jiang, Sen Chen, Junjie Wang, Xiaohong Li

Research Collection School Of Computing and Information Systems

The 2025 ACM Web Conference (WWW '25) took place from April 28 to May 2, 2025, in the Sydney Convention & Exhibition Centre, Australia. Its logo, featuring the Sydney Harbour Bridge, symbolizes the core "connecting" function of the Web. Formerly known as the International World Wide Web Conference (WWW), this event originated at CERN in 1994 and has long served as the premier venue for presenting and discussing research, development, standards, and applications related to the Web.The 2025 ACM Web Conference (WWW'25) took place from April 28 to May 2, 2025, in the Sydney Convention & Exhibition Centre, Australia. Its …

Decictor: Towards Evaluating The Robustness Of Decision-Making In Autonomous Driving Systems, Mingfei Cheng, Xiaofei Xie, Yuan Zhou, Junjie Wang, Guozhu Meng, Kairui Yang

Research Collection School Of Computing and Information Systems

Autonomous Driving System (ADS) testing is crucial in ADS development, with the current primary focus being on safety. However, the evaluation of non-safety-critical performance, particularly the ADS's ability to make optimal decisions and produce optimal paths for autonomous vehicles (AVs), is also vital to ensure the intelligence and reduce risks of AVs. Currently, there is little work dedicated to assessing the robustness of ADSs' path-planning decisions (PPDs), i.e., whether an ADS can maintain the optimal PPD after an insignificant change in the environment. The key challenges include the lack of clear oracles for assessing PPD optimality and the difficulty in …

Specgen: Automated Generation Of Formal Program Specifications Via Large Language Models, Lezhi Ma, Shangqing Liu, Yi Li, Xiaofei Xie, Lei Bu

Research Collection School Of Computing and Information Systems

In the software development process, formal program specifications play a crucial role in various stages, including requirement analysis, software testing, and verification. However, manually crafting formal program specifications is rather difficult, making the job time-consuming and labor-intensive. Moreover, it is even more challenging to write specifications that correctly and comprehensively describe the semantics of complex programs. To reduce the burden on software developers, automated specification generation methods have emerged. However, existing methods usually rely on predefined templates or grammar, making them struggle to accurately describe the behavior and functionality of complex real-world programs. To tackle this challenge, we introduce SpecGen, …

Oscar: Object Status And Contextual Awareness For Recipes To Support Non-Visual Cooking, Franklin Mingzhe Li, Kaitlyn Ng, Bin Zhu, Patrick Carrington

Research Collection School Of Computing and Information Systems

Following recipes while cooking is an important but difficult task for visually impaired individuals. We developed OSCAR (Object Status Context Awareness for Recipes), a novel approach that provides recipe progress tracking and context-aware feedback on the completion of cooking tasks through tracking object statuses. OSCAR leverages both Large-Language Models (LLMs) and Vision-Language Models (VLMs) to manipulate recipe steps, extract object status information, align visual frames with object status, and provide cooking progress tracking log. We evaluated OSCAR’s recipe following functionality using 173 YouTube cooking videos and 12 real-world non-visual cooking videos to demonstrate OSCAR’s capability to track cooking steps and …

Query Understanding In Llm-Based Conversational Information Seeking, Yifei Yuan, Zahra Abbasiantaeb, Yang Deng, Mohammad Aliannejadi

Research Collection School Of Computing and Information Systems

Query understanding in Conversational Information Seeking (CIS) involves accurately interpreting user intent through context-aware interactions. This includes resolving ambiguities, refining queries, and adapting to evolving information needs. Large Language Models (LLMs) enhance this process by interpreting nuanced language and adapting dynamically, improving the relevance and precision of search results in real-time. In this tutorial, we explore advanced techniques to enhance query understanding in LLM-based CIS systems. We delve into LLM-driven methods for developing robust evaluation metrics to assess query understanding quality in multiturn interactions, strategies for building more interactive systems, and applications like proactive query management and query reformulation. We …

Sans: Efficient Densest Subgraph Discovery Over Relational Graphs Without Materialization, Yudong Niu, Yuchen Li, Jiaxin Jiang, Laks V. S. Lakshmanan

Research Collection School Of Computing and Information Systems

How can we efficiently identify the densest subgraph over relational graphs? Existing dense subgraph discovery (DSD) approaches assume that a relational graph H is already derived from a heterogeneous data source and they focus on efficient discovery of the densest subgraph on the materialized H. Unfortunately, materializing relational graphs can be resource-intensive, which thus limits the practical usefulness of existing algorithms over large datasets. To mitigate this, we propose a novel Summary-bAsed deNsest Subgraph discovery (SANS) system. Our unique summary-based peeling algorithm forms the core of SANS. Following the peeling paradigm, it utilizes summaries of each node's neighborhood to efficiently …

Building Bridges Across Papua New Guinea’S Digital Divide In Growing The Ict Industry, Marc Cheong, Sankwi Abuzo, Hideaki Hata, Priscilla Kevin, Winifred Kula, Benson Mirou, Christoph Treude, Dong Wang, Raula Gaikovina Kula

Research Collection School Of Computing and Information Systems

Papua New Guinea (PNG) is an emerging tech society with an opportunity to overcome geographic and social boundaries, in order to engage with the global market. However, the current tech landscape, dominated by Big Tech in Silicon Valley and other multinational companies in the Global North, tends to overlook the requirements of emerging economies such as PNG. This is becoming more obvious as issues such as algorithmic bias (in tech product deployments) and the digital divide (as in the case of non-affordable commercial software) are affecting PNG users. The Open Source Software (OSS) movement, based on extant research, is seen …

“Ronaldo’S A Poser!”: How The Use Of Generative Ai Shapes Debates In Online Forums, Yuhan Zeng, Yingxuan Shi, Xuehan Huang, Fiona Fui-Hoon Nah, Ray Lc

Research Collection School Of Computing and Information Systems

Online debates can enhance critical thinking but may escalate into hostile attacks. As humans are increasingly reliant on Generative AI (GenAI) in writing tasks, we need to understand how people utilize GenAI in online debates. To examine the patterns of writing behavior while making arguments with GenAI, we created an online forum for soccer fans to engage in turn-based and free debates in a post format with the assistance of ChatGPT, arguing on the topic of "Messi vs Ronaldo". After 13 sessions of two-part study and semi-structured interviews with 39 participants, we conducted content and thematic analyses to integrate insights …

Flexfl: Flexible And Effective Fault Localization With Open-Source Large Language Models, Chuyang Xu, Zhongxin Liu, Xiaoxue Ren, Gehao Zhang, Ming Liang, David Lo

Research Collection School Of Computing and Information Systems

Fault localization (FL) targets identifying bug locations within a software system, which can enhance debugging efficiency and improve software quality. Due to the impressive code comprehension ability of Large Language Models (LLMs), a few studies have proposed to leverage LLMs to locate bugs, i.e., LLM-based FL, and demonstrated promising performance. However, first, these methods are limited in flexibility. They rely on bug-triggering test cases to perform FL and cannot make use of other available bug-related information, e.g., bug reports. Second, they are built upon proprietary LLMs, which are, although powerful, confronted with risks in data privacy. To address these limitations, …

Sigscope: Detecting And Understanding Off‑Chain Message Signing‑Related Vulnerabilities In Decentralized Applications, Sajad Meisami, Hugo Dabadie, Song Li, Yuzhe Tang, Yue Duan

Research Collection School Of Computing and Information Systems

In Web 3.0, an emerging paradigm of building decentralized applications or DApps is off-chain message signing, which has advantages in performance, cost efficiency, and usability compared to conventional transaction-signing schemes. However, message signing burdens DApp developers with extra coding complexity and message designing, leading to new security risks.This paper presents the first systematic study to uncover and characterize the security issues in off-chain message signing schemes and the DApps built atop them. We present a holistic static-analysis framework, SigScope, that uniquely combines the insights extracted from DApp front-end code (HTML and Javascript) off-chain and back-end smart contracts on-chain. We evaluate …

Real-Time Rectifying Flight Control Misconfiguration Using Intelligent Agent, Ruidong Han, Shangzhi Xu, Juanru Li, Elisa Bertino, David Lo, Jianfeng Ma, Siqi Ma

Research Collection School Of Computing and Information Systems

Configurations are supported by most flight control systems, allowing users to control a flying drone adapted to complexities such as environmental changes or mission alterations. Such an advanced functionality also introduces a significant problem—misconfiguration settings. It may cause drone instability, threaten drone safety, and potentially lead to substantial financial loss. However, detecting and rectifying misconfigurations across different flight control systems is challenging because (1) (mis)configuration-related code snippets might be syntactically correct and thus hard to identify through traditional code analysis; (2) the response to each configuration varies under different flying scenarios.In this article, we propose and implement a novel rectification …

Cyberoception: Finding A Painlessly-Measurable New Sense In The Cyberworld Towards Emotion-Awareness In Computing, Tadashi Okoshi, Zexiong Gao, Yi Zhen Tan, Takumi Karasawa, Takeshi Miki, Wataru Sasaki, Rajesh Krishna Balan

Research Collection School Of Computing and Information Systems

In Affective computing, recognizing users’ emotions accurately is the basis of affective human–computer interaction. Understanding users’ interoception contributes to a better understanding of individually different emotional abilities, which is essential for achieving inter-individually accurate emotion estimation. However, existing interoception measurement methods, such as the heart rate discrimination task, have several limitations, including their dependence on a well-controlled laboratory environment and precision apparatus, making monitoring users’ interoception challenging. This study aims to determine other forms of data that can explain users’ interoceptive or similar states in their real-world lives and propose a novel hypothetical concept “cyberoception,” a new sense (1) which …

Hierarchical Frameworks For Scaling-Up Multi-Agent Coordination, Minghong Geng

Research Collection School Of Computing and Information Systems

Multi-agent reinforcement learning has emerged as a powerful framework for developing collaborative behaviors in autonomous systems. However, existing MARL methods often struggle with scalability in terms of both the number of agents and decision-making horizons. My research focuses on developing hierarchicalapproaches to scale up MARL systems through two complementary directions: structural scaling by increasing the number of coordinated agents and temporal scaling by extending planning horizons. My initial work introduced HiSOMA, a hierarchical framework integrating self-organizing neural networks with MARL forlong-horizon planning, and MOSMAC, a benchmark for evaluating MARL methods on multi-objective MARL scenarios. Building on these foundations, my recent …

Toward Better Comprehension Of Breaking Changes In The Npm Ecosystem, Dezhen Kong, Jiakun Liu, Lingfeng Bao, David Lo

Research Collection School Of Computing and Information Systems

Code evolution is prevalent in software ecosystems, which can provide many benefits, such as new features, bug fixes, security patches, while still introducing breaking changes that make downstream projects fail to work. Breaking changes cause a lot of effort to both downstream and upstream developers: downstream developers need to adapt to breaking changes and upstream developers are responsible for identifying and documenting them. In the NPM ecosystem, characterized by frequent code changes and a high tolerance for making breaking changes, the effort is larger.For better comprehension of breaking changes in the NPM ecosystem and to enhance breaking change detection tools, …

From Text To Utility: Distance-Aware Contrastive Learning For Detection-Ready And Shareable Malware Descriptions, Ivan Alejandro Montoya Sanchez

Open Access Theses & Dissertations

The rapid rise of sophisticated malware variants poses significant challenges for cybersecurity analysts, particularly due to the scarcity of data on newly emerging threats. Due to privacy, legal, and operational constraints, malware samples are often not shareable; instead, organizations publish cyber threat intelligence (CTI) in natural language. However, these reports are typically unstructured and inconsistent, limiting their utility in machine learning (ML) models. This thesis explores whether high-fidelity, shareable threat intelligence can be automatically generated from structured malware behaviors to supplement ML models when direct access to malware samples is limited. Two central questions are addressed:(i) How can descriptions be …