Open Access. Powered by Scholars. Published by Universities.®

Digital Commons Network™

Open Access. Powered by Scholars. Published by Universities.®

Computer Sciences

Institution
Keyword
Publication Year
Publication
Publication Type
File Type

Articles 691 - 720 of 20568

Full-Text Articles in Entire DC Network

Gui Test Migration Via Abstraction And Concretization, Yakun Zhang, Chen Liu, Xiaofei Xie, Yun Lin, Jin Song Dong, Dan Hao, Lu Zhang Jan 2026

Gui Test Migration Via Abstraction And Concretization, Yakun Zhang, Chen Liu, Xiaofei Xie, Yun Lin, Jin Song Dong, Dan Hao, Lu Zhang

Research Collection School Of Computing and Information Systems

GUI test migration aims to produce test cases with events and assertions to test specific functionalities of a target app. Existing migration approaches typically focus on the widget-mapping paradigm that maps widgets from source apps to target apps. However, since different apps may implement the same functionality in different ways, direct mapping may result in incomplete or buggy test cases, thus significantly impacting the effectiveness of testing the target functionality and the practical applicability of migration approaches.In this article, we propose a new migration paradigm (i.e., the abstraction-concretization paradigm) that first abstracts the test logic for the target functionality and …

Go to article

A Case Study Of Gender And Online Team Communication In Software Engineering Education, Rita Garcia, Christoph Treude Jan 2026

A Case Study Of Gender And Online Team Communication In Software Engineering Education, Rita Garcia, Christoph Treude

Research Collection School Of Computing and Information Systems

Collaboration is crucial in Software Engineering (SE), yet factors like gender bias can shape team dynamics and behaviours. This descriptive case study examines an eight-week project involving 39 SE students across eight teams contributing to GitHub projects. Focusing on gender, we used a mixed-methods approach to analyse Slack communications, identifying gender differences in how students respond to initiated communications and comparing how students’ communications influenced other aspects of students’ performance, including learning gains. We found higher help-seeking and leadership behaviours in the all-woman team involved in this case study, while men responded more slowly. Although communication did not directly affect …

Go to article

Gig Worker Social Referrals On An On-Demand Food Delivery Platform, Hai Wang, Hao Sun, Peter Zhang Jan 2026

Gig Worker Social Referrals On An On-Demand Food Delivery Platform, Hai Wang, Hao Sun, Peter Zhang

Research Collection School Of Computing and Information Systems

Social referral programs are commonly used by online labor platforms to incentivize labor supply by rewarding existing workers for successful referrals. This study investigates the impact of such programs on gig workers' labor supply in online labor platforms using data from an on-demand food delivery platform in Singapore. In particular, we analyze how gig workers' past labor supply and referral behavior influence the generation and value of social referrals. This research offers insights into the mechanisms that drive labor supply dynamics in the gig economy and highlights the effectiveness of social referral programs for shaping worker behavior and enhancing platform …

Go to article

Generalization Bounds For Semi‑Supervised Matrix Completion With Distributional Side Information, Antoine Ledent, Mun Chong Soo, Minh Hieu Nong Jan 2026

Generalization Bounds For Semi‑Supervised Matrix Completion With Distributional Side Information, Antoine Ledent, Mun Chong Soo, Minh Hieu Nong

Research Collection School Of Computing and Information Systems

We study a matrix completion problem where both the ground truth R matrix and the unknown sampling distribution P over observed entries are low-rank matrices, and share a common subspace. We assume that a large amount M of unlabeled data drawn from the sampling distribution P is available, together with a small amount N of labeled data drawn from the same distribution and noisy estimates of the corresponding ground truth entries. This setting is inspired by recommender systems scenarios where the unlabeled data corresponds to ‘implicit feedback’ (consisting in interactions such as purchase, click, etc. ) and the labeled data …

Go to article

Interpretable Machine Learning For In-Home Mild Cognitive Impairment Detection, Budhitama Subagdja, Shanthoshigaa D, Ah-Hwee Tan, Iris Rawtaer Jan 2026

Interpretable Machine Learning For In-Home Mild Cognitive Impairment Detection, Budhitama Subagdja, Shanthoshigaa D, Ah-Hwee Tan, Iris Rawtaer

Research Collection School Of Computing and Information Systems

This paper introduces a novel system for in-home cognitive health assessment using ambient sensors and a machine learning technology that can robustly detect mild cognitive impairment (MCI) despite limited available data. The learned model can explain the aspects of individuals’ daily lives led to the prediction, while reliably predicting MCI, providing more insights to healthcare workers for further clinical interventions. We developed the robust transparent machine learning model, based on fusion adaptive resonance theory (Fusion ART) neural network to learn individuals’ daily patterns of activity from continuous sensor data in terms of a suite of digital biomarkers reflecting four key …

Go to article

Ai Systems For Physicians: A Review From Socio-Technical And Human-Computer Interaction Perspectives, Wu Jiaqi Young, Fiona Fui-Hoon Nah Jan 2026

Ai Systems For Physicians: A Review From Socio-Technical And Human-Computer Interaction Perspectives, Wu Jiaqi Young, Fiona Fui-Hoon Nah

Research Collection School Of Computing and Information Systems

The adoption of artificial intelligence (AI) in healthcare is accelerating, yet successful implementations of physician-facing AI systems remain limited and uneven. This paper presents a literature review of 40 peer-reviewed studies published between November 2022 and November 2024, spanning clinical, technical, and human-computer interaction (HCI) domains. Anchored in a socio-technical perspective, the review examines our existing understanding of how technical design, user expertise, and organizational factors shape the effectiveness of AI systems in real-world clinical settings. Our analysis identifies two meta-themes: (1) context as a dynamic, multi-level influence that actively reshapes AI system behavior, and (2) trust as an emergent …

Go to article

Thinkmatter: Panoramic-Aware Instructional Semantics For Monocular Vision-And-Language Navigation, Guangzhao Dai, Shuo Wang, Hao Zhao, Bin Zhu, Qianru Sun, Xiangbo Shu Jan 2026

Thinkmatter: Panoramic-Aware Instructional Semantics For Monocular Vision-And-Language Navigation, Guangzhao Dai, Shuo Wang, Hao Zhao, Bin Zhu, Qianru Sun, Xiangbo Shu

Research Collection School Of Computing and Information Systems

Vision-and-Language Navigation in continuous environments (VLN-CE) requires an embodied robot to navigate the target destination following the natural language instruction. Most existing methods use panoramic RGB-D cameras for 360° observation of environments. However, these methods struggle in real-world applications because of the higher cost of panoramic RGB-D cameras. This paper studies a low-cost and practical VLN-CE setting, e.g., using monocular cameras of limited field of view, which means “Look Less” for visual observations and environment semantics. In this paper, we propose a ThinkMatter framework for monocular VLN-CE, where we motivate monocular robots to “Think More” by 1) generating novel views …

Go to article

Development Of Virtual Reality Learning Environments In Science To Engage Secondary Students In Hazardous Activities, Luke Spartalis Jan 2026

Development Of Virtual Reality Learning Environments In Science To Engage Secondary Students In Hazardous Activities, Luke Spartalis

Theses: Doctorates and Masters

This research examines the need for change in including hazardous activities in education. As different learning technologies develop, platforms that retain authentic outcomes via virtual reality are needed. The main objective of this research is to examine the inclusion of Virtual Reality Learning Environments (VRLEs) to determine their value in areas that include hazardous conditions. The research considered the ways that VR tools could be optimised to support these activities, as well as considering the challenges of VRLE implementation. The study examined whether VRLE’s allowed for authentic experiences to sufficiently drive an acceptance of VR to complement existing teaching and …

Go to article

Learning-Based Graph Shrinking For Quantum Optimization Of Constrained Combinatorial Problems, Monit Sharma, Hoong Chuin Lau Jan 2026

Learning-Based Graph Shrinking For Quantum Optimization Of Constrained Combinatorial Problems, Monit Sharma, Hoong Chuin Lau

Research Collection School Of Computing and Information Systems

Graph shrinking has recently emerged as a powerful preprocessing technique for hybrid classical–quantum optimization, enabling variable and constraint reduction before quantum solving. Conventional approaches rely on Semi-Definite Programming (SDP) relaxations to compute vertex correlations, but these methods suffer from high computational overhead, instance-specific tuning, and limited generalizability. In this work, we replace the handcrafted SDP correlation stage with a reinforcement learning (RL) based correlation estimator, trained to predict merge quality directly from graph structure. We reformulate the graph shrinking process as a Markov Decision Process (MDP), design a Graph Neural Network (GNN) policy to guide vertex merging, and integrate the …

Go to article

Food Recognition With Visual Language Models: Search Re-Ranking Or Retrieval-Augmented Generation?, Kian Yu Gan, Phuong Anh Nguyen, Chong-Wah Ngo Jan 2026

Food Recognition With Visual Language Models: Search Re-Ranking Or Retrieval-Augmented Generation?, Kian Yu Gan, Phuong Anh Nguyen, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Despite the rapid advances in Visual Language Models (VLMs), these models struggle to recognize culture-specific food items. While VLMs are effective in recognizing popular cultural dishes, their performance is suboptimal for dishes that are unique but not widely known internationally. Specifically, VLMs often generate either generic labels or hallucinated names for dishes that are localized to a particular culture. As a result, retrieval-augmented generation (RAG), which retrieves relevant recipes as references for VLMs, emerges as a promising approach. Nevertheless, recipe retrieval, which is itself imperfect, could mislead VLMs into generating inaccurate or culturally inappropriate dish names. This paper presents a …

Go to article

Analysis Theories On Artificial Intelligence, Chatgpt, Data Science, And Metaverse: The Case Of Digital Medicine, Yin Yang, Xingyun Liu, Jorge Luis Cuyubamba Dominguez, Yuan Fang, Wen Xie, Bairong Shen, Keng Siau Jan 2026

Analysis Theories On Artificial Intelligence, Chatgpt, Data Science, And Metaverse: The Case Of Digital Medicine, Yin Yang, Xingyun Liu, Jorge Luis Cuyubamba Dominguez, Yuan Fang, Wen Xie, Bairong Shen, Keng Siau

Research Collection School Of Computing and Information Systems

Healthcare organizations are increasingly adopting digital technologies, with Artificial Intelligence (AI), Data Science, and the metaverse driving significant advancements in smart healthcare. Al facilitates personalized medicine and efficient drug development, while Data Science enables predictive analytics and big data management, enhancing patient outcomes and healthcare quality. The metaverse introduces immersive training and telemedicine platforms, revolutionizing patient engagement and healthcare research. This study conducts' a scoping review of 6,171 articles, analyzing the transformational impact of AI, ChatGPT, Data Science, and the metaverse on healthcare. It highlights the benefits and risks of these technologies, identifies research gaps in their application within the …

Go to article

Trajlens: Visual Analysis For Constructing Cell Developmental Trajectories In Cross-Sample Exploration, Qipeng Wang, Shaolun Ruan, Rui Sheng, Yong Wang, Min Zhu, Huamin Qu Jan 2026

Trajlens: Visual Analysis For Constructing Cell Developmental Trajectories In Cross-Sample Exploration, Qipeng Wang, Shaolun Ruan, Rui Sheng, Yong Wang, Min Zhu, Huamin Qu

Research Collection School Of Computing and Information Systems

Constructing cell developmental trajectories is a critical task in single-cell RNA sequencing (scRNA-seq) analysis, enabling the inference of potential cellular progression paths. However, current automated methods are limited to establishing cell developmental trajectories within individual samples, necessitating biologists to manually link cells across samples to construct complete cross-sample evolutionary trajectories that consider cellular spatial dynamics. This process demands substantial human effort due to the complex spatial correspondence between each pair of samples. To address this challenge, we first proposed a GNN-based model to predict cross-sample cell developmental trajectories. We then developed TrajLens, a visual analytics system that supports biologists in …

Go to article

Security-Enhanced Decentralized Conditional Privacy-Preserving Authentication In Vanets, Suqin Luo, Xinghua Li, Yinbin Miao, Xuelin Cao, Zhan Zhang, Yunwei Wang, Deng R.H. Jan 2026

Security-Enhanced Decentralized Conditional Privacy-Preserving Authentication In Vanets, Suqin Luo, Xinghua Li, Yinbin Miao, Xuelin Cao, Zhan Zhang, Yunwei Wang, Deng R.H.

Research Collection School Of Computing and Information Systems

To ensure the legitimacy of communicators while ad dressing the privacy concerns of vehicles in vehicular ad-hoc networks (VANETs), conditional privacy-preserving authentication (CPPA) schemes have been proposed. Given that existing schemes suffer from single point of failure due to centralized authorities, several distributed CPPA schemes have been proposed. However, these schemes all ignore the tight cementation between system secret keys and the authority, which could be a serious threat to system security, that the compromised authority may leak the system secret key. To address these issues, we propose a security enhanced decentralized conditional privacy-preserving authentication (DCPPA) scheme. DCPPA first introduces …

Go to article

Scaling Up Cooperative Multi-Agent Reinforcement Learning Through Hierarchical Heterogeneous Modular Architectures, Minghong Geng Jan 2026

Scaling Up Cooperative Multi-Agent Reinforcement Learning Through Hierarchical Heterogeneous Modular Architectures, Minghong Geng

Research Collection School Of Computing and Information Systems

Multi-agent reinforcement learning enables sophisticated collaborative behaviors in autonomous systems, yet fundamental scalability barriers persist: existing methods struggle to coordinate large agent populations and face challenges with extended decision-making horizons. This research develops hierarchical approaches to scale up multi-agent learning systems through two complementary directions: structural scaling for coordinating increasing numbers of agents and temporal scaling for extending decision-making horizons. This paper presents four integrated contributions: a taxonomic survey establishing hierarchical architectures as the theoretical foundation for scalable multi-agent learning systems, a benchmark for long-horizon multi-objective multi-agent reinforcement learning, a framework integrating self-organizing neural networks with multiple reinforcement learning agents …

Go to article

Revisiting The Canonicalization For Fast And Accurate Crystal Tensor Property Prediction, Haowei Hua Hua, Jingwen Yang, Wanyu Lin, Pan Zhou Jan 2026

Revisiting The Canonicalization For Fast And Accurate Crystal Tensor Property Prediction, Haowei Hua Hua, Jingwen Yang, Wanyu Lin, Pan Zhou

Research Collection School Of Computing and Information Systems

Predicting the tensor properties of crystalline materials is a fundamental task in materials science. Unlike single-value property prediction, which is inherently invariant, tensor property prediction requires maintaining O(3) group tensor equivariance. Such equivariance constraint often requires specialized architecture designs to achieve effective predictions, inevitably introducing tremendous computational costs. Canonicalization, a classical technique for geometry, has recently been explored for efficient learning with symmetry. In this work, we revisit the problem of crystal tensor property prediction through the lens of canonicalization. Specifically, we demonstrate how polar decomposition, a simple yet efficient algebraic method, can serve as a form of canonicalization and …

Go to article

Tempo: Training-Time Equilibration Of Modalities For Per-Sample Optimization In Multimodal Sentiment, Yi Zhao, Erik Cambria, Xiaosong E, Xianxun Zhu Jan 2026

Tempo: Training-Time Equilibration Of Modalities For Per-Sample Optimization In Multimodal Sentiment, Yi Zhao, Erik Cambria, Xiaosong E, Xianxun Zhu

Research Collection School Of Computing and Information Systems

Multimodal sentiment models often become over-reliant on the “easiest” modality (typically text), leading to three coupled sub-problems: (i) representation-level dominance, where weaker modalities contribute little to the fused representation; (ii) optimization-level dominance, where the strongest modality drives most gradient updates and suppresses learning in others; and (iii) robustness degradation, where audio or vision fail under noise or missing inputs at test time. We present TEMPO, a plug-and-play training framework that mitigates these issues by rebalancing learning pressure across modalities while leaving inference unchanged. For each mini-batch, TEMPO estimates relative modality strength and applies two synchronized, training-only controls: selective forward attenuation …

Go to article

Purified Zero-Shot Sketch-Based Image Retrieval, Yang Zhou, Jingru Yang, Jin Wang, Kaixiang Huang, Guodong Lu, Shengfeng He Jan 2026

Purified Zero-Shot Sketch-Based Image Retrieval, Yang Zhou, Jingru Yang, Jin Wang, Kaixiang Huang, Guodong Lu, Shengfeng He

Research Collection School Of Computing and Information Systems

Sketches, as a new solution in multimedia systems that can replace natural language, are characterized by sparse visual cues such as simple strokes that differ significantly from natural images containing complex elements such as background, foreground, and texture. This misalignment poses substantial challenges for zero-shot sketch-based image retrieval (ZS-SBIR). Prior approaches match sketches to full images and tend to overlook redundant elements in natural images, leading to model distraction and semantic ambiguity. To address this issue, we introduce a distraction-agnostic framework, purified cross-domain matching (PuXIM), which operates on a straightforward principle: masking and matching. We devise a visual-cross-linguistic (VxL) sampler …

Go to article

Portfoliopilot: An Agentic Platform For Financial Portfolio Management Algorithm Development And Evaluation, Jared Chan Xu Yang, Haokai Ma, Yunshan Ma Jan 2026

Portfoliopilot: An Agentic Platform For Financial Portfolio Management Algorithm Development And Evaluation, Jared Chan Xu Yang, Haokai Ma, Yunshan Ma

Research Collection School Of Computing and Information Systems

Developing new portfolio-management algorithms typically demands substantial programming effort, limiting rapid experimentation and excluding finance professionals without coding skills. Current robo-advisory tools offer pre-built but rigid strategies, restricting customization and experimentation. We introduce PortfolioPilot, an open-source, agentic platform that enables users to generate bespoke portfolio through natural-language descriptions. Leveraging the Anthropic Claude API, PortfolioPilot dynamically synthesizes executable TypeScript algorithms that run in the frontend with security validation. The system integrates real-time backtesting with historical market data, classical optimization algorithms (Markowitz, LSTM, ARIMA), and interactive performance visualizations.

Go to article

Nondeterministic Polynomial-Time Problem Challenge: An Ever-Scaling Reasoning Benchmark For Llms, Chang Yang, Ruiyu Wang, Junzhe Jiang, Qi Jiang, Qinggang Zhang, Yanchen Deng, Shuxin Li, Shuyue Hu, Bo Li, Florian T. Pokorny, Xiao Huang, Xinrun Wang Jan 2026

Nondeterministic Polynomial-Time Problem Challenge: An Ever-Scaling Reasoning Benchmark For Llms, Chang Yang, Ruiyu Wang, Junzhe Jiang, Qi Jiang, Qinggang Zhang, Yanchen Deng, Shuxin Li, Shuyue Hu, Bo Li, Florian T. Pokorny, Xiao Huang, Xinrun Wang

Research Collection School Of Computing and Information Systems

Reasoning is the fundamental capability of large language models (LLMs). Due to the rapid progress of LLMs, there are two main issues of current benchmarks: i) these benchmarks can be crushed in a short time (less than 1 year), and ii) these benchmarks may be easily hacked. To handle these issues, we propose the ever-scalingness for building the benchmarks which are scaling over complexity against crushing, instance against hacking and exploitation, oversight for easy verification, and coverage for real-world relevance. This paper presents Nondeterministic Polynomial-time Problem Challenge (NPPC), an ever-scaling reasoning benchmark for LLMs. Specifically, the NPPC has three main …

Go to article

Evaluating Large Language Models For Line-Level Vulnerability Localization, Jian Zhang, Chong Wang, Anran Li, Weisong Sun, Cen Zhang, Wei Ma, Yang Liu Jan 2026

Evaluating Large Language Models For Line-Level Vulnerability Localization, Jian Zhang, Chong Wang, Anran Li, Weisong Sun, Cen Zhang, Wei Ma, Yang Liu

Research Collection School Of Computing and Information Systems

Recently, Automated Vulnerability Localization (AVL) has attracted growing attention, aiming to facilitate diagnosis by pinpointing the specific lines of code responsible for vulnerabilities. Large Language Models (LLMs) have shown potential in various domains, yet their effectiveness in line-level vulnerability localization remains underexplored. In this work, we present the first comprehensive empirical evaluation of LLMs for AVL. Our study examines 19 leading LLMs suitable for code analysis, including ChatGPT and multiple open-source models, spanning encoder-only, encoder-decoder, and decoder-only architectures, with model sizes from 60M to 70B parameters. We evaluate three paradigms including few-shot prompting, discriminative fine-tuning, and generative fine-tuning with and …

Go to article

Interpretable Multimodal Zero Shot Ecg Diagnosis Via Structured Clinical Knowledge Alignment, Jialu Tang, Hung Manh Pham, Ignace De Lathauwer, Henk S. Schipper, Yuan Lu, Dong Ma, Aaqib Saeed Jan 2026

Interpretable Multimodal Zero Shot Ecg Diagnosis Via Structured Clinical Knowledge Alignment, Jialu Tang, Hung Manh Pham, Ignace De Lathauwer, Henk S. Schipper, Yuan Lu, Dong Ma, Aaqib Saeed

Research Collection School Of Computing and Information Systems

Electrocardiogram (ECG) interpretation is essential for cardiovascular disease diagnosis, but current automated systems often struggle with transparency and generalization to unseen conditions. To address this, we introduce ZETA, a zero-shot multimodal framework designed for interpretable ECG diagnosis aligned with clinical workflows. ZETA uniquely compares ECG signals against structured positive and negative clinical observations, which are curated through an LLM-assisted, expertvalidated process, thereby mimicking differential diagnosis. Our approach leverages a pre-trained multimodal model to align ECG and text embeddings without disease-specific fine-tuning. Empirical evaluations demonstrate ZETA’s competitive zero-shot classification performance and, importantly, provide qualitative and quantitative evidence of enhanced interpretability, grounding …

Go to article

Examining Inclusive Computing Education For Blind Students In India, Akshay Kolgar Nayak, Yash Prakash, Md Javedul Ferdous, Sampath Jayarathna, Hae-Na Lee, Vikas Ashok Jan 2026

Examining Inclusive Computing Education For Blind Students In India, Akshay Kolgar Nayak, Yash Prakash, Md Javedul Ferdous, Sampath Jayarathna, Hae-Na Lee, Vikas Ashok

Computer Science Faculty Publications

The growing demand for computer professionals, driven by the expanding Information Technology industry, has led to numerous inclusive computing education efforts. These efforts have even included blind or visually-impaired (BVI) students, who are being increasingly encouraged to pursue education and a career in computing, despite the visually-oriented nature of the discipline. Extant literature has predominantly focused on identifying and addressing the accessibility barriers faced by BVI students to promote more inclusive learning environments. While few studies have also investigated the accessibility of computing education from the perspectives of BVI learners and instructors, these have been primarily situated in the Global …

Go to article

An Explainable Transformer Framework For Sentiment Analysis In Aviation Workforce Data, Sovon Chakraborty, Protiva Das, Fahmid Al Farid, Fuyad Hasan Bhoyan, Farig Yousuf Sadeque, Jia Uddin, Hezerul Abdul Karim Jan 2026

An Explainable Transformer Framework For Sentiment Analysis In Aviation Workforce Data, Sovon Chakraborty, Protiva Das, Fahmid Al Farid, Fuyad Hasan Bhoyan, Farig Yousuf Sadeque, Jia Uddin, Hezerul Abdul Karim

Computer Science Faculty Publications

Aviation is one of the predominant sectors that contribute significantly to the global economy. With the advent of technology, this industry is witnessing a paradigm shift towards data-driven approaches. The morale of the airline employees is barely noticed, which causes fatigue and depression. Furthermore, these mental health issues can be active reasons for destructive accidents. In this research, the authors are focused on collecting insightful information on aviation employees from Glassdoor.com. Moreover, the authors focus on analyzing the sentiments of the employees of renowned aviation companies. Primarily, the authors scraped necessary data from Glassdoor.com and created a dataset named JetJobJoy …

Go to article

Finding The Signal In The Noise: An Exploratory Study On Assessing The Effectiveness Of Ai And Accessibility Forums For Blind Users' Support Needs, Satwik Ram Kodandaram, Jiawei Zhou, Xiaojun Bi, Iv Ramakrishnan, Vikas Ashok Jan 2026

Finding The Signal In The Noise: An Exploratory Study On Assessing The Effectiveness Of Ai And Accessibility Forums For Blind Users' Support Needs, Satwik Ram Kodandaram, Jiawei Zhou, Xiaojun Bi, Iv Ramakrishnan, Vikas Ashok

Computer Science Faculty Publications

Accessibility forums and, more recently, generative AI tools have become vital resources for blind users seeking solutions to computer-interaction issues and learning about new assistive technologies, screen reader features, tutorials, and software updates. Understanding user experiences with these resources is essential for identifying and addressing persistent support gaps. Towards this, we interviewed 14 blind users who regularly engage with forums and GenAI tools. Findings revealed that forums often overwhelm users with multiple overlapping topics, redundant or irrelevant content, and fragmented responses that must be mentally pieced together, increasing cognitive load. GenAI tools, while offering more direct assistance, introduce new barriers …

Go to article

Lost In Instructions: Study Of Blind Users' Experiences With Diy Manuals And Ai-Rewritten Instructions For Assembly, Operation, And Troubleshooting Of Tangible Products, Monalika Padma Reddy, Aruna Balasubramanian, Jiawei Zhou, Xiaojun Bi, Iv Ramakrishnan, Vikas Ashok Jan 2026

Lost In Instructions: Study Of Blind Users' Experiences With Diy Manuals And Ai-Rewritten Instructions For Assembly, Operation, And Troubleshooting Of Tangible Products, Monalika Padma Reddy, Aruna Balasubramanian, Jiawei Zhou, Xiaojun Bi, Iv Ramakrishnan, Vikas Ashok

Computer Science Faculty Publications

AI tools like ChatGPT and Be-My-AI are increasingly being used by blind individuals. Although prior work has explored their use in some Do-It-Yourself (DIY) tasks by blind individuals, little is known about how they use these tools and the available product-manual resources to assemble, operate, and troubleshoot physical/tangible products – tasks requiring spatial reasoning, structural understanding, and precise execution. We address this knowledge gap via an interview study and a usability study with blind participants, investigating how they leverage AI tools and product manuals for DIY tasks with physical products. Findings show that manuals are essential resources, but product-manual instructions …

Go to article

Contextual Scaffolding And Self-Efficacy: Supporting Computer Skill Development Among Blind Learners In India, Akshay Kolgar Nayak, Yash Prakash, Sampath Jayarathna, Hae-Na Lee, Vikas Ashok Jan 2026

Contextual Scaffolding And Self-Efficacy: Supporting Computer Skill Development Among Blind Learners In India, Akshay Kolgar Nayak, Yash Prakash, Sampath Jayarathna, Hae-Na Lee, Vikas Ashok

Computer Science Faculty Publications

Inclusive computer literacy education efforts, broadening the participation of blind or visually impaired (BVI) individuals, have gained traction in recent years. Existing literature investigating these efforts primarily draws evidence from affluent Global North contexts, where accessibility resources and legal frameworks are relatively more mature. Little is known about the in-situ teaching and learning challenges faced by trainers and BVI students, respectively, in resource-constrained, multicultural Global South countries like India. To address this knowledge gap, we conducted a four-month contextual inquiry at two computer training centers catering to 94 BVI students in India. We notably observed a rigid, experience-driven training environment …

Go to article

Voxvista: Enhancing Screen Reading Experience For Online User Comments, Yash Prakash, Akshay Kolgar Nayak, Mohammed Shoaib Alyaan, Sampath Jayarathna, Hae-Na Lee, Vikas Ashok Jan 2026

Voxvista: Enhancing Screen Reading Experience For Online User Comments, Yash Prakash, Akshay Kolgar Nayak, Mohammed Shoaib Alyaan, Sampath Jayarathna, Hae-Na Lee, Vikas Ashok

Computer Science Faculty Publications

Online discussions have become integral to how people exchange ideas, form opinions, and participate in collective deliberation. While sighted users can comfortably engage with online discussions, blind users who are dependent on screen readers are forced to listen to long threads narrated in a single, monotonic voice that lacks prosodic variation, rhythm, or emotion. This robotic auditory experience not only deteriorates the user engagement with the content but also increases cognitive strain, by making it difficult to remain attentive and discern meaning beyond literal words. In an interview study, most blind participants reported that monotonous narration hindered their ability to …

Go to article

Memebuddy: Dialog-Style Audio Representations For Engaging Non-Visual Meme Experiences, Chirag Bhansali, Vikas Ashok, Hae-Na Lee Jan 2026

Memebuddy: Dialog-Style Audio Representations For Engaging Non-Visual Meme Experiences, Chirag Bhansali, Vikas Ashok, Hae-Na Lee

Computer Science Faculty Publications

Image memes are a pervasive form of online communication, widely used to convey humor, opinions, and cultural references. Prior work has explored making memes accessible to blind users, primarily through auto-generated descriptive captions. While these approaches improve comprehensibility and sometimes incorporate prosodic or emotional cues, they often fail to capture the humor, narrative structure, and contextual nuances that make memes engaging. We present MemeBuddy, a system that models memes as dialog, generating structured, multi-turn audio representations using role-based speakers. MemeBuddy reinterprets a meme as a conversation between two speakers, integrating extracted meme text with contextual knowledge implicitly inferred by a …

Go to article

Graph-Based And Graph-Transformer Representation Learning For Healthcare Data, Rui Wang Jan 2026

Graph-Based And Graph-Transformer Representation Learning For Healthcare Data, Rui Wang

Electronic Theses & Dissertations (2024 - present)

Healthcare data exhibit complex structures, including heterogeneous clinical entities, sparse observations, and longitudinal patient trajectories. Effectively modeling such data remains a fundamental challenge in computational healthcare research. Traditional machine learning approaches often rely on flat feature representations that fail to capture relationships among clinical events, limiting their ability to model complex healthcare processes. These challenges motivate structured learning frameworks that capture both relational structure and temporal dynamics in healthcare data. This dissertation develops a series of graph-based representation learning approaches, extended through graph-transformer architectures for modeling complex healthcare data. Such data can be represented as graphs, where nodes correspond to …

Go to article

When Helpfulness Becomes Harmful: Jailbreaking Llms For Malicious Code Generation, Noelle Capodieci Jan 2026

When Helpfulness Becomes Harmful: Jailbreaking Llms For Malicious Code Generation, Noelle Capodieci

Electronic Theses & Dissertations (2024 - present)

Generative AI (GenAI) and Large Language Models (LLMs) have made large strides in coding task capabilities, with many software developers integrating agentic engineering into their workflow. While GenAI has largely benefited professional software engineers who can automate their work, it has also created room for those with little coding expertise to also create fully fledged programs and applications. It is commonly noted that GenAI is trained with two major goals in mind: to be as helpful as possible, and be as harmless as possible. There exist moments where helpfulness may be prioritized over harmlessness when these goals conflict. LLMs may …

Go to article

First Prev Next Last