Digital Commons Network^™

Analysis Theories On Artificial Intelligence, Chatgpt, Data Science, And Metaverse: The Case Of Digital Medicine, Yin Yang, Xingyun Liu, Jorge Luis Cuyubamba Dominguez, Yuan Fang, Wen Xie, Bairong Shen, Keng Siau

Research Collection School Of Computing and Information Systems

Healthcare organizations are increasingly adopting digital technologies, with Artificial Intelligence (AI), Data Science, and the metaverse driving significant advancements in smart healthcare. Al facilitates personalized medicine and efficient drug development, while Data Science enables predictive analytics and big data management, enhancing patient outcomes and healthcare quality. The metaverse introduces immersive training and telemedicine platforms, revolutionizing patient engagement and healthcare research. This study conducts' a scoping review of 6,171 articles, analyzing the transformational impact of AI, ChatGPT, Data Science, and the metaverse on healthcare. It highlights the benefits and risks of these technologies, identifies research gaps in their application within the …

Security-Enhanced Decentralized Conditional Privacy-Preserving Authentication In Vanets, Suqin Luo, Xinghua Li, Yinbin Miao, Xuelin Cao, Zhan Zhang, Yunwei Wang, Deng R.H.

Research Collection School Of Computing and Information Systems

To ensure the legitimacy of communicators while ad dressing the privacy concerns of vehicles in vehicular ad-hoc networks (VANETs), conditional privacy-preserving authentication (CPPA) schemes have been proposed. Given that existing schemes suffer from single point of failure due to centralized authorities, several distributed CPPA schemes have been proposed. However, these schemes all ignore the tight cementation between system secret keys and the authority, which could be a serious threat to system security, that the compromised authority may leak the system secret key. To address these issues, we propose a security enhanced decentralized conditional privacy-preserving authentication (DCPPA) scheme. DCPPA first introduces …

Purified Zero-Shot Sketch-Based Image Retrieval, Yang Zhou, Jingru Yang, Jin Wang, Kaixiang Huang, Guodong Lu, Shengfeng He

Research Collection School Of Computing and Information Systems

Sketches, as a new solution in multimedia systems that can replace natural language, are characterized by sparse visual cues such as simple strokes that differ significantly from natural images containing complex elements such as background, foreground, and texture. This misalignment poses substantial challenges for zero-shot sketch-based image retrieval (ZS-SBIR). Prior approaches match sketches to full images and tend to overlook redundant elements in natural images, leading to model distraction and semantic ambiguity. To address this issue, we introduce a distraction-agnostic framework, purified cross-domain matching (PuXIM), which operates on a straightforward principle: masking and matching. We devise a visual-cross-linguistic (VxL) sampler …

Portfoliopilot: An Agentic Platform For Financial Portfolio Management Algorithm Development And Evaluation, Jared Chan Xu Yang, Haokai Ma, Yunshan Ma

Research Collection School Of Computing and Information Systems

Developing new portfolio-management algorithms typically demands substantial programming effort, limiting rapid experimentation and excluding finance professionals without coding skills. Current robo-advisory tools offer pre-built but rigid strategies, restricting customization and experimentation. We introduce PortfolioPilot, an open-source, agentic platform that enables users to generate bespoke portfolio through natural-language descriptions. Leveraging the Anthropic Claude API, PortfolioPilot dynamically synthesizes executable TypeScript algorithms that run in the frontend with security validation. The system integrates real-time backtesting with historical market data, classical optimization algorithms (Markowitz, LSTM, ARIMA), and interactive performance visualizations.

Nondeterministic Polynomial-Time Problem Challenge: An Ever-Scaling Reasoning Benchmark For Llms, Chang Yang, Ruiyu Wang, Junzhe Jiang, Qi Jiang, Qinggang Zhang, Yanchen Deng, Shuxin Li, Shuyue Hu, Bo Li, Florian T. Pokorny, Xiao Huang, Xinrun Wang

Research Collection School Of Computing and Information Systems

Reasoning is the fundamental capability of large language models (LLMs). Due to the rapid progress of LLMs, there are two main issues of current benchmarks: i) these benchmarks can be crushed in a short time (less than 1 year), and ii) these benchmarks may be easily hacked. To handle these issues, we propose the ever-scalingness for building the benchmarks which are scaling over complexity against crushing, instance against hacking and exploitation, oversight for easy verification, and coverage for real-world relevance. This paper presents Nondeterministic Polynomial-time Problem Challenge (NPPC), an ever-scaling reasoning benchmark for LLMs. Specifically, the NPPC has three main …

The Soft Target Curriculum: Using Nigeria's 2026 Cascading Breaches To Teach Foundational Cybersecurity Failures, Chinedum Amaechi, Doris Asogwa, Samuel Alade

Journal of Cybersecurity Education, Research and Practice

SourceURL:file:///home/amaechi/Documents/ *Journal of Cybersecurity Education, Research and Practice (JCERP)*. **Title:** The Soft Target Curriculum: Using Nigeria's 2026 Cascading Breaches to Teach Foundational Cybersecurity Failures.docx

Background: Between March and April 2026, a single threat actor allegedly compromised four Nigerian institutions across banking, payment infrastructure, government registry, and power distribution sectors. The breaches exposed millions of records and disrupted critical services, yet all four exploited elementary vulnerabilities taught in introductory cybersecurity courses. Objective: This pedagogical case study analyzes the four breaches as a unified phenomenon of "normalized negligence" and provides ready-to-use teaching materials for cybersecurity educators. Methods: Using open-source intelligence analysis of …

Cognitive Prosthetic: An Ai-Enabled Multimodal System For Episodic Recall In Knowledge Work, Lawrence Obiuwevwi, Krzystof J. Rechowicz, Vikas Ashok, Sachin Shetty, Sampath Jayarathna

Computer Science Faculty Publications

Modern knowledge workplaces increasingly strain human episodic memory as individuals navigate fragmented attention, overlapping meetings, and multimodal information streams. Existing workplace tools provide partial support through note-taking or analytics but rarely integrate cognitive, physiological, and attentional context into retrievable memory representations. This paper presents the Cognitive Prosthetic Multimodal System (CPMS)—an AI-enabled proof-of-concept designed to support episodic recall in knowledge work through structured episodic capture and natural language retrieval. CPMS synchronizes speech transcripts, physiological signals, and gaze behavior into temporally aligned, JSON-based episodic records processed locally for privacy. Beyond data logging, the system includes a web-based retrieval interface that allows users …

Quantum Machine Learning Models: Principles, Frameworks, And Computational Challenges, K. A. Jayabalaji, S. Venkata Anand, Dineshkumar Rajendran, Prasanta Chatterjee Biswas, Sardor Omonov, Rubaid Ashfaq

Computer Science Faculty Publications

Quantum machine learning (QML) has become an optimistic avenue of harnessing quantum computation in data-driven modeling, especially of issues with high dimensionality and complicated correlations. Current methods are generally based on fixed or over-parameterized quantum circuits, and hence restricted to scalability as well as unproductive optimization in real-world hardware. This chapter introduces a hybrid quantum-classical learning system that is adaptive and provides principled quantum data encoding, architecture-conscious variational circuit design and resource-optimal optimization. The technique is based on the concepts of quantum architecture search and subspace-preserving transformations to trade expressiveness with trainability, and discretize the quantum model into a classical …

Examining Inclusive Computing Education For Blind Students In India, Akshay Kolgar Nayak, Yash Prakash, Md Javedul Ferdous, Sampath Jayarathna, Hae-Na Lee, Vikas Ashok

Computer Science Faculty Publications

The growing demand for computer professionals, driven by the expanding Information Technology industry, has led to numerous inclusive computing education efforts. These efforts have even included blind or visually-impaired (BVI) students, who are being increasingly encouraged to pursue education and a career in computing, despite the visually-oriented nature of the discipline. Extant literature has predominantly focused on identifying and addressing the accessibility barriers faced by BVI students to promote more inclusive learning environments. While few studies have also investigated the accessibility of computing education from the perspectives of BVI learners and instructors, these have been primarily situated in the Global …

The Privacy Paradox Of Llms: User Perceptions And The Reality Of Pii Leakage, Shuai Cheng, Haitao Xu, Shu Meng, Shuai Hao, Chuan Yue, Zhao Li

Computer Science Faculty Publications

Large language models (LLMs) are increasingly deployed, yet they introduce significant privacy risks by disclosing personally identifiable information (PII) during interactions. Although prior work has demonstrated the feasibility of extracting PII from LLMs, no comprehensive study has evaluated the actual extent of PII leakage across mainstream LLMs or investigated user perceptions, literacy, and behavioral responses to these risks. To address these gaps, we conduct a large-scale evaluation of PII leakage in popular LLMs, demonstrating that attackers can extract email addresses and phone numbers with high success rates. Through a mixed-methods study involving 20 interviews and 204 survey participants, we identify …

Towards Supporting Real-Time Estimation Of Vehicle Fuel Consumption And Co2 Emissions In Smart City Applications, Abrar Alali, Stephan Olariu

Computer Science Faculty Publications

This paper evaluates a simplified physics-based energy demand model designed to estimate vehicle fuel consumption and CO₂ emissions—a critical tool for sustainable transportation planning and smart city applications. Unlike data-driven regression models that lack generalizability for user-defined conditions or complex physics-based approaches that rely on extensive, often proprietary data, the simplified model is distinguished by its minimal parameter requirements, depending primarily on a single, overarching powertrain efficiency value. A key contribution is the comprehensive empirical evaluation of the simplified model against official Environmental Protection Agency (EPA) test data across multiple driving cycles and vehicle types, providing a rigorous validation previously …

Maxgrnet: A Multi-Axis Vision Transformer With Improved Generalization For Eye Disease Classification Using Explainable Ai With Insertion-Deletion Operations On Fundus Images, Md Mehedi Hasan Santo, Fuyad Hasan Bhoyan, Fuad Ibne Jashim Farhad, Fahmid Al Farid, Sovon Chakraborty, Md Humaion Kabir Mehedi, Jia Uddin, Hezerul Bin Abdul Karim

Computer Science Faculty Publications

Eye diseases, including diabetic retinopathy (DR), glaucoma, and cataracts, represent a major global health concern and can lead to severe visual impairment or blindness if not identified in a timely manner. This study proposes a novel eye disease classification framework based on a multi-axis vision transformer (MaxViT) applied to color fundus images with Explainable Artificial Intelligence (XAI) techniques to enhance model transparency. The proposed architecture integrates transformer-based attention mechanisms with Global Response Normalization (GRN)-based multi-layer perceptron (MLP) layers to capture complex spatial and contextual relationships within fundus images effectively. The model was evaluated on a publicly available eye disease classification …

Biosecure-Llm Framework: Protecting Llms From Cyberbiosecurity Threats And The Case For Independent Ai Safety Governance, Xavier-Lewis Palmer, Lucas Potter, Srdjan Lesaja, Sotirios Karathanasis, Mohammad Ghasemigol

Computer Science Faculty Publications

Large Language Models (LLMs) are becoming critical infrastructure in scientific, healthcare, and governmental contexts. As frontier AI laboratories increasingly partner with government agencies, a fundamental question arises: Who should control the safety and policy-enforcement layers that constrain model behavior? Current safety mechanisms (LLM guardrails) are typically designed for generic "harmlessness" and operate by detecting semantic patterns and refusing requests. However, they are inadequate governance instruments because they cannot implement auditable, domain-specific controls tied to external regulatory policy objects (e.g., control lists or rules governing personally identifying information). Even a perfectly aligned model is not able to express institution-specific policy without …

Open Scholarly Information Systems: Status Quo, Challenges, Opportunities, Hannah Bast, Guillaume Cabanac, Paolo Manghi, Jian Wu, Marcel R. Ackermann

Computer Science Faculty Publications

Over the past 30 years, a rich ecosystem of scholarly information systems has developed that openly provide their services to the scientific community. These systems include aggregators of bibliographic metadata (e.g., DBLP, OpenCitations, OpenAIRE Graph, OpenAlex, ORKG, Semantic Scholar, CiteSeerX, and CORE); publication, data, and software repositories (e.g., Arxiv.org, Figshare, Zenodo, Software Heritage, and Dataverse); and PID authorities (e.g., ORCID, ROR, Crossref, and DataCite). This interdisciplinary Dagstuhl Seminar "Open Scholarly Information Systems: Status Quo, Challenges, Opportunities" (25381) was the first of its kind to bring together practitioners from this ecosystem, as well as researchers investigating related questions or relying on …

An Investigation Of Federated Gnns Under Aggregation, Data Poisoning, And Differential Privacy For Icu Length-Of-Stay Prediction, Shakib Mahmud Dipto, Soumya Banerjee, Sandip Roy, Ahmad F. Al Musawi, Preetam Ghosh, Sachin Shetty, Pratip Rana

Computer Science Faculty Publications

Accurate prediction of ICU Length of Stay (LoS) is essential for clinical decision-making and healthcare resource management. Graph Neural Networks (GNNs), such as GraphSAGE, offer a natural fit by capturing patient data from Electronic Health Records (EHRs) through graph structures. However, the distributed and sensitive nature of this data raises both privacy and legal concerns regarding the aggregation and training of GNN models. This additionally leads to issues with data imbalance and model robustness. In this study, we perform an analysis of the Federated Graph Neural Network (GNN-FL) framework to enable decentralized learning on EHRs derived from the MIMIC-III dataset. …

Toward A Centralized Cross Domain Database For Reproducibility And Replicability Studies, Rochana R. Obadage, Sarah Rajtmajer, Jian Wu

Computer Science Faculty Publications

Reproducibility and replicability (R&R) are structural properties of scientific knowledge, yet existing R&R evidence remains fragmented across domains and initiatives. We present an ongoing effort to develop a centralized, cross-domain database of R&R studies that links published works to their corresponding R&R attempts and supporting assessments. Bibliographic metadata and title-based matching through scholarly indexing services identify canonical records and persistent identifiers. A heuristic, uncertainty-aware matching algorithm supports intra-source and inter-source deduplication, complemented by manual review of ambiguous cases. A unified schema accommodates heterogeneous assessment frameworks and records original studies, R&R studies, assessments, aggregated summaries, and source provenance. The database currently …

Replicatorbench: Benchmarking Llm Agents For Replicability In Social And Behavioral Sciences, Bang Nguyen, Dominik Soós, Qian Ma, Rochana R. Obadage, Zack Ranjan, Sai Koneru, Timothy M. Errington, Shakhlo Nematova, Sarah Rajtmajer, Jian Wu, Meng Jiang

Computer Science Faculty Publications

The literature has witnessed an emerging interest in developing and evaluating AI agents for automated assessment of research claims in scientific papers. Existing benchmarks focus primarily on the computational aspect of this task, testing agents' ability to reproduce or replicate research outcomes when having access to the code and data. This setting, while foundational, (1) fails to capture the inconsistent availability of new data for replication as opposed to reproduction, and (2) lacks ground-truth diversity by focusing exclusively on fully reproducible or replicable papers, thereby failing to evaluate an agent's ability to identify non-replicable research. Furthermore, most benchmarks only evaluate …

Untrained Position-Encoded Multilayer Perceptron Network For Structured Illumination Microscopy Reconstruction, Sahil Sharma, Leonidas Zimianitis, Krishnendu Samanta, Balpreet Singh Ahluwalia, Joby Joseph, Dushan N. Wadduwage

Computer Science Faculty Publications

Structured Illumination Microscopy (SIM) enables super-resolution imaging by encoding high-frequency spatial information through patterned light. While traditional Fourier-based reconstruction methods are prone to artifacts under suboptimal conditions, recent deep learning approaches often require large training datasets and lack adaptability across different imaging setups. In this work, we present Position Encoded Multi-Layer Perceptron (PEM) network that leverages implicit neural representations (INRs) and SIM forward-model-driven modeling to reconstruct super-resolved images without any training data. PEM-SIM represents each spatial coordinate as a combination of sinusoidal functions across multiple frequencies, enabling rich encoding of fine spatial detail. A forward model grounded in SIM image …

Adaptive Self-Attention For Enhanced Segmentation Of Adult Gliomas In Multi-Modal Mri, Evan P. Savaria, Jiangwen Sun

Computer Science Faculty Publications

Every year there are an estimated 80,000–90,000 new glioma cases, highlighting the need for reliable imaging-based decision support. Although deep learning has improved tumor sub-region segmentation, many state-of-the-art models fail to fully capture complementary information across T1, T1Gd, T2, and FLAIR MRI modalities and often operate as “black boxes,” limiting physician trust when precise delineation is critical for surgical planning, radiation targeting, and treatment monitoring. To address these limitations, we propose AIMS, an Adaptive Integrated Multi-Modal Segmentation framework that maintains modality-specific feature streams and employs adaptive self-attention within a hierarchical CNN-Transformer architecture to prioritize and fuse multi-modal MRI features. We …

Application Paths Of Semantic Modeling In Financial Fraud Detection And Risk Identification, Victor P. Gauthier, Daniel S. Wu

Computer Science Faculty Publications

Financial fraud and risk pose significant threats to economic stability and individual well-being. Traditional detection methods often struggle to keep pace with increasingly sophisticated fraudulent schemes. Semantic modeling, which focuses on understanding the meaning and relationships within data, offers a promising avenue for enhancing fraud detection and risk identification. This review paper explores the application paths of semantic modeling in this domain. We begin with a historical overview of fraud detection techniques, highlighting the limitations of traditional approaches. Subsequently, we delve into core themes, including knowledge graph-based fraud detection and semantic rule-based inference for risk assessment. We then compare and …

Design And Analysis Of Modern Quantum Neural Network Architectures For Intelligent Systems, Lakshmi Chandrakanth Kasireddy, Prabhakara Rao Kapula, Dineshkumar Rajendran, Neha Bharani, Srikanth Pulipeti, Islombek Khushvaktov

Computer Science Faculty Publications

Quantum neural networks (QNNs) offer a principled pathway for integrating quantum computation with machine learning through superposition- and entanglement-based representations. This chapter proposes an architecture-aware design and evaluation framework for modern QNNs, emphasizing robustness and system feasibility alongside predictive performance. Multiple architectures variational QNNs, quantum convolutional neural networks, tensor-network hybrids, and fully quantum models—are assessed under a unified protocol. Experimental analysis shows that the proposed architecture-search–guided QNN achieves 91.8% classification accuracy and an F1-score of 0.914, outperforming fixed-template variational QNNs by approximately 5.6 percentage points. Under depolarizing noise with probability p = 0.10, the proposed model retains 85.3% accuracy, whereas …

Integration Of Hybrid Quantum-Neuromorphic Ai With Cloud, Edge, And High-Performance Computing Environments, Arun B. Prasad, Ajay Prasad, Dineshkumar Rajendran, Anurag Tiwari, T. Akilan, Islombek Khushvaktov

Computer Science Faculty Publications

The convergence of quantum computing, neuromorphic learning, and distributed cloud infrastructures has occurred very rapidly, and intelligent systems are now providing new opportunities, but the challenge of instability, complexity of orchestration, and noise sensitivity remains in the way of practical integration. The proposed work is based on a hybrid quantum and neuromorphic architecture, which is the integration of event-based neuromorphic adaptation and quantum-assisted global optimization, orchestrated by cloud-HPC. The architecture presents the thermodynamically regularized learning and resourceful task scheduling to the probabilistic search and the continuous local adaptation. Experimental evaluation across financial modeling, medical imaging, and physical system prediction shows …

Contextual Scaffolding And Self-Efficacy: Supporting Computer Skill Development Among Blind Learners In India, Akshay Kolgar Nayak, Yash Prakash, Sampath Jayarathna, Hae-Na Lee, Vikas Ashok

Computer Science Faculty Publications

Inclusive computer literacy education efforts, broadening the participation of blind or visually impaired (BVI) individuals, have gained traction in recent years. Existing literature investigating these efforts primarily draws evidence from affluent Global North contexts, where accessibility resources and legal frameworks are relatively more mature. Little is known about the in-situ teaching and learning challenges faced by trainers and BVI students, respectively, in resource-constrained, multicultural Global South countries like India. To address this knowledge gap, we conducted a four-month contextual inquiry at two computer training centers catering to 94 BVI students in India. We notably observed a rigid, experience-driven training environment …

Voxvista: Enhancing Screen Reading Experience For Online User Comments, Yash Prakash, Akshay Kolgar Nayak, Mohammed Shoaib Alyaan, Sampath Jayarathna, Hae-Na Lee, Vikas Ashok

Computer Science Faculty Publications

Online discussions have become integral to how people exchange ideas, form opinions, and participate in collective deliberation. While sighted users can comfortably engage with online discussions, blind users who are dependent on screen readers are forced to listen to long threads narrated in a single, monotonic voice that lacks prosodic variation, rhythm, or emotion. This robotic auditory experience not only deteriorates the user engagement with the content but also increases cognitive strain, by making it difficult to remain attentive and discern meaning beyond literal words. In an interview study, most blind participants reported that monotonous narration hindered their ability to …

Modeling Joint Visual Attention In Naturalistic Dyadic Interactions, Kuushini Thennakoon, Yasasi Abeysinghe, Bhanuka Mahanama, Vikas Ashok, Sampath Jayarathna

Computer Science Faculty Publications

Joint visual attention (JVA) provides important insight into how individuals coordinate attention during social interaction. Egocentric eye tracking enables the study of JVA in natural, multi-user settings. This work presents a multi-stage framework to identify and analyze JVA using egocentric video and gaze data. The approach consists of three steps: spatiotemporal tube-based visual similarity, gaze-guided object detection, and attention pattern analysis using the ambient–focal coefficient K. Results show that object-focused collaborative activities exhibit high JVA, with object detection capturing higher joint attention than visual similarity, whereas conversation-based or independent activities show lower and more fragmented joint attention. Analysis of K …

Exploring Marshall–Olkin Models Through Bibliometric And Topic Modeling Approaches Uses Latent Dirichlet Allocation (1981-2025): A Study Based On Scopus Data, Humberto Llinás, Brian Llinás, Carlos López, Daniela Nuñez

Computer Science Faculty Publications

The Marshall–Olkin family of distributions has gained increasing attention in fields such as reliability engineering, survival analysis, financial risk modeling, and actuarial science because of its flexibility in modeling dependence among events and its wide range of extensions. Despite its growing relevance, a systematic understanding of how research on Marshall–Olkin models has evolved over time is still limited. This study addresses this gap by combining bibliometric techniques with topic modeling to analyze the structure and evolution of the scientific literature on Marshall–Olkin models. The analysis includes all 266 peer-reviewed publications on Marshall–Olkin models indexed in Scopus between 1981 and 2025. …

Exploring Large Language Models For Trustworthy Use: Insights From Research And Development, Sandeep Kalari, Sahithi Padidela, Vikas Ashok, Ravi Mukkamala

Computer Science Faculty Publications

Large Language Models (LLMs) are increasingly being adopted in a wide variety of domains, including sensitive domains such as healthcare and finance. However, persistent challenges such as unreliable data sources, privacy breaches, and hallucinated output continue to hinder their usage. We have experimented with several strategies to address these challenges. First, we developed BlockQwen, a blockchain-augmented framework that integrates decentralized trust validation, role-specific access control, and verifiable audit trails into the Qwen 2.5 LLM workflow. Second, we developed PrivAware, a multilayered privacy-enforcement framework, using a fine-tuned Flan-T5 model with self-attention masking, to safeguard data while maintaining high utility. Both systems …

A Comparative Analysis Of Explainable Ai (Xai) Techniques For Transparent And Reliable Image Classification, Sovon Chakraborty, Shakib Mahmud Dipto, Kevin R. Pilkiewicz, Michael L. Mayo, Pratip Rana

Computer Science Faculty Publications

Evaluating the trustworthiness of black-box machine learning models remains a significant methodological challenge. Their lack of transparency and interpretability limits applicability, because stakeholders often seek transparency before trusting the results of black-box machine learning models. Explainable AI (XAI) methods provide for human-understandable justifications and informed decision-making of these black-box architectures. Therefore, it is imperative to select the proper XAI model tailored to specific tasks. In this research, we focus on examining four XAI techniques: PEEK, LRP, GRAD-CAM, and LIME to understand how they perform against each other for image classification tasks. We evaluate the performance, robustness, generalizability, noise stability, and …

Susceptibility To High-Fidelity Misinformation: An Eye-Tracking Analysis, Yasasi Abeysinghe, Gavindya Jayawardena, Enkelejda Kasneci, Sampath Jayarathna

Computer Science Faculty Publications

With the rise of online misinformation and AI-generated text, understanding human perception of news truthfulness is critical. In this study, we examine visual attention and cognitive processing using eye-tracking measures as individuals read fake and real news articles sharing nearly identical structure and imagery, differing only in subtle textual changes. Using the public FakeNewsPerception dataset, we analyze advanced gaze measures, including scanpaths, AOI transitions, and luminance-corrected pupil measures, beyond basic gaze features, in relation to news truthfulness and perceived believability. Results show that, given the high fidelity of the fake news, readers exhibited comparable visual scanning patterns, attention allocation across …

Memebuddy: Dialog-Style Audio Representations For Engaging Non-Visual Meme Experiences, Chirag Bhansali, Vikas Ashok, Hae-Na Lee

Computer Science Faculty Publications

Image memes are a pervasive form of online communication, widely used to convey humor, opinions, and cultural references. Prior work has explored making memes accessible to blind users, primarily through auto-generated descriptive captions. While these approaches improve comprehensibility and sometimes incorporate prosodic or emotional cues, they often fail to capture the humor, narrative structure, and contextual nuances that make memes engaging. We present MemeBuddy, a system that models memes as dialog, generating structured, multi-turn audio representations using role-based speakers. MemeBuddy reinterprets a meme as a conversation between two speakers, integrating extracted meme text with contextual knowledge implicitly inferred by a …