Computer Sciences Commons^™

Towards Multimodal Emotional Support Conversation Systems, Yuqi Chu, Lizi Liao, Zhiyuan Zhou, Chong-Wah Ngo, Richang Hong

Research Collection School Of Computing and Information Systems

The integration of conversational artificial intelligence (AI) into mental health care promises a new horizon for therapist-client interactions, aiming to closely emulate the depth and nuance of human conversations. Despite the potential, the current landscape of conversational AI is markedly limited by its reliance on single-modal data, constraining the systems’ ability to empathize and provide effective emotional support. This limitation stems from a paucity of resources that encapsulate the multimodal nature of human communication essential for therapeutic counseling. To address this gap, we introduce the Multimodal Emotional Support Conversation (MESC) dataset, a first-of-its-kind resource enriched with comprehensive annotations across text, …

Rethinking Cognitive Complexity For Unit Tests: Toward A Readability-Aware Metric Grounded In Developer Perception, Wendkûuni C. Ouédraogo, Yinghua Li, Xueqi Dang, Xin Zhou, Anil Koyuncu, Jacques Klein, David Lo, Tegawendé F. Bissyandé

Research Collection School Of Computing and Information Systems

Automatically generated unit tests-from searchbased tools like EvoSuite or LLMs-vary significantly in structure and readability. Yet most evaluations rely on metrics like Cyclomatic Complexity and Cognitive Complexity, designed for functional code rather than test code. Recent studies have shown that SonarSource's Cognitive Complexity metric assigns nearzero scores to LLM-generated tests, yet its behavior on EvoSuitegenerated tests and its applicability to test-specific code structures remain unexplored. We introduce CCTR, a Test-Aware Cognitive Complexity metric tailored for unit tests. CCTR integrates structural and semantic features like assertion density, annotation roles, and test composition patterns-dimensions ignored by traditional complexity models but critical for …

Improving Co-Decoding Based Security Hardening Of Code Llms Leveraging Knowledge Distillation, Dong Li, Shanfu Shu, Meng Yan, Zhongxin Liu, Chao Liu, Xiaohong Zhang, David Lo

Research Collection School Of Computing and Information Systems

Large Language Models (LLMs) have been widely adopted by developers in software development. However, the massive pretraining code data is not rigorously filtered, allowing LLMs to learn unsafe coding patterns. Several prior studies have demonstrated that code LLMs tend to generate code with potential vulnerabilities. The widespread adoption of intelligent programming assistants poses a significant threat to the software development process. Existing approaches to mitigating this risk primarily involve constructing secure data that are free of vulnerabilities and then retraining or fine-tuning the models. However, such an effort is resource intensive and requires significant manual supervision. When the model parameters …

Ponzilens+: Visualizing Bytecode Actions For Smart Ponzi Scheme Identification, Xiaolin Wen, Tai D. Nguyen, Shaolun Ruan, Qiaomu Shen, Jun Sun, Feida Zhu, Yong Wang

Research Collection School Of Computing and Information Systems

With the prevalence of smart contracts, smart Ponzi schemes have become a common fraud on blockchain and have caused significant financial loss to cryptocurrency investors in the past few years. Despite the critical importance of detecting smart Ponzi schemes, a reliable and transparent identification approach adaptive to various smart Ponzi schemes is still missing. To fill the research gap, we first extract semantic-meaningful actions to represent the execution behaviors specified in smart contract bytecodes, which are derived from a literature review and in-depth interviews with domain experts. We then propose PonziLens+, a novel visual analytic approach that provides an intuitive …

A Difficult Act To Maintain, J.G. Allen

Research Collection Yong Pung How School Of Law

In "Where is Singapore's AI regulation headed?" (Issues, Summer 2025), Manoj Harjani starts by recounting its delicate balancing act in governing artificial intelligence. The city-state is able to maintain credibility on the global stage while remaining pragmatically grounded in technical experimentation, maintaining policy realism without overcommitting to rigid legal frameworks. The choice to adopt a regulatory “light touch” is often framed as a way to maintain flexibility, avoid overregulation, and enable innovation. But this obscures the extent to which this posture is itself a political and economic settlement—one that reinforces Singapore’s position in the global digital economy by facilitating capital …

Building A Novel Question-Answering System Using Retrieval-Augmented Generation For The California Fair Political Practices Commission, Saanvi Dua

Master's Theses

The California Fair Political Practices Commission (FPPC) receives a high volume of inquiries via email from public officials, the general public, and other agencies, which currently requires staff to manually search through informational documents and manuals to provide timely responses. This process is both labor- and time-intensive.

To address this challenge, we design a question-answering (QA) system that drafts responses to emailed questions by retrieving relevant information from the FPPC’s manuals using a retrieval-augmented generation (RAG) framework. Although the current implementation focuses on a single manual, the system is designed to be adaptable to the broader set of FPPC documents. …

Apidocbooster: An Extract-Then-Abstract Framework Leveraging Large Language Models For Augmenting Api Documentation, Chengran Yang, Jiakun Liu, Bowen Xu, Christoph Treude, Yunbo Lyu, Junda He, Ming Li, David Lo

Research Collection School Of Computing and Information Systems

API documentation is often the most trusted resource for programming. Many approaches have been proposed to augment API documentation by summarizing complementary information from external resources such as Stack Overflow. Existing extractive-based summarization approaches excel in producing faithful summaries that accurately represent the source content without input length restrictions. Nevertheless, they suffer from inherent readability limitations. On the other hand, our empirical study on the abstractive-based summarization method, i.e., GPT-4, reveals that GPT-4 can generate coherent and concise summaries but presents limitations in terms of informativeness and faithfulness. We introduce APIDocBooster, an extract-then-abstract framework that seamlessly fuses the advantages of …

Detecting Defi Fraud With A Graph-Transformer Language Model, Wei Ma, Junjie Shi, Jiaxi Qiu, Cong Wu, Jing Chen, Lingxiao Jiang, Shangqing Liu, Yang Liu, Yang Xiang

Research Collection School Of Computing and Information Systems

With the rapid development of blockchain technology, the widespread adoption of smart contracts—particularly in decentralized finance (DeFi) applications—has introduced significant security challenges, such as reentrancy attacks, phishing, and Sybil attacks. To address these issues, we propose a novel model called TrxGNNBERT, which combines Graph Neural Network (GNN) and the Transformer architecture to effectively handle both graph-structured and textual data. This combination enhances the detection of suspicious transactions and accounts on blockchain platforms like Ethereum. TrxGNNBERT was pre-trained using a masked language model (MLM) on a dataset of 60,000 Ethereum transactions by randomly masking the attributes of nodes and edges, thereby …

Map As A By-Product: Collective Landmark Mapping From Imu Data And User-Provided Texts In Situated Tasks, Ryo Yonetani, Kotaro Hara

Research Collection School Of Computing and Information Systems

This paper presents Collective Landmark Mapper, a novel map-as-a-by-product system for generating semantic landmark maps of indoor environments. Consider users engaged in situated tasks that require them to navigate these environments and regularly take notes on their smartphones. Collective Landmark Mapper exploits the smartphone's IMU data and the user's free text input during these tasks to identify a set of landmarks encountered by the user. The identified landmarks are then aggregated across multiple users to generate a unified map representing the positions and semantic information of all landmarks. In developing the proposed system, we focused specifically on retail applications and …

Implementing Slack-Free Custom Penalty Function For Qubo On Gate-Based Quantum Computers, Xin Wei Lee, Hoong Chuin Lau

Research Collection School Of Computing and Information Systems

Solving NP-hard constrained combinatorial optimization problems using quantum algorithms remains a challenging yet promising avenue toward quantum advantage. Variational Quantum Algorithms (VQAs), such as the Variational Quantum Eigensolver (VQE), typically require constrained problems to be reformulated as unconstrained ones using penalty methods. A common approach introduces slack variables and quadratic penalties in the QUBO formulation to handle inequality constraints. However, this leads to increased qubit requirements and often distorts the optimization landscape, making it harder to find high-quality feasible solutions. To address these issues, we explore a slack-free formulation that directly encodes inequality constraints using custom penalty functions, specifically the …

Conv4rec: A 1‑By‑1 Convolutional Autoencoder For User Profiling Through Joint Analysis Of Implicit And Explicit Feedbacks, Antoine Ledent, Petr Kasalický, Rodrigo Alves, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

We introduce a new convolutional autoencoder architecture for user modeling and recommendation tasks with several improvements over the state of the art. First, our model has the flexibility to learn a set of associations and combinations between different interaction types in a way that carries over to each user and item. Second, our model is able to learn jointly from both the explicit ratings and the implicit information in the sampling pattern (which we refer to as ”implicit feedback”). It can also make separate predictions for the probability of consuming content and the likelihood of granting it a high rating …

Vibemus: Proactive Agentic System For Music Personalization, Zhiliang Guo, Teng Tu, Yunshan Ma, Xun Yang

Research Collection School Of Computing and Information Systems

Large language models (LLMs) enable diverse forms of AI-assisted creation, yet they often struggle to bridge the preference-articulation gap: users may provide incomplete or vague intentions or lack the vocabulary to specify what they want, yielding outputs misaligned with true preferences. To address this gap and facilitate music creation in a vibe-centric environment, we introduce VibeMus, a proactive agentic system built on open-source components. The system engages in multi-turn dialogue to progressively determine the music’s emotion, genre, lyrics, and other aspects before generation. Simulated evaluations show that proactive clarification improves alignment with users’ intended nuances. Our approach is training-free, leveraging …

Finding Safety Violations Of Ai-Enabled Control Systems Through The Lens Of Synthesized Proxy Programs, Jieke Shi, Zhou Yang, Junda He, Bowen Xu, Dongsun Kim, Donggyun Han, David Lo

Research Collection School Of Computing and Information Systems

Given the increasing adoption of modern AI-enabled control systems, ensuring their safety and reliability has become a critical task in software testing. One prevalent approach to testing control systems is falsification, which aims to find an input signal that causes the control system to violate a formal safety specification using optimization algorithms. However, applying falsification to AI-enabled control systems poses two significant challenges: (1) it requires the system to execute numerous candidate test inputs, which can be time-consuming, particularly for systems with AI models that have many parameters, and (2) multiple safety requirements are typically defined as a conjunctive specification, …

Robface: A Test Suite For Efficient Robustness Evaluation Of Face Recognition Systems, Ruihan Zhang, Jun Sun

Research Collection School Of Computing and Information Systems

Face recognition is a widely used authentication technology in practice, where robustness is required. It is thus essential to have an efficient and easy-to-use method for evaluating the robustness of (possibly third-party) trained face recognition systems. Existing approaches to evaluating the robustness of face recognition systems are either based on empirical evaluation (e.g., measuring attacking success rate using state-of-the-art attacking methods) or formal analysis (e.g., measuring the Lipschitz constant). While the former demands significant user efforts and expertise, the latter is extremely time-consuming. In pursuit of a comprehensive, efficient, easy-to-use, and scalable estimation of the robustness of face recognition systems, …

Reimagining Academic Assessment In The Age Of Ai, Matthew Hammerton

Research Collection School of Social Sciences

In ‘Reimagining Academic Assessment in the Age of AI’, Matthew Hammerton examines the challenges and opportunities posed by generative AI for higher education assessment. He critiques common responses like banning AI, reverting to in-class exams, or abandoning essays altogether, arguing that they fail to preserve the deeper pedagogical goals of higher order, independent thinking. Instead, Hammerton proposes a guiding principle of intellectual responsibility: students should be accountable for explaining and defending each major choice in their work—regardless of whether they use AI tools. To operationalise this, he advocates for reintegrating oral examinations (‘vivas’) alongside written essays. In this model, students …

Exact And Approximate Conformal Inference For Multi-Output Regression, Chancellor Johnstone, Eugene Ndiaye

Faculty Publications

It is common in machine learning to estimate a response y given covariate information x . However, these predictions alone do not quantify any uncertainty associated with said predictions. One way to overcome this deficiency is with conformal inference methods, which construct a set containing the unobserved response with a prescribed probability. Unfortunately, even with a one-dimensional response, conformal inference is computationally expensive despite recent encouraging advances. In this paper, we explore multi-output regression, delivering exact derivations of conformal inference p-values when the predictive model can be described as a linear function of y . Additionally, we introduce a multivariate …

Robust Ai Solutions For Financial Markets Through Generative Modeling, Dynamic Graph Learning, And Reinforcement-Based Portfolio Optimization, Jingyi Gu

Dissertations

Financial markets are inherently uncertain and dynamic, driven by complex factors such as macroeconomic signals, investor sentiment, and evolving inter-asset relationships. While machine learning has advanced financial modeling, existing approaches often fall short in addressing the real-world intricacies of finance. This dissertation confronts two critical challenges, human-driven stochasticity and risk-intensive decision-making under real-world trading constraints, while seizing a pivotal opportunity, the structural dynamics of evolving financial systems. These elements are foundational to advancing robust and practical financial intelligence.

To this end, this dissertation develops a unified framework for robust financial modeling and decision-making. The framework is architected as a progressive, …

Large-Scale Graph Algorithms And Applications With An Emphasis On Fintech Data, Fuhuan Li

Dissertations

Graph algorithms are essential analytical tools with applications spanning cybersecurity, biology, social media, and increasingly, financial technology (FinTech). The complex and interconnected nature of financial data, particularly in cryptocurrency networks, presents unique opportunities for graph-based analysis in fraud detection and anomaly identification.

This dissertation presents the design and implementation of scalable graph algorithms tailored for large-scale networks, with particular emphasis on FinTech applications. The primary contributions include: (1) novel cover-edge based triangle counting algorithms that significantly reduce computational overhead through breadth-first search preprocessing, achieving substantial speedups over traditional methods and dramatic communication reduction in distributed settings, (2) optimized parallel implementations …

Optimizing Hip And Knee Assistance For Walking And Sit-To-Stand Transitions: An Intrinsic Muscle Mechanics Based Predictive Approach, Neethan Ratnakumar

Dissertations

As the global population ages, the demand for wearable assistive technologies continues to rise, driven by their potential to enhance mobility and independence in older adults. Effectively designed controllers for lower-limb exoskeletons to assist sit-to-stand (STS) and walking are crucial for delivering efficient, safe, and comfortable assistance during daily activities. Traditionally, controller optimization involves biomechanical modeling and user-specific customization. Musculoskeletal simulations play a central role in this process by providing insights into human-exoskeleton interaction dynamics, thereby informing and refining control strategies.

This work presents a simulation-driven approach for developing exoskeleton controllers for walking and STS using two distinct methods: optimal …

Sugar: A Sequence Unfolding Based Transformer Model For Group Activity Recognition, Yash U. Gondkar

Graduate Masters Theses

Large Language Models have improved significantly in the past couple of years due to the adoption of transformers. However, transformers still find it challenging to process videos due to limited context size caused by their quadratic computing cost. Therefore, we studied a booming field in machine learning which powers applications like social scene analysis and video surveillance systems called Group Activity Recognition (GAR). We found that recent models were able to achieve more than 90% accuracy on popular datasets like the Volleyball dataset, however, it turned out that even they relied on transformers.

Therefore, in this work, we developed a …

Design And Development Of A Standalone Digital Holographic Microscope Employing Phase-Driven Reconstruction And Classification For Biomedical Imaging And Optical Diagnostics, Charlotte Kyeremah

Graduate Doctoral Dissertations

Access to advanced biomedical imaging technologies remains a significant challenge in resource-limited settings, especially for early disease detection and monitoring of diseases such as malaria, HIV, and other blood-borne diseases. Although point-of-care (POC) devices have gained popularity in global health, many rely on antibody-based tests, lateral flow strips, or optical readouts that often lack quantitative capabilities, sensitivity to early infections, or versatility in different diagnostic targets. In addition, these systems are typically dependent on disposable reagents or manual interpretation, which limits their effectiveness in remote areas. Digital Holographic Microscopy (DHM) presents a promising alternative as a label-free imaging method capable …

Can Artificial Intelligence Models Provide Reliable Medical Counselling To Fertility Patients?, Idan Alcalay, Ariel Weissman, Hadas Ganer Herman, Avi Tsafrir, Matan Friedman, Eran Weiner, Raoul Orvieto, Nikolaos P. Polyzos, Michael H. Dahan, Alex Polyakov, Robert Fischer, Sandro C. Esteves, Baris Ata, Jason M. Franasiak, Yossi Mizrachi

Department of Obstetrics and Gynecology Faculty Papers

RESEARCH QUESTION: Can generative artificial intelligence (AI) models provide reliable counselling to fertility patients regarding real-world clinical questions?

DESIGN: In this cross-sectional study, 12 clinical questions were developed to reflect common, real-life dilemmas encountered during fertility workup and treatment. Responses to each question were generated by two experienced fertility specialists, and two AI models - ChatGPT and Gemini. Eight leading internationally recognized fertility experts, blinded to the source of each reply, independently rated all the responses on a scale from 1 (strongly disagree) to 10 (strongly agree). Ratings were compared across all four repliers using non-parametric statistical tests.

RESULTS: The …

Towards Age-Inclusive Human Computer Interaction: A Study Of Text Message Adoption By Seniors, Sam Takavarasha, Varaidzo Mapepa

African Conference on Information Systems and Technology

Since mobile phones are increasingly becoming livelihoods-enablers to people in developing economies, inclusive interaction design are critical. This research on the age inclusivity of feature phones was motivated by some observation that elderly users had challenges with adoption of text messaging. We, therefore, hypothesized that elderly people had challenges with texting ‘cash’, ‘cheque’ or ‘visa’ on a feature phone. The paper investigates if the required agility and interface ergonomics were age discriminatory inhibitors of the adoption of text messaging given the diminishing dexterity and cognitive skills of seniors. Using Sen’s (1999) ‘heterogeneity of capabilities’ theory and Davis et al (1989)’s …

Creepy, Invasive, And Exploitative Algorithms: A Cpm Analysis Of Users' Privacy Breakdowns And Recalibration Practices With Social Media Algorithms, Matthew J. A. Craig, Jeffrey T. Child

Human-Machine Communication

Social media content filtering algorithms can both provide desired personalized content and ads for users. However, sometimes these recommendations can resemble individual private information. How might users navigate these experiences to best manage their private information? The present exploratory study utilizes the rules- and systems-based framework of communication privacy management (CPM) theory to explore social media users’ experiences of privacy breakdowns with social media algorithms and investigates what users do in response to said breakdowns. These responses were refined using content analysis and divided into different categories of privacy breakdowns and recalibration strategies. Implications for future research surrounding human-machine communication …

Approximation And Parameterized Algorithms For Covering With Disks Of Two Types Of Radii, Sayan Bandyapadhyay, Eli Mitchell

Computer Science Faculty Publications and Presentations

We study the Discrete Covering with Two Types of Radii problem motivated by its application in wireless networks. In this problem, the goal is to assign either small-range high frequency or large-range low frequency to each access point, maximizing the number of users in high-frequency regions while ensuring that each user is in the range of an access point. Unlike other weighted covering problems, our problem requires satisfying two simultaneous objectives, which calls for novel approaches that leverage the underlying geometry of the problem. In our work, we present two new algorithms: the first is a polynomial-time (2.5 + ϵ)-approximation, …

Sociohydrodynamics: Data-Driven Modeling Of Social Behavior, Daniel S. Seara, Jonathan Colen, Michel Fruchart, Yael Avni, David G. Martin, Vincenzo Vitelli

Data Science Faculty Publications

Living systems display complex behaviors driven by physical forces as well as decision-making. Hydrodynamic theories hold promise for simplified universal descriptions of socially generated collective behaviors. However, the construction of such theories is often divorced from the data they should describe. Here, we develop and apply a data-driven pipeline that links micromotives to macrobehavior by augmenting hydrodynamics with individual preferences that guide motion. We illustrate this pipeline on a case study of residential dynamics in the United States, for which census and sociological data are available. Guided by Census data, sociological surveys, and neural network analysis, we systematically assess standard …

Enhancing Reliable And Energy-Efficient Uav Communications With Ris And Deep Reinforcement Learning, Wasim Ahmad, Umar Islam, Abdulkadhem A. Abdulkadhem, Babar Shah, Fernando Moreira, Ali Abbas

All Works

The rapid growth in wireless communication demands has led to a surge in research on technologies capable of enhancing communication reliability, coverage, and energy efficiency. Among these, uncrewed aerial vehicles (UAV) and reconfigurable intelligent surfaces (RIS) have emerged as promising solutions. Prior research on using deep reinforcement learning (DRL) to integrate RIS with UAV concentrated on enhancing signal quality and coverage, but it ignored the challenges caused by electromagnetic interference (EMI). This article introduces a novel framework addressing the challenges posed by EMI from Gallium nitride (GaN) power amplifiers in RIS-assisted UAV communication systems. By integrating DRL with quadrature phase …

Ddos Attack Detection In Edge-Iiot Digital Twin Environment Using Deep Learning Approach, Feras Al-Obeidat, Adnan Amin, Ahmed Shuhaiber, Inam Ul Haq

All Works

The industrial Internet of Things (IIoT) and digital twins are redefining how digital models and physical systems interact. IIoT connects physical intelligence, and digital twins virtually represent their physical counterparts. With the rapid growth of Edge-IIoT, it is crucial to create security and privacy regulations to prevent vulnerabilities and threats (i.e., distributed denial of service (DDoS)). DDoS attacks use botnets to overload the target system with requests. In this study, we introduce a novel approach for detecting DDoS attacks in an Edge-IIoT digital twin-based generated dataset. The proposed approach is designed to retain already learned knowledge and easily adapt to …

A Dual-Model Machine Learning Framework For Predictive Maintenance Of Industrial Digital Press Components, Richmond Darko, Emmanuel Adabor

African Conference on Information Systems and Technology

This study presents a novel dual-model predictive maintenance framework designed to improve maintenance scheduling for components in industrial digital presses. The framework integrates two complementary approaches: a Threshold-Based Maintenance Approach (TBMA) for components operating within acceptable usage limits, and an Overdue Severity-Based Maintenance Approach (OSBMA) for those that have exceeded their expected lifespans or show signs of critical degradation. This study uses real-world operational data from a Konica Minolta C6000 press. It applies advanced machine learning models, including Gradient Boosting Machines and Random Forest for classification, and Generalized Additive Models (GAM) for Remaining Useful Life (RUL) prediction. The goal is …

The Integration Of Agile Methodologies In Devops Practices Within The Information Technology Industry, Ashley Hourigan, Ridewaan Hanslo

African Conference on Information Systems and Technology

The demand for rapid software delivery in the Information Technology (IT) industry has significantly intensified, emphasising the need for faster software products and service releases with enhanced features to meet customer expectations. Agile methodologies are replacing traditional approaches such as Waterfall, where flexibility, iterative development and adaptation to change are favoured over rigid planning and execution. DevOps, a subsequent evolution from Agile, emphasises collaborative efforts in development and operations teams, focusing on continuous integration and deployment to deliver resilient and high-quality software products and services. This study aims to critically assess both Agile and DevOps practices in the IT industry …