Digital Commons Network^™

Explaining Explanations: An Empirical Study Of Explanations In Code Reviews, Ratnadira Widyasari, Ting Zhang, Abir Bouraffa, Walid Maalej, David Lo

Research Collection School Of Computing and Information Systems

Code reviews are central for software quality assurance. Ideally, reviewers should explain their feedback to enable authors of code changes to understand the feedback and act accordingly. Different developers might need different explanations in different contexts. Therefore, assisting this process first requires understanding the types of explanations reviewers usually provide. The goal of this article is to study the types of explanations used in code reviews and explore the potential of Large Language Models (LLMs), specifically ChatGPT, in generating these specific types. We extracted 793 code review comments from Gerrit and manually labeled them based on whether they contained a …

How Are We Detecting Inconsistent Method Names? An Empirical Study From Code Review Perspective, Kisub Kim, Xin Zhou, Dongsun Kim, Julia Lawall, Kui Liu, Tegawendé F. Bissyandé, Jacques Klein, Jaekwon Lee, David Lo

Research Collection School Of Computing and Information Systems

Proper naming of methods can make program code easier to understand, and thus enhance software maintainability. Yet, developers may use inconsistent names due to poor communication or a lack of familiarity with conventions within the software development lifecycle. To address this issue, much research effort has been invested into building automatic tools that can check for method name inconsistency and recommend consistent names. However, existing datasets generally do not provide precise details about why a method name was deemed improper and required to be changed. Such information can give useful hints on how to improve the recommendation of adequate method …

Eeg Based Real Time Classification Of Consecutive Two Eye Blinks For Brain Computer Interface Applications, Masud Rabbani, Nafi Us Sabbir Sabith, Anubhav Parida, Iysa Iqbal, Sayed Mashroor Mamun, Rumi Ahmed Khan, Farhad Ahmed, Sheikh Iqbal Ahamed

Computer Science Faculty Research and Publications

Human eye blinks are considered a significant contaminant or artifact in electroencephalogram (EEG), which impacts EEG-based medical or scientific applications. However, eye blink detection can instead be transformed into a potential application of brain–computer interfaces (BCI). This study introduces a novel real-time EEG-based framework for classifying three blink states: no blink, single blink, and two consecutive blinks in one model. EEG data were collected from ten healthy participants using an 8-channel wearable headset under controlled blinking conditions. The data were preprocessed and analyzed using four feature extraction techniques: basic statistical, time-domain, amplitude-driven, and frequency-domain methods. The most significant features were …

A Neuro-Symbolic Ai Approach To Scene Understanding In Autonomous Systems, Ruwan Tharanga Wickramarachchige Don

Theses and Dissertations

Effectively understanding scenes requires a unified representation of scene data and background knowledge. A neuro-symbolic AI approach to scene understanding leverages such a unified representation to enable advanced expression, inference, and labeling of scenes, improving the perception of autonomous systems.

Scene understanding remains a central challenge in the machine perception of autonomous systems. It requires the integration of multiple sources of information, background knowledge, and heterogeneous sensor data to perceive, interpret, and reason about both physical and semantic aspects of dynamic environments. Current approaches to scene understanding primarily rely on computer vision and deep learning models that operate directly on …

Sepsis: I Can Catch Your Lies – A New Paradigm For Deception Detection, Anku Rani, Dwip Dalal, Shreya Gautam, Pankaj Gupta, Vinija Jain, Aman Chadha, Amitava Das, Amit P. Sheth

Publications

Deception is the intentional practice of twisting information. It is a nuanced societal practice deeply intertwined with human societal evolution, characterized by a multitude of facets. This research explores the problem of deception through the lens of psychology, employing a framework that categorizes deception into three forms: lies of omission, lies of commission, and lies of influence. The primary focus of this study is specifically on investigating only lies of omission. We propose a novel framework for deception detection leveraging NLP techniques. We curated an annotated dataset of 876,784 samples by amalgamating a popular large-scale fake news dataset and scraped …

An Efficient Detection And Deep Clustering Based Pipeline For Reliable Rodent Ultrasonic Vocalization Analysis, Sabah S. Anis

Theses and Dissertations

Ultrasonic vocalizations (USVs) are critical for understanding rodents' emotional states and social behaviors. However, manual analysis of USVs is time-consuming, subjective, and prone to errors. This thesis presents an automated pipeline that addresses these challenges by performing efficient USV detection and clustering. The proposed approach significantly reduces the time and effort needed to analyze USV data while improving accuracy and reproducibility.

To address this gap, we introduce ContourUSV, a five-step pipeline for USV detection. First, it begins with generating spectrograms from audio recordings, which are then pre-processed to enhance the contrast between USVs and background noise. Key steps include median …

Hardware Accelerated Simulation Of Buck Converters Using Physics-Informed Neural Networks, James Clayton Crews

Theses and Dissertations

Physics-informed neural networks (PINNs) are an emerging machine learning method for learning the behavior of physical systems described by governing differential equations. Dc-dc power-electronic converters are used in a variety of industry applications such as motor drives or power supplies where real-time simulation is critical for control and safety. This thesis investigates physics-informed machine learning as an approach to develop a real-time digital twin for dc-dc power converters. Traditional numerical integration methods are used to approximate discretized behavior, and the results are compared with a trained PINN model. Modern ML frameworks (such as PyTorch and TensorFlow/Keras) are used to quickly …

Physics Oriented Deep Learning For Material Prediction And Generation, Nihang Fu

Theses and Dissertations

The discovery of new materials is critical to advancing various industries, but traditional experimental methods for materials discovery remain slow and resource-intensive. Recent advances in machine learning (ML), particularly deep learning (DL), have greatly improved and accelerated two main aspects of modern computational material discovery: material design (e.g., material generation) and material screening (e.g., property prediction). However, a key challenge remains: standard ML models often struggle to perform domain-specific tasks effectively. Incorporating domain-specific knowledge, specifically the underlying physics of materials, into ML/DL models is key to improving the accuracy and reliability of material generation and prediction models.

This dissertation discusses …

Explainable Process Recommendation Through Multi-Contextual Grounding Of Dynamic Multimodal Process Knowledge Graphs, Revathy Venkataramanan

Theses and Dissertations

Can I eat this food or not? Is this food suitable for diabetes and why? Which AI pipeline is best suited for a given task and dataset? How should an end-to-end pipeline be constructed? These questions differ from factual question-answering tasks. Recipes and AI pipelines are processes consisting of several entities interacting with each other. A recipe consists of ingredients, cooking methods, and their interactions, while an AI pipeline includes datasets, preprocessing techniques, models, hyperparameters, tasks, and results. Each entity must be analyzed individually, and collective inferencing is performed to derive the final decision. This decision-making process, known as compositional …

Multi-Task Deep Learning Approach For Segmenting And Classifying Competitive Swimming Activities Using A Single Imu, Mark Shperkin

Theses and Dissertations

Competitive swimming performance analysis has traditionally relied on manual video review and multi-sensor systems, both of which are resource-intensive and impractical for everyday training use. This study investigates whether a single wrist-worn inertial measurement unit (IMU) can be used to automatically segment and classify swimming activities with high accuracy. We propose a multi-task deep learning pipeline based on the MTHARS (Multi-Task Human Activity Recognition and Segmentation) architecture introduced by Duan et al. to perform stroke classification, lap segmentation, stroke count estimation, and underwater kick count estimation. Data were collected from eleven collegiate-level swimmers wearing left-wrist-mounted IMUs, each performing five 100-yard …

Process-Grounded Knowledge-Infused Learning And Decision Making, Kaushik Roy

Theses and Dissertations

This dissertation introduces process-grounded knowledge-infused learning and reasoning, a novel framework for integrating domain-expertise-based process knowledge into the learning and reasoning mechanisms of artificial intelligence systems. This approach is designed to produce controlled, transparent, and reliable predictions in critical tasks such as medical diagnosis and recommendation. By focusing on the case study of mental illness diagnosis and recommendation—where decision-making must be grounded in processes such as disorder-specific diagnostic criteria—this work demonstrates methods to embed structured decision-making directly into the system architecture during both training and inference. This integration facilitates end-to-end training and reasoning while ensuring that outputs strictly adhere to …

Elevating Next Generation Wireless Devices Towards Contactless Sensing For Healthcare Applications, Aakriti Adhikari

Theses and Dissertations

There is an increasing interest in technologies that can understand and perceive at-home human activities to provide personalized healthcare monitoring, aimed at early detection of disease markers and assisting physicians in making clinical decisions. Existing approaches, such as wearables, require users to wear sensors that can be cumbersome and cause discomfort. Vision based solutions, such as optical cameras, IRs, LiDARs, etc., can be used to design contactless at-home monitoring systems. However, these systems are limited by poor lighting and occlusion, and they are privacy-invasive. Fortunately, high-frequency millimeter-wave wireless devices provide an effective alternative to the existing systems to enable fine-grained …

Do Supplier Ceo's National Cultural Origins Affect Supplier-Customer Relationships?, Peng Liang, Hasan Cavusoglu, Nan Hu

Research Collection School Of Computing and Information Systems

This study investigates how the national cultural origins of supplier chief executive officers (CEOs), as characterized by Hofstede’s cross-cultural dimensions, influence the duration of supplier–customer relationships. By analyzing the cultural origins of supplier CEOs from 20 countries over a 25-year period, we find that supplier CEOs with high long-term orientation (LTO) and high uncertainty avoidance (UNA) are associated with longer lasting supplier–customer relationships, while those with high individualism (IND) are associated with shorter relationship durations. These findings are robust to several alternative explanations of customer and supplier CEO variables. To address potential endogeneity—specifically, the concern that CEOs with certain cultural …

Unbounded Multi-Hop Proxy Re-Encryption With Hra Security: An Lwe-Based Optimization, Xiaohan Wan, Yang Wang, Haiyang Xue, Mingqiang Wang

Research Collection School Of Computing and Information Systems

Proxy re-encryption (PRE) schemes enable a semi-honest proxy to transform a ciphertext of one user i to another user j while preserving the privacy of the underlying message. Multi-hop PRE schemes allow a legal ciphertext to undergo multiple transformations, but for lattice-based multi-hop PREs, the number of transformations is typically bounded due to the increase of error terms. Recently, Zhao et al. (ESORICS 2024) introduced a lattice-based unbounded multi-hop (homomorphic) PRE scheme that supports an unbounded number of hops. Nevertheless, their scheme only achieves the selective CPA security. In contrast, Fuchsbauer et al. (PKC 2019) proposed a generic framework for …

Ts-Diff: Two-Stage Diffusion Model For Low-Light Raw Image Enhancement, Yi Li, Zhiyuan Zhang, Jiangnan Xia, Jianghan Cheng, Qilong Wu, Junwei Li

Research Collection School Of Computing and Information Systems

This paper presents a novel Two-Stage Diffusion Model (TS-Diff) for enhancing extremely low-light RAW images. In the pre-training stage, TS-Diff synthesizes noisy images by constructing multiple virtual cameras based on a noise space. Camera Feature Integration (CFI) modules are then designed to enable the model to learn generalizable features across diverse virtual cameras. During the aligning stage, CFIs are averaged to create a target-specific CFIT, which is fine-tuned using a small amount of real RAW data to adapt to the noise characteristics of specific cameras. A structural reparameterization technique further simplifies CFIT for efficient deployment. To address color shifts during …

Rustmap: Towards Project-Scale C-To-Rust Migration Via Program Analysis And Llm, Xuemeng Cai, Jiakun Liu, Xiping Huang, Yijun Yu, Haitao Wu, Chunmiao Li, Bo Wang, Imam Nur Bani Yusuf, Lingxiao Jiang

Research Collection School Of Computing and Information Systems

Migrating existing C programs into Rust is increasingly desired, as Rust offers superior memory safety while maintaining C’s high performance. Existing automated translation tools, such as C2Rust, may rely too much on syntactic, template-based translation and generate unsafe Rust code that is hard for human developers to read, maintain, or even compile. More semantic-aware translation that produces safer, idiomatic, and runnable Rust code is much needed. This paper introduces a novel dependency-guided and large language model (LLM)-based C-to-Rust translation approach, RustMap, based on three key ideas: (1) Utilize LLM’s capabilities to produce idiomatic Rust code from given small pieces of …

Quantum Technologies In Decentralisation, Paul Robert Griffin, Rudy Raymond, Tsuyoshi Idé

Research Collection School Of Computing and Information Systems

Quantum technologies, rooted in the manipulation of quantum information, are revolutionizing computing and networking domains. Their impact on blockchains and decentralized systems is twofold. While much attention has been given to the potential of quantum computing to attack blockchains, these advanced technologies also offer avenues for strengthening and optimizing them. This chapter delves into the intricacies of quantum technologies, from the foundational concepts of qubits, quantum gates, and quantum networks to their implications for blockchains. We explore both the vulnerabilities of blockchains in a quantum-dominant era and the promising solutions quantum technologies provide, culminating in a use case examining their …

Full-Stack Web Applications: Infrastructure, Development Pipelines & Devsecops, Yassine Chahid, Patrick Slattery

Publications and Research

This research explores emerging development methodologies and technologies which facilitate the deployment and maintenance of software applications. It evaluates architectural styles for the development of software such as monolithic (legacy) and microservice models, with a focus on their key differences such as scalability or project structure through to the development of an application. By examining methodologies such as Agile and continuous integration/continuous development pipelines along with the deployment tools Docker and Git for version/release control, the study analyzes how these innovations speed up development, improve existing practices, and serve as the foundation for development operations. Cloud solutions for tasks such …

Evaluating Chatgpt To Answer Multi-Modal Exercises In Computer Science Education, Eng Lieh Ouh, Kar Way Tan, Siaw Ling Lo, Benjamin Gan

Research Collection School Of Computing and Information Systems

This study investigates ChatGPT-4o's ability to answer multi-modal assessment exercises in computer science (CS) courses. While the use of large language models (LLMs) to answer text-based exercises are extensively researched, their ability to answer exercises involving artifacts of other modalities remains underexplored. To close this gap, we evaluate ChatGPT-4o's answers to 120 multi-modal CS exercises in programming, software design, human-computer interaction, statistical analysis, process analysis, and simulation. The multi-modal artifacts in these exercises include class diagrams, sequence diagrams, user interface images, analytical charts, workflow diagrams and object-flow diagrams. Our comparisons to the expected answers of these exercises show that ChatGPT-4o …

Position: Trustworthy Ai Agents Require The Integration Of Large Language Models And Formal Methods, Yedi Zhang, Yufan Cai, Xinyue Zuo, Xiaokun Luan, Kailong Wang, Zhe Hou, Yifan Zhang, Zhiyuan Wei, Meng Sun, Jun Sun, Jing Sun, Jin Song Dong

Research Collection School Of Computing and Information Systems

Large Language Models (LLMs) have emerged as a transformative AI paradigm, profoundly influencing broad aspects of daily life. Despite their remarkable performance, LLMs exhibit a fundamental limitation: hallucination—the tendency to produce misleading outputs that appear plausible. This inherent unreliability poses significant risks, particularly in high-stakes domains where trustworthiness is essential. On the other hand, Formal Methods (FMs), which share foundations with symbolic AI, provide mathematically rigorous techniques for modeling, specifying, reasoning, and verifying the correctness of systems. These methods have been widely employed in mission-critical domains such as aerospace, defense, and cybersecurity. However, the broader adoption of FMs remains constrained …

An On-The-Fly Synthesis Framework For Ltl Over Finite Traces, Shengping Xiao, Yongkang Li, Shufang Zhu, Jun Sun, Jianwen Li, Geguang Pu, Moshe Vardi

Research Collection School Of Computing and Information Systems

We present an on-the-fly synthesis framework for Linear Temporal Logic over finite traces (LTLf) based on top-down deterministic automata construction. Existing approaches rely on constructing a complete Deterministic Finite Automaton (DFA) corresponding to the LTLf specification, a process with doubly exponential complexity relative to formula size in the worst case. In this case, the synthesis cannot be conducted until the entire DFA is constructed. This inefficiency is the main bottleneck of existing approaches. To address this challenge, we first present a method for converting LTLf into Transition-based DFA (TDFA) by directly leveraging LTLf semantics, incorporating intermediate results as direct components …

Advancing Food Nutrition Estimation Via Visual-Ingredient Feature Fusion, Huiyan Qi, Bin Zhu, Chong-Wah Ngo, Jingjing Chen, Ee-Peng Lim

Research Collection School Of Computing and Information Systems

Nutrition estimation is an important component of promoting healthy eating and mitigating diet-related health risks. Despite advances in tasks such as food classification and ingredient recognition, progress in nutrition estimation is limited due to the lack of datasets with nutritional annotations. To address this issue, we introduce FastFood, a dataset with 84,446 images across 908 fast food categories, featuring ingredient and nutritional annotations. In addition, we propose a new model-agnostic Visual-Ingredient Feature Fusion (VIF2 ) method to enhance nutrition estimation by integrating visual and ingredient features. Ingredient robustness is improved through synonym replacement and resampling strategies during training. The ingredient-aware …

Sanitizable Cross-Domain Access Control With Policy-Driven Dynamic Authorization, Jianfei Sun, Guowen Xu, Hongwei Li, Tianwei Zhang, Cong Wu, Xuehuan Yang, Robert H. Deng

Research Collection School Of Computing and Information Systems

The increasing demand for secure and efficient data sharing has underscored the importance of developing robust cryptographic schemes. However, many existing endeavors have overlooked the following critical issues: (1) unauthorized access resulting from malicious information leakage by senders; (2) absence of constraints on write and read permissions for participants; (3) and inflexibility of strategies to dynamically designate ciphertexts to multiple recipients. In this paper, we present SCPA, a cross-domain access control scheme imbued with sanitization features and propelled by policy-driven dynamic authorization, tailored for cloud-based data sharing. This scheme not only facilitates access controls, including regulations for no-read and no-write …

Action Dubber: Timing Audible Actions Via Inflectional Flow, Wenlong Wan, Weiying Zheng, Tianyi Xiang, Guiqing Li, Shengfeng He

Research Collection School Of Computing and Information Systems

We introduce the task of Audible Action Temporal Localization, which aims to identify the spatiotemporal coordinates of audible movements. Unlike conventional tasks such as action recognition and temporal action localization, which broadly analyze video content, our task focuses on the distinct kinematic dynamics of audible actions. It is based on the premise that key actions are driven by inflectional movements; for example, collisions that produce sound often involve abrupt changes in motion. To capture this, we propose T A2Net, a novel architecture that estimates inflectional flow using the second derivative of motion to determine collision timings without relying on audio …

Leakage-Resilient Easily Deployable And Efficiently Searchable Encryption (Edese), Jiaming Yuan, Yingjiu Li, Jun Li, Daoyuan Wu, Jianting Ning, Yangguang Tian, Robert H. Deng

Research Collection School Of Computing and Information Systems

Easily Deployable and Efficiently Searchable Encryption (EDESE) is a cryptographic primitive designed for practical searchable applications, offering efficient search and easy deployment. However, it remains vulnerable to Leakage-Abuse attacks, allowing adversaries to exploit keyword-matching processes to extract sensitive information. To address these vulnerabilities, we introduce Leakage-Resilient EDESE (LR-EDESE) with k-indistinguishability and controlled leakage functions. We then propose Volume Leakage-Resilient EDESE (VLR-EDESE), a new scheme to protect against both query and document volume leakage. Our experimental results demonstrate that at k = 5000 (maximum security setting), VLR-EDESE incurs an overhead of 63× compared to the baseline EDESE without leakage protection, outperforming …

Surrogate Learning In Meta-Black-Box Optimization: A Preliminary Study, Zeyuan Ma, Zhiyang Huang, Jiacheng Chen, Zhiguang Cao, Yue-Jiao Gong

Research Collection School Of Computing and Information Systems

Recent Meta-Black-Box Optimization (MetaBBO) approaches have shown possibility of enhancing the optimization performance through learning meta-level policies to dynamically configure low-level optimizers. However, existing MetaBBO approaches potentially consume massive function evaluations to train their meta-level policies. Inspired by the recent trend of using surrogate models for cost-friendly evaluation of expensive optimization problems, in this paper, we propose a novel MetaBBO framework which combines surrogate learning process and reinforcement learning-aided Differential Evolution algorithm, namely Surr-RLDE, to address the intensive function evaluation in MetaBBO. Surr-RLDE comprises two learning stages: surrogate learning and policy learning. In surrogate learning, we train a Kolmogorov-Arnold Networks …

O-Mapl: Offline Multi-Agent Preference Learning, The Viet Bui, Tien Mai, Hong Thanh Nguyen

Research Collection School Of Computing and Information Systems

Inferring reward functions from demonstrations is a key challenge in reinforcement learning (RL), particularly in multi-agent RL (MARL). The large joint state-action spaces and intricate inter-agent interactions in MARL make inferring the joint reward function especially challenging. While prior studies in single-agent settings have explored ways to recover reward functions and expert policies from human preference feedback, such studies in MARL remain limited. Existing methods typically combine two separate stages, supervised reward learning, and standard MARL algorithms, leading to unstable training processes. In this work, we exploit the inherent connection between reward functions and Q functions in cooperative MARL to …

Sparse-To-Dense: A Free Lunch For Lossless Acceleration Of Video Understanding In Llms, Xuan Zhang, Cunxiao Du, Sicheng Yu, Jiawei Wu, Fengzhuo Zhang, Wei Gao, Qian Liu

Research Collection School Of Computing and Information Systems

Due to the auto-regressive nature of current video large language models (Video-LLMs), the inference latency increases as the input sequence length grows, posing challenges for the efficient processing of video sequences that are usually very long. We observe that during decoding, the attention scores of most tokens in Video-LLMs tend to be sparse and concentrated, with only certain tokens requiring comprehensive full attention. Based on this insight, we introduce Sparse-to-Dense (StD), a novel decoding strategy that integrates two distinct modules: one leveraging sparse top-K attention and the other employing dense full attention. These modules collaborate to accelerate Video-LLMs without loss. …

Fashiondpo: Fine‑Tune Fashion Outfit Generation Model Using Direct Preference Optimization, Mingzhe Yu, Yunshan Ma, Lei Wu, Changshuo Wang, Xue Li, Lei Meng

Research Collection School Of Computing and Information Systems

Personalized outfit generation aims to construct a set of compatible and personalized fashion items as an outfit. Recently, generative AI models have received widespread attention, as they can generate fashion items for users to complete an incomplete outfit or create a complete outfit. However, they have limitations in terms of lacking diversity and relying on the supervised learning paradigm. Recognizing this gap, we propose a novel framework FashionDPO, which fine-tunes the fashion outfit generation model using direct preference optimization. This framework aims to provide a general fine-tuning approach to fashion generative models, refining a pre-trained fashion outfit generation model using …

What Are Anomalies In A Network?, Kai Ming Ting, Zhong Zhuang, Guansong Pang, Zongyou Liu, Tianrun Liang, Qiuran Zhao

Research Collection School Of Computing and Information Systems

This article examines a collection of assumptions used in the current literature on node anomaly detection in a network. The examination raises the question: What are anomalies in a network? Our attempt to answer this question has provided some interesting findings and led to some open questions. This is the first article which formally defines anomalies in a network and introduces the concept of self-verifiability of a detector without ground-truths in a network. They enable existing detectors to be categorized into two types along the line whether they are self-verifiable or not. We suggest a method to evaluate self-verifiable detectors …