Characterising Reproducibility Debt In Scientific Software: A Systematic Literature Review,
2025
Singapore Management University
Characterising Reproducibility Debt In Scientific Software: A Systematic Literature Review, Zara Hassan, Christoph Treude, Michael Norrish, Graham Williams, Alex Potanin
Research Collection School Of Computing and Information Systems
Context: In scientific software, the inability to reproduce results is often due to technical issues and challenges in recreating the full computational workflow from the original analysis. We conceptualise this problem as Reproducibility Debt (RpD). Much research has been performed to propose solutions to tackle these issues across various computational science disciplines. It is essential to identify and accumulate existing knowledge on reproducibility issues and state-of-the-art solutions so as to provide researchers and practitioners with information that enables further research activities and RpD management in practice. Objective: In the context of scientific software, we aim to characterise RpD by providing …
Use Of Search Tools In Software Development: A Study Of Microservice-Based Team Projects,
2025
Singapore Management University
Use Of Search Tools In Software Development: A Study Of Microservice-Based Team Projects, Yi Meng Lau, Christian Michael Koh, Lingxiao Jiang
Research Collection School Of Computing and Information Systems
Universities are increasingly integrating real-world projects into software engineering curricula to preparestudents for careers involving complex concepts like Microservices Architecture (MSA). Students frequentlystruggle with such concepts within limited class time and turn to various search tools and online resources for additional help. Search tools are also widely used in the software development industry. While search engines, like Google and Yahoo!, can provide quick solutions, they pose the risk of information overload. Large Language Models (LLMs) such as ChatGPT, offer the advantage of delivering more precise answers. Studies have shown that LLMs can comprehend codes, assist in system architectural design, and …
Verification Of Bit-Flip Attacks Against Quantized Neural Networks,
2025
Singapore Management University
Verification Of Bit-Flip Attacks Against Quantized Neural Networks, Yedi Zhang, Lei Huang, Pengfei Gao, Fu Song, Jun Sun, Jin Song Dong
Research Collection School Of Computing and Information Systems
In the rapidly evolving landscape of neural network security, the resilience of neural networks against bit-flip attacks (i.e., an attacker maliciously flips an extremely small amount of bits within its parameter storage memory system to induce harmful behavior), has emerged as a relevant area of research. Existing studies suggest that quantization may serve as a viable defense against such attacks. Recognizing the documented susceptibility of real-valued neural networks to such attacks and the comparative robustness of quantized neural networks (QNNs), in this work, we introduce BFAVerifier, the first verification framework designed to formally verify the absence of bit-flip attacks against …
Verifying Timed Properties Of Programs In Iot Nodes Using Parametric Time Petri Nets,
2025
Singapore Management University
Verifying Timed Properties Of Programs In Iot Nodes Using Parametric Time Petri Nets, Étienne André, Jean-Luc Béchennec, Sudipta Chattopadhyay, Sebastien Faucou, Didier Lime, Dylan Marinho, Olivier H. Roux, Jun Sun
Research Collection School Of Computing and Information Systems
The analysis of timed properties of programs is a complex task, as it is highly dependent on both the software and the hardware. In this work, we propose a framework for modeling with timed formal models the execution of programs, taking into account the micro-architecture of the machine on which it executes. We model both the program, at the instruction set architecture level, and the hardware, including the processor micro-architecture, using time Petri nets. Our implementation uses the ARM Cortex-M instruction set architecture and a hardware architecture representative of microcontrollers used in IoT nodes. The whole translation is fully automated …
Democratic Training Against Universal Adversarial Perturbations,
2025
Singapore Management University
Democratic Training Against Universal Adversarial Perturbations, Bing Sun, Jun Sun, Wei Zhao
Research Collection School Of Computing and Information Systems
Despite their advances and success, real-world deep neural networks are known to be vulnerable to adversarial attacks. Universal adversarial perturbation, an inputagnostic attack, poses a serious threat for them to be deployed in security-sensitive systems. In this case, a single universal adversarial perturbation deceives the model on a range of clean inputs without requiring input-specific optimization, which makes it particularly threatening. In this work, we observe that universal adversarial perturbations usually lead to abnormal entropy spectrum in hidden layers, which suggests that the prediction is dominated by a small number of “feature” in such cases (rather than democratically by many …
Can Llms Replace Manual Annotation Of Software Engineering Artifacts?,
2025
Singapore Management University
Can Llms Replace Manual Annotation Of Software Engineering Artifacts?, Toufique Ahmed, Premkumar Devanbu, Christoph Treude, Michael Pradel
Research Collection School Of Computing and Information Systems
Experimental evaluations of software engineering innovations, e.g., tools and processes, often include human-subject studies as a component of a multi-pronged strategy to obtain greater generalizability of the findings. However, human-subject studies in our field are challenging, due to the cost and difficulty of finding and employing suitable subjects, ideally, professional programmers with varying degrees of experience. Meanwhile, large language models (LLMs) have recently started to demonstrate human-level performance in several areas. This paper explores the possibility of substituting costly human subjects with much cheaper LLM queries in evaluations of code and code-related artifacts. We study this idea by applying six …
How Developers Interact With Ai: A Taxonomy Of Human-Ai Collaboration In Software Engineering,
2025
Singapore Management University
How Developers Interact With Ai: A Taxonomy Of Human-Ai Collaboration In Software Engineering, Christoph Treude, Marco A. Gerosa
Research Collection School Of Computing and Information Systems
Artificial intelligence (AI), including large language models and generative AI, is emerging as a significant force in software development, offering developers powerful tools that span the entire development lifecycle. Although software engineering research has extensively studied AI tools in software development, the specific types of interactions between developers and these AI-powered tools have only recently begun to receive attention. Understanding and improving these interactions has the potential to enhance productivity, trust, and efficiency in AI-driven workflows. In this paper, we propose a taxonomy of interaction types between developers and AI tools, identifying eleven distinct interaction types, such as auto-complete code …
One-For-All: Towards Universal Domain Translation With A Single Stylegan,
2025
Singapore Management University
One-For-All: Towards Universal Domain Translation With A Single Stylegan, Yong Du, Jiahui Zhan, Xinzhe Li, Junyu Dong, Sheng Chen, Ming-Hsuan Yang, Shengfeng He
Research Collection School Of Computing and Information Systems
In this paper, we propose a novel translation model, UniTranslator, for transforming representations between visually distinct domains under conditions of limited training data and significant visual differences. The main idea behind our approach is leveraging the domain-neutral capabilities of CLIP as a bridging mechanism, while utilizing a separate module to extract abstract, domain-agnostic semantics from the embeddings of both the source and target realms. Fusing these abstract semantics with target-specific semantics results in a transformed embedding within the CLIP space. To bridge the gap between the disparate worlds of CLIP and StyleGAN, we introduce a new non-linear mapper, the CLIP2P …
A Functional Software Reference Architecture For Llm-Integrated Systems,
2025
Singapore Management University
A Functional Software Reference Architecture For Llm-Integrated Systems, Alessio Bucaioni, Martin Weyssow, Junda He, Yunbo Lyu, David Lo
Research Collection School Of Computing and Information Systems
The integration of large language models into software systems is transforming capabilities such as natural language understanding, decision-making, and autonomous task execution. However, the absence of a commonly accepted software reference architecture hinders systematic reasoning about their design and quality attributes. This gap makes it challenging to address critical concerns like privacy, security, modularity, and interoperability, which are increasingly important as these systems grow in complexity and societal impact. In this paper, we describe our emerging results for a preliminary functional reference architecture as a conceptual framework to address these challenges and guide the design, evaluation, and evolution of large …
Bigcodebench: Benchmarking Code Generation With Diverse Function Calls And Complex Instructions,
2025
Singapore Management University
Bigcodebench: Benchmarking Code Generation With Diverse Function Calls And Complex Instructions, T.Y. Zhuo, M.C. Vu, J. Chim, ..., David Lo
Research Collection School Of Computing and Information Systems
Task automation has been greatly empowered by the recent advances in Large Language Models (LLMs) via Python code, where the tasks ranging from software engineering development to general-purpose reasoning. While current benchmarks have shown that LLMs can solve tasks using programs like human developers, the majority of their evaluations are limited to short and self-contained algorithmic tasks or standalone function calls. Solving challenging and practical tasks requires the capability of utilizing diverse function calls as tools to efficiently implement functionalities like data analysis and web development. In addition, using multiple tools to solve a task needs compositional reasoning by accurately …
Scuzer: A Scheduling Optimization Fuzzer For Tvm,
2025
Zhejiang University
Scuzer: A Scheduling Optimization Fuzzer For Tvm, Xiangxiang Chen, Xingwei Lin, Jingyi Wang, Jun Sun, Jiashui Wang, Wenhai Wang
Research Collection School Of Computing and Information Systems
The concept of Deep Learning (DL) compiler was proposed to deploy DL models more efficiently on diverse hardware through optimization techniques. As one of the most popular DL compilers, TVM incorporates three levels (high-level, schedule, and low-level) of optimizations, which can inadvertently introduce code logic bugs and build failure bugs. Among these optimizations, scheduling optimization is the core component of DL compilers, which ensures the acceleration of models on all devices. However, the existing works only focus on the testing of high-level and low-level optimizations in TVM, fail to take the most important and challenging intermediate scheduling optimization layer into …
Overcoming Motor Imagery Bci Illiteracy: Adaptive Decoding And Knowledge Transfer In Eeg-Based Brain-Computer Interfaces,
2025
United Arab Emirates University
Overcoming Motor Imagery Bci Illiteracy: Adaptive Decoding And Knowledge Transfer In Eeg-Based Brain-Computer Interfaces, Zaid Shuqfa
Dissertations
Brain–computer interfaces (BCIs), also known as brain–machine interfaces (BMIs), enable direct communication between the brain and external devices without the involvement of peripheral nerves or muscles. Among various BCI paradigms, motor imagery (MI)–based BCIs are particularly appealing due to their intuitive, cue-independent nature, allowing users to issue control commands at will. MI–BCIs hold substantial promise for improving the quality of life of individuals with motor impairments, as well as enhancing hands-free control for healthy users. However, their widespread adoption remains limited by challenges such as low signal-to-noise ratio, inter- and intra-subject variability, and the need for frequent calibration. These challenges …
A Data-Driven Recommendation System For Selecting The Appropriate Mode Of Learning And Instructional Tools Based On Course Characteristics,
2025
United Arab Emirates University
A Data-Driven Recommendation System For Selecting The Appropriate Mode Of Learning And Instructional Tools Based On Course Characteristics, Ayisha Manzoor
Theses
The rapid transformation of educational delivery methods during the COVID-19 pandemic required institutions to transition between online, hybrid, and offline learning approaches, creating both challenges and opportunities for educators and students. While online and hybrid learning modes ensured continuity, their effectiveness across different course types remained uncertain. This thesis addresses this gap by developing a datadriven recommendation framework that predicts Course Learning Outcome (CLO) achievement scores using regression, and recommends the most appropriate learning mode (online, hybrid, or offline) along with instructional tools based on course characteristics. This study analyzed 100 undergraduate and postgraduate courses from the College of Information …
Understanding The Oss Communities Of Deep Learning Frameworks: A Comparative Case Study Of Pytorch And Tensorflow,
2025
Zhejiang University
Understanding The Oss Communities Of Deep Learning Frameworks: A Comparative Case Study Of Pytorch And Tensorflow, Yunqi Chen, Zhiyuan Wan, Yifei Zhuang, Ning Liu, David Lo, Xiaohu Yang
Research Collection School Of Computing and Information Systems
Over the past two decades, deep learning has received tremendous success in developing software systems across various domains. Deep learning frameworks have been proposed to facilitate the development of such software systems, among which, PyTorch and TensorFlow stand out as notable examples. Considerable attention focuses on exploring software engineering practices and addressing diverse technical aspects in developing and deploying deep learning frameworks and software systems. Despite these efforts, little is known about the open source software communities involved in the development of deep learning frameworks. In this article, we perform a comparative investigation into the open source software communities of …
Adaptive Deviation Learning For Visual Anomaly Detection With Data Contamination,
2025
Singapore Management University
Adaptive Deviation Learning For Visual Anomaly Detection With Data Contamination, Aanindya Sundar Das, Guansong Pang, Monowar Bhuyan
Research Collection School Of Computing and Information Systems
Visual anomaly detection targets to detect images that notably differ from normal pattern, and it has found extensive application in identifying defective parts within the manufacturing industry. These anomaly detection paradigms predominantly focus on training detection models using only clean, unlabeled normal samples, assuming an absence of contamination; a condition often unmet in real-world scenarios. The performance of these methods significantly depends on the quality of the data and usually decreases when exposed to noise. We introduce a systematic adaptive method that employs deviation learning to compute anomaly scores end-to-end while addressing data contamination by assigning relative importance to the …
Neurovig: Integrating Event Cameras For Resource-Efficient Video Grounding,
2025
Singapore Management University
Neurovig: Integrating Event Cameras For Resource-Efficient Video Grounding, Dulanga Weerakoon, Vigneshwaran Subbaraju, Joo Hwee Lim, Archan Misra
Research Collection School Of Computing and Information Systems
Spatio-Temporal Video Grounding (STVG) - the task of identifying the target object in the field-of-view that the language instruction refers to - is a fundamental vision-language task. Current STVG approaches typically utilize feeds from an RGB camera that is assumed to be always-on and process the video frames using complex neural network pipelines. As a result they often impose prohibitive system overheads (energy latency) on pervasive devices. To address this we propose NeuroViG with two key innovations: (a) leveraging on event streams from a low-power neuromorphic event camera sensor to perform selective triggering of the more energy-hungry RGB camera for …
Revisiting Sentiment Analysis For Software Engineering In The Era Of Large Language Models,
2025
Singapore Management University
Revisiting Sentiment Analysis For Software Engineering In The Era Of Large Language Models, Ting Zhang, Ivana Clairine Irsan, Thung Ferdian, David Lo
Research Collection School Of Computing and Information Systems
Software development involves collaborative interactions where stakeholders express opinions across various platforms. Recognizing the sentiments conveyed in these interactions is crucial for the effective development and ongoing maintenance of software systems. For software products, analyzing the sentiment of user feedback, e.g., reviews, comments, and forum posts can provide valuable insights into user satisfaction and areas for improvement. This can guide the development of future updates and features. However, accurately identifying sentiments in software engineering datasets remains challenging.This study investigates bigger large language models (bLLMs) in addressing the labeled data shortage that hampers fine-tuned smaller large language models (sLLMs) in software …
Cachealarm: Monitoring Sensitive Behaviors Of Android Apps Using Cache Side Channel,
2025
Singapore Management University
Cachealarm: Monitoring Sensitive Behaviors Of Android Apps Using Cache Side Channel, Jianwen Tian, Haoyu Ma, Debin Gao, Xiaohui Kuang
Research Collection School Of Computing and Information Systems
Malware attack has been a serious threat to the security and privacy of both individual and corporation users of the Android platform. Business entities seek to protect themselves by means of monitoring privacy-related sensitive behaviors conducted on company-issued Android devices. However, due to Android’s own access control and privacy protection policies, this is difficult to be done with third-party apps using only normal privileges. Existing works proposed using side-channel readings from leaky APIs and system virtual files to speculate runtime app behaviors, which could be unreliable due to future system updates (that ban exploited resources), hardware jittering, etc. In this …
Adapting Knowledge Prompt Tuning For Enhanced Automated Program Repair,
2025
Singapore Management University
Adapting Knowledge Prompt Tuning For Enhanced Automated Program Repair, Xuemeng Cai, Lingxiao Jiang
Research Collection School Of Computing and Information Systems
Automated Program Repair (APR) aims to enhance software reliability by automatically generating bug-fixing patches. Recent work has improved the state-of-the-art of APR by fine-tuning pre-trained large language models (LLMs), such as CodeT5, for APR. However, the effectiveness of fine-tuning be-comes weakened in data scarcity scenarios, and data scarcity can be a common issue in practice, limiting fine-tuning performance. To alleviate this limitation, this paper adapts prompt tuning for enhanced APR and conducts a comprehensive study to evaluate its effectiveness in data scarcity scenarios, using three LLMs of different sizes and six diverse datasets across four programming languages. Prompt tuning rewrites …
Evaluating Software Development Agents: Patch Patterns, Code Quality, And Issue Complexity In Real-World Github Scenarios,
2025
Singapore Management University
Evaluating Software Development Agents: Patch Patterns, Code Quality, And Issue Complexity In Real-World Github Scenarios, Zhi Chen, Lingxiao Jiang
Research Collection School Of Computing and Information Systems
In recent years, AI-based software engineering has progressed from pre-trained models to advanced agentic workflows, with Software Development Agents representing the next major leap. These agents, capable of reasoning, planning, and interacting with external environments, offer promising solutions to complex software engineering tasks. However, while much research has evaluated code generated by large language models (LLMs), comprehensive studies on agent-generated patches, particularly in real-world settings, are lacking. This study addresses that gap by evaluating 4,892 patches from 10 top-ranked agents on 500 real-world GitHub issues from SWE-Bench Verified, focusing on their impact on code quality. Our analysis shows no single …
