Documenting Ethical Considerations In Open Source Ai Models,
2024
Singapore Management University
Documenting Ethical Considerations In Open Source Ai Models, Haoyu Gao, Mansooreh Zahedi, Christoph Treude, Sarita Rosenstock, Marc Cheong
Research Collection School Of Computing and Information Systems
Background: The development of AI-enabled software heavily depends on AI model documentation, such as model cards, due to different domain expertise between software engineers and model developers. From an ethical standpoint, AI model documentation conveys critical information on ethical considerations along with mitigation strategies for downstream developers to ensure the delivery of ethically compliant software. However, knowledge on such documentation practice remains scarce. Aims: The objective of our study is to investigate how developers document ethical aspects of open source AI models in practice, aiming at providing recommendations for future documentation endeavours. Method: We selected three sources of documentation on …
An Empirical Study Of Api Misuses Of Data-Centric Libraries,
2024
Singapore Management University
An Empirical Study Of Api Misuses Of Data-Centric Libraries, Akalanda Galappaththi, Sarah Nadi, Christoph Treude
Research Collection School Of Computing and Information Systems
Developers rely on third-party library Application Programming Interfaces (APIs) when developing software. However, libraries typically come with assumptions and API usage constraints, whose violation results in API misuse. API misuses may result in crashes or incorrect behavior. Even though API misuse is a well-studied area, a recent study of API misuse of deep learning libraries showed that the nature of these misuses and their symptoms are different from misuses of traditional libraries, and as a result highlighted potential shortcomings of current misuse detection tools. We speculate that these observations may not be limited to deep learning API misuses but may …
A Survey Of Protocol Fuzzing,
2024
Singapore Management University
A Survey Of Protocol Fuzzing, Xiaohan Zhang, Cen Zhang, Xinghua Li, Zhengjie Du, Bing Mao, Yeting Li, Pan Li
Research Collection School Of Computing and Information Systems
Communication protocols form the bedrock of our interconnected world, yet vulnerabilities within their implementations pose significant security threats. Recent developments have seen a surge in fuzzing-based research dedicated to uncovering these vulnerabilities within protocol implementations. However, there still lacks a systematic overview of protocol fuzzing for answering the essential questions such as what the unique challenges are, how existing works solve them, and so on. To bridge this gap, we conducted a comprehensive investigation of related works from both academia and industry. Our study includes a detailed summary of the specific challenges in protocol fuzzing and provides a systematic categorization …
Promise And Peril Of Collaborative Code Generation Models : Balancing Effectiveness And Memorization,
2024
Singapore Management University
Promise And Peril Of Collaborative Code Generation Models : Balancing Effectiveness And Memorization, Zhi Chen, Lingxiao Jiang
Research Collection School Of Computing and Information Systems
In the rapidly evolving field of machine learning, training models with datasets from various locations and organizations presents significant challenges due to privacy and legal concerns. The exploration of effective collaborative training settings, which are capable of leveraging valuable knowledge from distributed and isolated datasets, is increasingly crucial. This study investigates key factors that impact the effectiveness of collaborative training methods in code next-token prediction, as well as the correctness and utility of the generated code, showing the promise of such methods. Additionally, we evaluate the memorization of different participant training data across various collaborative training settings, including centralized, federated, …
Stagedvulbert: Multi-Granular Vulnerability Detection With A Novel Pre-Trained Code Model,
2024
Singapore Management University
Stagedvulbert: Multi-Granular Vulnerability Detection With A Novel Pre-Trained Code Model, Yuan Jiang, Yujian Zhang, Xiaohong Su, Christoph Treude, Tiantian Wang
Research Collection School Of Computing and Information Systems
The emergence of pre-trained model-based vulnerability detection methods has significantly advanced the field of automated vulnerability detection. However, these methods still face several challenges, such as difficulty in learning effective feature representations of statements for fine-grained predictions and struggling to process overly long code sequences. To address these issues, this study introduces StagedVulBERT, a novel vulnerability detection framework that leverages a pre-trained code language model and employs a coarse-to-fine strategy. The key innovation and contribution of our research lies in the development of the CodeBERT-HLS component within our framework, specialized in hierarchical, layered, and semantic encoding. This component is designed …
Nigerian Software Engineer Or American Data Scientist? Github Profile Recruitment Bias In Large Language Models,
2024
Singapore Management University
Nigerian Software Engineer Or American Data Scientist? Github Profile Recruitment Bias In Large Language Models, Takashi Nakano, Kazumasa Shimari, Raula Gaikovina Kula, Christoph Treude, Marc Cheong, Kenichi Matsumoto
Research Collection School Of Computing and Information Systems
Large Language Models (LLMs) have taken the world by storm, demonstrating their ability not only to automate tedious tasks, but also to show some degree of proficiency in completing software engineering tasks. A key concern with LLMs is their “black-box” nature, which obscures their internal workings and could lead to societal biases in their outputs. In the software engineering context, in this early results paper, we empirically explore how well LLMs can automate recruitment tasks for a geographically diverse software team. We use OpenAI's ChatGPT to conduct an initial set of experiments using GitHub User Profiles from four regions to …
Kpiroot: Efficient Monitoring Metric-Based Root Cause Localization In Large-Scale Cloud Systems,
2024
Singapore Management University
Kpiroot: Efficient Monitoring Metric-Based Root Cause Localization In Large-Scale Cloud Systems, Wenwei Gu, Xinying Sun, Jinyang Liu, Yintong Huo, Zhuangbin Chen, Jianping Zhang, Jiazhen Gu, Yongqiang Yang, Michael R. Lyu
Research Collection School Of Computing and Information Systems
To ensure the reliability of cloud systems, their run-time status reflecting the service quality is periodically monitored with monitoring metrics, i.e., KPIs (key performance indicators). When performance issues happen, root cause localization pinpoints the specific KPIs that are responsible for the degradation of overall service quality, facilitating prompt problem diagnosis and resolution. To this end, existing methods generally locate root-cause KPIs by identifying the KPIs that exhibit a similar anomalous trend to the overall service performance. While straightforward, solely relying on the similarity calculation may be ineffective when dealing with cloud systems with complicated interdependent services. Recent deep learning-based methods …
An Edge Platform Streamlining Connectivity Between Modern Edge Devices And Cloud,
2024
Department of Technology, Engineering and Mathematics, Munster Technological University, Kerry, Ireland
An Edge Platform Streamlining Connectivity Between Modern Edge Devices And Cloud, Anderson Carvalho
Theses
The numerous uses of cloud, fog, and edge computing in a variety of industries are thoroughly examined in this thesis, with a special emphasis on smart factories, smart cities, and smart agriculture. It starts with an introduction to cloud computing, going over its history, importance in contemporary digital infrastructures, and related security concerns. It emphasizes the value of cloud computing for processing and storing data while addressing issues like guaranteeing low latency applications and possible improvements from container technologies. The conversation then shifts to fog computing, going over its history, designs, and uses. It focuses on how fog computing might …
Interoperability In Deep Learning: A User Survey And Failure Analysis Of Onnx Model Converters,
2024
Purdue University
Interoperability In Deep Learning: A User Survey And Failure Analysis Of Onnx Model Converters, Purvish Jajal, Wenxin Jiang, Arav Tewari, Erik Kocinare, Joseph Woo, Anusha Sarraf, Yung-Hsiang Lu, George Thiruvathukal, James C. Davis
Computer Science: Faculty Publications and Other Works
Software engineers develop, fine-tune, and deploy deep learning (DL) models using a variety of development frameworks and runtime environments. DL model converters move models between frameworks and to runtime environments. Conversion errors compromise model quality and disrupt deployment. However, the failure characteristics of DL model converters are unknown, adding risk when using DL interoperability technologies. This paper analyzes failures in DL model converters. We survey software engineers about DL interoperability tools, use cases, and pain points (N=92). Then, we characterize failures in model converters associated with the main interoperability tool, ONNX (N=200 issues in PyTorch and TensorFlow). Finally, we formulate …
Evaluating Szz Implementations : An Empirical Study On The Linux Kernel,
2024
Singapore Management University
Evaluating Szz Implementations : An Empirical Study On The Linux Kernel, Yunbo Lyu, Hong Jin Kang, Ratnadira Widyasari, Julia Lawall, David Lo
Research Collection School Of Computing and Information Systems
The SZZ algorithm is used to connect bug-fixing commits to the earlier commits that introduced bugs. This algorithm has many applications and many variants have been devised. However, there are some types of commits that cannot be traced by the SZZ algorithm, referred to as “ghost commits”. The evaluation of how these ghost commits impact the SZZ implementations remains limited. Moreover, these implementations have been evaluated on datasets created by software engineering researchers from information in bug trackers and version controlled histories. Since Oct 2013, the Linux kernel developers have started labelling bug-fixing patches with the commit identifiers of the …
Quality Assurance In Software Engineering: A Journey Towards Explainable Automated Solutions,
2024
Singapore Management University
Quality Assurance In Software Engineering: A Journey Towards Explainable Automated Solutions, Ratnadira Widyasari
Dissertations and Theses Collection (Open Access)
In today's digital era, the pervasive influence of software on daily life underscores the necessity for high-quality and reliable systems. Software failures can result in substantial harm and financial losses, highlighting the pivotal role of Software Quality Assurance (SQA). While automated SQA techniques have evolved to aid developers in ensuring software quality, the necessity for explainability in these automated solutions has become equally important. For example, in automated fault localization, only identifying suspicious locations is insufficient; it is essential to provide reasoning on why these locations are suspicious. This dissertation presents a series of interconnected studies aimed at developing explainable …
Integrating Blockchain Technology Into The Software Development Life Cycle To Satisfy The Software Bill Of Materials Requirement For Government Software Systems,
2024
Air Force Institute of Technology
Integrating Blockchain Technology Into The Software Development Life Cycle To Satisfy The Software Bill Of Materials Requirement For Government Software Systems, Walter T. Scott Ii
Theses and Dissertations
This thesis explores the integration of Blockchain Technology (BT) into the Software Development Life Cycle (SDLC) to satisfy the Software Bill of Materials (SBOM) requirement for government software systems. This study begins by synthesizing a standard SDLC definition from various government and industry references, which may provide the foundation for future efforts to standardize software development practices across the government software development community. This study proceeds to define working definitions for the software supply chain (SSC) and software supply chain management (SCM) before introducing and detailing the SBOM requirement as well as providing an overview of prior research regarding SBOMs …
Quantum Relaxation For Solving Multiple Knapsack Problems,
2024
Singapore Management University
Quantum Relaxation For Solving Multiple Knapsack Problems, Monit Sharma, Jin Yan, Hoong Chuin Lau, Rudy Raymond
Research Collection School Of Computing and Information Systems
Combinatorial problems are a common challenge in business, requiring finding optimal solutions under specified constraints. While significant progress has been made with variational approaches such as QAOA, most problems addressed are unconstrained (such as Max-Cut). In this study, we investigate a hybrid quantum-classical method for constrained optimization problems, particularly those with knapsack constraints that occur frequently in financial and supply chain applications. Our proposed method relies firstly on relaxations to local quantum Hamiltonians, defined through commutative maps. Drawing inspiration from quantum random access code (QRAC) concepts, particularly Quantum Random Access Optimizer (QRAO), we explore QRAO's potential in solving large constrained …
Granular3d: Delving Into Multi-Granularity 3d Scene Graph Prediction,
2024
Singapore Management University
Granular3d: Delving Into Multi-Granularity 3d Scene Graph Prediction, Kaixiang Huang, Jingru Yang, Jin Wang, Shengfeng He, Zhan Wang, Haiyan He, Qifeng Zhang, Guodong Lu
Research Collection School Of Computing and Information Systems
This paper addresses the significant challenges in 3D Semantic Scene Graph (3DSSG) prediction, essential for understanding complex 3D environments. Traditional approaches, primarily using PointNet and Graph Convolutional Networks, struggle with effectively extracting multi-grained features from intricate 3D scenes, largely due to a focus on global scene processing and single-scale feature extraction. To overcome these limitations, we introduce Granular3D, a novel approach that shifts the focus towards multi-granularity analysis by predicting relation triplets from specific sub-scenes. One key is the Adaptive Instance Enveloping Method (AIEM), which establishes an approximate envelope structure around irregular instances, providing shape-adaptive local point cloud sampling, thereby …
Neuron Sensitivity Guided Test Case Selection,
2024
University of Hong Kong
Neuron Sensitivity Guided Test Case Selection, Dong Huang, Qingwen Bu, Yichao Fu, Yuhao Qing, Xiaofei Xie, Junjie Chen, Heming Cui
Research Collection School Of Computing and Information Systems
Deep Neural Networks (DNNs) have been widely deployed in software to address various tasks (e.g., autonomous driving, medical diagnosis). However, they can also produce incorrect behaviors that result in financial losses and even threaten human safety. To reveal and repair incorrect behaviors in DNNs, developers often collect rich, unlabeled datasets from the natural world and label them to test DNN models. However, properly labeling a large number of datasets is a highly expensive and time-consuming task. To address the above-mentioned problem, we propose NSS, Neuron Sensitivity Guided Test Case Selection, which can reduce the labeling time by selecting valuable test …
Certified Continual Learning For Neural Network Regression,
2024
Singapore Management University
Certified Continual Learning For Neural Network Regression, Hong Long Pham, Jun Sun
Research Collection School Of Computing and Information Systems
On the one hand, there has been considerable progress on neural network verification in recent years, which makes certifying neural networks a possibility. On the other hand, neural network in practice are often re-trained over time to cope with new data distribution or for solving different tasks (a.k.a. continual learning). Once re-trained, the verified correctness of the neural network is likely broken, particularly in the presence of the phenomenon known as catastrophic forgetting. In this work, we propose an approach called certified continual learning which improves existing continual learning methods by preserving, as long as possible, the established correctness properties …
Meta-Learning For Multi-Family Android Malware Classification,
2024
Singapore Management University
Meta-Learning For Multi-Family Android Malware Classification, Yao Li, Dawei Yuan, Tao Zhang, Haipeng Cai, David Lo, Cuiyun Gao, Xiapu Luo, He Jiang
Research Collection School Of Computing and Information Systems
With the emergence of smartphones, Android has become a widely used mobile operating system. However, it is vulnerable when encountering various types of attacks. Every day, new malware threatens the security of users' devices and private data. Many methods have been proposed to classify malicious applications, utilizing static or dynamic analysis for classification. However, previous methods still suffer from unsatisfactory performance due to two challenges. First, they are unable to address the imbalanced data distribution problem, leading to poor performance for malware families with few members. Second, they are unable to address the zero-day malware (zero-day malware refers to malicious …
Enhancing Multi-Agent System Testing With Diversity-Guided Exploration And Adaptive Critical State Exploitation,
2024
Singapore Management University
Enhancing Multi-Agent System Testing With Diversity-Guided Exploration And Adaptive Critical State Exploitation, Xuyan Ma, Yawen Wang, Junjie Wang, Xiaofei Xie
Research Collection School Of Computing and Information Systems
Multi-agent systems (MASs) have achieved remarkable success in multi-robot control, intelligent transportation, and multiplayer games, etc. Thorough testing for MAS is urgently needed to ensure its robustness in the face of constantly changing and unexpected scenarios. Existing methods mainly focus on single-agent system testing and cannot be directly applied to MAS testing due to the complexity of MAS. To our best knowledge, there are fewer studies on MAS testing. While several studies have focused on adversarial attacks on MASs, they primarily target failure detection from an attack perspective, i.e., discovering failure scenarios, while ignoring the diversity of scenarios. In this …
Bugs In Pods: Understanding Bugs In Container Runtime Systems,
2024
Singapore Management University
Bugs In Pods: Understanding Bugs In Container Runtime Systems, Jiongchi Yu, Xiaofei Xie, Ceng Zhang, Sen Chen
Research Collection School Of Computing and Information Systems
Container Runtime Systems (CRSs), which form the foundational infrastructure of container clouds, are critically important due to their impact on the quality of container cloud implementations. However, a comprehensive understanding of the quality issues present in CRS implementations remains lacking. To bridge this gap, we conduct the first comprehensive empirical study of CRS bugs. Specifically, we gather 429 bugs from 8,271 commits across dominant CRS projects, including runc, gvisor, containerd, and cri-o. Through manual analysis, we develop taxonomies of CRS bug symptoms and root causes, comprising 16 and 13 categories, respectively. Furthermore, we evaluate the capability of popular testing approaches, …
How Effective Are They? Exploring Large Language Model Based Fuzz Driver Generation,
2024
Singapore Management University
How Effective Are They? Exploring Large Language Model Based Fuzz Driver Generation, Cen Zhang, Yaowen Zheng, Mingqiang Bai, Yeting Li, Wei Ma, Xiaofei Xie
Research Collection School Of Computing and Information Systems
Fuzz drivers are essential for library API fuzzing. However, automatically generating fuzz drivers is a complex task, as it demands the creation of high-quality, correct, and robust API usage code. An LLM-based (Large Language Model) approach for generating fuzz drivers is a promising area of research. Unlike traditional program analysis-based generators, this text-based approach is more generalized and capable of harnessing a variety of API usage information, resulting in code that is friendly for human readers. However, there is still a lack of understanding regarding the fundamental issues on this direction, such as its e ectiveness and potential challenges. To …
