Open Access. Powered by Scholars. Published by Universities.®
- Discipline
-
- Physical Sciences and Mathematics (8595)
- Computer Sciences (8578)
- Databases and Information Systems (3467)
- Software Engineering (2164)
- Artificial Intelligence and Robotics (1728)
-
- Information Security (1072)
- Numerical Analysis and Scientific Computing (1025)
- Graphics and Human Computer Interfaces (936)
- Engineering (913)
- Social and Behavioral Sciences (682)
- Business (647)
- Theory and Algorithms (493)
- Computer Engineering (459)
- Operations Research, Systems Engineering and Industrial Engineering (426)
- Programming Languages and Compilers (379)
- OS and Networks (324)
- Communication (300)
- Social Media (242)
- Public Affairs, Public Policy and Public Administration (212)
- Transportation (189)
- Medicine and Health Sciences (186)
- Education (172)
- Management Information Systems (168)
- Data Storage Systems (162)
- E-Commerce (148)
- International and Area Studies (114)
- Asian Studies (113)
- Health Information Technology (112)
- Digital Communications and Networking (109)
- Technology and Innovation (106)
- Keyword
-
- Deep learning (124)
- Machine learning (122)
- Social media (76)
- Artificial intelligence (71)
- Reinforcement learning (69)
-
- Privacy (65)
- Data mining (64)
- Cloud computing (58)
- Deep Learning (56)
- Empirical study (54)
- Security (54)
- Optimization (53)
- Visualization (52)
- Task analysis (50)
- Neural networks (49)
- Online learning (49)
- Singapore (49)
- Software engineering (49)
- Training (49)
- Anomaly detection (47)
- Large Language Models (47)
- Feature extraction (46)
- Twitter (46)
- Blockchain (44)
- Collaboration (44)
- Semantics (43)
- Access control (41)
- Algorithms (40)
- Android (39)
- Classification (38)
- Publication Year
- File Type
Articles 871 - 900 of 8651
Full-Text Articles in Entire DC Network
Bi-Objective Dynamic Tugboat Scheduling With Speed Optimization Under Stochastic And Time-Varying Service Demands, Xiaoyang Wei, Hoong Chuin Lau, Zhe Xiao, Xiuju Fu, Xiaocai Zhang, Zheng Qin
Bi-Objective Dynamic Tugboat Scheduling With Speed Optimization Under Stochastic And Time-Varying Service Demands, Xiaoyang Wei, Hoong Chuin Lau, Zhe Xiao, Xiuju Fu, Xiaocai Zhang, Zheng Qin
Research Collection School Of Computing and Information Systems
With the growing emphasis on green shipping to reduce the environmental impact of maritime transportation, optimizing fuel consumption with maintaining high service quality has become critical in port operations. Ports are essential nodes in global supply chains, where tugboats play a pivotal role in the safe and efficient maneuvering of ships within constrained environments. However, existing literature lacks approaches that address tugboat scheduling under realistic operational conditions. To fill the research gap, this is the first work to propose the bi-objective dynamic tugboat scheduling problem that optimizes speed under stochastic and time-varying demands, aiming to minimize fuel consumption and manage …
Fuzzing Drones For Anomaly Detection: A Systematic Literature Review, Vikas Kumar Malviya, Wei Minn, Lwin Khin Shar, Lingxiao Jiang
Fuzzing Drones For Anomaly Detection: A Systematic Literature Review, Vikas Kumar Malviya, Wei Minn, Lwin Khin Shar, Lingxiao Jiang
Research Collection School Of Computing and Information Systems
Drones, also referred to as Unmanned Aerial Vehicles (UAVs), are becoming popular today due to their uses in different fields and recent technological advancements which provide easy control of UAVs via mobile apps. However, UAVs may contain vulnerabilities or software bugs that cause serious safety and security concerns. For example, the communication protocol used by the UAV may contain authentication and authorization vulnerabilities, which may be exploited by attackers to gain remote access over the UAV. Drones must therefore undergo extensive testing before being released or deployed to identify and fix any software bugs or security vulnerabilities. Fuzzing is one …
Measuring Model Alignment For Code Clone Detection Using Causal Interpretation, Shamsa Abid, Xuemeng Cai, Lingxiao Jiang
Measuring Model Alignment For Code Clone Detection Using Causal Interpretation, Shamsa Abid, Xuemeng Cai, Lingxiao Jiang
Research Collection School Of Computing and Information Systems
Deep Neural Network-based models have demonstrated high accuracy for semantic code clone detection. However, the lack of generalization poses a threat to the trustworthiness and reliability of these models. Furthermore, the black-box nature of these models makes interpreting the model’s decisions very challenging. Currently, there is only a limited understanding of the semantic code clone detection behavior of existing models. There is a lack of transparency in understanding how a model identifies semantic code clones and the exact code components influencing its prediction. In this paper, we introduce the use of a causal interpretation framework based on the Neyman-Rubin causal …
A Review Of Chinese Sentiment Analysis: Subjects, Methods, And Trends, Zhaoxia Wang, Donghao Huang, Jingfeng Cui, Xinyue Zhang, Seng-Beng Ho, Erik Cambria
A Review Of Chinese Sentiment Analysis: Subjects, Methods, And Trends, Zhaoxia Wang, Donghao Huang, Jingfeng Cui, Xinyue Zhang, Seng-Beng Ho, Erik Cambria
Research Collection School Of Computing and Information Systems
Sentiment analysis has emerged as a prominent research domain within the realm of natural language processing, garnering increasing attention and a growing body of literature. While numerous literature reviews have examined sentiment analysis techniques, methods, topics and applications, there remains a gap in the literature concerning thematic trends and research methodologies in sentiment analysis, particularly in the context of Chinese text. This study addresses this gap by presenting a comprehensive survey dedicated to the progression of research subjects, methods and trends in sentiment analysis of Chinese text. Employing a framework that combines keyword co-occurrence analysis with a sophisticated community detection …
Performance Evaluation Of Newsql Databases In A Distributed Architecture, Zhiyao Zhang, Alan @ Ali Madjelisi Megargel, Lingxiao Jiang
Performance Evaluation Of Newsql Databases In A Distributed Architecture, Zhiyao Zhang, Alan @ Ali Madjelisi Megargel, Lingxiao Jiang
Research Collection School Of Computing and Information Systems
In the last decade, application architectures have evolved drastically, moving from monolithic architectures to distributed architectures where deployment has shifted from dedicated on-premises servers to the cloud. Distributed architectures and cloud computing has enabled businesses to scale their application components across different geographical locations. While it is easy to scale the application layer, scaling its database layer that relies on traditional SQL databases is challenging and often is a common source of bottlenecks when it comes to application performance. This paper evaluates the performance characteristics between two NewSQL databases solutions, MySQL NDB Cluster vs. TIBCO ActiveSpaces IMDG. Serving as an …
Llms-Based Augmentation For Domain Adaptation In Long-Tailed Food Datasets, Qing Wang, Chong-Wah Ngo, Ee-Peng Lim, Qianru Sun
Llms-Based Augmentation For Domain Adaptation In Long-Tailed Food Datasets, Qing Wang, Chong-Wah Ngo, Ee-Peng Lim, Qianru Sun
Research Collection School Of Computing and Information Systems
Training a model for food recognition is challenging because the training samples, which are typically crawled from the Internet, are visually different from the pictures captured by users in the free-living environment. In addition to this domain-shift problem, the real-world food datasets tend to be long-tailed distributed and some dishes of different categories exhibit subtle variations that are difficult to distinguish visually. In this paper, we present a framework empowered with large language models (LLMs) to address these challenges in food recognition. We first leverage LLMs to parse food images to generate food titles and ingredients. Then, we project the …
Demo2test: Transfer Testing Of Agent In Competitive Environment With Failure Demonstrations, Jianming Chen, Yawen Wang, Junjie Wang, Xiaofei Xie, Dandan Wang, Qing Wang, Fanjiang Xu
Demo2test: Transfer Testing Of Agent In Competitive Environment With Failure Demonstrations, Jianming Chen, Yawen Wang, Junjie Wang, Xiaofei Xie, Dandan Wang, Qing Wang, Fanjiang Xu
Research Collection School Of Computing and Information Systems
The competitive game between agents exists in many critical applications, such as military unmanned aerial vehicles. It is urgent to test these agents to reduce the significant losses caused by their failures. Existing studies mainly are to construct a testing agent that competes with the target agent to induce its failures. These approaches usually focus on a single task, requiring much more time for multi-task testing. However, if the previously tested tasks (source tasks) and the task to be tested (target task) share similar agents or task objectives, the transferable knowledge in source tasks can potentially increase the effectiveness of …
Neuron Semantic-Guided Test Generation For Deep Neural Networks Fuzzing, Li Huang, Weifeng Sun, Meng Yan, Zhongxin Liu, Yan Lei, David Lo
Neuron Semantic-Guided Test Generation For Deep Neural Networks Fuzzing, Li Huang, Weifeng Sun, Meng Yan, Zhongxin Liu, Yan Lei, David Lo
Research Collection School Of Computing and Information Systems
In recent years, significant progress has been made in testing methods for deep neural networks (DNNs) to ensure their correctness and robustness. Coverage-guided criteria, such as neuron-wise, layer-wise, and path-/trace-wise, have been proposed for DNN fuzzing. However, existing coverage-based criteria encounter performance bottlenecks for several reasons: Testing Adequacy: Partial neural coverage criteria have been observed to achieve full coverage using only a small number of test inputs. In this case, increasing the number of test inputs does not consistently improve the quality of models. Interpretability: The current coverage criteria lack interpretability. Consequently, testers are unable to identify and understand which …
Interpreting Topic Models In Byte-Pair Encoding Space, Jia Peng Lim, Hady Wirawan Lauw
Interpreting Topic Models In Byte-Pair Encoding Space, Jia Peng Lim, Hady Wirawan Lauw
Research Collection School Of Computing and Information Systems
Byte-pair encoding (BPE) is pivotal for processing text into chunksize tokens, particularly in Large Language Model (LLM). From a topic modeling perspective, as these chunksize tokens might be mere parts of valid words, evaluating and interpreting these tokens for coherence is challenging. Most, if not all, of coherence evaluation measures are incompatible as they benchmark using valid words. We propose to interpret the recovery of valid words from these tokens as a ranking problem and present a model-agnostic and training-free recovery approach from the topic-token distribution onto a selected vocabulary space, following which we could apply existing evaluation measures. Results …
Weakly-Supervised Semantic Segmentation With Image-Level Labels: From Traditional Models To Foundation Models, Zhaozheng Chen, Qianru Sun
Weakly-Supervised Semantic Segmentation With Image-Level Labels: From Traditional Models To Foundation Models, Zhaozheng Chen, Qianru Sun
Research Collection School Of Computing and Information Systems
The rapid development of deep learning has driven significant progress in image semantic segmentation—a fundamental task in computer vision. Semantic segmentation algorithms often depend on the availability of pixel-level labels (i.e., masks of objects), which are expensive, time consuming, and labor intensive. Weakly supervised semantic segmentation (WSSS) is an effective solution to avoid such labeling. It utilizes only partial or incomplete annotations and provides a cost-effective alternative to fully supervised semantic segmentation. In this article, our focus is on the WSSS with image-level labels, which is the most challenging form of WSSS. Our work has two parts. First, we conduct …
Synthesizing Multi-Person And Rare Pose Images For Human Pose Estimation, Liuqing Zhao, Zichen Tian, Zou Peng, Richang Hong, Qianru Sun
Synthesizing Multi-Person And Rare Pose Images For Human Pose Estimation, Liuqing Zhao, Zichen Tian, Zou Peng, Richang Hong, Qianru Sun
Research Collection School Of Computing and Information Systems
Human pose estimation (HPE) models underperform in recognizing rare poses because they suffer from data imbalance problems (i.e., there are few image samples for rare poses) in their training datasets. From a data perspective, the most intuitive solution is to synthesize data for rare poses. Specifically, the rule-based methods apply manual manipulations (such as Cutout and GridMask) to the existing data, so the limited diversity of the data constrains the model. An alternative method is to learn the underlying data distribution via deep generative models (such as ControlNet and HumanSD) and then sample “new data” from the distribution. This works …
Dims: Distributed Index For Similarity Search In Metric Spaces, Yifan Zhu, Chengyang Luo, Tang Qian, Lu Chen, Yunjun Gao, Baihua Zheng
Dims: Distributed Index For Similarity Search In Metric Spaces, Yifan Zhu, Chengyang Luo, Tang Qian, Lu Chen, Yunjun Gao, Baihua Zheng
Research Collection School Of Computing and Information Systems
Similarity search finds objects that are similar to a given query object based on a similarity metric. As the amount and variety of data continue to grow, similarity search in metric spaces has gained significant attention. Metric spaces can accommodate any type of data and support flexible distanc e metrics, making similarity search in metric spaces beneficial for many real-world applications, such as multimedia retrieval, personalized recommendation, trajectory analytics, data mining, decision planning, and distributed servers. However, existing studies mostly focus on indexing metric spaces on a single machine, which faces efficiency and scalability limitations with increasing data volume and …
Transforming Urban Dynamics: Harnessing Large Language Models For Smarter Mobility, Hao Xue, Ming Jin, Shirui Pan, Flora Salim, Guansong Pang
Transforming Urban Dynamics: Harnessing Large Language Models For Smarter Mobility, Hao Xue, Ming Jin, Shirui Pan, Flora Salim, Guansong Pang
Research Collection School Of Computing and Information Systems
Artificial intelligence (AI) has the potential to analyze mobility data and make mobility systems smarter by leveraging diverse data sources such as geospatial data, transportation logs, and real-time sensor data to optimize traffic flow, enhance public transportation systems, and support the development of autonomous vehicles. With the newly emerged generative AI paradigm, exemplified by large language models (LLMs), there is great potential to transform the current AI applications in mobility, transportation, and urban domains. This article provides an overview of recent efforts and aims to shed light on the challenges and future opportunities to facilitate the adaptation of LLMs for …
Attribute-Based Encryption With Searchable Encryption, Yang Yang
Attribute-Based Encryption With Searchable Encryption, Yang Yang
Research Collection School Of Computing and Information Systems
Attribute-based encryption (ABE) with searchable encryption is a notion that inherits the advantages of both ABE (Goyal et al., 2006) and searchable encryption (SE) (Boneh et al., 2004; Boneh and Waters, 2007) mechanisms to realize secure share and search for the outsourced data. ABE creates fine-grained access control system to prevent sensitive data from being accessed by unauthorized user or external attacker (Bethencourt et al., 2007). SE generates encrypted index for outsourced data such that it can be searched by a keyword trapdoor (or token) (Shi et al., 2007; Naveed et al., 2014), where the outsourced content and search keyword(s) …
Adapting Installation Instructions In Rapidly Evolving Software Ecosystems, Haoyu Gao, Christoph Treude, Mansooreh Zahedi
Adapting Installation Instructions In Rapidly Evolving Software Ecosystems, Haoyu Gao, Christoph Treude, Mansooreh Zahedi
Research Collection School Of Computing and Information Systems
files play an important role in providing installation-related instructions to software users and are widely used in open source software systems on platforms such as GitHub. Software projects evolve rapidly alongside their dependencies in dynamic software ecosystems, requiring frequent updates to installation instructions. These instructions are crucial for users to start with a software project. Despite their significance, there is a lack of systematic understanding regarding the documentation efforts invested in README files and the triggers behind them. To fill the research gap, we conducted a qualitative study, investigating 400 GitHub repositories with 1,163 README commits that focused on updates …
Adversarial Generative Flow Network For Solving Vehicle Routing Problems, Ni Zhang, Jingfeng Yang, Zhiguang Cao, Xu Chi
Adversarial Generative Flow Network For Solving Vehicle Routing Problems, Ni Zhang, Jingfeng Yang, Zhiguang Cao, Xu Chi
Research Collection School Of Computing and Information Systems
Recent research into solving vehicle routing problems (VRPs) has gained significant traction, particularly through the application of deep (reinforcement) learning for end-to-end solution construction. However, many current construction-based neural solvers predominantly utilize Transformer architectures, which can face scalability challenges and struggle to produce diverse solutions. To address these limitations, we introduce a novel framework beyond Transformer-based approaches, i.e., Adversarial Generative Flow Networks (AGFN). This framework integrates the generative flow network (GFlowNet)-a probabilistic model inherently adept at generating diverse solutions (routes)-with a complementary model for discriminating (or evaluating) the solutions. These models are trained alternately in an adversarial manner to improve …
Gnnsynergy: A Multi-View Graph Neural Network For Predicting Anti-Cancer Drug Synergy, Zhifeng Hao, Jianming Zhan, Yuan Fang, Min Wu, Ruichu Cai
Gnnsynergy: A Multi-View Graph Neural Network For Predicting Anti-Cancer Drug Synergy, Zhifeng Hao, Jianming Zhan, Yuan Fang, Min Wu, Ruichu Cai
Research Collection School Of Computing and Information Systems
Drug combinations play very important roles in cancer therapy, as they can enhance curative efficacy and overcome drug resistance. Due to the increasing size of combinatorial space, experimental screening for all the drug combinations becomes infeasible in practice. Therefore, there is a great need to develop accurate computational approaches that can predict potential drug combinations to direct the experimental screening. In this paper, we propose a novel method called GNNSynergy to learn drug embeddings for drug synergy prediction. Given a specific cancer cell line, we propose a multi-view graph neural network framework which considers the current cell line as main …
Double Oracle Neural Architecture Search For Game Theoretic Deep Learning Models, Aye Phyu Phyu Aung, Xinrun Wang, Ruiyu Wang, Hau Chan, Bo An, Xiaoli Li, J. Senthilnath
Double Oracle Neural Architecture Search For Game Theoretic Deep Learning Models, Aye Phyu Phyu Aung, Xinrun Wang, Ruiyu Wang, Hau Chan, Bo An, Xiaoli Li, J. Senthilnath
Research Collection School Of Computing and Information Systems
In this paper, we propose a new approach to train deep learning models using game theory concepts including Generative Adversarial Networks (GANs) and Adversarial Training (AT) where we deploy a double-oracle framework using best response oracles. GAN is essentially a two-player zero-sum game between the generator and the discriminator. The same concept can be applied to AT with attacker and classifier as players. Training these models is challenging as a pure Nash equilibrium may not exist and even finding the mixed Nash equilibrium is difficult as training algorithms for both GAN and AT have a large-scale strategy space. Extending our …
Recdreamer: Consistent Text-To-3d Generation Via Uniform Score Distillation, Chenxi Zheng, Yihong Lin, Bangzhen Liu, Xuemiao Xu, Yongwei Nie, Shengfeng He
Recdreamer: Consistent Text-To-3d Generation Via Uniform Score Distillation, Chenxi Zheng, Yihong Lin, Bangzhen Liu, Xuemiao Xu, Yongwei Nie, Shengfeng He
Research Collection School Of Computing and Information Systems
Current text-to-3D generation methods based on score distillation often suffer from geometric inconsistencies, leading to repeated patterns across different poses of 3D assets. This issue, known as the Multi-Face Janus problem, arises because existing methods struggle to maintain consistency across varying poses and are biased toward a canonical pose. While recent work has improved pose control and approximation, these efforts are still limited by this inherent bias, which skews the guidance during generation. To address this, we propose a solution called RecDreamer, which reshapes the underlying data distribution to achieve more consistent pose representation. The core idea behind our method …
Label Correlated Contrastive Learning For Medical Report Generation, Xinyao Liu, Junchang Xin, Bing Tian Dai, Qi Shen, Zhihong Huang, Zhiqiong Wang
Label Correlated Contrastive Learning For Medical Report Generation, Xinyao Liu, Junchang Xin, Bing Tian Dai, Qi Shen, Zhihong Huang, Zhiqiong Wang
Research Collection School Of Computing and Information Systems
Background and Objective: Automatic generation of medical reports reduces both the burden on radiologists and the possibility of errors due to the inexperience of radiologists. The model that utilizes attention mechanism and contrastive learning can generate medical reports by capturing both general and specific semantics. However, existing contrastive learning methods ignore the specificity of medical data, that is, a patient may suffer from multiple diseases at the same time. This means that the lack of fine-grained relationships for contrastive learning will lead to the problem of insufficient specificity. Methods: To address the above problem, a label correlated contrastive learning method …
The Effectiveness Of Local Updates For Decentralized Learning Under Data Heterogeneity, Tongle Wu, Zhize Li, Ying Sun
The Effectiveness Of Local Updates For Decentralized Learning Under Data Heterogeneity, Tongle Wu, Zhize Li, Ying Sun
Research Collection School Of Computing and Information Systems
We revisit two fundamental decentralized optimization methods, Decentralized Gradient Tracking (DGT) and Decentralized Gradient Descent (DGD), with multiple local updates. We consider two settings and demonstrate that incorporating local update steps can reduce communication complexity. Specifically, for $\mu$-strongly convex and $L$-smooth loss functions, we proved that local DGT achieves communication complexity {}{$\tilde{\mathcal{O}} \Big(\frac{L}{\mu(K+1)} + \frac{\delta + {}{\mu}}{\mu (1 - \rho)} + \frac{\rho }{(1 - \rho)^2} \cdot \frac{L+ \delta}{\mu}\Big)$}, where $K$ is the number of additional local update}, $\rho$ measures the network connectivity and $\delta$ measures the second-order heterogeneity of the local losses. Our results reveal the tradeoff between communication and …
Risk Spillover Effect Of China-Asean Supply Chains: Insights Of Industrial Transfer, Zeyang Bian, Yuning Zhang, Keng Siau, Yaqian Zhang, Jianjia He
Risk Spillover Effect Of China-Asean Supply Chains: Insights Of Industrial Transfer, Zeyang Bian, Yuning Zhang, Keng Siau, Yaqian Zhang, Jianjia He
Research Collection School Of Computing and Information Systems
As labour costs in China increase, labour-intensive industries are migrating to ASEAN countries, attracted by lower labour costs and market potential. This shift not only affects the economies of China and ASEAN but also reshapes the global manufacturing landscape. This paper investigates the correlation and spillover of supply chain risks using production exposure indicators derived from inter-country input-output data and the R-Vine Copula model. We assess the risk spillover of each country within the global supply chain. Our findings indicate that industrial relocation can significantly alter supply chain structures, thereby affecting the concentration and direction of risks. While China's role …
More Effective Javascript Breaking Change Detection Via Dynamic Object Relation Graph, Dezhen Kong, Jiakun Liu, Chao Ni, David Lo, Lingfeng Bao
More Effective Javascript Breaking Change Detection Via Dynamic Object Relation Graph, Dezhen Kong, Jiakun Liu, Chao Ni, David Lo, Lingfeng Bao
Research Collection School Of Computing and Information Systems
JavaScript libraries are characterized by their widespread use, frequent code changes, and a high tolerance for backward incompatible changes. Awareness of such breaking changes can help developers adapt to version updates and avoid negative impacts. Several tools have been targeted to or can be used to detect breaking change detection in the JavaScript community. However, these tools detect breaking changes using different ways, and there are currently no systematic reviews of these approaches. From a preliminary study on popular JavaScript libraries, we find that existing approaches, including simple regression testing, model-based testing and type differencing cannot detect many breaking changes …
Charge Your Clients: Payable Secure Computation And Its Applications, Cong Zhang, Liqiang Peng, Weiran Liu, Shuaishuai Li, Meng Hao, Lei Zhang, Dongdai Lin
Charge Your Clients: Payable Secure Computation And Its Applications, Cong Zhang, Liqiang Peng, Weiran Liu, Shuaishuai Li, Meng Hao, Lei Zhang, Dongdai Lin
Research Collection School Of Computing and Information Systems
The online realm has witnessed a surge in the buying and selling of data, prompting the emergence of dedicated data marketplaces. These platforms cater to servers (sellers), enabling them to set prices for access to their data, and clients (buyers), who can subsequently purchase these data, thereby streamlining and facilitating such transactions. However, the current data market is primarily confronted with the following issues. Firstly, they fail to protect client privacy, presupposing that clients submit their queries in plaintext. Secondly, these models are susceptible to being impacted by malicious client behavior, for example, enabling clients to potentially engage in arbitrage …
Financial Named Entity Recognition: How Far Can Llm Go?, Yi-Te Lu, Yintong Huo
Financial Named Entity Recognition: How Far Can Llm Go?, Yi-Te Lu, Yintong Huo
Research Collection School Of Computing and Information Systems
The surge of large language models (LLMs) has revolutionized the extraction and analysis of crucial information from a growing volume of financial statements, announcements, and business news. Recognition for named entities to construct structured data poses a significant challenge in analyzing financial documents and is a foundational task for intelligent financial analytics. However, how effective are these generic LLMs and their performance under various prompts are yet need a better understanding. To fill in the blank, we present a systematic evaluation of state-of-the-art LLMs and prompting methods in the financial Named Entity Recognition (NER) problem. Specifically, our experimental results highlight …
Gotcha ! This Model Uses My Code ! Evaluating Membership Leakage Risks In Code Models, Zhou Yang, Zhipeng Zhao, Chenyu Wang, Jieke Shi, Dongsum Kim, Donggyun Han, David Lo
Gotcha ! This Model Uses My Code ! Evaluating Membership Leakage Risks In Code Models, Zhou Yang, Zhipeng Zhao, Chenyu Wang, Jieke Shi, Dongsum Kim, Donggyun Han, David Lo
Research Collection School Of Computing and Information Systems
Leveraging large-scale datasets from open-source projects and advances in large language models, recent progress has led to sophisticated code models for key software engineering tasks, such as program repair and code completion. These models are trained on data from various sources, including public open-source projects like GitHub and private, confidential code from companies, raising significant privacy concerns. This paper investigates a crucial but unexplored question: What is the risk of membership information leakage in code models? Membership leakage refers to the vulnerability where an attacker can infer whether a specific data point was part of the training dataset. We present …
Chain Of Preference Optimization: Improving Chain-Of-Thought Reasoning In Llms, Xuan Zhang, Chao Du, Tianyu Pang, Qian Liu, Wei Gao, Min Lin
Chain Of Preference Optimization: Improving Chain-Of-Thought Reasoning In Llms, Xuan Zhang, Chao Du, Tianyu Pang, Qian Liu, Wei Gao, Min Lin
Research Collection School Of Computing and Information Systems
The recent development of chain-of-thought (CoT) decoding has enabled large language models (LLMs) to generate explicit logical reasoning paths for complex problem-solving. However, research indicates that these paths are not always deliberate and optimal. The tree-of-thought (ToT) method employs tree-searching to extensively explore the reasoning space and find better reasoning paths that CoT decoding might overlook. This deliberation, however, comes at the cost of significantly increased inference complexity. In this work, we demonstrate that fine-tuning LLMs leveraging the search tree constructed by ToT allows CoT to achieve similar or better performance, thereby avoiding the substantial inference burden. This is achieved …
Harnessing Collective Structure Knowledge In Data Augmentation For Graph Neural Networks, Rongrong Ma, Guansong Pang, Ling Chen
Harnessing Collective Structure Knowledge In Data Augmentation For Graph Neural Networks, Rongrong Ma, Guansong Pang, Ling Chen
Research Collection School Of Computing and Information Systems
Graph neural networks (GNNs) have achieved state-of-the-art performance in graph representation learning. Message passing neural networks, which learn representations through recursively aggregating information from each node and its neighbors, are among the most commonly-used GNNs. However, a wealth of structural information of individual nodes and full graphs is often ignored in such process, which restricts the expressive power of GNNs. Various graph data augmentation methods that enable the message passing with richer structure knowledge have been introduced as one main way to tackle this issue, but they are often focused on individual structure features and difficult to scale up with …
Adan: Adaptive Nesterov Momentum Algorithm For Faster Optimizing Deep Models, Xingyu Xie, Pan Zhou, Huan Li, Zhouchen Lin, Shuicheng Yan
Adan: Adaptive Nesterov Momentum Algorithm For Faster Optimizing Deep Models, Xingyu Xie, Pan Zhou, Huan Li, Zhouchen Lin, Shuicheng Yan
Research Collection School Of Computing and Information Systems
In deep learning, different kinds of deep networks typically need different optimizers, which have to be chosen after multiple trials, making the training process inefficient. To relieve this issue and consistently improve the model training speed across deep networks, we propose the ADAptive Nesterov momentum algorithm, Adan for short. Adan first reformulates the vanilla Nesterov acceleration to develop a new Nesterov momentum estimation (NME) method, which avoids the extra overhead of computing gradient at the extrapolation point. Then Adan adopts NME to estimate the gradient's first- and second-order moments in adaptive gradient algorithms for convergence acceleration. Besides, we prove that …
Flexfl: Heterogeneous Federated Learning Via Apoz-Guided Flexible Pruning In Uncertain Scenarios, Zekai Chen, Chentao Jia, Ming Hu, Xiaofei Xie, Anran Li, Mingsong Chen
Flexfl: Heterogeneous Federated Learning Via Apoz-Guided Flexible Pruning In Uncertain Scenarios, Zekai Chen, Chentao Jia, Ming Hu, Xiaofei Xie, Anran Li, Mingsong Chen
Research Collection School Of Computing and Information Systems
Along with the increasing popularity of Deep Learning (DL) techniques, more and more Artificial Intelligence of Things (AIoT) systems are adopting federated learning (FL) to enable privacy-aware collaborative learning among AIoT devices. However, due to the inherent data and device heterogeneity issues, existing FL-based AIoT systems suffer from the model selection problem. Although various heterogeneous FL methods have been investigated to enable collaborative training among heterogeneous models, there is still a lack of i) wise heterogeneous model generation methods for devices, ii) consideration of uncertain factors, and iii) performance guarantee for large models, thus strongly limiting the overall FL performance. …