Databases and Information Systems Commons^™

Causalabstain: Enhancing Multilingual Llms With Causal Reasoning For Trustworthy Abstention, Yuxi Sun, Aoqi Zuo, Wei Gao, Jing Ma

Research Collection School Of Computing and Information Systems

Large Language Models (LLMs) often exhibit knowledge disparities across languages. Encouraging LLMs to abstain when faced with knowledge gaps is a promising strategy to reduce hallucinations in multilingual settings. Current abstention strategies for multilingual scenarios primarily rely on generating feedback in various languages using LLMs and performing self-reflection. However, these methods can be adversely impacted by inaccuracies and biases in the generated feedback. To address this, from a causal perspective, we introduce CausalAbstain, a method that helps LLMs determine whether to utilize multiple generated feedback responses and how to identify the most useful ones. Extensive experiments demonstrate that CausalAbstain effectively …

Towards Context-Aware Traffic Classification Via Time-Wavelet Fusion Network, Ziming Zhao, Zhuoxue Song, Xiaofei Xie, Zhaoxuan Li, Jiongchi Yu, Fan Terry Zhang, Tingting Li

Research Collection School Of Computing and Information Systems

Encrypted traffic classification occupies a significant role in cybersecurity and network management. The existing encrypted traffic classification technology mostly relies on intra-flow semantics for extracting features. However, considering that some attack behaviors inherently have similar patterns to legitimate behaviors, and powerful adversaries could simulate benign users to conceal their attack intentions, intra-flow features may be similar between different categories. In this paper, we propose TrafficScope, a time-wavelet fusion network based on Transformer to enhance the performance of encrypted traffic classification. Specifically, in addition to using intra-flow semantics, TrafficScope also extracts contextual information to construct more comprehensive representations. Moreover, to cope …

Cami: A Counselor Agent Supporting Motivational Interviewing Through State Inference And Topic Exploration, Yizhe Yang, Palakorn Achananuparp, Heyan Huang, Jing Jiang, Phey Ling Kit, Nicholas Gabriel Lim, Cameron Shi Ern Tan, Ee-Peng Lim

Research Collection School Of Computing and Information Systems

Conversational counselor agents have become essential tools for addressing the rising demand for scalable and accessible mental health support. This paper introduces CAMI, a novel automated counselor agent grounded in Motivational Interviewing (MI) – a client-centered counseling approach designed to address ambivalence and facilitate behavior change. CAMI employs a novel STAR framework, consisting of client’s state inference, motivation topic exploration, and response generation modules, leveraging large language models (LLMs). These components work together to evoke change talk, aligning with MI principles and improving counseling outcomes for diverse clients. We evaluate CAMI’s performance through both automated and expert evaluations, utilizing simulated …

Gradients As An Action: Towards Communication-Efficient Federated Recommender Systems Via Adaptive Action Sharing, Zhufeng Lu, Chentao Jia, Ming Hu, Xiaofei Xie, Mingsong Chen

Research Collection School Of Computing and Information Systems

As a promising privacy-aware collaborative model training paradigm, Federated Learning (FL) is becoming popular in the design of distributed recommender systems. However, Federated Recommender Systems (FedRecs) greatly suffer from two major problems: i) extremely high communication overhead due to massive item embeddings involved in recommendation systems, and ii) intolerably low training efficiency caused by the entanglement of both heterogeneous network environments and client devices. Although existing methods attempt to employ various compression techniques to reduce communication overhead, due to the parameter errors introduced by model compression, they inevitably suffer from model performance degradation. To simultaneously address the above problems, this …

Fine‑Tuning Multimodal Large Language Models For Product Bundling, Xiaohao Liu, Jie Wu, Zhulin Tao, Yunshan Ma, Yinwei Wei, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

Recent advances in product bundling have leveraged multimodal information through sophisticated encoders, but remain constrained by limited semantic understanding and a narrow scope of knowledge. Therefore, some attempts employ In-context Learning (ICL) to explore the potential of large language models (LLMs) for their extensive knowledge and complex reasoning abilities. However, these efforts are inadequate in understanding mulitmodal data and exploiting LLMs' knowledge for product bundling. To bridge the gap, we introduce Bundle-MLLM, a novel framework that fine-tunes LLMs through a hybrid item tokenization approach within a well-designed optimization strategy. Specifically, we integrate textual, media, and relational data into a unified …

Anomalygfm: Graph Foundation Model For Zero/Few-Shot Anomaly Detection, Hezhe Qiao, Chaoxi Niu, Ling Chen, Guansong Pang

Research Collection School Of Computing and Information Systems

Graph anomaly detection (GAD) aims to identify abnormal nodes that differ from the majority of the nodes in a graph, which has been attracting significant attention in recent years. Existing generalist graph models have achieved remarkable success in different graph tasks but struggle to generalize to the GAD task. This limitation arises from their difficulty in learning generalized knowledge for capturing the inherently infrequent, irregular and heterogeneous abnormality patterns in graphs from different domains. To address this challenge, we propose AnomalyGFM, a GAD-oriented graph foundation model that supports zero-shot inference and few-shot prompt tuning for GAD in diverse graph datasets. …

Affinitytune: A Prompt-Tuning Framework For Few-Shot Anomaly Detection On Graphs, Jingyan Chen, Guanghui Zhu, Guansong Pang, Chunfeng Yuan, Yihua Huang

Research Collection School Of Computing and Information Systems

Graph anomaly detection (GAD) is a critical task with applications in domains such as networking, finance, and bioinformatics. % However, the scarcity of labeled anomalies and the limitations of unsupervised methods hinder effective detection. % While semi-supervised and few-shot learning approaches offer improvements, they struggle with knowledge transfer and rely heavily on labeled data. % Recent advancements in prompt tuning on graphs provide a promising direction, but their application to heterophilous graphs in anomaly detection remains underexplored. % In this work, we propose AffinityTune, a novel framework for few-shot graph anomaly detection based on prompt tuning. % Our approach introduces …

Non-Blackbox Robust Design Of Machine Learning In Networks, Venkat Sai Suman Lamba Karanam

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

Networked systems have become increasingly complex, with newer communication technologies and standards being added every day. Machine Learning (ML) and Artificial Intelligence (AI) paradigms have been adopted in networks to not only solve many fundamental problems, but also to allow seamless integration of components comprising them. The saying “let’s not reinvent the wheel” in ML/AI adoption implies that model architecture design be left for pure ML/AI researchers, while network researchers focus on input preprocessing (e.g. formatting the packet data to be fed to a model), hyperparameter fine-tuning and a trial-and-error approach to find the “best” result. …

Optimal Transport Alignment Of User Preferences From Ratings And Texts, Nhu Thuat Tran, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Modeling hidden factors driving user preferences is crucial for recommendation yet challenging due to sparse rating data. While aligning preference factors from ratings and texts, as a solution, shows improvements, existing methods impose restrictive one-to-one factor correspondences and underutilize cross-modal interest signals. We propose an optimal transport (OT) approach to address these gaps. By modeling rating- and text-based preference factors as distributions, we compute an OT plan that captures their probabilistic relationships. This plan serves dual roles: 1) to regularize cross-modal preference factors without rigid correspondence assumptions, and 2) to blend preference signals across modalities through barycentric mapping. Experiments on …

Coordinating Instruments For Multi-Messenger Astrophysics, Daisy Wang, Ye Htet, Marion Sudvarg, Roger Chamberlain, Jeremy Buhler, James Buckley

Computer Science Faculty Research & Creative Works

In multi-messenger astrophysics, signals of multiple types (e.g., gravitational waves, neutrinos, electromagnetic waves) are combined in an effort to learn more about the observed phenomena of interest. The Advanced Particle-astrophyics Telescope (APT) is a mission concept for a space-borne instrument that detects gammaray bursts (GRBs) omnidirectionally, facilitating multi-messenger observations by identifying and localizing celestial events of interest. Here, we describe the on-instrument computations for APT and its Antarctic Demonstrator (ADAPT) as well as techniques for follow-up observations of transient events.

Syntax-Enhanced Boundary-Aware Named Entity Recognition Model, Chuanming Yu, Bin Deng, Zhengang Zhang

Journal of Scientific Information Research

[Purpose/significance] This study addresses the issue of inadequate perception of entity boundaries in traditional character-level modeling-based named entity recognition models by integrating syntax information containing entity boundary features into the task using a multi-head graph attention network with dense connections. This integration enhances the effectiveness of named entity recognition.

[Method/process] This study proposes a Syntax-enhanced Boundary-aware Named Entity Recognition Model (SynBNER), which utilizes BERT for text semantic representation and integrates syntax information using a dense-connected graph attention network. This integration incorporates implicit entity boundary information from syntax information into word representations, thereby enhancing the model's entity boundary perception capability.

[Result/conclusion] …

The B2biers System: A Content-Based Perspective On Maximizing Influence And Subscription In Social Networks, Konstantinos Theocharidis, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

The popular problem of Influence Maximization (IM) asks for the k users who can maximize the influence of a fixed post in a social network. In contrast, the problem of Content- Aware Influence Maximization (CAIM) asks for the k features to form a viral tunable post in a social network starting its diffusion from a fixed set of initial adopters. CAIM paves the way for a number of novel problems to be studied that altogether can lead to the development of a system that would be valuable for advertisers who manage social network pages. This holds since features (brands) in …

An Efficient Diffusion-Based Non-Autoregressive Solver For Traveling Salesman Problem, Mingzhao Wang, You Zhou, Zhiguang Cao, Yubin Xiao, Xuan Wu, Wei Pang, Yuan Jiang, Hui Yang, Peng Zhao, Yuanshu Li

Research Collection School Of Computing and Information Systems

Recent advances in neural models have shown considerable promise in solving Traveling Salesman Problems (TSPs) without relying on much hand-crafted engineering. However, while non-autoregressive (NAR) approaches benefit from faster inference through parallelism, they typically deliver solutions of inferior quality compared to autoregressive ones. To enhance the solution quality while maintaining fast inference, we propose DEITSP, a diffusion model with efficient iterations tailored for TSP that operates in a NAR manner. Firstly, we introduce a one-step diffusion model that integrates the controlled discrete noise addition process with self-consistency enhancement, enabling optimal solution prediction through simultaneous denoising of multiple solutions. Secondly, we …

Sparse-To-Dense: A Free Lunch For Lossless Acceleration Of Video Understanding In Llms, Xuan Zhang, Cunxiao Du, Sicheng Yu, Jiawei Wu, Fengzhuo Zhang, Wei Gao, Qian Liu

Research Collection School Of Computing and Information Systems

Due to the auto-regressive nature of current video large language models (Video-LLMs), the inference latency increases as the input sequence length grows, posing challenges for the efficient processing of video sequences that are usually very long. We observe that during decoding, the attention scores of most tokens in Video-LLMs tend to be sparse and concentrated, with only certain tokens requiring comprehensive full attention. Based on this insight, we introduce Sparse-to-Dense (StD), a novel decoding strategy that integrates two distinct modules: one leveraging sparse top-K attention and the other employing dense full attention. These modules collaborate to accelerate Video-LLMs without loss. …

Finir: The 2nd Workshop On Financial Information Retrieval In The Era Of Generative Ai, Fengbin Zhu, Yunshan Ma, Fuli Feng, Chao Wang, Huanbo Luan, Guangnan Ye, Shuo Zhang, Dhagash Mehta, Pingping Chen, Bing Xiang, Tat‑Seng Chua

Research Collection School Of Computing and Information Systems

Recent advancements in Generative AI, such as Large Language Models (LLMs), have demonstrated remarkable success across various general tasks. Extensive studies have explored leveraging generative models in finance, but significant challenges persist. This half-day workshop explores potential approaches and research directions to address these challenges by equipping generative models with advanced Information Retrieval (IR) models. Specifically, this workshop seeks to provide a platform for discussing innovative ideas that facilitate the advancement of IR technology to enrich generative models in finance from four key perspectives: (i) financial IR techniques (ii) financial IR benchmarking and evaluation (iii) financial systems and agents/assistants (iv) …

Fashiondpo: Fine‑Tune Fashion Outfit Generation Model Using Direct Preference Optimization, Mingzhe Yu, Yunshan Ma, Lei Wu, Changshuo Wang, Xue Li, Lei Meng

Research Collection School Of Computing and Information Systems

Personalized outfit generation aims to construct a set of compatible and personalized fashion items as an outfit. Recently, generative AI models have received widespread attention, as they can generate fashion items for users to complete an incomplete outfit or create a complete outfit. However, they have limitations in terms of lacking diversity and relying on the supervised learning paradigm. Recognizing this gap, we propose a novel framework FashionDPO, which fine-tunes the fashion outfit generation model using direct preference optimization. This framework aims to provide a general fine-tuning approach to fashion generative models, refining a pre-trained fashion outfit generation model using …

Dual-Target Disjointed Cross-Domain Recommendation Mediated Via Latent User Preferences, Dinh Hieu Do, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Users often navigate multiple platforms online, each characterized by its own set of scarce data. Recommender systems face a significant challenge in such fragmented environments. This paper proposes a novel approach to enhance recommendation systems by leveraging connections across distinct yet conceptually similar datasets from multiple platforms. We introduce a unique scenario of dual-target overlapping-free cross-platform recommendation, presenting a bridging mechanism to mutually improve across platforms and learn latent user preferences. Our approach addresses the data sparsity prevalent in each platform and enhances recommendation quality by harnessing redundant, rich, and similar domain data. Experiments validate the effectiveness of our method, …

Do Supplier Ceo's National Cultural Origins Affect Supplier-Customer Relationships?, Peng Liang, Hasan Cavusoglu, Nan Hu

Research Collection School Of Computing and Information Systems

This study investigates how the national cultural origins of supplier chief executive officers (CEOs), as characterized by Hofstede’s cross-cultural dimensions, influence the duration of supplier–customer relationships. By analyzing the cultural origins of supplier CEOs from 20 countries over a 25-year period, we find that supplier CEOs with high long-term orientation (LTO) and high uncertainty avoidance (UNA) are associated with longer lasting supplier–customer relationships, while those with high individualism (IND) are associated with shorter relationship durations. These findings are robust to several alternative explanations of customer and supplier CEO variables. To address potential endogeneity—specifically, the concern that CEOs with certain cultural …

Wa-Fdnet: A Unified Weight Adaptation Network For Multimodal Image Fusion And Object Detection, Yanyin Guo, Ying Luo, Junwei Li, Zhiyuan Zhang

Research Collection School Of Computing and Information Systems

Multimodal image fusion and object detection are critical tasks in computer vision, particularly in scenarios requiring robust perception under low illumination conditions. Existing approaches that attempt to combine these tasks often rely on cascaded or loosely coupled designs, which can result in suboptimal performance due to gradient conflicts and task imbalance. In this paper, we propose WA-FDNet, a novel Weight Adaptation Fusion Detection Network that unifies multimodal image fusion and object detection into a single end-to-end framework. WA-FDNet adopts a shared encoder–private decoder architecture, enabling efficient feature sharing while preserving task-specific characteristics. The image fusion branch employs a spatial attention-based …

Towards Metrology 4.0 In Developing Countries’ Manufacturing Industries, Jailos Nzumile

Tanzania Journal of Engineering and Technology (TJET)

A systematic literature review was conducted to unveil the status of the digital transformation of metrology in developing countries, as they are lagging in utilising fourth industrial revolution (IR4.0) technologies to transform manufacturing industries. A PRISMA technique was employed using various keywords to identify, screen, and select the relevant literature. Forty publications were selected for the review, mainly discussing IR 4.0 technologies in metrological operations. The results indicate that the digital transformation of metrology has yet to be initiated in developing countries. However, the employment of IR4.0 technologies in advancing metrological operations in manufacturing industries is mostly discussed in the …