Databases and Information Systems Commons^™

Gradients As An Action: Towards Communication-Efficient Federated Recommender Systems Via Adaptive Action Sharing, Zhufeng Lu, Chentao Jia, Ming Hu, Xiaofei Xie, Mingsong Chen

Research Collection School Of Computing and Information Systems

As a promising privacy-aware collaborative model training paradigm, Federated Learning (FL) is becoming popular in the design of distributed recommender systems. However, Federated Recommender Systems (FedRecs) greatly suffer from two major problems: i) extremely high communication overhead due to massive item embeddings involved in recommendation systems, and ii) intolerably low training efficiency caused by the entanglement of both heterogeneous network environments and client devices. Although existing methods attempt to employ various compression techniques to reduce communication overhead, due to the parameter errors introduced by model compression, they inevitably suffer from model performance degradation. To simultaneously address the above problems, this …

Fine‑Tuning Multimodal Large Language Models For Product Bundling, Xiaohao Liu, Jie Wu, Zhulin Tao, Yunshan Ma, Yinwei Wei, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

Recent advances in product bundling have leveraged multimodal information through sophisticated encoders, but remain constrained by limited semantic understanding and a narrow scope of knowledge. Therefore, some attempts employ In-context Learning (ICL) to explore the potential of large language models (LLMs) for their extensive knowledge and complex reasoning abilities. However, these efforts are inadequate in understanding mulitmodal data and exploiting LLMs' knowledge for product bundling. To bridge the gap, we introduce Bundle-MLLM, a novel framework that fine-tunes LLMs through a hybrid item tokenization approach within a well-designed optimization strategy. Specifically, we integrate textual, media, and relational data into a unified …

Anomalygfm: Graph Foundation Model For Zero/Few-Shot Anomaly Detection, Hezhe Qiao, Chaoxi Niu, Ling Chen, Guansong Pang

Research Collection School Of Computing and Information Systems

Graph anomaly detection (GAD) aims to identify abnormal nodes that differ from the majority of the nodes in a graph, which has been attracting significant attention in recent years. Existing generalist graph models have achieved remarkable success in different graph tasks but struggle to generalize to the GAD task. This limitation arises from their difficulty in learning generalized knowledge for capturing the inherently infrequent, irregular and heterogeneous abnormality patterns in graphs from different domains. To address this challenge, we propose AnomalyGFM, a GAD-oriented graph foundation model that supports zero-shot inference and few-shot prompt tuning for GAD in diverse graph datasets. …

Affinitytune: A Prompt-Tuning Framework For Few-Shot Anomaly Detection On Graphs, Jingyan Chen, Guanghui Zhu, Guansong Pang, Chunfeng Yuan, Yihua Huang

Research Collection School Of Computing and Information Systems

Graph anomaly detection (GAD) is a critical task with applications in domains such as networking, finance, and bioinformatics. % However, the scarcity of labeled anomalies and the limitations of unsupervised methods hinder effective detection. % While semi-supervised and few-shot learning approaches offer improvements, they struggle with knowledge transfer and rely heavily on labeled data. % Recent advancements in prompt tuning on graphs provide a promising direction, but their application to heterophilous graphs in anomaly detection remains underexplored. % In this work, we propose AffinityTune, a novel framework for few-shot graph anomaly detection based on prompt tuning. % Our approach introduces …

Coordinating Instruments For Multi-Messenger Astrophysics, Daisy Wang, Ye Htet, Marion Sudvarg, Roger Chamberlain, Jeremy Buhler, James Buckley

Computer Science Faculty Research & Creative Works

In multi-messenger astrophysics, signals of multiple types (e.g., gravitational waves, neutrinos, electromagnetic waves) are combined in an effort to learn more about the observed phenomena of interest. The Advanced Particle-astrophyics Telescope (APT) is a mission concept for a space-borne instrument that detects gammaray bursts (GRBs) omnidirectionally, facilitating multi-messenger observations by identifying and localizing celestial events of interest. Here, we describe the on-instrument computations for APT and its Antarctic Demonstrator (ADAPT) as well as techniques for follow-up observations of transient events.

Syntax-Enhanced Boundary-Aware Named Entity Recognition Model, Chuanming Yu, Bin Deng, Zhengang Zhang

Journal of Scientific Information Research

[Purpose/significance] This study addresses the issue of inadequate perception of entity boundaries in traditional character-level modeling-based named entity recognition models by integrating syntax information containing entity boundary features into the task using a multi-head graph attention network with dense connections. This integration enhances the effectiveness of named entity recognition.

[Method/process] This study proposes a Syntax-enhanced Boundary-aware Named Entity Recognition Model (SynBNER), which utilizes BERT for text semantic representation and integrates syntax information using a dense-connected graph attention network. This integration incorporates implicit entity boundary information from syntax information into word representations, thereby enhancing the model's entity boundary perception capability.

[Result/conclusion] …

Fashiondpo: Fine‑Tune Fashion Outfit Generation Model Using Direct Preference Optimization, Mingzhe Yu, Yunshan Ma, Lei Wu, Changshuo Wang, Xue Li, Lei Meng

Research Collection School Of Computing and Information Systems

Personalized outfit generation aims to construct a set of compatible and personalized fashion items as an outfit. Recently, generative AI models have received widespread attention, as they can generate fashion items for users to complete an incomplete outfit or create a complete outfit. However, they have limitations in terms of lacking diversity and relying on the supervised learning paradigm. Recognizing this gap, we propose a novel framework FashionDPO, which fine-tunes the fashion outfit generation model using direct preference optimization. This framework aims to provide a general fine-tuning approach to fashion generative models, refining a pre-trained fashion outfit generation model using …

Finir: The 2nd Workshop On Financial Information Retrieval In The Era Of Generative Ai, Fengbin Zhu, Yunshan Ma, Fuli Feng, Chao Wang, Huanbo Luan, Guangnan Ye, Shuo Zhang, Dhagash Mehta, Pingping Chen, Bing Xiang, Tat‑Seng Chua

Research Collection School Of Computing and Information Systems

Recent advancements in Generative AI, such as Large Language Models (LLMs), have demonstrated remarkable success across various general tasks. Extensive studies have explored leveraging generative models in finance, but significant challenges persist. This half-day workshop explores potential approaches and research directions to address these challenges by equipping generative models with advanced Information Retrieval (IR) models. Specifically, this workshop seeks to provide a platform for discussing innovative ideas that facilitate the advancement of IR technology to enrich generative models in finance from four key perspectives: (i) financial IR techniques (ii) financial IR benchmarking and evaluation (iii) financial systems and agents/assistants (iv) …

Wa-Fdnet: A Unified Weight Adaptation Network For Multimodal Image Fusion And Object Detection, Yanyin Guo, Ying Luo, Junwei Li, Zhiyuan Zhang

Research Collection School Of Computing and Information Systems

Multimodal image fusion and object detection are critical tasks in computer vision, particularly in scenarios requiring robust perception under low illumination conditions. Existing approaches that attempt to combine these tasks often rely on cascaded or loosely coupled designs, which can result in suboptimal performance due to gradient conflicts and task imbalance. In this paper, we propose WA-FDNet, a novel Weight Adaptation Fusion Detection Network that unifies multimodal image fusion and object detection into a single end-to-end framework. WA-FDNet adopts a shared encoder–private decoder architecture, enabling efficient feature sharing while preserving task-specific characteristics. The image fusion branch employs a spatial attention-based …

The B2biers System: A Content-Based Perspective On Maximizing Influence And Subscription In Social Networks, Konstantinos Theocharidis, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

The popular problem of Influence Maximization (IM) asks for the k users who can maximize the influence of a fixed post in a social network. In contrast, the problem of Content- Aware Influence Maximization (CAIM) asks for the k features to form a viral tunable post in a social network starting its diffusion from a fixed set of initial adopters. CAIM paves the way for a number of novel problems to be studied that altogether can lead to the development of a system that would be valuable for advertisers who manage social network pages. This holds since features (brands) in …

Dual-Target Disjointed Cross-Domain Recommendation Mediated Via Latent User Preferences, Dinh Hieu Do, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Users often navigate multiple platforms online, each characterized by its own set of scarce data. Recommender systems face a significant challenge in such fragmented environments. This paper proposes a novel approach to enhance recommendation systems by leveraging connections across distinct yet conceptually similar datasets from multiple platforms. We introduce a unique scenario of dual-target overlapping-free cross-platform recommendation, presenting a bridging mechanism to mutually improve across platforms and learn latent user preferences. Our approach addresses the data sparsity prevalent in each platform and enhances recommendation quality by harnessing redundant, rich, and similar domain data. Experiments validate the effectiveness of our method, …

An Efficient Diffusion-Based Non-Autoregressive Solver For Traveling Salesman Problem, Mingzhao Wang, You Zhou, Zhiguang Cao, Yubin Xiao, Xuan Wu, Wei Pang, Yuan Jiang, Hui Yang, Peng Zhao, Yuanshu Li

Research Collection School Of Computing and Information Systems

Recent advances in neural models have shown considerable promise in solving Traveling Salesman Problems (TSPs) without relying on much hand-crafted engineering. However, while non-autoregressive (NAR) approaches benefit from faster inference through parallelism, they typically deliver solutions of inferior quality compared to autoregressive ones. To enhance the solution quality while maintaining fast inference, we propose DEITSP, a diffusion model with efficient iterations tailored for TSP that operates in a NAR manner. Firstly, we introduce a one-step diffusion model that integrates the controlled discrete noise addition process with self-consistency enhancement, enabling optimal solution prediction through simultaneous denoising of multiple solutions. Secondly, we …

Sparse-To-Dense: A Free Lunch For Lossless Acceleration Of Video Understanding In Llms, Xuan Zhang, Cunxiao Du, Sicheng Yu, Jiawei Wu, Fengzhuo Zhang, Wei Gao, Qian Liu

Research Collection School Of Computing and Information Systems

Due to the auto-regressive nature of current video large language models (Video-LLMs), the inference latency increases as the input sequence length grows, posing challenges for the efficient processing of video sequences that are usually very long. We observe that during decoding, the attention scores of most tokens in Video-LLMs tend to be sparse and concentrated, with only certain tokens requiring comprehensive full attention. Based on this insight, we introduce Sparse-to-Dense (StD), a novel decoding strategy that integrates two distinct modules: one leveraging sparse top-K attention and the other employing dense full attention. These modules collaborate to accelerate Video-LLMs without loss. …

Towards Metrology 4.0 In Developing Countries’ Manufacturing Industries, Jailos Nzumile

Tanzania Journal of Engineering and Technology (TJET)

A systematic literature review was conducted to unveil the status of the digital transformation of metrology in developing countries, as they are lagging in utilising fourth industrial revolution (IR4.0) technologies to transform manufacturing industries. A PRISMA technique was employed using various keywords to identify, screen, and select the relevant literature. Forty publications were selected for the review, mainly discussing IR 4.0 technologies in metrological operations. The results indicate that the digital transformation of metrology has yet to be initiated in developing countries. However, the employment of IR4.0 technologies in advancing metrological operations in manufacturing industries is mostly discussed in the …

Towards Future Sustainable Infrastructure: The Role Of Technical Audit In Tanzania’S Public Works, George C. Haule

Tanzania Journal of Engineering and Technology (TJET)

This study aimed to investigate the vital role and impact of technical audits in promoting sustainable infrastructure development in Tanzania. The role and effects of technical audits in long-term infrastructure development were studied using a mixed-methods approach with both quantitative and qualitative parts. Data were collected through analysis of technical audit documentation, a semi-structured questionnaire, and stakeholder interviews. The study revealed the various dimensions of infrastructure investment projects, including initiation and planning, design, procurement of contractors and consultants, contract management, environment, health, and safety. The technical audit findings reported weaknesses or non-performance issues in infrastructure planning at the national level …

Assessment Of Digital Solutions For Conformity Assessment Of Legally Controlled Measuring Instruments In Tanzania, Faraja Nyoni

Tanzania Journal of Engineering and Technology (TJET)

The advent of state-of-the-art digital technologies since 2011 has led to the digital transformation of legal metrology practices to ensure the trustworthiness of software-controlled measuring instruments globally. Despite the digital transformation in legal metrological practices, the conformity assessment of legally controlled measuring instruments is manually done (i.e., paper-based) in Tanzania. The paper-based conformity assessment of legally controlled measuring instruments is prone to error and lacks efficiency and effectiveness. This study aimed to assess digital solutions for improving conformity assessment through a comprehensive survey conducted across various regions in Tanzania, targeting a stratified sample of 51 respondents from organizations involved in …

Adapting Large Language Models For Parameter-Efficient Log Anomaly Detection, Ying Fu Lim, Jiawen Zhu, Guansong Pang

Research Collection School Of Computing and Information Systems

Log Anomaly Detection (LAD) seeks to identify atypical patterns in log data that are crucial to assessing the security and condition of systems. Although Large Language Models (LLMs) have shown tremendous success in various fields, the use of LLMs in enabling the detection of log anomalies is largely unexplored. This work aims to fill this gap. Due to the prohibitive costs involved in fully fine-tuning LLMs,we explore the use of parameter-efficient fine-tuning techniques (PEFTs) for adapting LLMs to LAD.To have an in-depth exploration of the potential of LLM-driven LAD, we present a comprehensive investigation of leveraging two of the most …

A Decision Support System For Conference Session Selection Using Natural Language Processing, Tillman E. Erb

Master's Theses

Conference attendees are faced with selecting from hundreds to thousands of presentations and sessions in pursuit of new findings and methods relevant to their area of interest, an overwhelming amount of information from which to clearly make a decision. To address this, we developed a decision support system leveraging natural language processing (NLP) techniques such as semantic matching. By creating and matching embeddings of conference presentation abstracts and titles, the application provides improved query matching compared to keyword searching. We introduce Session Scout, a novel conference decision support system built upon a semantic retrieval framework. Session Scout is designed to …

Alayadb: The Data Foundation For Efficient And Effective Long-Context Llm Inference, Yangshen Deng, Zhengxin You, Long Xiang, Qilong Li, Peiqi Yuan, Zhaoyang Hong, Yitao Zheng, Wanting Li, Runzhong Li, Haotian Liu, Kyriakos Mouratidis, Man Lung Yiu, Huan Li, Qiaomu Shen, Rui Mao, Bo Tang

Research Collection School Of Computing and Information Systems

AlayaDB is a cutting-edge vector database system natively architected for efficient and effective long-context inference for Large Language Models (LLMs) at AlayaDB AI. Specifically, it decouples the KV cache and attention computation from the LLM inference systems, and encapsulates them into a novel vector database system. For the Model as a Service providers (MaaS), AlayaDB consumes fewer hardware resources and offers higher generation quality for various workloads with different kinds of Service Level Objectives (SLOs), when compared with the existing alternative solutions (e.g., KV cache disaggregation, retrieval-based sparse attention). The crux of AlayaDB is that it abstracts the attention computation …

Rich Models And Methods For On-Demand Same Day Deliveries, Zhiqin Zhang

Dissertations and Theses Collection (Open Access)

Same-day delivery has brought numerous conveniences to people’s lives, but it has also presented challenges in terms of service management. To effectively optimize on-demand same-day delivery operations within urban logistics, intelligent decision-making strategies capable of adapting to rapidly changing circumstances are essential. Employing effective decisionmaking strategies that account for order allocation, route planning, courier scheduling, and other relevant factors, is pivotal in advancing logistics operations, enhancing efficiency, customer satisfaction, and resource utilization in the context of dynamic same-day delivery problems.

The focus of this thesis revolves around different emerging challenges presented by on-demand same-day delivery problems, with a particular emphasis …