Databases and Information Systems Commons^™

Human-Ai Synergy In Survey Development: Implications From Large Language Models In Business And Research, Ping Fan Ke, Ka Chung Ng

Research Collection School Of Computing and Information Systems

This study examines the novel integration of Large Language Models (LLMs) into the survey development process in business and research through the development and evaluation of the Behavioral Research ASSistant (BRASS) Bot. We first analyzed the traditional scale development process to identify tasks suitable for LLM integration, including both human-in-the-loop and automated LLM data collection methods. Following this analysis, we developed the details of BRASS Bot, incorporating design principles of falsifiability and reproducibility. We then conducted a comprehensive evaluation of the BRASS Bot across a diverse set of LLMs, including GPT, Claude, Gemini, and Llama, to assess its usability, validity, …

Towards Smart Farming: Image-Based Crop Health Assessment And Disease Diagnosis Using Deep Learning Techniques, Kristina Botova

Master's Theses or Doctor of Nursing Practice

Accurate crop monitoring is essential for optimizing agricultural productivity and ensuring food security. This study presents a comprehensive deep learning framework for image crop type recognition, health status prediction, and disease detection using multiple Convolutional Neural Network (CNN) models. The proposed approach uses open-source datasets consisting of five crop types (apple, corn, grape, potato, tomato), varying health conditions, and common diseases. By deploying specialized CNN architecture focused on each task, the system achieves a high accuracy of 99.25% in classifying crop types, identifying health status, and detecting specific diseases. Compared to a single CNN model, the use of the proposed …

Enhanced Network Anomaly Detection Using Machine Learning Models, Ousmane Barry

CCAC Theses and Dissertations

This dissertation investigates enhanced network anomaly detection using Machine Learning (ML) models. The study addresses two distinct classification problems: binary classification and multiclass classification. In the binary classification task, network traffic data is categorized as either "normal" or "abnormal," where abnormal includes all non-normal traffic. Leveraging the balanced nature of the dataset, this study develops optimized models that achieve consistently high classification performance. Key metrics, including precision, recall, and F1 scores, are used to ensure robust evaluation and reliable detection across all classes.

For multiclass classification, only classes present in both training and test datasets are included to ensure meaningful …

Digital Platform Transitions In The Finance Industry: Three Essays, Cheryll-Ann Wilson

2025

This three-paper dissertation is motivated by an emerging dichotomy in the financial sector: an increasing use of an open-source digital platform—the Python platform—in an industry that historically has been wedded to proprietary systems.

Chapter 1 is a qualitative pilot study to ascertain which factors are likely to motivate investment professionals to select Python versus other tools and/or technologies. I find that efficiency and access to industry-specific libraries—notably Pandas and NumPy—are significant motivators in their selection of Python over Excel. Chapters 2 and 3 examine the issues through a sequential, exploratory mixed methods approach.

Chapter 2—the qualitative field study—investigates how and …

A Review Of Chinese Sentiment Analysis: Subjects, Methods, And Trends, Zhaoxia Wang, Donghao Huang, Jingfeng Cui, Xinyue Zhang, Seng-Beng Ho, Erik Cambria

Research Collection School Of Computing and Information Systems

Sentiment analysis has emerged as a prominent research domain within the realm of natural language processing, garnering increasing attention and a growing body of literature. While numerous literature reviews have examined sentiment analysis techniques, methods, topics and applications, there remains a gap in the literature concerning thematic trends and research methodologies in sentiment analysis, particularly in the context of Chinese text. This study addresses this gap by presenting a comprehensive survey dedicated to the progression of research subjects, methods and trends in sentiment analysis of Chinese text. Employing a framework that combines keyword co-occurrence analysis with a sophisticated community detection …

Llms-Based Augmentation For Domain Adaptation In Long-Tailed Food Datasets, Qing Wang, Chong-Wah Ngo, Ee-Peng Lim, Qianru Sun

Research Collection School Of Computing and Information Systems

Training a model for food recognition is challenging because the training samples, which are typically crawled from the Internet, are visually different from the pictures captured by users in the free-living environment. In addition to this domain-shift problem, the real-world food datasets tend to be long-tailed distributed and some dishes of different categories exhibit subtle variations that are difficult to distinguish visually. In this paper, we present a framework empowered with large language models (LLMs) to address these challenges in food recognition. We first leverage LLMs to parse food images to generate food titles and ingredients. Then, we project the …

Defending Federated Recommender Systems Against Untargeted Attacks: A Contribution-Aware Robust Aggregation Scheme, Ruicheng Liang, Yuanchun Jiang, Feida Zhu, Ling Cheng, Huiwen Liu

Research Collection School Of Computing and Information Systems

Federated recommender systems (FedRSs) effectively tackle the tradeoff between recommendation accuracy and privacy preservation. However, recent studies have revealed severe vulnerabilities in FedRSs, particularly against untargeted attacks seeking to undermine their overall performance. Defense methods employed in traditional recommender systems are not applicable to FedRSs, and existing robust aggregation schemes for other federated learning-based applications have proven ineffective in FedRSs. Building on the observation that malicious clients contribute negatively to the training process, we design a novel contribution-aware robust aggregation scheme to defend FedRSs against untargeted attacks, named contribution-aware Bayesian knowledge distillation aggregation (ConDA), comprising two key components for the …

A Survey Of Multilingual Large Language Models, Libo Qin, Qiguang Chen, Yuhang Zhou, Zhi Chen, Yinghui Li, Lizi Liao, Min Li, Wanxiang Che, Philip S. Yu

Research Collection School Of Computing and Information Systems

Multilingual large language models (MLLMs) leverage advanced large language models to process and respond to queries across multiple languages, achieving significant success in polyglot tasks. Despite these breakthroughs, a comprehensive survey summarizing existing approaches and recent developments remains absent. To this end, this paper presents a unified and thorough review of the field, highlighting recent progress and emerging trends in MLLM research. The contributions of this paper are as follows. (1) Extensive survey: to our knowledge, this is the pioneering thorough review of multilingual alignment in MLLMs. (2) Unified taxonomy: we provide a unified framework to summarize the current progress …

Fedart: A Neural Model Integrating Federated Learning And Adaptive Resonance Theory, Shubham Pateria, Budhitama Subagdja, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

Federated Learning (FL) has emerged as a promising paradigm for collaborative model training across distributed clients while preserving data privacy. However, prevailing FL approaches aggregate the clients’ local models into a global model through multi-round iterative parameter averaging. This leads to the undesirable bias of the aggregated model towards certain clients in the presence of heterogeneous data distributions among the clients. Moreover, such approaches are restricted to supervised classification tasks and do not support unsupervised clustering. To address these limitations, we propose a novel one-shot FL approach called Federated Adaptive Resonance Theory (FedART) which leverages self-organizing Adaptive Resonance Theory (ART) …

Interactive Video Search With Multi-Modal Llm Video Captioning, Yu-Tong Cheng, Jiaxin Wu, Zhixin Ma, Jiangshan He, Xiao-Yong Wei, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Cross-modal representation learning is essential for interactive text-to-video search tasks. However, the representation learning is limited by the size and quality of video-caption pairs. To improve the search accuracy, we propose to enlarge the size of available video-caption pairs by leveraging multi-model LLM on video captioning. Specifically, we use LLM to generate video captions for a large video collection (i.e., WebVid dataset) and use the generated video-caption pairs to pre-train a text-to-video search model. Additionally, we use LLM to generate fine-grained captions for test video collections to enable text-to-caption retrieval. Furthermore, we build a semantic overview of the retrieved rank …

Utilizing Large Language Models To Synthesize Product Desirability Datasets, John D. Hastings, Sherri Weitl-Harms, Joseph Doty, Zachary L. Myers, Warren Thompson

Research & Publications

This research explores the application of large language models (LLMs) to generate synthetic datasets for Product Desirability Toolkit (PDT) testing, a key component in evaluating user sentiment and product experience. Utilizing gpt-4o-mini, a cost-effective alternative to larger commercial LLMs, three methods, Word+Review, Review+Word, and Supply-Word, were each used to synthesize 1000 product reviews. The generated datasets were assessed for sentiment alignment, textual diversity, and data generation cost. Results demonstrated high sentiment alignment across all methods, with Pearson correlations ranging from 0.93 to 0.97. Supply-Word exhibited the highest diversity and coverage of PDT terms, although with increased generation costs. Despite minor …

La Creatividad En Peligro: Como La Inteligencia Artificial Es Un Reto Para Los Artistas., Nathaly Cisneros

Capstones

Los artistas digitales han creado obras maestras que nos han dejado sin aliento con sus pinceles digitales, lápices y pinturas. Desde retratos que parecen saltar de la pantalla hasta paisajes que nos transportan a mundos desconocidos, su arte ha sido una fuente constante de inspiración.

Pero en los últimos años, una nueva fuerza ha comenzado a cambiar el juego. La inteligencia artificial ha estado avanzando a pasos agigantados y ahora se perfila como una amenaza para el futuro de los artistas digitales. ¿Qué significa esto para el arte y la creatividad?

Link: https://docs.google.com/document/d/1xe8UxDMekX_SwiIppyt_JppK8M-lB-YWNWGyeyShlJM/edit?usp=sharing

Unpacking Bias, Accountability, And Ethical Practices In Ai, Manya Chandra, Micol Hebron

Student Scholar Symposium Abstracts and Posters

This study is based on understanding how text-to-image generative AI platforms perpetuate biases such as racism and sexism and decoding how this bias is programmed within large language models and datasets. In this study, the results of generative AI are analyzed through the lens of affect and affect theory, as they are applied to investigate the machine learning and computer theory behind generative AI algorithms. The purpose of the study is to explain why generative AI is biased and whether this bias is generated due to current trends or to deficits and biases within the database that it draws information …

Using Llms To Establish Implicit User Sentiment Of Software Desirability, Sherri Weitl-Harms, John D. Hastings, Jonah Lum

Research & Publications

This study explores the use of LLMs for providing quantitative zero-shot sentiment analysis of implicit software desirability, addressing a critical challenge in product evaluation where traditional review scores, though convenient, fail to capture the richness of qualitative user feedback. Innovations include establishing a method that 1) works with qualitative user experience data without the need for explicit review scores, 2) focuses on implicit user satisfaction, and 3) provides scaled numerical sentiment analysis, offering a more nuanced understanding of user sentiment, instead of simply classifying sentiment as positive, neutral, or negative.

Data is collected using the Microsoft Product Desirability Toolkit (PDT), …

Generative Artificial Intelligence In Business Higher Education: A Focus Group Study, Xuenan Huo, Keng Siau

Research Collection School Of Computing and Information Systems

This research investigates the opportunities and challenges of integrating generative artificial intelligence (GenAI) into business higher education, drawing insights from an asynchronous focus group research study with doctoral students who serve dual roles as both learners and educators. Key opportunities identified through thematic analysis include knowledge acquisition, intelligent co-ideation, supportive augmentation, and personalized learning. Challenges identified include AI trustworthiness, cognitive dependency, human value, policy and instruction, assessment integrity, and identity management. This study clarifies GenAI’s specific role in business education and provides practical insights for effectively integrating GenAI to enhance learning outcomes and address emerging challenges. An analysis theory on …

Meta-Entrepreneurship: An Analysis Theory On Integrating Generative Ai, Agentic Ai, And Metaverse For Entrepreneurship, Yingying Zhang, Keng Siau

Research Collection School Of Computing and Information Systems

Metaverse entrepreneurship has emerged as an innovative topic alongside the development of generative AI, agentic AI and metaverse. This study conceptualizes meta-entrepreneurship as a novel form of entrepreneurial activity that enables value creation within virtual and physical realms and proposes an analytical theoretical framework based on a systematic literature review, observations, and focus group study. Our framework is structured around three layers (infrastructure, content, and experience) and two domains (metaverse-based operational domain and AI-based production domain), aims to conceptualize “what is meta-entrepreneurship” and identify new possibilities. The research highlights the multifaceted impact of meta-entrepreneurship on individuals, corporations, industries, societies, and …

Virtual Conferencing Fatigue: Look‑Alike Avatar And Facial Attractiveness, Yuxin Liu, Keng Siau, Xueqing Wang, Yang Yang

Research Collection School Of Computing and Information Systems

The rapid evolution of avatar-related technologies provides extensive opportunities for diverse avatar applications in various areas. This study aims to investigate the innovative use of avatars to mitigate virtual conferencing fatigue, which refers to the physical and mental exhaustion from the inappropriate use of virtual conferencing applications. Grounded in Self-Awareness Theory, the research compares the impact of using real faces and user-look-alike avatars on virtual conferencing fatigue, delving into its underlying factors. In addition, the study examines the role of facial attractiveness enhancement on virtual conferencing fatigue. Laboratory experiments with a 2-by-2 between-subject design are employed to test hypotheses. The …

Trustworthy Web3 Domains: A Framework For Digital Identity Verification, Yi Meng Lau, Ping Fan Ke

Research Collection School Of Computing and Information Systems

As decentralized applications evolve, digital identities represented through Web3 domain names gained prominence. This study addresses the challenges of establishing trust in Web3 domain names. The decentralized nature of Web3 introduces complexities in verifying domain name authenticity, making them targets for malicious activities such as cybersquatting and phishing. We propose a comprehensive framework that enhances traditional identification, authentication, and authorization processes by incorporating technological and social trust elements. This framework enables organizations and users to systematically assess the trustworthiness of Web3 domain names, offering a structured approach to managing digital identities in decentralized environments.

A Community-Driven Framework To Evaluate Factors Influencing Nft Buyers, Yi Meng Lau, Ping Fan Ke

Research Collection School Of Computing and Information Systems

This study examines the pivotal role of community-driven social dynamics in shaping non-fungible tokens (NFT) buyers’ purchasing intentions and the increasing social significance of digital assets. Building on prior research in online word-of-mouth, we propose a comprehensive framework that integrates technological, personal, social, economic, and political factors influencing NFT purchases. The framework emphasizes the importance of service providers, personalization, perceived value, and associated risks, while also providing insights into how online word-of-mouth and community dynamics impact these aspects. As a preliminary exploration, this research lays the foundation for future empirical studies to validate the framework and assess its applicability across …

Improving Environment Novelty Quantification For Effective Unsupervised Environment Design, Jayden Teoh, Wenjun Li, Pradeep Varakantham

Research Collection School Of Computing and Information Systems

Unsupervised Environment Design (UED) formalizes the problem of autocurricula through interactive training between a teacher agent and a student agent. The teacher generates new training environments with high learning potential, curating an adaptive curriculum that strengthens the student’s ability to handle unseen scenarios. Existing UED methods mainly rely on regret, a metric that measures the difference between the agent’s optimal and actual performance, to guide curriculum design. Regret-driven methods generate curricula that progressively increase environment complexity for the student but overlook environment novelty–a critical element for enhancing an agent’s generalizability. Measuring environment novelty is especially challenging due to the underspecified …

Ultra-High Resolution Image Segmentation Via Locality-Aware Context Fusion And Alternating Local Enhancement, Wenxi Liu, Qi Li, Xindai Lin, Weixiang Yang, Shengfeng He, Yuanlong Yu

Research Collection School Of Computing and Information Systems

Ultra-high resolution image segmentation has raised increasing interests in recent years due to its realistic applications. In this paper, we innovate the widely used high-resolution image segmentation pipeline, in which an ultra-high resolution image is partitioned into regular patches for local segmentation and then the local results are merged into a high-resolution semantic mask. In particular, we introduce a novel locality-aware context fusion based segmentation model to process local patches, where the relevance between local patch and its various contexts are jointly and complementarily utilized to handle the semantic regions with large variations. Additionally, we present the alternating local enhancement …

Food Computing: Domain Adaptation And Causal Inference, Qing Wang

Dissertations and Theses Collection (Open Access)

This dissertation addresses two challenges in food computing: food recognition and food image-to-recipe retrieval. The main research ideas are: (1) leveraging Large Language Models (LLMs) to augment food image representations to mitigate the combined challenges of domain gaps and data imbalance in fine-grained food recognition; (2) proposing a causal-theory inspired cross-modal representation learning formulation for reducing the bias caused by the emphasis on certain ingredients for cross-modal recipe retrieval; and (3) extending the framework to incorporate multiple confounding factors, particularly ingredients and cooking actions, allows for more comprehensive modeling of the food image-torecipe retrieval problem.

We first explore the challenges …

Navigating Weight Prediction With Diet Diary, Yinxuan Gui, Bin Zhu, Jingjing Chen, Chong-Wah Ngo, Yu-Gang Jiang

Research Collection School Of Computing and Information Systems

Current research in food analysis primarily concentrates on tasks such as food recognition, recipe retrieval and nutrition estimation from a single image. Nevertheless, there is a significant gap in exploring the impact of food intake on physiological indicators (e.g., weight) over time. This paper addresses this gap by introducing the DietDiary dataset, which encompasses daily dietary diaries and corresponding weight measurements of real users. Furthermore, we propose a novel task of weight prediction with a dietary diary that aims to leverage historical food intake and weight to predict future weights. To tackle this task, we propose a model-agnostic time series …

Key Technology Selection And Countermeasures To Promote Full Lifecycle Data Governance, Yuyao Feng, Hongyun Zhang, Pengfei Wang, Jianping Li, Zongben Xu

Bulletin of Chinese Academy of Sciences (Chinese Version)

In recent years, the digital economy, driven by data as a critical element, has developed rapidly. Nevertheless, China’s progress in data factorization and valorization is still at a preliminary stage. The data governance system remains underdeveloped, with numerous challenges and technical issues arising in the full lifecycle governance of data, including supply, circulation, application, and security protection. Against this backdrop, this study analyzes the primary technical bottlenecks encountered during the modernization of China’s data governance framework. By employing bibliometric analysis, patent data analysis, Delphi surveys, and expert opinions, a critical technology list to support the modernization of data governance in …

Themis: Automatic And Efficient Deep Learning System Testing With Strong Fault Detection Capability, Dong Huang, Tsz On Li, Xiaofei Xie, Heming Cui

Research Collection School Of Computing and Information Systems

Deep Learning Systems (DLSs) have been widely applied in safety-critical tasks such as autopilot. However, when a perturbed input is fed into a DLS for inference, the DLS often has incorrect outputs (i.e., faults). DLS testing techniques (e.g., DeepXplore) detect such faults by generating perturbed inputs to explore data flows that induce faults. Since a DLS often has infinitely many data flows, existing techniques require developers to manually specify a set of activation values in a DLS’s neurons for exploring fault-inducing data flows. Unfortunately, recent studies show that such manual effort is tedious and can detect only a tiny proportion …

Retrofitting A Legacy Cutlery Washing Machine Using Computer Vision, Hua Leong Fwa

Research Collection School Of Computing and Information Systems

Industry 4.0, the digitalization of manufacturing promises to lead to lowered cost, efficient processes and even discovery of new business models. However, many of the enterprises have huge investments in legacy machines which are not 'smart'. In this study, we thus designed a cost-efficient solution to retrofit a legacy conveyor belt-based cutlery washing machine with a commodity web camera. We then applied computer vision (using both traditional image processing and deep learning techniques) to infer the speed and utilization of the machine. We detailed the algorithms that we designed for computing both speed andutilization. With the existing operational constraints of …

D2sr: Decentralized Detection, De-Synchronization, And Recovery Of Lidar Interference, Darshana Rathnayake, Hemanth Sabbella, Meera Radhakrishnan, Archan Misra

Research Collection School Of Computing and Information Systems

We address the challenge of multi-LiDAR interference, an issue of growing importance as LiDAR sensors are embedded in a growing set of pervasive devices. We introduce a novel approach named D2SR, enabling decentralized interference detection, mitigation, and recovery without explicit coordination among nearby LiDAR devices. D2SR comprises three stages: (a) Detection, which identifies interfered frames, (b) Mitigation, which performs time-shifting of a LiDAR’s active period to reduce interference, and (c) Recovery, which corrects or reconstructs the depth values in interfered regions of a depth frame. Key contributions include a lightweight interference detection algorithm achieving an F1-score of 92%, a simple …

Architecting Standards: Leveraging Ia To Drive Emerging Technology Standards​, Noreen Y. Whysel

Publications and Research

In this talk for the annual meeting of the W3C Information Architecture Community Group, I discuss how standards bodies can learn from the Information Architecture field to improve accessibility and usability. By adopting user-centered design principles and engaging in iterative feedback loops, standards organizations can create more relevant and practical standards that align with real-world applications. Emphasizing collaboration with industry experts and end-users will help ensure that standards evolve along with technological advancements.

In the meantime, key standards are examined, such as ISO 9241, which provides guidelines for usability and user-centered design, and the W3C's Web Content Accessibility Guidelines (WCAG), …

Fintech Digital Transformation: Generative Ai, Humanoid Robots, Metaverse, Human-Ai Collaboration, And Industry 5.0, Yuxin Liu, Runyu Wang, Keng Siau

Research Collection School Of Computing and Information Systems

This paper discusses the transformative impact of emerging digital technologies on the digital transformation of the financial industry, focusing on integrating Generative AI (GenAI), humanoid robots, and the Metaverse within the framework of Industry 5.0. Industry 5.0 emphasizes a human-centric approach to technology, where human-AI collaboration plays a central role in reshaping financial services. By reviewing both academic research and practical applications, the paper highlights the current advancements in FinTech, particularly in AI technologies and the Metaverse, and their future potential, demonstrating how these innovations are driving growth, efficiency, and resilience in the financial sector. Further, the paper proposes a …

A Two-Stage Matheuristic For The Home Healthcare Routing And Scheduling Problem With Perishable Products, Aldy Gunawan, Nabila Yuraisyah Salsabila, Vincent F. Yu, Pham Kien Minh Nguyen

Research Collection School Of Computing and Information Systems

This study proposes a home healthcare routing and scheduling problem, where perishable products such as medicines, vaccines, or meals must be provided for some patients’ treatments. This problem is formulated as a mixed integer linear programming (MILP). A two-stage matheuristic is then developed as the solution approach. The first stage is a local search to solve the nurse routing problem, and the second stage is run as the relaxed MILP to solve the scheduling problem. The matheuristic is tested on newly generated instances and compared with the results of CPLEX. The proposed matheuristic is able to obtain CPLEX solutions within …