Open Access. Powered by Scholars. Published by Universities.®

Digital Commons Network™

Open Access. Powered by Scholars. Published by Universities.®

Discipline
Institution
Keyword
Publication Year
Publication
Publication Type
File Type

Articles 24721 - 24750 of 713670

Full-Text Articles in Entire DC Network

N-Refined Neutrosophic Twofold Algebra: A Novel Framework For Evaluating Competitiveness In The Power And Electronics Technology Industry, Zhanglan You, Isaac Wasonga Owino, Yuwei Chen Aug 2025

N-Refined Neutrosophic Twofold Algebra: A Novel Framework For Evaluating Competitiveness In The Power And Electronics Technology Industry, Zhanglan You, Isaac Wasonga Owino, Yuwei Chen

Neutrosophic Sets and Systems

No abstract provided.


Neutrosophic Appurtenance-Inclusion Algebra: A Novel Framework For Personalized Product Design Schemes Decision Modeling, Xiaoyan Cong Aug 2025

Neutrosophic Appurtenance-Inclusion Algebra: A Novel Framework For Personalized Product Design Schemes Decision Modeling, Xiaoyan Cong

Neutrosophic Sets and Systems

No abstract provided.


Neutrosophic Rama Distribution With An Application, Maya Singh, Gyan Prakash Singh, Isha Singh Aug 2025

Neutrosophic Rama Distribution With An Application, Maya Singh, Gyan Prakash Singh, Isha Singh

Neutrosophic Sets and Systems

No abstract provided.


A Neutrosophic Genetic Algebraic Model For Financial Risk Evaluation In Technology Innovation Enterprises, Yushan Zhou Aug 2025

A Neutrosophic Genetic Algebraic Model For Financial Risk Evaluation In Technology Innovation Enterprises, Yushan Zhou

Neutrosophic Sets and Systems

No abstract provided.


A Superhyperneutrosophic Statistical Model For Interaction Design In Virtual Reality Art, Xiaobin Guo Aug 2025

A Superhyperneutrosophic Statistical Model For Interaction Design In Virtual Reality Art, Xiaobin Guo

Neutrosophic Sets and Systems

No abstract provided.


Decision On Insurance Policy Selection By Weighted Correlation Approach On Neutrosophic Fuzziness Through Topsis, S. Golui, B. S. Mahapatra, M B. Bera, M. K. Mondal, G. S. Mahapatra Aug 2025

Decision On Insurance Policy Selection By Weighted Correlation Approach On Neutrosophic Fuzziness Through Topsis, S. Golui, B. S. Mahapatra, M B. Bera, M. K. Mondal, G. S. Mahapatra

Neutrosophic Sets and Systems

No abstract provided.


Analysis Of New Development Paths For International Cultural Trade Based On Digitalization: A Neutrosophic Hyperreal Valuation Model (Nhvm), Yan Li, Yu Cao Aug 2025

Analysis Of New Development Paths For International Cultural Trade Based On Digitalization: A Neutrosophic Hyperreal Valuation Model (Nhvm), Yan Li, Yu Cao

Neutrosophic Sets and Systems

No abstract provided.


Neutrosophic Sets And Systems, Vol. 86,2025, Florentin Smarandache, Mohamed Abdel-Basset, Maikel. Leyva Vazquez Aug 2025

Neutrosophic Sets And Systems, Vol. 86,2025, Florentin Smarandache, Mohamed Abdel-Basset, Maikel. Leyva Vazquez

Neutrosophic Sets and Systems

No abstract provided.


Dreamanime: Learning Style-Identity Textual Disentanglement For Anime And Beyond, Chenshu Xu, Yangyang Xu, Huaidong Zhang, Xuemiao Xu, Shengfeng He Aug 2025

Dreamanime: Learning Style-Identity Textual Disentanglement For Anime And Beyond, Chenshu Xu, Yangyang Xu, Huaidong Zhang, Xuemiao Xu, Shengfeng He

Research Collection School Of Computing and Information Systems

Text-to-image generation models have significantly broadened the horizons of creative expression through the power of natural language. However, navigating these models to generate unique concepts, alter their appearance, or reimagine them in unfamiliar roles presents an intricate challenge. For instance, how can we exploit language-guided models to transpose an anime character into a different art style, or envision a beloved character in a radically different setting or role? This paper unveils a novel approach named DreamAnime, designed to provide this level of creative freedom. Using a minimal set of 2-3 images of a user-specified concept such as an anime character …


L3net: Localized And Layered Reparameterization For Incremental Learning, Xuandi Luo, Huaidong Zhang, Yi Xie, Hongrui Zhang, Xuemiao Xu, Shengfeng He Aug 2025

L3net: Localized And Layered Reparameterization For Incremental Learning, Xuandi Luo, Huaidong Zhang, Yi Xie, Hongrui Zhang, Xuemiao Xu, Shengfeng He

Research Collection School Of Computing and Information Systems

Model-based class incremental learning (CIL) methods aim to address the challenge of catastrophic forgetting by retaining certain parameters and expanding the model architecture. However, retaining too many parameters can lead to an overly complex model, increasing inference overhead. Additionally, compressing these parameters to reduce the model size can result in performance degradation. To tackle these challenges, we propose a novel three-stage CIL framework called Localized and Layered Reparameterization for Incremental Learning (L3Net). The rationale behind our approach is to balance model complexity and performance by selectively expanding and optimizing critical components. Specifically, the framework introduces a Localized Dual-path Expansion structure, …


Solving Two-Stage Stochastic Integer Programs Via Representation Learning, Yaoxin Wu, Zhiguang Cao, Wen Song, Yingqian Zhang Aug 2025

Solving Two-Stage Stochastic Integer Programs Via Representation Learning, Yaoxin Wu, Zhiguang Cao, Wen Song, Yingqian Zhang

Research Collection School Of Computing and Information Systems

Solving stochastic integer programs (SIPs) is extremely intractable due to the high computational complexity. To solve two-stage SIPs efficiently, we propose a conditional variational autoencoder (CVAE) for scenario representation learning. A graph convolutional network (GCN) based VAE embeds scenarios into a low-dimensional latent space, conditioned on the deterministic context of each instance. With the latent representations of stochastic scenarios, we perform two auxiliary tasks: objective prediction and scenario contrast, which predict scenario objective values and the similarities between them, respectively. These tasks further integrate objective information into the representations through gradient backpropagation. Experiments show that the learned scenario representations can …


Focus: Evaluating Pre-Trained Vision-Language Models On Underspecification Reasoning, Kankan Zhou, Yibin Lai, Kyriakos Mouratidis, Jing Jiang Aug 2025

Focus: Evaluating Pre-Trained Vision-Language Models On Underspecification Reasoning, Kankan Zhou, Yibin Lai, Kyriakos Mouratidis, Jing Jiang

Research Collection School Of Computing and Information Systems

Humans possess a remarkable ability to interpret underspecified ambiguous statements by inferring their meanings from contexts such as visual inputs. This ability, however, may not be as developed in recent pre-trained visionlanguage models (VLMs). In this paper, we introduce a novel probing dataset called FOCUS to evaluate whether state-of-the-art VLMs have this ability. FOCUS consists of underspecified sentences paired with image contexts and carefully designed probing questions. Our experiments reveal that VLMs still fall short in handling underspecification even when visual inputs that can help resolve the ambiguities are available. To further support research in underspecification, FOCUS will be released …


Cami: A Counselor Agent Supporting Motivational Interviewing Through State Inference And Topic Exploration, Yizhe Yang, Palakorn Achananuparp, Heyan Huang, Jing Jiang, Phey Ling Kit, Nicholas Gabriel Lim, Cameron Shi Ern Tan, Ee-Peng Lim Aug 2025

Cami: A Counselor Agent Supporting Motivational Interviewing Through State Inference And Topic Exploration, Yizhe Yang, Palakorn Achananuparp, Heyan Huang, Jing Jiang, Phey Ling Kit, Nicholas Gabriel Lim, Cameron Shi Ern Tan, Ee-Peng Lim

Research Collection School Of Computing and Information Systems

Conversational counselor agents have become essential tools for addressing the rising demand for scalable and accessible mental health support. This paper introduces CAMI, a novel automated counselor agent grounded in Motivational Interviewing (MI) – a client-centered counseling approach designed to address ambivalence and facilitate behavior change. CAMI employs a novel STAR framework, consisting of client’s state inference, motivation topic exploration, and response generation modules, leveraging large language models (LLMs). These components work together to evoke change talk, aligning with MI principles and improving counseling outcomes for diverse clients. We evaluate CAMI’s performance through both automated and expert evaluations, utilizing simulated …


How To Enable Effective Cooperation Between Humans And Nlp Models: A Survey Of Principles, Formalizations, And Beyond, Chen Huang, Yang Deng, Wenqiang Lei, Jiancheng Lv, Tat-Seng Chua, Jimmy Huang Aug 2025

How To Enable Effective Cooperation Between Humans And Nlp Models: A Survey Of Principles, Formalizations, And Beyond, Chen Huang, Yang Deng, Wenqiang Lei, Jiancheng Lv, Tat-Seng Chua, Jimmy Huang

Research Collection School Of Computing and Information Systems

With the advancement of large language models (LLMs), intelligent models have evolved from mere tools to autonomous agents with their own goals and strategies for cooperating with humans. This evolution has birthed a novel paradigm in NLP, i.e., human-model cooperation, that has yielded remarkable progress in numerous NLP tasks in recent years. In this paper, we take the first step to present a thorough review of human-model cooperation, exploring its principles, formalizations, and open challenges. In particular, we introduce a new taxonomy that provides a unified perspective to summarize existing approaches. Also, we discuss potential frontier areas and their corresponding …


Evowiki: Evaluating Llms On Evolving Knowledge, Wei Tang, Yixin Cao, Yang Deng, Jiahao Ying, Bo Wang, Yizhe Yang, Yuyue Zhao, Qi Zhang, Xuanjing Huang, Yu-Gang Jiang, Yong Liao Aug 2025

Evowiki: Evaluating Llms On Evolving Knowledge, Wei Tang, Yixin Cao, Yang Deng, Jiahao Ying, Bo Wang, Yizhe Yang, Yuyue Zhao, Qi Zhang, Xuanjing Huang, Yu-Gang Jiang, Yong Liao

Research Collection School Of Computing and Information Systems

Knowledge utilization is a critical aspect of LLMs, and understanding how they adapt to evolving knowledge is essential for their effective deployment. However, existing benchmarks are predominantly static, failing to capture the evolving nature of LLMs and knowledge, leading to inaccuracies and vulnerabilities such as contamination. In this paper, we introduce EvoWiki, an evolving dataset designed to reflect knowledge evolution by categorizing information into stable, evolved, and uncharted states. EvoWiki is fully auto-updated, enabling precise evaluation of continuously changing knowledge and newly released LLMs. Through experiments with Retrieval-Augmented Generation (RAG) and Continual Learning (CL), we evaluate how effectively LLMs adapt …


Fact-Audit: An Adaptive Multi-Agent Framework For Dynamic Fact-Checking Evaluation Of Large Language Models, Hongzhan Lin, Yang Deng, Yuxuan Gu, Wenxuan Zhang, Jing Ma, See-Kiong Ng, Tat-Seng Chua Aug 2025

Fact-Audit: An Adaptive Multi-Agent Framework For Dynamic Fact-Checking Evaluation Of Large Language Models, Hongzhan Lin, Yang Deng, Yuxuan Gu, Wenxuan Zhang, Jing Ma, See-Kiong Ng, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

Large Language Models (LLMs) have significantly advanced the fact-checking studies. However, existing automated fact-checking evaluation methods rely on static datasets and classification metrics, which fail to automatically evaluate the justification production and uncover the nuanced limitations of LLMs in fact-checking. In this work, we introduce FACT-AUDIT, an agent-driven framework that adaptively and dynamically assesses LLMs’ fact-checking capabilities. Leveraging importance sampling principles and multi-agent collaboration, FACT-AUDIT generates adaptive and scalable datasets, performs iterative model-centric evaluations, and updates assessments based on model-specific responses. By incorporating justification production alongside verdict prediction, this framework provides a comprehensive and evolving audit of LLMs’ factual reasoning …


Non-Homophilic Graph Pre-Training And Prompt Learning, Xingtong Yu, Jie Zhang, Yuan Fang, Renhe Jiang Aug 2025

Non-Homophilic Graph Pre-Training And Prompt Learning, Xingtong Yu, Jie Zhang, Yuan Fang, Renhe Jiang

Research Collection School Of Computing and Information Systems

Graphs are ubiquitous for modeling complex relationships between objects across various fields. Graph neural networks (GNNs) have become a mainstream technique for graph-based applications, but their performance heavily relies on abundant labeled data. To reduce labeling requirement, pre-training and prompt learning has become a popular alternative. However, most existing prompt methods do not distinguish between homophilic and heterophilic characteristics in graphs. In particular, many real-world graphs are non-homophilic-neither strictly nor uniformly homophilic-as they exhibit varying homophilic and heterophilic patterns across graphs and nodes. In this paper, we propose ProNoG, a novel pre-training and prompt learning framework for such non-homophilic graphs. …


Coleclip: Open-Domain Continual Learning Via Joint Task Prompt And Vocabulary Learning, Yukun Li, Guansong Pang, Wei Suo, Chenchen Chen, Yuling Xi, Lingqiao Liu, Hao Chen, Guoqiang Liang, Peng Wang Aug 2025

Coleclip: Open-Domain Continual Learning Via Joint Task Prompt And Vocabulary Learning, Yukun Li, Guansong Pang, Wei Suo, Chenchen Chen, Yuling Xi, Lingqiao Liu, Hao Chen, Guoqiang Liang, Peng Wang

Research Collection School Of Computing and Information Systems

This article investigates the problem of continual learning (CL) of vision-language models (VLMs) in open domains, where models are required to perform continual updating and inference on a stream of datasets from diverse seen and unseen domains with novel classes. Such a capability is crucial for various applications in open environments, e.g., AI assistants, autonomous driving systems, and robotics. Current CL studies mostly focus on closed-set scenarios in a single domain with known classes. Large pretrained VLMs such as CLIP have showcased exceptional zero-shot recognition capabilities, and several recent studies have leveraged the unique characteristics of VLMs to mitigate catastrophic …


Bhvit: Binarized Hybrid Vision Transformer, Tian Gao, Yu Zhang, Zhiyuan Zhang, Huajun Liu, Kaijie Yin, Chengzhong Xu, Hui Kong Aug 2025

Bhvit: Binarized Hybrid Vision Transformer, Tian Gao, Yu Zhang, Zhiyuan Zhang, Huajun Liu, Kaijie Yin, Chengzhong Xu, Hui Kong

Research Collection School Of Computing and Information Systems

Model binarization has made significant progress in enabling real-time and energy-efficient computation for con-volutional neural networks (CNN), offering a potential solution to the deployment challenges faced by Vision Transformers (ViTs) on edge devices. However, due to the structural differences between CNN and Transformer architectures, simply applying binary CNN strategies to the ViT models will lead to a significant performance drop. To tackle this challenge, we propose BHViT, a binarization-friendly hybrid ViT architecture and its full binarization model with the guidance of three important observations. Initially, BHViT utilizes the local information interaction and hierarchical feature aggregation technique from coarse to fine …


A Comprehensive Analysis Of Evolving Permission Usage In Android Apps: Trends, Threats, And Ecosystem Insights, Ali Alkinoon, Trung Cuong Dang, Ahod Alghuried, Abdulaziz Alghamdi, Soohyeon Choi, Manar Mohaisen, An Wang, Saeed Salem, David Mohaisen Aug 2025

A Comprehensive Analysis Of Evolving Permission Usage In Android Apps: Trends, Threats, And Ecosystem Insights, Ali Alkinoon, Trung Cuong Dang, Ahod Alghuried, Abdulaziz Alghamdi, Soohyeon Choi, Manar Mohaisen, An Wang, Saeed Salem, David Mohaisen

Research Collection School Of Computing and Information Systems

The proper use of Android app permissions is crucial to the success and security of these apps. Users must agree to permission requests when installing or running their apps. Despite official Android platform documentation on proper permission usage, there are still many cases of permission abuse. This study provides a comprehensive analysis of the Android permission landscape, highlighting trends and patterns in permission requests across various applications from the Google Play Store. By distinguishing between benign and malicious applications, we uncover developers’ evolving strategies, with malicious apps increasingly requesting fewer permissions to evade detection, while benign apps request more to …


Other Orienteering Problem Variants, Pieter Vansteenwegen, Aldy Gunawan Aug 2025

Other Orienteering Problem Variants, Pieter Vansteenwegen, Aldy Gunawan

Research Collection School Of Computing and Information Systems

In this chapter, different variants of routing problems with profits will be discussed. Based on what is available in literature, mostly variants of the orienteering problem will be discussed. A first variant considers capacity constraints, since these appear frequently in many practical applications. Next, multi-objective orienteering problems, explicitly considering different types of profits separately are discussed. Time-dependent and stochastic travel times are also relevant for most practical applications. These are considered together with time-dependent and stochastic profits. More and more routing problems are considered together with inventory management. For routing problems with profits, this leads to the inventory orienteering problem, …


Optimal Transport Alignment Of User Preferences From Ratings And Texts, Nhu Thuat Tran, Hady Wirawan Lauw Aug 2025

Optimal Transport Alignment Of User Preferences From Ratings And Texts, Nhu Thuat Tran, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Modeling hidden factors driving user preferences is crucial for recommendation yet challenging due to sparse rating data. While aligning preference factors from ratings and texts, as a solution, shows improvements, existing methods impose restrictive one-to-one factor correspondences and underutilize cross-modal interest signals. We propose an optimal transport (OT) approach to address these gaps. By modeling rating- and text-based preference factors as distributions, we compute an OT plan that captures their probabilistic relationships. This plan serves dual roles: 1) to regularize cross-modal preference factors without rigid correspondence assumptions, and 2) to blend preference signals across modalities through barycentric mapping. Experiments on …


Analysis Of Extended Producer Responsibility In E-Waste Management: Policy Drivers And Challenges In Singapore, Aldy Gunawan, Aidan Marc Wong, Tasaporn Visawameteekul, Minh Phuong Huynh, Linh Chi Tran Aug 2025

Analysis Of Extended Producer Responsibility In E-Waste Management: Policy Drivers And Challenges In Singapore, Aldy Gunawan, Aidan Marc Wong, Tasaporn Visawameteekul, Minh Phuong Huynh, Linh Chi Tran

Research Collection School Of Computing and Information Systems

This paper examines the role of the Extended Producer Responsibility (EPR) scheme in electronic waste (e-waste) management in Singapore. It investigates the policy drivers and challenges of e-waste management, using data from an online survey to explore the attitudes and behaviors of young consumers, with a particular focus on youth. We employ the Theory of Reasoned Action (TRA) and the Theory of Planned Behavior (TPB) frameworks to develop a model that examines the relationships among attitudes, perceived norms, awareness, and perceived convenience in relation to EPR awareness and perception. The findings highlight the need for customized policies tailored to different …


Explainable Multimodal Sentiment Analysis Of Social Media Visual Content For Child Safety, Yee Sen Tan, Zhaoxia Wang Aug 2025

Explainable Multimodal Sentiment Analysis Of Social Media Visual Content For Child Safety, Yee Sen Tan, Zhaoxia Wang

Research Collection School Of Computing and Information Systems

Ensuring the safety and well-being of children is increasingly important, especially in a world where visual content is pervasive. This paper proposes a novel multimodal, multilingual, and multiclass sentiment analysis method for social media content, aimed at improving content moderation for child safety. Our approach integrates textual, visual, and audio data from videos, categorizing sentiment into four levels: positive, slightly negative, negative, and strongly negative, enabling granular detection of harmful content. To enhance explainability and trust, we also leverage interpretable mechanisms to analyze the contributions of each modality. Evaluation of our method demonstrates strong generalization across diverse video types, and …


Information-Theoretic Detection Of Unusual Source Code Changes, Adriano Torres, Markus Wagner, Christoph Treude, Sebastian Baltes Aug 2025

Information-Theoretic Detection Of Unusual Source Code Changes, Adriano Torres, Markus Wagner, Christoph Treude, Sebastian Baltes

Research Collection School Of Computing and Information Systems

The code base of software projects evolves essentially through inserting and removing information to and from the source code. We can measure this evolution via the elements of information—tokens, words, nodes—of the respective representation of the code. In this work, we approach the measurement of the information content of the source code of open-source projects from an information-theoretic standpoint. Our focus is on the entropy of two fundamental representations of code: tokens and abstract syntax tree nodes, from which we derive definitions of textual and structural entropy. We proceed with an empirical assessment where we evaluate the evolution patterns of …


Leveraging Reviewer Experience In Code Review Comment Generation, Hong Yi Lin, Patanamon Thongtanunam, Christoph Treude, Michael W. Godfrey, Chunhua Liu, Wachiraphan Charoenwet Aug 2025

Leveraging Reviewer Experience In Code Review Comment Generation, Hong Yi Lin, Patanamon Thongtanunam, Christoph Treude, Michael W. Godfrey, Chunhua Liu, Wachiraphan Charoenwet

Research Collection School Of Computing and Information Systems

Modern code review is a ubiquitous software quality assurance process aimed at identifying and resolving potential issues (e.g., functional, evolvability) within newly written code. Despite its effectiveness, the process demands large amounts of effort from the human reviewers involved. To help alleviate this workload, researchers have trained various deep learning based language models to imitate human reviewers in providing natural language code reviews for submitted code. Formally, this automation task is known as code review comment generation. Prior work has demonstrated improvements in code review comment generation by leveraging machine learning techniques and neural models, such as transfer learning and …


Eformer: An Effective Edge-Based Transformer For Vehicle Routing Problems, Dian Meng, Zhiguang Cao, Yaoxin Wu, Yaqing Hou, Hongwei Ge, Qiang Zhang Aug 2025

Eformer: An Effective Edge-Based Transformer For Vehicle Routing Problems, Dian Meng, Zhiguang Cao, Yaoxin Wu, Yaqing Hou, Hongwei Ge, Qiang Zhang

Research Collection School Of Computing and Information Systems

Recent neural heuristics for the Vehicle Routing Problem (VRP) primarily rely on node coordinates as input, which may be less effective in practical scenarios where real cost metrics--such as edge-based distances--are more relevant. To address this limitation, we introduce EFormer, an Edge-based Transformer model that uses edge as the sole input for VRPs. Our approach employs a precoder module with a mixed-score attention mechanism to convert edge information into temporary node embeddings. We also present a parallel encoding strategy characterized by a graph encoder and a node encoder, each responsible for processing graph and node embeddings in distinct feature spaces, …


Graph Positional Autoencoders As Self-Supervised Learners, Yang Liu, Deyu Bo, Wenxuan Cao, Yuan Fang, Yawen Li, Chuan Shi Aug 2025

Graph Positional Autoencoders As Self-Supervised Learners, Yang Liu, Deyu Bo, Wenxuan Cao, Yuan Fang, Yawen Li, Chuan Shi

Research Collection School Of Computing and Information Systems

Graph self-supervised learning seeks to learn effective graph representations without relying on labeled data. Among various approaches, graph autoencoders (GAEs) have gained significant attention for their efficiency and scalability. Typically, GAEs take incomplete graphs as input and predict missing elements, such as masked node features or edges. Although effective, our experimental investigation reveals that traditional feature or edge masking paradigms primarily capture low-frequency signals in the graph and fail to learn expressive structural information. To address these issues, we propose Graph Positional Autoencoders (GraphPAE), which employ a dual-path architecture to reconstruct both node features and positions. Specifically, the feature path …


Connecting Giants: Synergistic Knowledge Transfer Of Large Multimodal Models For Few-Shot Learning, Hao Tang, Shengfeng He, Jing Qin Aug 2025

Connecting Giants: Synergistic Knowledge Transfer Of Large Multimodal Models For Few-Shot Learning, Hao Tang, Shengfeng He, Jing Qin

Research Collection School Of Computing and Information Systems

Few-shot learning (FSL) addresses the challenge of classifying novel classes with limited training samples. While some methods leverage semantic knowledge from smaller-scale models to mitigate data scarcity, these approaches often introduce noise and bias due to the data's inherent simplicity. In this paper, we propose a novel framework, Synergistic Knowledge Transfer (SYNTRANS), which effectively transfers diverse and complementary knowledge from large multimodal models to empower the off-the-shelf few-shot learner. Specifically, SYNTRANS employs CLIP as a robust teacher and uses a few-shot vision encoder as a weak student, distilling semantic-aligned visual knowledge via an unsupervised proxy task. Subsequently, a training-free synergistic …


Xfinbench: Benchmarking Llms In Complex Financial Problem Solving And Reasoning, Zhihan Zhang, Yixin Cao, Lizi Liao Aug 2025

Xfinbench: Benchmarking Llms In Complex Financial Problem Solving And Reasoning, Zhihan Zhang, Yixin Cao, Lizi Liao

Research Collection School Of Computing and Information Systems

Solving financial problems demands complex reasoning, multimodal data processing, and a broad technical understanding, presenting unique challenges for current large language models (LLMs). We introduce **XFinBench**, a novel benchmark with 4,235 examples designed to evaluate LLM’s ability in solving comple**X**, knowledge-intensive **Fin**ancial problems across diverse graduate-level finance topics with multi-modal context. We identify five core capabilities of LLMs using XFinBench, i.e., _terminology understanding_, _temporal reasoning_, _future forecasting_, _scenario planning_, and _numerical modelling_. Upon XFinBench, we conduct extensive experiments on 18 leading models. The result shows that o1 is the best-performing text-only model with an overall accuracy of 67.3%, but still …