Open Access. Powered by Scholars. Published by Universities.®

Digital Commons Network™

Open Access. Powered by Scholars. Published by Universities.®

Singapore Management University

Discipline
Keyword
Publication Year
Publication
Publication Type
File Type

Articles 751 - 780 of 10054

Full-Text Articles in Entire DC Network

Rethinking Light Decoder-Based Solvers For Vehicle Routing Problems, Ziwei Huang, Jianan Zhou, Zhiguang Cao, Yixin Xu Apr 2025

Rethinking Light Decoder-Based Solvers For Vehicle Routing Problems, Ziwei Huang, Jianan Zhou, Zhiguang Cao, Yixin Xu

Research Collection School Of Computing and Information Systems

Light decoder-based solvers have gained popularity for solving vehicle routing problems (VRPs) due to their efficiency and ease of integration with reinforcement learning algorithms. However, they often struggle with generalization to larger problem instances or different VRP variants. This paper revisits light decoder-based approaches, analyzing the implications of their reliance on static embeddings and the inherent challenges that arise. Specifically, we demonstrate that in the light decoder paradigm, the encoder is implicitly tasked with capturing information for all potential decision scenarios during solution construction within a single set of embeddings, resulting in high information density. Furthermore, our empirical analysis reveals …


Rethinking Neural Multi-Objective Combinatorial Optimization Via Neat Weight Embedding, Jinbiao Chen, Zhiguang Cao, Jiahai Wang, Yaoxin Wu, Hanzhang Qin, Zizhen Zhang, Yue-Jiao Gong Apr 2025

Rethinking Neural Multi-Objective Combinatorial Optimization Via Neat Weight Embedding, Jinbiao Chen, Zhiguang Cao, Jiahai Wang, Yaoxin Wu, Hanzhang Qin, Zizhen Zhang, Yue-Jiao Gong

Research Collection School Of Computing and Information Systems

Recent decomposition-based neural multi-objective combinatorial optimization (MOCO) methods struggle to achieve desirable performance. Even equipped with complex learning techniques, they often suffer from significant optimality gaps in weight-specific subproblems. To address this challenge, we propose a neat weight embedding method to learn weight-specific representations, which captures weight-instance interaction for the subproblems and was overlooked by most current methods. We demonstrate the potentials of our method in two instantiations. First, we introduce a succinct addition model to learn weight-specific node embeddings, which surpassed most existing neural methods. Second, we design an enhanced conditional attention model to simultaneously learn the weight embedding …


Learning-Guided Bi-Objective Evolutionary Optimization For Green Municipal Waste Collection Vehicle Routing, Shubing Liao, Yixin Xu, Yunyun Niu, Zhiguang Cao Apr 2025

Learning-Guided Bi-Objective Evolutionary Optimization For Green Municipal Waste Collection Vehicle Routing, Shubing Liao, Yixin Xu, Yunyun Niu, Zhiguang Cao

Research Collection School Of Computing and Information Systems

Waste management has emerged as a critical issue in modern society, where vehicles are scheduled to visit multiple locations for waste collection and transport. This study focuses on a key problem in waste management: route optimization of waste collection vehicles, and formulate it as a bi-objective vehicle routing problem with stochastic demand (VRPSD), aiming to minimizing both total costs and carbon emissions. Although previous studies have significantly advanced our understanding of solving similar problems, the lack of real-world data and limited problem-solving capabilities still restrict the practical applicability of existing methods. To bridge this research gap, this study designed a …


Llm-Enhanced Multiple Instance Learning For Joint Rumor And Stance Detection With Social Context Information, Ruichao Yang, Jing Ma, Wei Gao, Hongzhan Lin Apr 2025

Llm-Enhanced Multiple Instance Learning For Joint Rumor And Stance Detection With Social Context Information, Ruichao Yang, Jing Ma, Wei Gao, Hongzhan Lin

Research Collection School Of Computing and Information Systems

The proliferation of misinformation, such as rumors on social media, has drawn significant attention, prompting various expressions of stance among users. Although rumor detection and stance detection are distinct tasks, they can complement each other. Rumors can be identified by cross-referencing stances in related posts, and stances are influenced by the nature of the rumor. However, existing stance detection methods often require post-level stance annotations, which are costly to obtain. We propose a novel LLM-enhanced Multiple Instance Learning (MIL) approach to jointly predict post stance and claim class labels, supervised solely by claim labels, using an undirected microblog propagation model. …


Dps: Design Pattern Summarisation Using Code Features, Najam Nazar, Sameer Sikka, Christoph Treude Apr 2025

Dps: Design Pattern Summarisation Using Code Features, Najam Nazar, Sameer Sikka, Christoph Treude

Research Collection School Of Computing and Information Systems

Automatic summarisation has been used efficiently in recent years to condense texts, conversations, audio, code, and various other artefacts. A range of methods, from simple template-based summaries to complex machine learning techniques -- and more recently, large language models -- have been employed to generate these summaries. Summarising software design patterns is important because it helps developers quickly understand and reuse complex design concepts, thereby improving software maintainability and development efficiency. However, the generation of summaries for software design patterns has not yet been explored.Our approach utilises code features and JavaParser to parse the code and create a JSON representation. …


Context-Aware Representation: Jointly Learning Item Features And Selection From Triplets, Rodrigo Alves, Antoine Ledent Apr 2025

Context-Aware Representation: Jointly Learning Item Features And Selection From Triplets, Rodrigo Alves, Antoine Ledent

Research Collection School Of Computing and Information Systems

In areas of machine learning such as cognitive modeling or recommendation, user feedback is usually context-dependent. For instance, a website might provide a user with a set of recommendations and observe which (if any) of the links were clicked by the user. Similarly, there is growing interest in the so-called “odd-one-out” learning setting, where human participants are provided with a basket of items and asked which is the most dissimilar to the others. In both of those cases, the presence of all the items in the basket can influence the final decision. In this article, we consider a classification task …


Predictive Modelling For Vessel Traffic Flow: A Comprehensive Survey From Statistics To Ai, Deshan. Chen, Chen. Huang, Tengze. Fan, Hoong Chuin Lau, Xinping. Yan Apr 2025

Predictive Modelling For Vessel Traffic Flow: A Comprehensive Survey From Statistics To Ai, Deshan. Chen, Chen. Huang, Tengze. Fan, Hoong Chuin Lau, Xinping. Yan

Research Collection School Of Computing and Information Systems

Recognizing the specific complexities of vessel traffic flow, this comprehensive survey exclusively addresses the predictive modelling in maritime transportation, tracing the evolution from conventional statistical approaches to modern artificial intelligence (AI) techniques. The survey examines a broad range of predictive targets, including vessel volume, trajectories, velocities, destinations and traffic patterns. Through bibliometric analysis utilizing Citespace, the central research themes and technological trends characterizing the vessel traffic flow prediction domain have been identified and discussed. Our analysis indicates a clear trend towards AI-based models, highlighting their increasing dominance in enhancing predictive accuracy and efficiency. Additionally, we highlight persistent challenges, such as …


Open-Set Graph Anomaly Detection Via Normal Structure Regularisation, Qizhou Wang, Guansong Pang, Mahsa Salehi, Xiaokun Xia, Christopher Leckie Apr 2025

Open-Set Graph Anomaly Detection Via Normal Structure Regularisation, Qizhou Wang, Guansong Pang, Mahsa Salehi, Xiaokun Xia, Christopher Leckie

Research Collection School Of Computing and Information Systems

This paper considers an important Graph Anomaly Detection (GAD) task, namely open-set GAD, which aims to train a detection model using a small number of normal and anomaly nodes (referred to as *seen anomalies*) to detect both seen anomalies and *unseen anomalies* (*i.e*., anomalies that cannot be illustrated the training anomalies). Those labelled training data provide crucial prior knowledge about abnormalities for GAD models, enabling substantially reduced detection errors. However, current supervised GAD methods tend to over-emphasise fitting the seen anomalies, leading to many errors of detecting the unseen anomalies as normal nodes. Further, existing open-set AD models were introduced …


A Functional Software Reference Architecture For Llm-Integrated Systems, Alessio Bucaioni, Martin Weyssow, Junda He, Yunbo Lyu, David Lo Apr 2025

A Functional Software Reference Architecture For Llm-Integrated Systems, Alessio Bucaioni, Martin Weyssow, Junda He, Yunbo Lyu, David Lo

Research Collection School Of Computing and Information Systems

The integration of large language models into software systems is transforming capabilities such as natural language understanding, decision-making, and autonomous task execution. However, the absence of a commonly accepted software reference architecture hinders systematic reasoning about their design and quality attributes. This gap makes it challenging to address critical concerns like privacy, security, modularity, and interoperability, which are increasingly important as these systems grow in complexity and societal impact. In this paper, we describe our emerging results for a preliminary functional reference architecture as a conceptual framework to address these challenges and guide the design, evaluation, and evolution of large …


Enhancing Llm-Based Coding Tools Through Native Integration Of Ide-Derived Static Context, Yichen Li, Yun Peng, Yintong Huo, R. Michael Lyu Apr 2025

Enhancing Llm-Based Coding Tools Through Native Integration Of Ide-Derived Static Context, Yichen Li, Yun Peng, Yintong Huo, R. Michael Lyu

Research Collection School Of Computing and Information Systems

Large Language Models (LLMs) have achieved remarkable success in code completion, as evidenced by their essential roles in developing code assistant services such as Copilot. Being trained on in-file contexts, current LLMs are quite effective in completing code for single source files. However, it is challenging for them to conduct repository-level code completion for large software projects that require cross-file information. Existing research on LLM-based repository-level code completion identifies and integrates cross-file contexts, but it suffers from low accuracy and limited context length of LLMs. In this paper, we argue that Integrated Development Environments (IDEs) can provide direct, accurate and …


On Minimizing Adversarial Counterfactual Error In Adversarial Reinforcement Learning, Roman Belaire, Arunesh Sinha, Pradeep Varakantham Apr 2025

On Minimizing Adversarial Counterfactual Error In Adversarial Reinforcement Learning, Roman Belaire, Arunesh Sinha, Pradeep Varakantham

Research Collection School Of Computing and Information Systems

Deep Reinforcement Learning (DRL) policies are highly susceptible to adversarial noise in observations, which poses significant risks in safety-critical scenarios. The challenge inherent to adversarial perturbations is that by altering the information observed by the agent, the state becomes only partially observable. Existing approaches address this by either enforcing consistent actions across nearby states or maximizing the worst-case value within adversarially perturbed observations. However, the former suffers from performance degradation when attacks succeed, while the latter tends to be overly conservative, leading to suboptimal performance in benign settings. We hypothesize that these limitations stem from their failing to account for …


Building Skills Now For Asean’S Future, Shoeb Kagda Mar 2025

Building Skills Now For Asean’S Future, Shoeb Kagda

Asian Management Insights

Upskilling of workers is critical for building a more resilient workforce and future-proofing economic growth. Upskilling has become a buzzword for governments across the region as they gear up to boost economic growth and improve productivity. A confluence of factors such as digitalisation, automation, and artificial intelligence is heralding a new age where these elements have become powerful drivers of economic success. There is enormous potential for Southeast Asia, which is home to the third largest labour force in the world and has a relatively young population, to upskill its workers. Historically a region that has depended on low-skilled manufacturing …


Wingspan: Taking Digital Learning To New Heights, Adam Tatarynowicz, Wee-Kiat Lim, Mahima Rao-Kachroo Mar 2025

Wingspan: Taking Digital Learning To New Heights, Adam Tatarynowicz, Wee-Kiat Lim, Mahima Rao-Kachroo

Asian Management Insights

How an internal learning platform became a market success. Launched in April 2018, the learning experience platform (LXP) Wingspan was the brainchild of Infosys Co-Founder and Chairman Nandan Nilekani. He had observed that several critical trends were reshaping the world economy. For instance, digital natives were increasingly expecting the learning environment at their workplace to be available 24/7. The late 2000s were also a time when Infosys’ corporate clients had just started on their digital transformation journey. Hence, capturing talent and market share was a strategic priority for the company. In contrast, the learning delivery landscape at Infosys then was …


Why Ai’S Role In Advancing Sustainability Is Underestimated, Lipika Bhattacharya Mar 2025

Why Ai’S Role In Advancing Sustainability Is Underestimated, Lipika Bhattacharya

CCX Research

AI has quietly, but powerfully, woven itself into the fabric of our everyday lives. Yet, AI's potential impact on creating a more sustainable world is undervalued. The author examined artificial intelligence's (AI) role in advancing sustainability. She outlined how AI can be applied in various domains such as agriculture, water management, industry, urban planning, and biodiversity conservation for transformative effects.


Csr As Hedging Against Institutional Transition Risk: Corporate Philanthropy After The Sunflower Movement In Taiwan, Yishu Cai, Lori Yue, Fangwen Lin, Shipeng Yan, Haibin Yang Mar 2025

Csr As Hedging Against Institutional Transition Risk: Corporate Philanthropy After The Sunflower Movement In Taiwan, Yishu Cai, Lori Yue, Fangwen Lin, Shipeng Yan, Haibin Yang

Research Collection Lee Kong Chian School Of Business

Firms with political connections to a regime with an authoritarian history face a dilemma when the regime undergoes a democratic transition. Such connections provide an essential competitive advantage when the regime is in power but become a liability when an institutional transition brings democratic change. This study theorizes that when mass protests expose a regime’s distorted policies favoring elites over others and signal a high probability of regime turnover, firms may hedge against the risks associated with their political connections by engaging in philanthropy. We further contend that this effect is stronger for firms located in regions characterized by the …


A Contrastive Framework With User, Item And Review Alignment For Recommendation, Viet Hoang Dong, Yuan Fang, Hady Wirawan Lauw Mar 2025

A Contrastive Framework With User, Item And Review Alignment For Recommendation, Viet Hoang Dong, Yuan Fang, Hady Wirawan Lauw

Research Collection School Of Computing and Information Systems

Learning effective latent representations for users and items is the cornerstone of recommender systems. Traditional approaches rely on user-item interaction data to map users and items into a shared latent space, but the sparsity of interactions often poses challenges. While leveraging user reviews could mitigate this sparsity, existing review-aware recommendation models often exhibit two key limitations. First, they typically rely on reviews as additional features, but reviews are not universal, with many users and items lacking them. Second, such approaches do not integrate reviews into the useritem space, leading to potential divergence or inconsistency among user, item, and review representations. …


Unexpected Defaults: The Role Of Information Opacity, Aytekin Ertan, Yun Lee, Regina Wittenberg-Moerman Mar 2025

Unexpected Defaults: The Role Of Information Opacity, Aytekin Ertan, Yun Lee, Regina Wittenberg-Moerman

Research Collection School Of Accountancy

Bond defaults are undesirable yet natural outcomes of risky investments. What is also crucial but hitherto underexplored is the unexpectedness of defaults. We develop a parsimonious measure of default unexpectedness and highlight its economic importance by demonstrating that unexpected defaults are associated with unfavorable recovery outcomes and adverse price changes in peer firm bonds. We then examine how default unexpectedness relates to information opacity. We find that firms with opaque financial reporting and weak voluntary disclosure experience more unexpected defaults. Defaults also occur more unexpectedly when the external information environment is opaque—when rating agencies disagree on a firm’s credit risk …


Neurovig: Integrating Event Cameras For Resource-Efficient Video Grounding, Dulanga Weerakoon, Vigneshwaran Subbaraju, Joo Hwee Lim, Archan Misra Mar 2025

Neurovig: Integrating Event Cameras For Resource-Efficient Video Grounding, Dulanga Weerakoon, Vigneshwaran Subbaraju, Joo Hwee Lim, Archan Misra

Research Collection School Of Computing and Information Systems

Spatio-Temporal Video Grounding (STVG) - the task of identifying the target object in the field-of-view that the language instruction refers to - is a fundamental vision-language task. Current STVG approaches typically utilize feeds from an RGB camera that is assumed to be always-on and process the video frames using complex neural network pipelines. As a result they often impose prohibitive system overheads (energy latency) on pervasive devices. To address this we propose NeuroViG with two key innovations: (a) leveraging on event streams from a low-power neuromorphic event camera sensor to perform selective triggering of the more energy-hungry RGB camera for …


Unlocking The Potential Of Black-Box Pre-Trained Gnns For Graph Few-Shot Learning, Qiannan Zhang, Shichao Pei, Yuan Fang, Xiangliang Zhang Mar 2025

Unlocking The Potential Of Black-Box Pre-Trained Gnns For Graph Few-Shot Learning, Qiannan Zhang, Shichao Pei, Yuan Fang, Xiangliang Zhang

Research Collection School Of Computing and Information Systems

Few-shot learning has emerged as an important problem on graphs to combat label scarcity, which can be approached by current trends in pre-trained graph neural networks (GNNs) and meta-learning. Recent efforts integrate both paradigms in a white-box setting, leaving the more realistic black-box setting largely underexplored, where the parameters and gradients in the pre-trained GNNs are inaccessible. In this paper, we study the critical problem: Leveraging black-box pre-trained GNNs for graph few-shot learning. Despite its appeal, two key issues hinder the unlocking of its potential: the inherent task gap between pre-training and downstream stages, which can introduce irrelevant knowledge and …


Mimic: Ai And Ar-Enhanced Multi-Modal, Immersive, Relative Instruction Comprehension, Dhanuja Wanniarachchi, Archan Misra Mar 2025

Mimic: Ai And Ar-Enhanced Multi-Modal, Immersive, Relative Instruction Comprehension, Dhanuja Wanniarachchi, Archan Misra

Research Collection School Of Computing and Information Systems

We present a multimodal instruction comprehension framework, called MImIC, that utilizes visual sensing (including LIDAR and 2D RGB sensing) & AI spatial reasoning capabilities to support more seamless and immersive interaction between humans and AI-driven situated assistive agents. MImIC's key new capability is to support disambiguation of a wider set of relative spatial references that users naturally employ while issuing spatially-situated instructions. To support enhanced visual grounding via a combination of both fully-qualified and relative attribute references, MImIC uses (a) a fine-tuned transformer-based language translation DNN to accurately convert natural verbal commands into a structured set of machine understandable constraints …


Explainable Neural Networks With Guarantee: A Sparse Estimation Approach, Antoine Ledent, Peng Liu Mar 2025

Explainable Neural Networks With Guarantee: A Sparse Estimation Approach, Antoine Ledent, Peng Liu

Research Collection School Of Computing and Information Systems

Balancing predictive power and interpretability has long been a challenging research area, particularly in powerful yet complex models like neural networks, where nonlinearity obstructs direct interpretation. This paper introduces a novel approach to constructing an explainable neural network that harmonizes predictiveness and explainability. Our model is designed as a linear combination of a sparse set of jointly learned features, each derived from a different trainable function applied to a single 1-dimensional input feature. Leveraging the ability to learn arbitrarily complex relationships, our neural network architecture enables automatic selection of a sparse set of important features, with the final prediction being …


Learning: Human Versus Machine, Sanjay Sarma Mar 2025

Learning: Human Versus Machine, Sanjay Sarma

Asian Management Insights

Outdated education paradigms must be revamped to reclaim the all-important human quality: agency.

Sanjay Sarma, CEO, President, and Dean of the Asia School of Business, Kuala Lumpur, Malaysia and the Fred Fort Flowers (1941) and Daniel Fort Flowers (1941) Professor in Mechanical Engineering at the Massachusetts Institute of Technology (MIT), shares insights on the artificial intelligence (AI)-agency revolution and how the human brain works.


How Can Foreign Commercial Vehicle Manufacturers Succeed In India?, Debjit Roy, Shubham Mar 2025

How Can Foreign Commercial Vehicle Manufacturers Succeed In India?, Debjit Roy, Shubham

Asian Management Insights

Seven steps to achieve market entry based on lessons from recent market exits. New entrants need to tailor their trucks for India's geography, infrastructure, and conditions to improve acceptability and market share. Boost demand by building an export-driven business model in India to counter the threat from inadequate and stagnant domestic demand. Align service offerings with customer expectations to gain greater vehicle acceptability.


The Ethics Of Ai Nudges: How Ai Influences Decision-Making, Seema Chokshi Mar 2025

The Ethics Of Ai Nudges: How Ai Influences Decision-Making, Seema Chokshi

Asian Management Insights

And why decision-makers should care about it. Artificial intelligence (AI) systems, through mechanisms like nudges and choice architecture, actively, yet often subtly, shape human decision-making in everyday life and professional settings. AI systems can prioritise profit or efficiency at the expense of human agency, fairness, and well-being, highlighting the need to balance AI’s capabilities with ethical considerations. The EU AI Act is a landmark framework designed to curb manipulative AI practices, emphasising the protection of human autonomy and accountability in decision-making.


Mind The Green Skills Gap, Panchali Guha Mar 2025

Mind The Green Skills Gap, Panchali Guha

Asian Management Insights

The need to build tomorrow’s sustainable green economy today. Climate change and the shift towards a net zero economy pose significant risks to jobs globally unless workers are equipped with green skills and competencies. There is already a green skills gap in the labour market that will only widen over time if it is not addressed. Comprehensive and coordinated policies must be developed to define and measure green jobs and skills, enhance educational offerings, and provide support for workers and employers during the transition.


Graph Foundation Models: Concepts, Opportunities And Challenges, Jiawei Liu, Cheng Yang, Zhiyuan Lu, Junze Chen, Yibo Li, Mengmei Zhang, Ting Bai, Fang Yuan, Lichao Sun, Philip S. Yu, Chuan Shi Mar 2025

Graph Foundation Models: Concepts, Opportunities And Challenges, Jiawei Liu, Cheng Yang, Zhiyuan Lu, Junze Chen, Yibo Li, Mengmei Zhang, Ting Bai, Fang Yuan, Lichao Sun, Philip S. Yu, Chuan Shi

Research Collection School Of Computing and Information Systems

Foundation models have emerged as critical components in a variety of artificial intelligence applications, and showcase significant success in natural language processing and several other domains. Meanwhile, the field of graph machine learning is witnessing a paradigm transition from shallow methods to more sophisticated deep learning approaches. The capabilities of foundation models in generalization and adaptation motivate graph machine learning researchers to discuss the potential of developing a new graph learning paradigm. This paradigm envisions models that are pre-trained on extensive graph data and can be adapted for various graph tasks. Despite this burgeoning interest, there is a noticeable lack …


Leveraging Constraint Violation Signals For Action Constrained Reinforcement Learning, Janaka Chathuranga Brahmanage, Jiajing Ling, Akshat Kumar Mar 2025

Leveraging Constraint Violation Signals For Action Constrained Reinforcement Learning, Janaka Chathuranga Brahmanage, Jiajing Ling, Akshat Kumar

Research Collection School Of Computing and Information Systems

In many RL applications, ensuring an agent’s actions adhere to constraints is crucial for safety. Most previous methods in Action-Constrained Reinforcement Learning (ACRL) employ a projection layer after the policy network to correct the action. However projection-based methods suffer from issues like the zero gradient problem and higher runtime due to the usage of optimization solvers. Recently methods were proposed to train generative models to learn a differentiable mapping between latent variables and feasible actions to address this issue. However, generative models require training using samples from the constrained action space, which itself is challenging. To address such limitations, first, …


Adapting Knowledge Prompt Tuning For Enhanced Automated Program Repair, Xuemeng Cai, Lingxiao Jiang Mar 2025

Adapting Knowledge Prompt Tuning For Enhanced Automated Program Repair, Xuemeng Cai, Lingxiao Jiang

Research Collection School Of Computing and Information Systems

Automated Program Repair (APR) aims to enhance software reliability by automatically generating bug-fixing patches. Recent work has improved the state-of-the-art of APR by fine-tuning pre-trained large language models (LLMs), such as CodeT5, for APR. However, the effectiveness of fine-tuning be-comes weakened in data scarcity scenarios, and data scarcity can be a common issue in practice, limiting fine-tuning performance. To alleviate this limitation, this paper adapts prompt tuning for enhanced APR and conducts a comprehensive study to evaluate its effectiveness in data scarcity scenarios, using three LLMs of different sizes and six diverse datasets across four programming languages. Prompt tuning rewrites …


Adaptive Deviation Learning For Visual Anomaly Detection With Data Contamination, Aanindya Sundar Das, Guansong Pang, Monowar Bhuyan Mar 2025

Adaptive Deviation Learning For Visual Anomaly Detection With Data Contamination, Aanindya Sundar Das, Guansong Pang, Monowar Bhuyan

Research Collection School Of Computing and Information Systems

Visual anomaly detection targets to detect images that notably differ from normal pattern, and it has found extensive application in identifying defective parts within the manufacturing industry. These anomaly detection paradigms predominantly focus on training detection models using only clean, unlabeled normal samples, assuming an absence of contamination; a condition often unmet in real-world scenarios. The performance of these methods significantly depends on the quality of the data and usually decreases when exposed to noise. We introduce a systematic adaptive method that employs deviation learning to compute anomaly scores end-to-end while addressing data contamination by assigning relative importance to the …


Improving Multimodal Human Pose Estimation By Adversarial Modality Enhancement, Jiangnan Xia, Qilong Wu, Yanyin Guo, Yi Li, Jianghan Cheng, Junwei Li, Zhiyuan Zhang Mar 2025

Improving Multimodal Human Pose Estimation By Adversarial Modality Enhancement, Jiangnan Xia, Qilong Wu, Yanyin Guo, Yi Li, Jianghan Cheng, Junwei Li, Zhiyuan Zhang

Research Collection School Of Computing and Information Systems

Human pose estimation in computer vision predominantly focuses on the visible modality, with limited research on the infrared modality. No existing methods demonstrate robust performance across both modalities, missing their complementary strengths. This gap arises from the lack of a multimodal benchmark and the difficulty of developing robust multimodal capabilities. To address this, we introduce MMPD, a novel visible-infrared multimodal pose benchmark with high-quality annotations for both modalities. Leveraging MMPD, we expose the limitations of state-of-the-art methods due to modality variance. To overcome this challenge, we propose a novel method-agnostic scheme called AMMPE. By employing the Modality Adversarial Enhancement Stage …