Open Access. Powered by Scholars. Published by Universities.®

Digital Commons Network™

Open Access. Powered by Scholars. Published by Universities.®

Singapore Management University

Discipline
Keyword
Publication Year
Publication
Publication Type
File Type

Articles 421 - 450 of 10474

Full-Text Articles in Entire DC Network

The Impact Of Sanctions On Github Developers And Activities, Youmei Fan, Ani Hovhannisyan, Hideaki Hata, Christoph Treude, Raula G. Kula Nov 2025

The Impact Of Sanctions On Github Developers And Activities, Youmei Fan, Ani Hovhannisyan, Hideaki Hata, Christoph Treude, Raula G. Kula

Research Collection School Of Computing and Information Systems

The GitHub platform has fueled the creation of truly global software, enabling contributions from developers across various geographical regions of the world. As software becomes more entwined with global politics and social regulations, it becomes similarly subject to government sanctions. In 2019, GitHub restricted access to certain services for users in specific locations but rolled back these restrictions for some communities (e.g., the Iranian community) in 2021. We conducted a largescale empirical study, collecting approximately 156 thousand user profiles and their 41 million activity points from 2008 to 2022, to understand the response of developers. Our results indicate that many …

Go to article

Sketch-Sparsenet: Sparse Convolution Framework For Sketch Recognition, Jingru Yang, Jin Wang, Yang Zhou, Guodong Lu, Yu Sun, Huan Yu, Heming Fang, Zhihui Li, Shengfeng He Nov 2025

Sketch-Sparsenet: Sparse Convolution Framework For Sketch Recognition, Jingru Yang, Jin Wang, Yang Zhou, Guodong Lu, Yu Sun, Huan Yu, Heming Fang, Zhihui Li, Shengfeng He

Research Collection School Of Computing and Information Systems

In free-hand sketch recognition, state-of-the-art methods often struggle to extract spatial features from sketches with sparse distributions, which are characterized by significant blank regions devoid of informative content. To address this challenge, we introduce a novel framework for sketch recognition, termed Sketch-SparseNet. This framework incorporates an advanced convolutional component: the Sketch-Driven Dilated Deformable Block (SD3B). This component excels at extracting spatial features and accurately recognizing free-hand sketches with sparse distributions. The SD3B component innovatively bridges gaps in the blank areas of sketches by establishing spatial relationships among disconnected stroke points through adaptive reshaping of convolution kernels. These kernels are deformable, …

Go to article

Sustainable Llm Inference For Edge Ai: Evaluating Quantized Llms For Energy Efficiency, Output Accuracy, And Inference Latency, Erik Johanne Husom, Arda Goknil, Merve Astekin, Lwin Khin Shar, Andre Kasen, Sagar Sen, Benedikt Andreas Mithassel, Ahmet Soylu Nov 2025

Sustainable Llm Inference For Edge Ai: Evaluating Quantized Llms For Energy Efficiency, Output Accuracy, And Inference Latency, Erik Johanne Husom, Arda Goknil, Merve Astekin, Lwin Khin Shar, Andre Kasen, Sagar Sen, Benedikt Andreas Mithassel, Ahmet Soylu

Research Collection School Of Computing and Information Systems

Deploying Large Language Models (LLMs) on edge devices presents significant challenges due to computational constraints, memory limitations, inference speed, and energy consumption. Model quantization has emerged as a key technique to enable efficient LLM inference by reducing model size and computational overhead. In this study, we conduct a comprehensive analysis of 28 quantized LLMs from the Ollama library, which applies by default Post-Training Quantization (PTQ) and weight-only quantization techniques, deployed on an edge device (Raspberry Pi 4 with 4GB RAM). We evaluate energy efficiency, inference performance, and output accuracy across multiple quantization levels and task types. Models are benchmarked on …

Go to article

Enhancing Spatial Understanding In Mixed-Reality Presentations, Nam-Dang Vo, Van-Vinh Thai, Nam-Hoi Do, Viet-Tham Huynh, Anthony Tang, Khan-Duy Le Nov 2025

Enhancing Spatial Understanding In Mixed-Reality Presentations, Nam-Dang Vo, Van-Vinh Thai, Nam-Hoi Do, Viet-Tham Huynh, Anthony Tang, Khan-Duy Le

Research Collection School Of Computing and Information Systems

Mixed reality (MR) presentations often involve a presenter wearing a head-mounted display (HMD) and an audience watching via a large display, making it difficult for audiences to perceive spatial relationships between the presenter and virtual objects. We report two experiments testing three design variations: (1) scene camera placement (audience-aligned vs. opposite), (2) overlaying the presenter’s first-person view, and (3) highlighting objects in the presenter’s view. Results show that audience-aligned cameras and object highlighting improve spatial understanding, while combining third- and first-person views can further aid perception. We derive design guidelines for configuring MR presentations to better support audience comprehension.

Go to article

Disc: Decentralized Identity System With Self-Sovereign Credential Aggregation, Yang Yang, Wai Keung Ching, Minming Huang, Supachate Innet, Guomin Yang, Hwee Hwa Pang, Robert H. Deng Nov 2025

Disc: Decentralized Identity System With Self-Sovereign Credential Aggregation, Yang Yang, Wai Keung Ching, Minming Huang, Supachate Innet, Guomin Yang, Hwee Hwa Pang, Robert H. Deng

Research Collection School Of Computing and Information Systems

The evolution of decentralized identity (DID) and self-sovereign identity (SSI) frameworks, as endorsed by W3C Verifiable Credentials (VC) and eIDAS 2.0, underscores the need for secure, efficient, and privacy-preserving credential management. However, existing credential systems often depend on centralized issuers, lack efficient aggregation mechanisms, or fail to ensure unlinkability across authentication sessions. To address these challenges, we propose DISC (Decentralized Identity System with Self-Sovereign Credential Aggregation), a novel credential system that enables multi-authority credential issuance, user-controlled credential aggregation, and unlinkable authentication. DISC allows users to aggregate credentials from multiple issuers while maintaining constant-size authentication tokens and supporting batch verification for …

Go to article

Addressing Sparsity For Knowledge Graph Completion: Data And Model Perspectives, Ran Liu Nov 2025

Addressing Sparsity For Knowledge Graph Completion: Data And Model Perspectives, Ran Liu

Dissertations and Theses Collection (Open Access)

Knowledge graphs (KGs) are powerful tools for structuring factual knowledge into relational triples, yet their practical utility is often adversely affected by data sparsity. Many entities and relations are associated with only a few observations, which limits the quality of learned embeddings and weakens generalization in downstream tasks. The problem of sparsity led to two interrelated challenges. Firstly, it restricts the informativeness of training samples: positive examples are scarce, and conventional negative sampling often produces trivial or redundant negatives that resulting in limited guidance. Secondly, in few-shot relation learning scenarios, sparsity worsens distribution shifts between training and test relations, as …

Go to article

How Behavioral Science Can Improve The Return On Ai Investments, David De Cremer, Shane Schweitzer, Jack Mcguire, Devesh Narayanan Nov 2025

How Behavioral Science Can Improve The Return On Ai Investments, David De Cremer, Shane Schweitzer, Jack Mcguire, Devesh Narayanan

Research Collection Lee Kong Chian School Of Business

Many AI projects fail because leaders treat adoption as a tech purchase instead of a behavioral change problem. People resist tools that disrupt routines, overreact to visible AI errors, and prefer familiar human judgment. As a result, even good systems fail to gain purchase. Leaders can address this problem by applying “Behavioral Human-Centered AI” across the AI adoption cycle. In the design phrase, companies should co-design with diverse users, add purposeful friction where it improves scrutiny, require beta tests with subgroup results and behavioral input. During adoption, they should frame AI as an augmenter, disclose limits and safeguards, use explainability …

Go to article

Building Confidence For Class Participation, Tamas Makany, Ivy Seow Nov 2025

Building Confidence For Class Participation, Tamas Makany, Ivy Seow

Research Collection Lee Kong Chian School Of Business

What happens to students’ critical thinking when half the class filters their thoughts through AI? During a recent debate on AI policy in education, one student mentioned they routinely run their ideas through ChatGPT before speaking up. When I asked who else did the same, more than half the class raised their hands.

Go to article

Global Standards And Local Ambitions Across Green Taxonomies: Climate Change Mitigation From The European Union To South Africa, Theodor Florian Cojoianu, Andreas G. F. Hoepner, Ifigeneia Paliampelou, Anh Vu, Dariusz Wojcik Nov 2025

Global Standards And Local Ambitions Across Green Taxonomies: Climate Change Mitigation From The European Union To South Africa, Theodor Florian Cojoianu, Andreas G. F. Hoepner, Ifigeneia Paliampelou, Anh Vu, Dariusz Wojcik

Research Collection College of Integrative Studies

Country-level green finance taxonomy standards have emerged to provide clarity on environmentally-sustainable economic activities to attract investment, protect financial services consumers, and counteract greenwashing. This paper adopts the Global Production and Financial Network (GPFN) approach and analyses factors affecting the climate change mitigation ambition level of the South African Green Finance Taxonomy (RSA GFT) in comparison with the EU taxonomy, which served as a model for South Africa's (RSA) regulators. It accounts for (i) the interplay between EU’s and RSA’s production and financial networks, and (ii) RSA’s willingness to attract European funding for sustainable development. We find that EU private …

Go to article

Seeing Culture: A Benchmark For Visual Reasoning And Grounding, Burak Satar, Zhixin Ma, Patrick Amadeus Irrawan, Wilfried Ariel Mulyawan, Jing Jiang, Ee-Peng Lim, Chong-Wah Ngo Nov 2025

Seeing Culture: A Benchmark For Visual Reasoning And Grounding, Burak Satar, Zhixin Ma, Patrick Amadeus Irrawan, Wilfried Ariel Mulyawan, Jing Jiang, Ee-Peng Lim, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Multimodal vision-language models (VLMs) have made substantial progress in various tasks that require a combined understanding of visual and textual content, particularly in cultural understanding tasks, with the emergence of new cultural datasets. However, these datasets frequently fall short of providing cultural reasoning while underrepresenting many cultures.In this paper, we introduce the Seeing Culture Benchmark (SCB), focusing on cultural reasoning with a novel approach that requires VLMs to reason on culturally rich images in two stages: i) selecting the correct visual option with multiple-choice visual question answering (VQA), and ii) segmenting the relevant cultural artifact as evidence of reasoning. Visual …

Go to article

Seeing Is Fixing: Cross-Modal Reasoning With Multimodal Llms For Visual Software Issue Fixing, Kai Huang, Jian Zhang, Xiaofei Xie, Chunyang Chen Nov 2025

Seeing Is Fixing: Cross-Modal Reasoning With Multimodal Llms For Visual Software Issue Fixing, Kai Huang, Jian Zhang, Xiaofei Xie, Chunyang Chen

Research Collection School Of Computing and Information Systems

Large language model (LLM)-based automated program repair (APR) techniques have shown promising results in resolving real-world github issue tasks. Existing APR systems are primarily evaluated in unimodal settings (e.g., SWE-bench), relying solely on textual issue descriptions and source code. However, these autonomous systems struggle to resolve multimodal problem scenarios (e.g., SWE-bench M) due to limitations in interpreting and leveraging visual information. In multimodal scenarios, LLMs need to rely on visual information in the graphical user interface (GUI) to understand bugs and generate fixes. To bridge this gap, we propose GUIRepair, a cross-modal reasoning approach for resolving multimodal issue scenarios by …

Go to article

From Personas To Talks: Revisiting The Impact Of Personas On Llm-Synthesized Emotional Support Conversations, Shenghan Wu, Yimo Zhu, Wynne Hsu, Mong-Li Lee, Yang Deng Nov 2025

From Personas To Talks: Revisiting The Impact Of Personas On Llm-Synthesized Emotional Support Conversations, Shenghan Wu, Yimo Zhu, Wynne Hsu, Mong-Li Lee, Yang Deng

Research Collection School Of Computing and Information Systems

The rapid advancement of Large Language Models (LLMs) has revolutionized the generation of emotional support conversations (ESC), offering scalable solutions with reduced costs and enhanced data privacy. This paper explores the role of personas in the creation of ESC by LLMs. Our research utilizes established psychological frameworks to measure and infuse persona traits into LLMs, which then generate dialogues in the emotional support scenario. We conduct extensive evaluations to understand the stability of persona traits in dialogues, examining shifts in traits post-generation and their impact on dialogue quality and strategy distribution. Experimental results reveal several notable findings: 1) LLMs can …

Go to article

Adasteer: Your Aligned Llm Is Inherently An Adaptive Jailbreak Defender, Weixiang Zhao, Jiahe Guo, Yulin Hu, Yang Deng, An Zhang, Xingyu Sui, Xinyang Han, Yanyan Zhao, Bing Qin, Tat-Seng Chua, Ting Liu Nov 2025

Adasteer: Your Aligned Llm Is Inherently An Adaptive Jailbreak Defender, Weixiang Zhao, Jiahe Guo, Yulin Hu, Yang Deng, An Zhang, Xingyu Sui, Xinyang Han, Yanyan Zhao, Bing Qin, Tat-Seng Chua, Ting Liu

Research Collection School Of Computing and Information Systems

Despite extensive efforts in safety alignment, large language models (LLMs) remain vulnerable to jailbreak attacks. Activation steering offers a training-free defense method but relies on fixed steering coefficients, resulting in suboptimal protection and increased false rejections of benign inputs. To address this, we propose AdaSteer, an adaptive activation steering method that dynamically adjusts model behavior based on input characteristics. We identify two key properties: Rejection Law (R-Law), which shows that stronger steering is needed for jailbreak inputs opposing the rejection direction, and Harmfulness Law (H-Law), which differentiates adversarial and benign inputs. AdaSteer steers input representations along both the Rejection Direction …

Go to article

Chain Of Strategy Optimization Makes Large Language Models Better Emotional Supporter, Weixiang Zhao, Xingyu Sui, Xinyang Han, Yang Deng, Yulin Hu, Jiahe Guo, Libo Qin, Qianyun Du, Shijin Wang, Yanyan Zhao, Bing Qin, Ting Liu Nov 2025

Chain Of Strategy Optimization Makes Large Language Models Better Emotional Supporter, Weixiang Zhao, Xingyu Sui, Xinyang Han, Yang Deng, Yulin Hu, Jiahe Guo, Libo Qin, Qianyun Du, Shijin Wang, Yanyan Zhao, Bing Qin, Ting Liu

Research Collection School Of Computing and Information Systems

The growing emotional stress in modern society has increased the demand for Emotional Support Conversations (ESC). While Large Language Models (LLMs) show promise for ESC, they face two key challenges: (1) low strategy selection accuracy, and (2) preference bias, limiting their adaptability to users’ emotional needs. Existing supervised fine-tuning (SFT) struggles to address these issues, as it rigidly trains models on single gold-standard responses without modeling nuanced strategy trade-offs. To overcome these limitations, we propose a novel two-stage framework that optimizes strategy selection preferences at each dialogue turn. We first leverage Monte Carlo Tree Search to construct ESC-Pro, a high-quality …

Go to article

Exploring Autonomous Agents: A Closer Look At Why They Fail When Completing Tasks, Ruofan Lu, Yichen Li, Yintong Huo Nov 2025

Exploring Autonomous Agents: A Closer Look At Why They Fail When Completing Tasks, Ruofan Lu, Yichen Li, Yintong Huo

Research Collection School Of Computing and Information Systems

Autonomous agent systems powered by Large Language Models (LLMs) have demonstrated promising capabilities in automating complex tasks. However, current evaluations largely rely on success rates without systematically analyzing the interactions, communication mechanisms, and failure causes within these systems. To bridge this gap, we present a benchmark of 34 representative programmable tasks designed to rigorously assess autonomous agents. Using this benchmark, we evaluate three popular open-source agent frameworks combined with two LLM backbones, observing a task completion rate of approximately 50%. Through in-depth failure analysis, we develop a three-tier taxonomy of failure causes aligned with task phases, highlighting planning errors, task …

Go to article

Envisioning Future Interactive Web Development: Editing Webpage With Natural Language, Truong Hai Dang, Jingyu Xiao, Yintong Huo Nov 2025

Envisioning Future Interactive Web Development: Editing Webpage With Natural Language, Truong Hai Dang, Jingyu Xiao, Yintong Huo

Research Collection School Of Computing and Information Systems

The evolution of web applications relies on iterative code modifications, a process that is traditionally manual and time-consuming. While Large Language Models (LLMs) can generate UI code, their ability to edit existing code from new design requirements (e.g., ”center the logo”) remains a challenge. This is largely due to the absence of large-scale, high-quality tuning data to align model performance with human expectations. In this paper, we introduce a novel, automated data generation pipeline that uses LLMs to synthesize a high-quality fine-tuning dataset for web editing, named Instruct4Edit. Our approach generates diverse instructions, applies the corresponding code modifications, and performs …

Go to article

Damslnet: Dual-Attention Multi-Scale Lightweight Network For Plant Disease Classification, Linfan Deng, Juan Qin, Kun Li, Jinhua Zhu, Zhaoxia Wang Nov 2025

Damslnet: Dual-Attention Multi-Scale Lightweight Network For Plant Disease Classification, Linfan Deng, Juan Qin, Kun Li, Jinhua Zhu, Zhaoxia Wang

Research Collection School Of Computing and Information Systems

Accurately identifying crop diseases plays a crucial role in advancing intelligent and modern agricultural production. Deep learning techniques have performed robust performance in classifying plant disease images. However, current studies face the challenge that many plant disease datasets are generated in controlled environments, leading to reduced model performance in real-world agricultural settings. This paper aims to provide a lightweight model that can accurately classify plant diseases in natural environments. Specifically, this paper investigates the Dual-Attention Multi-Scale Lightweight Network (DAMSLNet), which combines dual-attention-based multi-scale feature extraction and deep information fusion, to classify plant diseases. At the front end, the model employs …

Go to article

Context-Aware Hierarchical Taxonomy Generation For Scientific Papers Via Llm-Guided Multi-Aspect Clustering, Kun Zhu, Lizi Liao, Yuxuan Gu, Lei Huang, Xiaocheng Feng, Bing Qin Nov 2025

Context-Aware Hierarchical Taxonomy Generation For Scientific Papers Via Llm-Guided Multi-Aspect Clustering, Kun Zhu, Lizi Liao, Yuxuan Gu, Lei Huang, Xiaocheng Feng, Bing Qin

Research Collection School Of Computing and Information Systems

The rapid growth of scientific literature demands efficient methods to organize and synthesize research findings. Existing taxonomy construction methods, leveraging unsupervised clustering or direct prompting of large language models (LLMs), often lack coherence and granularity. We propose a novel context-aware hierarchical taxonomy generation framework that integrates LLM-guided multi-aspect encoding with dynamic clustering. Our method leverages LLMs to identify key aspects of each paper (e.g., methodology, dataset, evaluation) and generates aspect-specific paper summaries, which are then encoded and clustered along each aspect to form a coherent hierarchy. In addition, we introduce a new evaluation benchmark of 156 expert-crafted taxonomies encompassing 11.6k …

Go to article

Why Stop At One Error? Benchmarking Llms As Data Science Code Debuggers For Multi-Hop And Multi-Bug Errors, Zhiyu Yang, Shuo Wang, Yukun Yan, Yang Deng Nov 2025

Why Stop At One Error? Benchmarking Llms As Data Science Code Debuggers For Multi-Hop And Multi-Bug Errors, Zhiyu Yang, Shuo Wang, Yukun Yan, Yang Deng

Research Collection School Of Computing and Information Systems

LLMs are transforming software development, yet current code generation and code repair benchmarks mainly assess syntactic and functional correctness in simple, single-error cases. LLMs’ capabilities to autonomously find and fix runtime logical errors in complex data science code remain largely unexplored. To address this gap, we introduce DSDBench: the Data Science Debugging Benchmark, the first benchmark for systematic evaluation of LLMs on multi-hop error tracing and multi-bug detection in data science code debugging. DSDBench adapts datasets from existing data science task benchmarks, such as DABench and MatPlotBench, featuring realistic data science debugging tasks with automatically synthesized multi-hop, multi-bug code snippets. …

Go to article

Temporal And Heterogeneous Graph Neural Network For Remaining Useful Life Prediction, Zhihao Wen, Yuan Fang, Pengcheng Wei, Fayao Liu, Zhenghua Chen, Min Wu Nov 2025

Temporal And Heterogeneous Graph Neural Network For Remaining Useful Life Prediction, Zhihao Wen, Yuan Fang, Pengcheng Wei, Fayao Liu, Zhenghua Chen, Min Wu

Research Collection School Of Computing and Information Systems

Predicting remaining useful life (RUL) plays a crucial role in the prognostics and health management of industrial systems that involve a variety of interrelated sensors. Given a constant stream of time-series sensory data from such systems, deep learning (DL) models have risen to prominence at identifying complex, nonlinear temporal dependencies in these data. In addition to the temporal dependencies of individual sensors, spatial dependencies emerge as important correlations among these sensors, which can be naturally modeled by a temporal graph that describes time-varying spatial relationships. However, the majority of existing studies have relied on capturing discrete snapshots of this temporal …

Go to article

Does Generative Ai Facilitate Investor Trading? Early Evidence From Chatgpt Outages, Qiang Cheng, Pengkai Lin, Yue Zhao Nov 2025

Does Generative Ai Facilitate Investor Trading? Early Evidence From Chatgpt Outages, Qiang Cheng, Pengkai Lin, Yue Zhao

Research Collection School Of Accountancy

In this paper, we use ChatGPT outages to provide early evidence on whether investors rely on generative artificial intelligence (GenAI) to perform professional tasks and the associated impact on stock price informativeness. We document a significant decline in stock trading volume during ChatGPT outages. The effect is stronger for firms with corporate news released immediately before or during the outages and for firms with higher ownership held by transient institutional investors. We then document declines in short-run price impact and return variance during the outage periods, consistent with reduced informed trading. Lastly, we document a positive effect of GenAI-assisted trading …

Go to article

Global Cooling Watch 2025, Omar Abdelaziz, Ray Gluckman, Ian Hamilton, Radhika Khosla, Lily Riahi Nov 2025

Global Cooling Watch 2025, Omar Abdelaziz, Ray Gluckman, Ian Hamilton, Radhika Khosla, Lily Riahi

Research Collection College of Integrative Studies

The second edition of UNEP’s Global Cooling Watch Report takes a deep dive into one of the decade’s most urgent challenges: surging heat, soaring cooling demand, and stark inequalities in access. Produced by the UNEP-led Cool Coalition, the report provides a comprehensive assessment of the rapidly growing global demand for cooling and the need for climate-friendly solutions to the issue. The 2025 report builds on the first Global Cooling Watch (2023), which established the Sustainable Cooling Pathway framework. The new edition deepens analysis of intensifying extreme heat and its effect on cooling demand, improved assessment of passive cooling, and coverage …

Go to article

Branch-And-Cut-And-Price For Agile Earth Observation Satellite Scheduling, Guansheng Peng, Jianjiang Wang, Guopeng Song, Aldy Gunawan, Lining Xing, Pieter Vansteenwegen Nov 2025

Branch-And-Cut-And-Price For Agile Earth Observation Satellite Scheduling, Guansheng Peng, Jianjiang Wang, Guopeng Song, Aldy Gunawan, Lining Xing, Pieter Vansteenwegen

Research Collection School Of Computing and Information Systems

The Agile Earth Observation Satellite scheduling selects and sequences satellite observations of possible targets on the Earth’s surface, each with a specific profit and multiple time windows. The objective is to maximize the collected profit of all observations completed under some operational constraints. The problem can be modeled as a variant of the Team Orienteering Problem with Time Windows (TOPTW). The key differences with the regular TOPTW are twofold: first, a time-dependent transition time is required for each pair of consecutive observations to adjust the camera’s look angles. Second, the time windows of each target vary during different observation cycles, …

Go to article

Defects4c: Benchmarking Large Language Model Repair Capability With C/C++ Bugs, Jian Wang, Xiaofei Xie, Qiang Hu, Shangqing Liu, Jiongchi Yu, Jiaolong Kong, Yi Li Nov 2025

Defects4c: Benchmarking Large Language Model Repair Capability With C/C++ Bugs, Jian Wang, Xiaofei Xie, Qiang Hu, Shangqing Liu, Jiongchi Yu, Jiaolong Kong, Yi Li

Research Collection School Of Computing and Information Systems

Automated Program Repair (APR) plays a critical role in enhancing the quality and reliability of software systems. While substantial progress has been made in Java-based APR, largely facilitated by benchmarks like Defects4J, there remains a significant gap in research on C/C++ program repair, despite the widespread use of C/C++ and the prevalence of associated vulnerabilities. This gap is primarily due to the lack of high-quality, open-source benchmarks tailored for C/C++. To address this issue, we introduce Defects4C, a comprehensive and executable benchmark specifically designed for C/C++ program repair. Our dataset is constructed from real-world C/C++ repositories and includes a large …

Go to article

Mmlu-Prox: A Multilingual Benchmark For Advanced Large Language Model Evaluation, Weihao Xuan, Et. Al. Nov 2025

Mmlu-Prox: A Multilingual Benchmark For Advanced Large Language Model Evaluation, Weihao Xuan, Et. Al.

Research Collection School Of Computing and Information Systems

Existing large language model (LLM) evaluation benchmarks primarily focus on English, while current multilingual tasks lack parallel questions that specifically assess cross-lingual reasoning abilities. This dual limitation makes it challenging to assess LLMs’ performance in the multilingual setting comprehensively. To fill this gap, we introduce MMLU-ProX, a comprehensive benchmark covering 29 languages, built on an English benchmark. Each language version consists of 11,829 identical questions, enabling direct cross-lingual comparisons. Additionally, to meet efficient evaluation needs, we provide a lite version containing 658 questions per language. To ensure the high quality of MMLU-ProX, we employ a rigorous development process that involves …

Go to article

Interaction2code: Benchmarking Mllm-Based Interactive Webpage Code Generation From Interactive Prototyping, Jingyu Xiao, Yuxuan Wan, Yintong Huo, Zixin Wang, Xinyi Xu, Wenxuan Wang, Zhiyao Xu, Yuhang Wang, Michael R. Lyu Nov 2025

Interaction2code: Benchmarking Mllm-Based Interactive Webpage Code Generation From Interactive Prototyping, Jingyu Xiao, Yuxuan Wan, Yintong Huo, Zixin Wang, Xinyi Xu, Wenxuan Wang, Zhiyao Xu, Yuhang Wang, Michael R. Lyu

Research Collection School Of Computing and Information Systems

Multimodal Large Language Models (MLLMs) have demonstrated remarkable performance on the design-to-code task, i.e., generating UI code from UI mock-ups. However, existing benchmarks only contain static web pages for evaluation and ignore the dynamic interaction, limiting the practicality, usability and user engagement of the generated webpages. To bridge these gaps, we present the first systematic investigation of MLLMs in generating interactive webpages. Specifically, we formulate the Interaction-to-Code task and establish the Interaction2Code benchmark, encompassing 127 unique webpages and 374 distinct interactions across 15 webpage types and 31 interaction categories. Through comprehensive experiments utilizing state-of-theart (SOTA) MLLMs, evaluated via both automatic …

Go to article

Distillcaps: Enhancing Audio-Language Alignment In Captioning Via Retrieval-Augmented Knowledge Distillation, Thinh Pham, Nghiem Diep, Lizi Liao, Binh Nguyen Nov 2025

Distillcaps: Enhancing Audio-Language Alignment In Captioning Via Retrieval-Augmented Knowledge Distillation, Thinh Pham, Nghiem Diep, Lizi Liao, Binh Nguyen

Research Collection School Of Computing and Information Systems

Automated audio captioning (AAC) benefits from incorporatingexternal context to interpret complex sounds, but doing so withretrieval-augmented generation (RAG) at inference is sometimesinfeasible due to data availability or incurs significant latency andcomplexity. We propose DistillCaps, a novel training-time frame-work that leverages RAG to guide knowledge distillation for im-proved audio-language alignment, while lessening the relianceon retrieval during inference. In our framework, a RAG-equippedteacher model retrieves relevant textual information (e.g., simi-lar captions) for each audio clip and uses it for training to gener-ate context-enriched captions. Simultaneously, a student model istrained to imitate this teacher, learning to produce high-qualitycaptions from audio alone. We further …

Go to article

Designing For Novice Debuggers: A Pilot Study On An Ai-Assisted Debugging Tool, Oka Kurniawan, Erick Chandra, Christopher M. Poskitt, Yannic Noller, Kenny T.W. Choo, Cyrille Jegourel Nov 2025

Designing For Novice Debuggers: A Pilot Study On An Ai-Assisted Debugging Tool, Oka Kurniawan, Erick Chandra, Christopher M. Poskitt, Yannic Noller, Kenny T.W. Choo, Cyrille Jegourel

Research Collection School Of Computing and Information Systems

Debugging is a fundamental skill that novice programmers must develop. Numerous tools have been created to assist novice programmers in this process. Recently, large language models (LLMs) have been integrated with automated program repair techniques to generate fixes for students' buggy code. However, many of these tools foster an over-reliance on AI and do not actively engage students in the debugging process. In this work, we aim to design an intuitive debugging assistant, CodeHinter, that combines traditional debugging tools with LLM-based techniques to help novice debuggers fix semantic errors while promoting active engagement in the debugging process. We present findings …

Go to article

Instructors’ Strategies In Creating And Implementing Constructivist Llm-Based Learning Activities, Emily Aurelia, Shun Yi Yeo, Michelle Lui, Effie Lai-Chong Law, Anthony Tang Nov 2025

Instructors’ Strategies In Creating And Implementing Constructivist Llm-Based Learning Activities, Emily Aurelia, Shun Yi Yeo, Michelle Lui, Effie Lai-Chong Law, Anthony Tang

Research Collection School Of Computing and Information Systems

Large language models (LLMs) are increasingly being integrated into educational settings, enabling more adoption of constructivist teaching and learning approaches in classrooms. This paper explores the strategies instructors are currently using to incorporate LLMs into learning activities that align with constructivist principles, which emphasize that learners actively construct their own knowledge. Through interviews with nine instructors who have designed eleven distinct LLM-based activities and using reflexive thematic analysis, this study identifies various types of learning activities with respect to four different aspects of the constructivist learning theory. The strategies employed and challenges faced to foster constructivist student-LLM interaction were also …

Go to article

Competition Through Entry Fees Between Auctions For Differentiated Objects, Massimiliano Landi, Domenico Menicucci, Domenico Colucci Nov 2025

Competition Through Entry Fees Between Auctions For Differentiated Objects, Massimiliano Landi, Domenico Menicucci, Domenico Colucci

Research Collection School Of Economics

This paper considers two competing auctions with objects differentiated according to the random utility framework introduced in Perloff and Salop (1985): bidders privately observe their values for the two objects, and values are ex ante i.i.d. across objects and across bidders. For the case of uniform distribution of values, we show that competition under entry fees is less intense than competition under reserve prices in the sense that sellers are better off, and bidders are worse off when competition takes place with entry fees rather than under reserve prices. The key difference between the two settings is that undercutting under …

Go to article

First Prev Next Last