Open Access. Powered by Scholars. Published by Universities.®
- Institution
-
- Singapore Management University (1107)
- TÜBİTAK (199)
- Wright State University (191)
- Technological University Dublin (182)
- Old Dominion University (126)
-
- Missouri University of Science and Technology (112)
- San Jose State University (111)
- City University of New York (CUNY) (92)
- Neutrosophic Systems with Applications (89)
- MBZUAI (70)
- Dartmouth College (67)
- Brigham Young University (65)
- University of Texas at El Paso (63)
- Chulalongkorn University (62)
- University of Nebraska - Lincoln (54)
- Zayed University (54)
- Boise State University (48)
- Edith Cowan University (48)
- Kennesaw State University (47)
- New Jersey Institute of Technology (44)
- California Polytechnic State University, San Luis Obispo (43)
- Embry-Riddle Aeronautical University (42)
- Purdue University (41)
- Chapman University (40)
- University of Nebraska at Omaha (40)
- University of Arkansas, Fayetteville (38)
- Montclair State University (36)
- University of South Florida (36)
- Air Force Institute of Technology (35)
- MMU Press (35)
- Keyword
-
- Machine learning (184)
- Natural language processing (182)
- Artificial intelligence (139)
- Natural Language Processing (131)
- Machine Learning (125)
-
- Deep learning (118)
- Artificial Intelligence (94)
- Large language models (84)
- Social media (80)
- Computer Science (78)
- Twitter (64)
- Deep Learning (61)
- NLP (60)
- Sentiment analysis (59)
- Large Language Models (56)
- Computational linguistics (53)
- Department of Computer Science and Engineering (53)
- Text mining (51)
- Neural networks (48)
- Data mining (44)
- Generative AI (44)
- AI (42)
- Computer science (39)
- Classification (37)
- Information retrieval (36)
- Social Media (36)
- Fuzzy logic (35)
- Semantics (34)
- Sentiment Analysis (33)
- LLM (32)
- Publication Year
- Publication
-
- Research Collection School Of Computing and Information Systems (1032)
- Turkish Journal of Electrical Engineering and Computer Sciences (199)
- Theses and Dissertations (160)
- Master's Projects (99)
- Conference papers (93)
-
- Neutrosophic Systems with Applications (89)
- Kno.e.sis Publications (84)
- Dissertations (70)
- Computer Science Faculty Research & Creative Works (66)
- Chulalongkorn University Theses and Dissertations (Chula ETD) (62)
- Browse all Theses and Dissertations (61)
- Computer Science Faculty Publications (58)
- All Works (54)
- Faculty Publications (49)
- Computer Science Faculty Publications and Presentations (45)
- Publications and Research (44)
- Articles (40)
- Electronic Theses and Dissertations (39)
- Computer Science and Engineering Faculty Publications (38)
- Natural Language Processing Faculty Publications (38)
- Departmental Technical Reports (CS) (36)
- Journal of Informatics and Web Engineering (35)
- Dissertations and Theses Collection (Open Access) (34)
- USF Tampa Graduate Theses and Dissertations (34)
- Computer Science: Faculty Publications (33)
- Dissertations, Theses, and Capstone Projects (32)
- Theses (31)
- CCAC Theses and Dissertations (30)
- Faculty Scholarship (27)
- Masters Theses (26)
- Publication Type
- File Type
Articles 451 - 480 of 4467
Full-Text Articles in Entire DC Network
Computational Fact-Checking With Limited Resources, Fengzhu Zeng
Computational Fact-Checking With Limited Resources, Fengzhu Zeng
Dissertations and Theses Collection (Open Access)
The rapid dissemination of information through online platforms has sparked widespread concern about the propagation of misinformation. Manual fact-checking by pro- fessional fact-checkers is time-consuming and lacks scalability to address the vast volume of daily information. Consequently, computational fact-checking, driven by automated techniques in natural language processing (NLP), has garnered interest as
a potential solution. However, computational fact-checking faces critical challenges limited resources, particularly due to the issues of data scarcity and computing resource constraints. One key challenge is data scarcity, which arises from the constant generation of new information and emerging events on social media. This scarcity manifests in …
Dreamanime: Learning Style-Identity Textual Disentanglement For Anime And Beyond, Chenshu Xu, Yangyang Xu, Huaidong Zhang, Xuemiao Xu, Shengfeng He
Dreamanime: Learning Style-Identity Textual Disentanglement For Anime And Beyond, Chenshu Xu, Yangyang Xu, Huaidong Zhang, Xuemiao Xu, Shengfeng He
Research Collection School Of Computing and Information Systems
Text-to-image generation models have significantly broadened the horizons of creative expression through the power of natural language. However, navigating these models to generate unique concepts, alter their appearance, or reimagine them in unfamiliar roles presents an intricate challenge. For instance, how can we exploit language-guided models to transpose an anime character into a different art style, or envision a beloved character in a radically different setting or role? This paper unveils a novel approach named DreamAnime, designed to provide this level of creative freedom. Using a minimal set of 2-3 images of a user-specified concept such as an anime character …
Focus: Evaluating Pre-Trained Vision-Language Models On Underspecification Reasoning, Kankan Zhou, Yibin Lai, Kyriakos Mouratidis, Jing Jiang
Focus: Evaluating Pre-Trained Vision-Language Models On Underspecification Reasoning, Kankan Zhou, Yibin Lai, Kyriakos Mouratidis, Jing Jiang
Research Collection School Of Computing and Information Systems
Humans possess a remarkable ability to interpret underspecified ambiguous statements by inferring their meanings from contexts such as visual inputs. This ability, however, may not be as developed in recent pre-trained visionlanguage models (VLMs). In this paper, we introduce a novel probing dataset called FOCUS to evaluate whether state-of-the-art VLMs have this ability. FOCUS consists of underspecified sentences paired with image contexts and carefully designed probing questions. Our experiments reveal that VLMs still fall short in handling underspecification even when visual inputs that can help resolve the ambiguities are available. To further support research in underspecification, FOCUS will be released …
Evowiki: Evaluating Llms On Evolving Knowledge, Wei Tang, Yixin Cao, Yang Deng, Jiahao Ying, Bo Wang, Yizhe Yang, Yuyue Zhao, Qi Zhang, Xuanjing Huang, Yu-Gang Jiang, Yong Liao
Evowiki: Evaluating Llms On Evolving Knowledge, Wei Tang, Yixin Cao, Yang Deng, Jiahao Ying, Bo Wang, Yizhe Yang, Yuyue Zhao, Qi Zhang, Xuanjing Huang, Yu-Gang Jiang, Yong Liao
Research Collection School Of Computing and Information Systems
Knowledge utilization is a critical aspect of LLMs, and understanding how they adapt to evolving knowledge is essential for their effective deployment. However, existing benchmarks are predominantly static, failing to capture the evolving nature of LLMs and knowledge, leading to inaccuracies and vulnerabilities such as contamination. In this paper, we introduce EvoWiki, an evolving dataset designed to reflect knowledge evolution by categorizing information into stable, evolved, and uncharted states. EvoWiki is fully auto-updated, enabling precise evaluation of continuously changing knowledge and newly released LLMs. Through experiments with Retrieval-Augmented Generation (RAG) and Continual Learning (CL), we evaluate how effectively LLMs adapt …
Xfinbench: Benchmarking Llms In Complex Financial Problem Solving And Reasoning, Zhihan Zhang, Yixin Cao, Lizi Liao
Xfinbench: Benchmarking Llms In Complex Financial Problem Solving And Reasoning, Zhihan Zhang, Yixin Cao, Lizi Liao
Research Collection School Of Computing and Information Systems
Solving financial problems demands complex reasoning, multimodal data processing, and a broad technical understanding, presenting unique challenges for current large language models (LLMs). We introduce **XFinBench**, a novel benchmark with 4,235 examples designed to evaluate LLM’s ability in solving comple**X**, knowledge-intensive **Fin**ancial problems across diverse graduate-level finance topics with multi-modal context. We identify five core capabilities of LLMs using XFinBench, i.e., _terminology understanding_, _temporal reasoning_, _future forecasting_, _scenario planning_, and _numerical modelling_. Upon XFinBench, we conduct extensive experiments on 18 leading models. The result shows that o1 is the best-performing text-only model with an overall accuracy of 67.3%, but still …
Taclr: A Scalable And Efficient Retrieval-Based Method For Industrial Product Attribute Value Identification, Yindu Su, Huike Zou, Lin Sun, Ting Zhang, Haiyang Yang, Chen Li Yu, David Lo, Qingheng Zhang, Shuguang Han, Jufeng Chen
Taclr: A Scalable And Efficient Retrieval-Based Method For Industrial Product Attribute Value Identification, Yindu Su, Huike Zou, Lin Sun, Ting Zhang, Haiyang Yang, Chen Li Yu, David Lo, Qingheng Zhang, Shuguang Han, Jufeng Chen
Research Collection School Of Computing and Information Systems
Product Attribute Value Identification (PAVI) involves identifying attribute values from product profiles, a key task for improving product search, recommendation, and business analytics on e-commerce platforms. However, existing PAVI methods face critical challenges, such as inferring implicit values, handling outof-distribution (OOD) values, and producing normalized outputs. To address these limitations, we introduce Taxonomy-Aware Contrastive Learning Retrieval (TACLR), the first retrieval-based method for PAVI. TACLR formulates PAVI as an information retrieval task by encoding product profiles and candidate values into embeddings and retrieving values based on their similarity. It leverages contrastive training with taxonomy-aware hard negative sampling and employs adaptive inference …
Predicting Music Origin With Deep Learning, Fruzsina Ladanyi
Predicting Music Origin With Deep Learning, Fruzsina Ladanyi
Electronic Theses, Projects, and Dissertations
This project explores the usage of a late fusion deep learning architecture to predict the geographic origin of music. Mel-Frequency Cepstral Coefficients (MFCCs) and the language of the music sample are used as features. MFCCs were extracted from audio files to capture sound features. The language was identified using OpenAI’s Whisper model to provide additional context. A late fusion neural network architecture combining Long Short-Term Memory (LSTM) layers for sequential MFCC input and dense layers for non-sequential language features were employed to support both classification and regression tasks. The classification model achieved an accuracy of 33.03% across 56 countries or …
How To Do Things With Little Talking Tubes: Nonideal Speech Acts In The Digital Age, Anthony Holdier
How To Do Things With Little Talking Tubes: Nonideal Speech Acts In The Digital Age, Anthony Holdier
Graduate Theses and Dissertations
In this work, I develop a view about what it means to share a social or conversational context with others, as well as what is normatively entailed by doing so. Working from a broadly Austinian perspective about the moral foundations of language use and how we use words to position ourselves within social space, as well as from a generally Stalnakerian social ontology (demarcating groups by dint of aligned or overlapping sets of commitments), I present three papers demonstrating how nonidealized, ordinary language philosophy can make sense of complex, real-world phenomena. Through analyses of heretical utterances, context collapse, and chatbot …
Faithfulrag: Fact-Level Conflict Modeling For Context-Faithful Retrieval-Augmented Generation, Qinggang Zhang, Zhishang Xiang, Yilin Xiao, Le Wang, Junhui Li, Xinrun Wang, Jinsong Su
Faithfulrag: Fact-Level Conflict Modeling For Context-Faithful Retrieval-Augmented Generation, Qinggang Zhang, Zhishang Xiang, Yilin Xiao, Le Wang, Junhui Li, Xinrun Wang, Jinsong Su
Research Collection School Of Computing and Information Systems
Large language models (LLMs) augmented with retrieval systems have demonstrated significant potential in handling knowledge-intensive tasks. However, these models often struggle with unfaithfulness issues, generating outputs that either ignore the retrieved context or inconsistently blend it with the LLM’s parametric knowledge. This issue is particularly severe in cases of knowledge conflict, where the retrieved context conflicts with the model’s parametric knowledge. While existing faithful RAG approaches enforce strict context adherence through well-designed prompts or modified decoding strategies, our analysis reveals a critical limitation: they achieve faithfulness by forcibly suppressing the model’s parametric knowledge, which undermines the model’s internal knowledge structure …
Debate, Reflect, And Distill: Multi-Agent Feedback With Tree-Structured Preference Optimization For Efficient Language Model Enhancement, Xiaofeng Zhou, Heyan Huang, Lizi Liao
Debate, Reflect, And Distill: Multi-Agent Feedback With Tree-Structured Preference Optimization For Efficient Language Model Enhancement, Xiaofeng Zhou, Heyan Huang, Lizi Liao
Research Collection School Of Computing and Information Systems
Large Language Models (LLMs) continue to set new standards in knowledge-intensive and complex reasoning tasks, yet their high computational demands limit widespread adoption. While distilling large models into smaller ones offers a sustainable solution, current techniques—such as static knowledge distillation, resource-intensive reinforcement learning from human feedback, or limited self-reflection—struggle to yield substantial and lasting performance gains. In this paper, we present a novel Debate and Reflect (D&R) framework that orchestrates multi-turn debates between smaller models and stronger teacher models, eliciting actionable feedback (e.g., error analysis, corrective strategies) to guide student models. Further, we introduce Tree-structured Direct Preference Optimization (T-DPO) to …
Memotune: A Measure And Moment-Driven Fine-Tuning Framework For Quantized Large Language Models, Yun Zhang, Xue Geng, Lizi Liao, Jintong Sun, Minghe Yu, Ge Yu
Memotune: A Measure And Moment-Driven Fine-Tuning Framework For Quantized Large Language Models, Yun Zhang, Xue Geng, Lizi Liao, Jintong Sun, Minghe Yu, Ge Yu
Research Collection School Of Computing and Information Systems
Quantizing large language models (LLMs) is essential for reducing memory and computational costs in natural language processing. Existing methods combine quantization with parameter-efficient fine-tuning but often fail to meet practical performance requirements. This paper introduces MeMoTune, a novel fine-tuning framework for quantized LLMs. By employing a measure and moment approach within a low-rank approximation framework in probability measure space, MeMoTune optimizes the objective function for superior fine-tuning results. The update process is further refined through scaled gradient, enhancing convergence efficiency and noise robustness. Experiments on tasks like text generation, summarization, and understanding show MeMoTune significantly outperforms state-of-the-art methods, e.g. fine-tuning …
R2dqg: A Quality Meets Diversity Framework For Question Generation Over Knowledge Bases, Yimeng Ren, Yanhua Yu, Lizi Liao, Yuhu Shang, Kangkang Lu, Mingliang Yan
R2dqg: A Quality Meets Diversity Framework For Question Generation Over Knowledge Bases, Yimeng Ren, Yanhua Yu, Lizi Liao, Yuhu Shang, Kangkang Lu, Mingliang Yan
Research Collection School Of Computing and Information Systems
The task of Knowledge-Based Question Generation (KBQG) involves generating natural language questions from structured knowledge sources, posing unique challenges in balancing linguistic diversity and semantic relevance. Existing models often focus on maximizing surface-level similarity to ground-truth questions, neglecting the need for diverse syntactic forms and leading to semantic drift during generation. To overcome these challenges, we propose Refine-Reinforced Diverse Question Generation (R2DQG), a two-phase framework leveraging a generation-then-refinement paradigm. The Generator first constructs a diverse set of expressive templates using dependency parse tree similarity, capturing a wide range of syntactic patterns and styles. These templates guide the creation of question …
Consistent Client Simulation For Motivational Interviewing-Based Counseling, Yizhe Yang, Palakorn Achananuparp, Heyan Huang, Jing Jiang, Nicholas Gabriel Lim, Cameron Shi Ern Tan, Phey Ling Kit, Jenny Xiuhui Giam, John Pinto, Ee-Peng Lim
Consistent Client Simulation For Motivational Interviewing-Based Counseling, Yizhe Yang, Palakorn Achananuparp, Heyan Huang, Jing Jiang, Nicholas Gabriel Lim, Cameron Shi Ern Tan, Phey Ling Kit, Jenny Xiuhui Giam, John Pinto, Ee-Peng Lim
Research Collection School Of Computing and Information Systems
Simulating human clients in mental health counseling is crucial for training and evaluating counselors (both human or simulated) in a scalable manner. Nevertheless, past research on client simulation did not focus on complex conversation tasks such as mental health counseling. In these tasks, the challenge is to ensure that the client’s actions (i.e., interactions with the counselor) are consistent with with its stipulated profiles and negative behavior settings. In this paper, we propose a novel framework that supports consistent client simulation for mental health counseling. Our framework tracks the mental state of a simulated client, controls its state transitions, and …
Knowledge Boundary Of Large Language Models: A Survey, Moxin Li, Yong Zhao, Wenxuan Zhang, Shuaiyi Li, Wenya Xie, See-Kiong Ng, Tat-Seng Chua, Yang Deng
Knowledge Boundary Of Large Language Models: A Survey, Moxin Li, Yong Zhao, Wenxuan Zhang, Shuaiyi Li, Wenya Xie, See-Kiong Ng, Tat-Seng Chua, Yang Deng
Research Collection School Of Computing and Information Systems
Although large language models (LLMs) store vast amount of knowledge in their parameters, they still have limitations in the memorization and utilization of certain knowledge, leading to undesired behaviors such as generating untruthful and inaccurate responses. This highlights the critical need to understand the knowledge boundary of LLMs, a concept that remains inadequately defined in existing research. In this survey, we propose a comprehensive definition of the LLM knowledge boundary and introduce a formalized taxonomy categorizing knowledge into four distinct types. Using this foundation, we systematically review the field through three key lenses: the motivation for studying LLM knowledge boundaries, …
Colloquial Singaporean English Style Transfer With Fine-Grained Explainable Control, Jinggui Liang, Dung Vo, Yap Hong Xian, Hai Leong Chieu, Kian Ming A. Chai, Jing Jiang, Lizi Liao
Colloquial Singaporean English Style Transfer With Fine-Grained Explainable Control, Jinggui Liang, Dung Vo, Yap Hong Xian, Hai Leong Chieu, Kian Ming A. Chai, Jing Jiang, Lizi Liao
Research Collection School Of Computing and Information Systems
Colloquial Singaporean English (Singlish) is an informal English marked by a unique blend of languages reflecting Singapore’s multicultural identity. Style transfer between Singlish and Standard (formal) English is vital for various applications, yet existing methods often lack explainability and fine-grained control. To fill this gap, we contribute in two key ways. First, we construct a large, high-quality dataset of formal and informal sentences, annotated across six linguistic aspects—Syntax, Lexical Borrowing, Pragmatics, Prosody/Phonology, Emoticons/Punctuation, and Code-Switching—with detailed explanations. Starting with manually annotated cases, we scaled the dataset to 140K with ensured quality. Second, inspired by the “Society of Mind” theory, we …
Enhancing Non-Visual Interaction With Online User-Generated Content, Mohan Krishna Sunkara
Enhancing Non-Visual Interaction With Online User-Generated Content, Mohan Krishna Sunkara
Computer Science Theses & Dissertations
The Web has become the dominant medium for our everyday activities, including communication, business, e-commerce, news, and entertainment. Consequently, the online world is experiencing an explosion of User-Generated Content (UGC), particularly on social media platforms and online review systems. To facilitate convenient interaction with UGC, web platforms have adopted various presentation strategies that enable users to efficiently browse and contribute to the UGC. However, these user interfaces are primarily designed for sighted individuals, so they do little to assist blind users who rely predominantly on audio-based screen reader assistive technology. The extant efforts to improve web interaction for blind users …
Intersecting Realities And Evolving Landscapes: Mapping Generative Ai Within The Framework Of Digital Rhetoric, Joshua Troy Nieubuurt
Intersecting Realities And Evolving Landscapes: Mapping Generative Ai Within The Framework Of Digital Rhetoric, Joshua Troy Nieubuurt
English Theses & Dissertations
The increased usage of [Generative] AI technologies (GenAI) in the 21st century has called into the question the rhetorical agency of these digital things. [Gen]AI has historically been framed within a Heideggerian “readiness-to-hand” dynamic in which it has been unilaterally conceived as a tool to be used by humans. This dissertation proposes that the GenAI assemblage is capable of being a co-actor in rhetorical spaces. To provide evidence for this stance This dissertation utilizes Actor Network Theory to map the actants within a GenAI assemblage. In doing so it allows for an understanding of the stakeholders (both human and non-human) …
Service With A Smile Or Salesperson Mirroring? Understanding The Flow Of Emotional Contagion In Sales Encounters, Vinh Quoc Trong Luong
Service With A Smile Or Salesperson Mirroring? Understanding The Flow Of Emotional Contagion In Sales Encounters, Vinh Quoc Trong Luong
Theses and Dissertations in Business Administration
This study examines the directionality of emotional contagion in sales interactions, addressing a critical gap in understanding whether emotions flow primarily from the salesperson to the customer, from the customer to the salesperson, or bidirectionally. While prior research emphasizes customer-driven emotional flow or bidirectional alignment, this study challenges these assumptions by employing categorical Cross-Recurrence Quantification Analysis (CRQA) to assess temporal emotional synchronization in sales dialogues. Leveraging automated sentiment analysis and multi-agent AI evaluation for performance metrics, the research analyzes 166 sales interactions to quantify emotional influence dynamics. Results reveal that salespeople predominantly lead emotional exchanges, exhibiting stronger and more stable …
Evaluating And Mitigating Linguistic Discrimination In Large Language Models: Perspectives On Safety Equity And Knowledge Equity, Guoliang Dong, Haoyu Wang, Jun Sun, Xinyu Wang
Evaluating And Mitigating Linguistic Discrimination In Large Language Models: Perspectives On Safety Equity And Knowledge Equity, Guoliang Dong, Haoyu Wang, Jun Sun, Xinyu Wang
Research Collection School Of Computing and Information Systems
By training on text in various languages, large language models (LLMs) typically possess multilingual support and demonstrate remarkable capabilities in solving tasks described in different languages. However, LLMs can exhibit linguistic discrimination due to the uneven distribution of training data across languages. That is, LLMs are hard to keep the consistency of responses when faced with the same task but depicted in different languages. In this study, we first explore the consistency in the LLMs’ outputs responding to queries in various languages from two aspects: safety and quality. We conduct this analysis with two datasets (AdvBench and NQ) based on …
Ai In The Judiciary: The Singapore Case, Nydia Remolina Leon
Ai In The Judiciary: The Singapore Case, Nydia Remolina Leon
Research Collection Yong Pung How School Of Law
This paper examines the integration of Artificial Intelligence (AI) within the judicial system of Singapore. Singapore's judiciary has embraced AI not as a tool for adjudication, but as an augmentative instrument for legal research, procedural efficiency, and access to justice. It provides a detailed account of AI use cases in the courts, including case summarization, evidence review, assistance for selfrepresented litigants, and tools like the Divorce Assets Informative Division Estimator. The discussion then turns to the legal profession, exploring how law firms in Singapore are adopting AI technologies. The paper also addresses how AI implementation in the judicial system is …
Trust In Healthcare Ai Can’T Just Be Designed – It Must Be Felt By Clinicians And Patients, Adriana Banozic-Tang, Heng Wang
Trust In Healthcare Ai Can’T Just Be Designed – It Must Be Felt By Clinicians And Patients, Adriana Banozic-Tang, Heng Wang
Research Collection Yong Pung How School Of Law
Trust in healthcare AI currently over-relies on system design, not lived medical realities.Continuous feedback loops are necessary to embed trust in healthcare AI that is responsive to clinician and patient needs.Initiatives in South-East Asia show how trust in technology can be extended from policy to practice.
Cami: A Counselor Agent Supporting Motivational Interviewing Through State Inference And Topic Exploration, Yizhe Yang, Palakorn Achananuparp, Heyan Huang, Jing Jiang, Phey Ling Kit, Nicholas Gabriel Lim, Cameron Shi Ern Tan, Ee-Peng Lim
Cami: A Counselor Agent Supporting Motivational Interviewing Through State Inference And Topic Exploration, Yizhe Yang, Palakorn Achananuparp, Heyan Huang, Jing Jiang, Phey Ling Kit, Nicholas Gabriel Lim, Cameron Shi Ern Tan, Ee-Peng Lim
Research Collection School Of Computing and Information Systems
Conversational counselor agents have become essential tools for addressing the rising demand for scalable and accessible mental health support. This paper introduces CAMI, a novel automated counselor agent grounded in Motivational Interviewing (MI) – a client-centered counseling approach designed to address ambivalence and facilitate behavior change. CAMI employs a novel STAR framework, consisting of client’s state inference, motivation topic exploration, and response generation modules, leveraging large language models (LLMs). These components work together to evoke change talk, aligning with MI principles and improving counseling outcomes for diverse clients. We evaluate CAMI’s performance through both automated and expert evaluations, utilizing simulated …
How To Enable Effective Cooperation Between Humans And Nlp Models: A Survey Of Principles, Formalizations, And Beyond, Chen Huang, Yang Deng, Wenqiang Lei, Jiancheng Lv, Tat-Seng Chua, Jimmy Huang
How To Enable Effective Cooperation Between Humans And Nlp Models: A Survey Of Principles, Formalizations, And Beyond, Chen Huang, Yang Deng, Wenqiang Lei, Jiancheng Lv, Tat-Seng Chua, Jimmy Huang
Research Collection School Of Computing and Information Systems
With the advancement of large language models (LLMs), intelligent models have evolved from mere tools to autonomous agents with their own goals and strategies for cooperating with humans. This evolution has birthed a novel paradigm in NLP, i.e., human-model cooperation, that has yielded remarkable progress in numerous NLP tasks in recent years. In this paper, we take the first step to present a thorough review of human-model cooperation, exploring its principles, formalizations, and open challenges. In particular, we introduce a new taxonomy that provides a unified perspective to summarize existing approaches. Also, we discuss potential frontier areas and their corresponding …
Fact-Audit: An Adaptive Multi-Agent Framework For Dynamic Fact-Checking Evaluation Of Large Language Models, Hongzhan Lin, Yang Deng, Yuxuan Gu, Wenxuan Zhang, Jing Ma, See-Kiong Ng, Tat-Seng Chua
Fact-Audit: An Adaptive Multi-Agent Framework For Dynamic Fact-Checking Evaluation Of Large Language Models, Hongzhan Lin, Yang Deng, Yuxuan Gu, Wenxuan Zhang, Jing Ma, See-Kiong Ng, Tat-Seng Chua
Research Collection School Of Computing and Information Systems
Large Language Models (LLMs) have significantly advanced the fact-checking studies. However, existing automated fact-checking evaluation methods rely on static datasets and classification metrics, which fail to automatically evaluate the justification production and uncover the nuanced limitations of LLMs in fact-checking. In this work, we introduce FACT-AUDIT, an agent-driven framework that adaptively and dynamically assesses LLMs’ fact-checking capabilities. Leveraging importance sampling principles and multi-agent collaboration, FACT-AUDIT generates adaptive and scalable datasets, performs iterative model-centric evaluations, and updates assessments based on model-specific responses. By incorporating justification production alongside verdict prediction, this framework provides a comprehensive and evolving audit of LLMs’ factual reasoning …
Beware Of Your Po! Measuring And Mitigating Ai Safety Risks In Role-Play Fine-Tuning Of Llms, Weixiang Zhao, Yulin Hu, Yang Deng, Jiahe Guo, Xingyu Sui, Xinyang Han, An Zhang, Yanyan Zhao, Bing Qin, Tat-Seng Chua, Ting Liu
Beware Of Your Po! Measuring And Mitigating Ai Safety Risks In Role-Play Fine-Tuning Of Llms, Weixiang Zhao, Yulin Hu, Yang Deng, Jiahe Guo, Xingyu Sui, Xinyang Han, An Zhang, Yanyan Zhao, Bing Qin, Tat-Seng Chua, Ting Liu
Research Collection School Of Computing and Information Systems
Although large language models (LLMs) store vast amount of knowledge in their parameters, they still have limitations in the memorization and utilization of certain knowledge, leading to undesired behaviors such as generating untruthful and inaccurate responses. This highlights the critical need to understand the knowledge boundary of LLMs, a concept that remains inadequately defined in existing research. In this survey, we propose a comprehensive definition of the LLM knowledge boundary and introduce a formalized taxonomy categorizing knowledge into four distinct types. Using this foundation, we systematically review the field through three key lenses: the motivation for studying LLM knowledge boundaries, …
Browsing Like Human: A Multimodal Web Agent With Experiential Fast-And-Slow Thinking, Haohao Luo, Jiayi Kuang, Wei Liu, Ying Shen, Jian Luan, Yang Deng
Browsing Like Human: A Multimodal Web Agent With Experiential Fast-And-Slow Thinking, Haohao Luo, Jiayi Kuang, Wei Liu, Ying Shen, Jian Luan, Yang Deng
Research Collection School Of Computing and Information Systems
Automating web navigation which aims to build a web agent that follows user instructions to complete tasks like booking flights by interacting with websites, has received increasing attention due to its practical value. Although existing web agents are mostly equipped with visual perception, planning, and memory abilities, their reasoning process are still deviate from human cognition. In this work, we study the human thought pattern to empower agent with more human-like abilities in web navigation. To tackle this problem, we propose a novel multimodal web agent framework called WebExperT, which is designed to emulate the human planning process of “thinking …
Causalabstain: Enhancing Multilingual Llms With Causal Reasoning For Trustworthy Abstention, Yuxi Sun, Aoqi Zuo, Wei Gao, Jing Ma
Causalabstain: Enhancing Multilingual Llms With Causal Reasoning For Trustworthy Abstention, Yuxi Sun, Aoqi Zuo, Wei Gao, Jing Ma
Research Collection School Of Computing and Information Systems
Large Language Models (LLMs) often exhibit knowledge disparities across languages. Encouraging LLMs to abstain when faced with knowledge gaps is a promising strategy to reduce hallucinations in multilingual settings. Current abstention strategies for multilingual scenarios primarily rely on generating feedback in various languages using LLMs and performing self-reflection. However, these methods can be adversely impacted by inaccuracies and biases in the generated feedback. To address this, from a causal perspective, we introduce CausalAbstain, a method that helps LLMs determine whether to utilize multiple generated feedback responses and how to identify the most useful ones. Extensive experiments demonstrate that CausalAbstain effectively …
Advancing Molecular Graph-Text Pre-Training Via Fine-Grained Alignment, Yibo Li, Yuan Fang, Mengmei Zhang, Chuan Shi
Advancing Molecular Graph-Text Pre-Training Via Fine-Grained Alignment, Yibo Li, Yuan Fang, Mengmei Zhang, Chuan Shi
Research Collection School Of Computing and Information Systems
Understanding molecular structure and related knowledge is crucialfor scientific research. Recent studies integrate molecular graphswith their textual descriptions to enhance molecular representationlearning. However, they focus on the whole molecular graph andneglect frequently occurring subgraphs, known as motifs, whichare essential for determining molecular properties. Without suchfine-grained knowledge, these models struggle to generalize to un-seen molecules and tasks that require motif-level insights. To bridgethis gap, we propose FineMolTex, a novel Fine-grained Moleculargraph-Text pre-training framework to jointly learn coarse-grainedmolecule-level knowledge and fine-grained motif-level knowledge.Specifically, FineMolTex consists of two pre-training tasks: a con-trastive alignment task for coarse-grained matching and a maskedmulti-modal modeling task for …
“Silent Is Not Actually Silent”: An Investigation Of Toxicity On Bug Report Discussion, Mia Mohammad Imran, Jaydeb Sarker
“Silent Is Not Actually Silent”: An Investigation Of Toxicity On Bug Report Discussion, Mia Mohammad Imran, Jaydeb Sarker
Computer Science Faculty Research & Creative Works
Toxicity in bug report discussions poses significant challenges to the collaborative dynamics of open-source software development. Bug reports are crucial for identifying and resolving defects, yet their inherently problem-focused nature and emotionally charged context make them susceptible to toxic interactions. This study explores toxicity in GitHub bug reports through a qualitative analysis of 203 bug threads, including 81 toxic ones. Our findings reveal that toxicity frequently arises from misaligned perceptions of bug severity and priority, unresolved frustrations with tools, and lapses in professional communication. These toxic interactions not only derail productive discussions but also reduce the likelihood of actionable outcomes, …
Llput: Investigating Large Language Models For Bug Report-Based Input Generation, Alif Al Hasan, Subarna Saha, Mia Mohammad Imran, Tarannum Shaila Zaman
Llput: Investigating Large Language Models For Bug Report-Based Input Generation, Alif Al Hasan, Subarna Saha, Mia Mohammad Imran, Tarannum Shaila Zaman
Computer Science Faculty Research & Creative Works
Failure-inducing inputs play a crucial role in diagnosing and analyzing software bugs. Bug reports typically contain these inputs, which developers extract to facilitate debugging. Since bug reports are written in natural language, prior research has leveraged various Natural Language Processing (NLP) techniques for automated input extraction. With the advent of Large Language Models (LLMs), an important research question arises: how effectively can generative LLMs extract failure-inducing inputs from bug reports? In this paper, we propose LLPut, a technique to empirically evaluate the performance of three open-source generative LLMs-LLaMA, Qwen, and Qwen-Coder-in extracting relevant inputs from bug reports. We conduct an …