Open Access. Powered by Scholars. Published by Universities.®
- Institution
-
- Singapore Management University (1116)
- TÜBİTAK (210)
- Wright State University (197)
- Technological University Dublin (193)
- University of New Mexico (165)
-
- Old Dominion University (143)
- Claremont Colleges (126)
- Missouri University of Science and Technology (125)
- University of Nebraska - Lincoln (123)
- San Jose State University (119)
- City University of New York (CUNY) (115)
- Brigham Young University (105)
- Neutrosophic Systems with Applications (89)
- University of Texas at El Paso (88)
- University of Northern Iowa (78)
- University of South Florida (77)
- Chulalongkorn University (73)
- Dartmouth College (71)
- MBZUAI (70)
- Kennesaw State University (66)
- Portland State University (60)
- Zayed University (58)
- Chapman University (57)
- New Jersey Institute of Technology (57)
- Boise State University (56)
- Edith Cowan University (54)
- University of Arkansas, Fayetteville (54)
- University of Nevada, Las Vegas (53)
- Purdue University (51)
- Montclair State University (49)
- Keyword
-
- Natural language processing (209)
- Machine learning (208)
- Artificial intelligence (155)
- Natural Language Processing (152)
- Machine Learning (145)
-
- Deep learning (131)
- Artificial Intelligence (100)
- Large language models (88)
- Social media (83)
- Computer Science (82)
- NLP (74)
- Twitter (70)
- Sentiment analysis (69)
- Mathematics (68)
- Deep Learning (67)
- Large Language Models (62)
- Text mining (59)
- Neural networks (58)
- Computational linguistics (54)
- Department of Computer Science and Engineering (53)
- Computer science (52)
- Education (49)
- Fuzzy logic (49)
- AI (47)
- Data mining (47)
- Generative AI (46)
- Linguistics (43)
- Classification (41)
- Social Media (39)
- Information retrieval (38)
- Publication Year
- Publication
-
- Research Collection School Of Computing and Information Systems (1033)
- Theses and Dissertations (222)
- Turkish Journal of Electrical Engineering and Computer Sciences (199)
- Branch Mathematics and Statistics Faculty and Staff Publications (150)
- Master's Projects (99)
-
- Conference papers (96)
- Neutrosophic Systems with Applications (89)
- Kno.e.sis Publications (84)
- Dissertations (83)
- Chulalongkorn University Theses and Dissertations (Chula ETD) (70)
- Computer Science Faculty Research & Creative Works (66)
- Electronic Theses and Dissertations (65)
- Journal of Humanistic Mathematics (63)
- Browse all Theses and Dissertations (62)
- Faculty Publications (59)
- All Works (58)
- Computer Science Faculty Publications (58)
- USF Tampa Graduate Theses and Dissertations (55)
- Publications and Research (51)
- Iowa Academy of Science Documents (50)
- Computer Science Faculty Publications and Presentations (45)
- Departmental Technical Reports (CS) (44)
- Dissertations, Theses, and Capstone Projects (43)
- Articles (42)
- Faculty, Staff and Student Publications (42)
- Open Access Theses & Dissertations (42)
- SMU Data Science Review (41)
- Walden Dissertations and Doctoral Studies (39)
- Computer Science and Engineering Faculty Publications (38)
- Natural Language Processing Faculty Publications (38)
- Publication Type
- File Type
Articles 571 - 600 of 6245
Full-Text Articles in Entire DC Network
Investigating Information Extraction And Language Models In Medical Domain Text Processing, Pouyan Nahed
Investigating Information Extraction And Language Models In Medical Domain Text Processing, Pouyan Nahed
UNLV Theses, Dissertations, Professional Papers, and Capstones
This dissertation demonstrates that carefully adapted language-model pipelines can transform unstructured clinical-trial and pharmacological prose into reliable, low-latency structured data. Four interconnected studies support this claim.Tri-AL platform. An open-source dashboard ingests all 440 k+ ClinicalTrials.gov records—including every historical revision—into a normalized schema and parses the 20 GB XML archive over 10x faster than a BeautifulSoup baseline, while exposing hooks for demographic analytics and supporting integration of user-defined modules. Clinical trial summarization. An encoder–decoder model is trained on 57k description–summary pairs to condense clinical trials into a few sentences. ROUGE evaluation shows a 20% improvement over the baseline, while graph-based evaluation …
Quantified Possibility Neutrosophic Soft Set Based Decision Support System For Enhanced Accuracy In Sustainable Supplier Selection Decision Analysis, Neha Andaleeb Khalid, Muhammad Saeed
Quantified Possibility Neutrosophic Soft Set Based Decision Support System For Enhanced Accuracy In Sustainable Supplier Selection Decision Analysis, Neha Andaleeb Khalid, Muhammad Saeed
Neutrosophic Systems with Applications
To deal with the concepts of vulnerability, ambiguity, and indeterminacy that are typical in complex decision analysis contexts, neutrosophic set-like structures are frequently used. Although neutrosophic sets are particularly good at handling indeterminate circumstances, indeterminacy plays a part in making the decision making process imprecise and ambiguous. This paper develops a more advanced technique to improve the accuracy of decision analysis problems: the Quantified Possibility Neutrosophic Soft Set Decision Support System (Qt PNSSDSS). In order to reduce the element of indeterminacy present in conventional neutrosophic sets, the proposed DSS is based on the Quantified Neutrosophic Set, which employs a …
Some Properties Of Neutrosophic Cubic Hypersoft Sets, Lubna Nayab, Muhammad Gulistan, Fawad Hussain
Some Properties Of Neutrosophic Cubic Hypersoft Sets, Lubna Nayab, Muhammad Gulistan, Fawad Hussain
Neutrosophic Systems with Applications
This study addresses the limitations of NCS in managing uncertainties associated with multiple attributes and their further bifurcation. To address this challenge, we propose a generalization of the neutrosophic cubic soft set, introducing the concept of "neutrosophic cubic hyper soft set." Within this framework, we define internal and external neutrosophic cubic hypersoft sets, along with operations such as P-intersection, P-union, P-restricted union, P-extended intersection, P-OR operator, P-AND operator, R-intersection, R-union, R-restricted union, R-extended intersection, R-OR operator, R-AND operator, complement, and relative complement of neutrosophic cubic hyper soft sets. The study explores and presents relevant results, demonstrating the enhanced capability of …
Digital Trading Platform Selection Under Neutrosophic Numbers And Multi-Criteria Decision-Making Methodology: An Illustrative Example, Eman Sayed, Karam M. Sallam, Ibrahim Alrashdi
Digital Trading Platform Selection Under Neutrosophic Numbers And Multi-Criteria Decision-Making Methodology: An Illustrative Example, Eman Sayed, Karam M. Sallam, Ibrahim Alrashdi
Neutrosophic Systems with Applications
Uncertainty, vagueness, and incomplete information are pervasive in real-world decision-making scenarios, particularly in multi-criteria decision-making (MCDM) contexts involving expert judgments. To address these challenges, this study introduces a comprehensive decision-making framework that integrates Triangular Neutrosophic Numbers (TNNs) with the Weighted Aggregated Sum Product Assessment (WASPAS) method. The framework begins by capturing expert evaluations using TNNs, which effectively represent the degrees of truth, indeterminacy, and falsity inherent in subjective assessments. These evaluations are then transformed into crisp values using a novel score function that preserves the embedded uncertainty. The resulting decision matrices are aggregated into a unified structure to ensure consistency …
Topnet R1: A Multi-Stage Ai Framework For Topic Discovery In Scientific Abstracts, Md Elias Hossain
Topnet R1: A Multi-Stage Ai Framework For Topic Discovery In Scientific Abstracts, Md Elias Hossain
Theses and Dissertations
Scientific abstracts are rich sources of knowledge, yet extracting meaningful topics remains challenging due to limitations in existing topic modeling techniques. Traditional methods often struggle with interpretability, scalability, and contextual understanding. To overcome these issues, we introduce TopNet R1, a multi-stage ensemble framework that integrates traditional topic models with contextual embeddings from Bidirectional Encoder Representations from Transformers (BERT) and Generative Pre-trained Transformer 4 (GPT-4) large language models (LLMs). Top- Net R1 operates in three phases: (1) topic generation using Latent Dirichlet Allocation (LDA), Non-Negative Matrix Factorization (NMF), Latent Semantic Analysis (LSA), and Hierarchical Dirichlet Process (HDP); (2) LLM-assisted pattern recognition …
Unboxing The Black Box: Graph-Based Interpretability In Transformer Models, Ramak Nassiri
Unboxing The Black Box: Graph-Based Interpretability In Transformer Models, Ramak Nassiri
Theses and Dissertations
This thesis introduces a novel interpretability framework for transformer encoder models by hypothesizing that their internal embedding updates define a state transition system. We propose that transformers implicitly learn token-to-token influence dynamics, which can be analyzed using graph-theoretic methods. To validate this, we construct transition graphs from embedding changes and rank token importance using the PageRank algorithm. We develop two transformer models from scratch: a self-supervised model that incorporates serotype tokens to learn contextualized embeddings, and a supervised model initialized with these embeddings. Cosine similarity analysis of their token influence patterns reveals strong structural alignment, with values exceeding 93%. This …
Imputation Via Domain Adaptation: Rethinking Variable Subset Forecasting From Knowledge Transfer, Runchang Liang, Qi Hao, Yue Gao, Kunpeng Liu, Lu Jiang, Pengyang Wang, Minghao Yin
Imputation Via Domain Adaptation: Rethinking Variable Subset Forecasting From Knowledge Transfer, Runchang Liang, Qi Hao, Yue Gao, Kunpeng Liu, Lu Jiang, Pengyang Wang, Minghao Yin
Computer Science Faculty Publications and Presentations
Multivariate time series forecasting in practical deployment faces a critical challenge termed Variable Subset Forecasting (VSF), where certain variables accessible during training are entirely missing during inference. This creates a stark discrepancy between the training (source domain with full variables) and inference (target domain with partial variables) environments, disrupting cross-variable dependencies and fragmenting global temporal patterns. Existing imputation methods, limited to transferring local knowledge (e.g., temporal neighbors or pairwise correlations), fail to capture essential global dynamics, leading to severe performance degradation under distribution shifts. To address these challenges, we redefine VSF as a cross-domain knowledge transfer problem and propose VIDA, …
Analysis Of Popular Songs In The Us Market, Michael Myers
Analysis Of Popular Songs In The Us Market, Michael Myers
Theses, Dissertations and Culminating Projects
In today’s digitally driven music landscape, understanding what drive’s a song’s popularity requires insight not only into its acoustic and lyrical content, but also into patterns of listener engagement across platforms. This thesis explores the predictive and descriptive dimensions of song popularity by applying supervised and unsupervised machine learning models to a multi-source dataset integrating audio features, sentiment analysis, and temporal consumption behavior. Drawing from a novel, multi-platform dataset that includes Billboard Hot 100 rankings, Spotify acoustic features and popularity scores, streaming, airplay, and sales metrics as reported on Luminate’s Music Connect, and lyrics from AZLyrics, the study investigates the …
Mpo: Multilingual Safety Alignment Via Reward Gap Optimization, Weixiang Zhao, Yulin Hu, Yang Deng, Tongtong Wu, Wenxuan Zhang, Jiahe Guo, An Zhang, Yanyan Zhao, Bing Qin, Tat-Seng Chua, Ting Liu
Mpo: Multilingual Safety Alignment Via Reward Gap Optimization, Weixiang Zhao, Yulin Hu, Yang Deng, Tongtong Wu, Wenxuan Zhang, Jiahe Guo, An Zhang, Yanyan Zhao, Bing Qin, Tat-Seng Chua, Ting Liu
Research Collection School Of Computing and Information Systems
Large language models (LLMs) have become increasingly central to AI applications worldwide, necessitating robust multilingual safety alignment to ensure secure deployment across diverse linguistic contexts. Existing preference learning methods for safety alignment, such as RLHF and DPO, are primarily monolingual and struggle with noisy multilingual data. To address these limitations, we introduce Multilingual reward gaP Optimization (MPO), a novel approach that leverages the well-aligned safety capabilities of the dominant language (e.g., English) to improve safety alignment across multiple languages. MPO directly minimizes the reward gap difference between the dominant language and target languages, effectively transferring safety capabilities while preserving the …
Think Both Ways: Teacher-Student Bidirectional Reasoning Enhances Mcq Generation And Distractor Quality, Yimiao Qiu, Yang Deng, Quanming Yao, Zhimeng Zhang, Zhiang Dong, Chang Yao, Jingyuan Chen
Think Both Ways: Teacher-Student Bidirectional Reasoning Enhances Mcq Generation And Distractor Quality, Yimiao Qiu, Yang Deng, Quanming Yao, Zhimeng Zhang, Zhiang Dong, Chang Yao, Jingyuan Chen
Research Collection School Of Computing and Information Systems
Generating high-quality Multiple Choice Questions (MCQs) remains challenging for educational tools due to the need for contextual relevance and plausible distractors. Existing methods still struggle with these dual requirements, leading to questions that lack depth and distractors that are either too obvious or irrelevant. In this paper, we propose BiFlow, a novel framework that integrates bidirectional reasoning perspectives: teacher reasoning generates contextually relevant questions and plausible distractors, while student reasoning evaluates question clarity and the misleading nature of the distractors. To further enhance reasoning, we introduce PathFinder, a mechanism that employs breadth-first search and Chainof-Thought (CoT) strategies to explore diverse …
How Developers Use Type-System Related Programming Language Features, Samuel W. Flint
How Developers Use Type-System Related Programming Language Features, Samuel W. Flint
Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–
Optional type annotations are a popular feature of programming languages that allow developers to omit explicit type information in code while, in some cases, retaining many of the benefits of static typing, such as in-code documentation, improved detection of type errors, or enforcement of code properties. However, how developers use and understand optional type annotations is not clear. The focus of this dissertation is to understand the use and comprehension of optional type annotations.
Optional type annotations are examined through four lenses: first, by examining the evolution of usage in a statically typed programming language (Kotlin, the default language for …
How Developers Use Type-System Related Programming Language Features, Samuel W. Flint
How Developers Use Type-System Related Programming Language Features, Samuel W. Flint
School of Computing: Dissertations, Theses, and Student Research
Optional type annotations are a popular feature of programming languages that allow developers to omit explicit type information in code while, in some cases, retaining many of the benefits of static typing, such as in-code documentation, improved detection of type errors, or enforcement of code properties. However, how developers use and understand optional type annotations is not clear. The focus of this dissertation is to understand the use and comprehension of optional type annotations.
Optional type annotations are examined through four lenses: first, by examining the evolution of usage in a statically typed programming language (Kotlin, the default language for …
Computational Fact-Checking With Limited Resources, Fengzhu Zeng
Computational Fact-Checking With Limited Resources, Fengzhu Zeng
Dissertations and Theses Collection (Open Access)
The rapid dissemination of information through online platforms has sparked widespread concern about the propagation of misinformation. Manual fact-checking by pro- fessional fact-checkers is time-consuming and lacks scalability to address the vast volume of daily information. Consequently, computational fact-checking, driven by automated techniques in natural language processing (NLP), has garnered interest as
a potential solution. However, computational fact-checking faces critical challenges limited resources, particularly due to the issues of data scarcity and computing resource constraints. One key challenge is data scarcity, which arises from the constant generation of new information and emerging events on social media. This scarcity manifests in …
Dreamanime: Learning Style-Identity Textual Disentanglement For Anime And Beyond, Chenshu Xu, Yangyang Xu, Huaidong Zhang, Xuemiao Xu, Shengfeng He
Dreamanime: Learning Style-Identity Textual Disentanglement For Anime And Beyond, Chenshu Xu, Yangyang Xu, Huaidong Zhang, Xuemiao Xu, Shengfeng He
Research Collection School Of Computing and Information Systems
Text-to-image generation models have significantly broadened the horizons of creative expression through the power of natural language. However, navigating these models to generate unique concepts, alter their appearance, or reimagine them in unfamiliar roles presents an intricate challenge. For instance, how can we exploit language-guided models to transpose an anime character into a different art style, or envision a beloved character in a radically different setting or role? This paper unveils a novel approach named DreamAnime, designed to provide this level of creative freedom. Using a minimal set of 2-3 images of a user-specified concept such as an anime character …
Focus: Evaluating Pre-Trained Vision-Language Models On Underspecification Reasoning, Kankan Zhou, Yibin Lai, Kyriakos Mouratidis, Jing Jiang
Focus: Evaluating Pre-Trained Vision-Language Models On Underspecification Reasoning, Kankan Zhou, Yibin Lai, Kyriakos Mouratidis, Jing Jiang
Research Collection School Of Computing and Information Systems
Humans possess a remarkable ability to interpret underspecified ambiguous statements by inferring their meanings from contexts such as visual inputs. This ability, however, may not be as developed in recent pre-trained visionlanguage models (VLMs). In this paper, we introduce a novel probing dataset called FOCUS to evaluate whether state-of-the-art VLMs have this ability. FOCUS consists of underspecified sentences paired with image contexts and carefully designed probing questions. Our experiments reveal that VLMs still fall short in handling underspecification even when visual inputs that can help resolve the ambiguities are available. To further support research in underspecification, FOCUS will be released …
Evowiki: Evaluating Llms On Evolving Knowledge, Wei Tang, Yixin Cao, Yang Deng, Jiahao Ying, Bo Wang, Yizhe Yang, Yuyue Zhao, Qi Zhang, Xuanjing Huang, Yu-Gang Jiang, Yong Liao
Evowiki: Evaluating Llms On Evolving Knowledge, Wei Tang, Yixin Cao, Yang Deng, Jiahao Ying, Bo Wang, Yizhe Yang, Yuyue Zhao, Qi Zhang, Xuanjing Huang, Yu-Gang Jiang, Yong Liao
Research Collection School Of Computing and Information Systems
Knowledge utilization is a critical aspect of LLMs, and understanding how they adapt to evolving knowledge is essential for their effective deployment. However, existing benchmarks are predominantly static, failing to capture the evolving nature of LLMs and knowledge, leading to inaccuracies and vulnerabilities such as contamination. In this paper, we introduce EvoWiki, an evolving dataset designed to reflect knowledge evolution by categorizing information into stable, evolved, and uncharted states. EvoWiki is fully auto-updated, enabling precise evaluation of continuously changing knowledge and newly released LLMs. Through experiments with Retrieval-Augmented Generation (RAG) and Continual Learning (CL), we evaluate how effectively LLMs adapt …
Xfinbench: Benchmarking Llms In Complex Financial Problem Solving And Reasoning, Zhihan Zhang, Yixin Cao, Lizi Liao
Xfinbench: Benchmarking Llms In Complex Financial Problem Solving And Reasoning, Zhihan Zhang, Yixin Cao, Lizi Liao
Research Collection School Of Computing and Information Systems
Solving financial problems demands complex reasoning, multimodal data processing, and a broad technical understanding, presenting unique challenges for current large language models (LLMs). We introduce **XFinBench**, a novel benchmark with 4,235 examples designed to evaluate LLM’s ability in solving comple**X**, knowledge-intensive **Fin**ancial problems across diverse graduate-level finance topics with multi-modal context. We identify five core capabilities of LLMs using XFinBench, i.e., _terminology understanding_, _temporal reasoning_, _future forecasting_, _scenario planning_, and _numerical modelling_. Upon XFinBench, we conduct extensive experiments on 18 leading models. The result shows that o1 is the best-performing text-only model with an overall accuracy of 67.3%, but still …
Taclr: A Scalable And Efficient Retrieval-Based Method For Industrial Product Attribute Value Identification, Yindu Su, Huike Zou, Lin Sun, Ting Zhang, Haiyang Yang, Chen Li Yu, David Lo, Qingheng Zhang, Shuguang Han, Jufeng Chen
Taclr: A Scalable And Efficient Retrieval-Based Method For Industrial Product Attribute Value Identification, Yindu Su, Huike Zou, Lin Sun, Ting Zhang, Haiyang Yang, Chen Li Yu, David Lo, Qingheng Zhang, Shuguang Han, Jufeng Chen
Research Collection School Of Computing and Information Systems
Product Attribute Value Identification (PAVI) involves identifying attribute values from product profiles, a key task for improving product search, recommendation, and business analytics on e-commerce platforms. However, existing PAVI methods face critical challenges, such as inferring implicit values, handling outof-distribution (OOD) values, and producing normalized outputs. To address these limitations, we introduce Taxonomy-Aware Contrastive Learning Retrieval (TACLR), the first retrieval-based method for PAVI. TACLR formulates PAVI as an information retrieval task by encoding product profiles and candidate values into embeddings and retrieving values based on their similarity. It leverages contrastive training with taxonomy-aware hard negative sampling and employs adaptive inference …
Predicting Music Origin With Deep Learning, Fruzsina Ladanyi
Predicting Music Origin With Deep Learning, Fruzsina Ladanyi
Electronic Theses, Projects, and Dissertations
This project explores the usage of a late fusion deep learning architecture to predict the geographic origin of music. Mel-Frequency Cepstral Coefficients (MFCCs) and the language of the music sample are used as features. MFCCs were extracted from audio files to capture sound features. The language was identified using OpenAI’s Whisper model to provide additional context. A late fusion neural network architecture combining Long Short-Term Memory (LSTM) layers for sequential MFCC input and dense layers for non-sequential language features were employed to support both classification and regression tasks. The classification model achieved an accuracy of 33.03% across 56 countries or …
Empirical Evaluation Of Bayes Error Rate Bounds In Binary Classification, Riley May
Empirical Evaluation Of Bayes Error Rate Bounds In Binary Classification, Riley May
All Graduate Theses and Dissertations, Fall 2023 to Present
Classification tasks are fundamental in statistical machine learning. In classification tasks, a general goal is to build or select a model that can correctly classify data with as few errors as possible. However, for a particular dataset, the minimal number of errors achievable is seldom zero since overlap in the data makes errors unavoidable. As a result, it is often difficult for machine learning practitioners and data scientists to know whether classification errors can be reduced through further refinement. A potential solution to this lies in the Bayes error rate (BER). The BER is the lowest error rate achievable for …
How To Do Things With Little Talking Tubes: Nonideal Speech Acts In The Digital Age, Anthony Holdier
How To Do Things With Little Talking Tubes: Nonideal Speech Acts In The Digital Age, Anthony Holdier
Graduate Theses and Dissertations
In this work, I develop a view about what it means to share a social or conversational context with others, as well as what is normatively entailed by doing so. Working from a broadly Austinian perspective about the moral foundations of language use and how we use words to position ourselves within social space, as well as from a generally Stalnakerian social ontology (demarcating groups by dint of aligned or overlapping sets of commitments), I present three papers demonstrating how nonidealized, ordinary language philosophy can make sense of complex, real-world phenomena. Through analyses of heretical utterances, context collapse, and chatbot …
Rhetorics Of Encounter: Toward A Biocentric Theory Of Discourse, Matthew D. Whitaker
Rhetorics Of Encounter: Toward A Biocentric Theory Of Discourse, Matthew D. Whitaker
Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–
Encounters with more-than-human identities are transformative moments that stand to affect dispositional and bodily change in individuals. From close brushes with wild animals in National Parks to everyday interactions with local ecologies, encounters invite us to feel and think differently about the nature of our realities. In Rhetorics of Encounter: Toward a Biocentric Theory of Discourse, I draw from interdisciplinary perspectives to disrupt the idea of rhetoric as a representational medium, arguing that rhetoric occurs not just through textual exchanges of words and symbols, but through embodied moments of contact with other responsive beings. Invoking George Kennedy’s theory …
Faithfulrag: Fact-Level Conflict Modeling For Context-Faithful Retrieval-Augmented Generation, Qinggang Zhang, Zhishang Xiang, Yilin Xiao, Le Wang, Junhui Li, Xinrun Wang, Jinsong Su
Faithfulrag: Fact-Level Conflict Modeling For Context-Faithful Retrieval-Augmented Generation, Qinggang Zhang, Zhishang Xiang, Yilin Xiao, Le Wang, Junhui Li, Xinrun Wang, Jinsong Su
Research Collection School Of Computing and Information Systems
Large language models (LLMs) augmented with retrieval systems have demonstrated significant potential in handling knowledge-intensive tasks. However, these models often struggle with unfaithfulness issues, generating outputs that either ignore the retrieved context or inconsistently blend it with the LLM’s parametric knowledge. This issue is particularly severe in cases of knowledge conflict, where the retrieved context conflicts with the model’s parametric knowledge. While existing faithful RAG approaches enforce strict context adherence through well-designed prompts or modified decoding strategies, our analysis reveals a critical limitation: they achieve faithfulness by forcibly suppressing the model’s parametric knowledge, which undermines the model’s internal knowledge structure …
Debate, Reflect, And Distill: Multi-Agent Feedback With Tree-Structured Preference Optimization For Efficient Language Model Enhancement, Xiaofeng Zhou, Heyan Huang, Lizi Liao
Debate, Reflect, And Distill: Multi-Agent Feedback With Tree-Structured Preference Optimization For Efficient Language Model Enhancement, Xiaofeng Zhou, Heyan Huang, Lizi Liao
Research Collection School Of Computing and Information Systems
Large Language Models (LLMs) continue to set new standards in knowledge-intensive and complex reasoning tasks, yet their high computational demands limit widespread adoption. While distilling large models into smaller ones offers a sustainable solution, current techniques—such as static knowledge distillation, resource-intensive reinforcement learning from human feedback, or limited self-reflection—struggle to yield substantial and lasting performance gains. In this paper, we present a novel Debate and Reflect (D&R) framework that orchestrates multi-turn debates between smaller models and stronger teacher models, eliciting actionable feedback (e.g., error analysis, corrective strategies) to guide student models. Further, we introduce Tree-structured Direct Preference Optimization (T-DPO) to …
Memotune: A Measure And Moment-Driven Fine-Tuning Framework For Quantized Large Language Models, Yun Zhang, Xue Geng, Lizi Liao, Jintong Sun, Minghe Yu, Ge Yu
Memotune: A Measure And Moment-Driven Fine-Tuning Framework For Quantized Large Language Models, Yun Zhang, Xue Geng, Lizi Liao, Jintong Sun, Minghe Yu, Ge Yu
Research Collection School Of Computing and Information Systems
Quantizing large language models (LLMs) is essential for reducing memory and computational costs in natural language processing. Existing methods combine quantization with parameter-efficient fine-tuning but often fail to meet practical performance requirements. This paper introduces MeMoTune, a novel fine-tuning framework for quantized LLMs. By employing a measure and moment approach within a low-rank approximation framework in probability measure space, MeMoTune optimizes the objective function for superior fine-tuning results. The update process is further refined through scaled gradient, enhancing convergence efficiency and noise robustness. Experiments on tasks like text generation, summarization, and understanding show MeMoTune significantly outperforms state-of-the-art methods, e.g. fine-tuning …
R2dqg: A Quality Meets Diversity Framework For Question Generation Over Knowledge Bases, Yimeng Ren, Yanhua Yu, Lizi Liao, Yuhu Shang, Kangkang Lu, Mingliang Yan
R2dqg: A Quality Meets Diversity Framework For Question Generation Over Knowledge Bases, Yimeng Ren, Yanhua Yu, Lizi Liao, Yuhu Shang, Kangkang Lu, Mingliang Yan
Research Collection School Of Computing and Information Systems
The task of Knowledge-Based Question Generation (KBQG) involves generating natural language questions from structured knowledge sources, posing unique challenges in balancing linguistic diversity and semantic relevance. Existing models often focus on maximizing surface-level similarity to ground-truth questions, neglecting the need for diverse syntactic forms and leading to semantic drift during generation. To overcome these challenges, we propose Refine-Reinforced Diverse Question Generation (R2DQG), a two-phase framework leveraging a generation-then-refinement paradigm. The Generator first constructs a diverse set of expressive templates using dependency parse tree similarity, capturing a wide range of syntactic patterns and styles. These templates guide the creation of question …
Consistent Client Simulation For Motivational Interviewing-Based Counseling, Yizhe Yang, Palakorn Achananuparp, Heyan Huang, Jing Jiang, Nicholas Gabriel Lim, Cameron Shi Ern Tan, Phey Ling Kit, Jenny Xiuhui Giam, John Pinto, Ee-Peng Lim
Consistent Client Simulation For Motivational Interviewing-Based Counseling, Yizhe Yang, Palakorn Achananuparp, Heyan Huang, Jing Jiang, Nicholas Gabriel Lim, Cameron Shi Ern Tan, Phey Ling Kit, Jenny Xiuhui Giam, John Pinto, Ee-Peng Lim
Research Collection School Of Computing and Information Systems
Simulating human clients in mental health counseling is crucial for training and evaluating counselors (both human or simulated) in a scalable manner. Nevertheless, past research on client simulation did not focus on complex conversation tasks such as mental health counseling. In these tasks, the challenge is to ensure that the client’s actions (i.e., interactions with the counselor) are consistent with with its stipulated profiles and negative behavior settings. In this paper, we propose a novel framework that supports consistent client simulation for mental health counseling. Our framework tracks the mental state of a simulated client, controls its state transitions, and …
Knowledge Boundary Of Large Language Models: A Survey, Moxin Li, Yong Zhao, Wenxuan Zhang, Shuaiyi Li, Wenya Xie, See-Kiong Ng, Tat-Seng Chua, Yang Deng
Knowledge Boundary Of Large Language Models: A Survey, Moxin Li, Yong Zhao, Wenxuan Zhang, Shuaiyi Li, Wenya Xie, See-Kiong Ng, Tat-Seng Chua, Yang Deng
Research Collection School Of Computing and Information Systems
Although large language models (LLMs) store vast amount of knowledge in their parameters, they still have limitations in the memorization and utilization of certain knowledge, leading to undesired behaviors such as generating untruthful and inaccurate responses. This highlights the critical need to understand the knowledge boundary of LLMs, a concept that remains inadequately defined in existing research. In this survey, we propose a comprehensive definition of the LLM knowledge boundary and introduce a formalized taxonomy categorizing knowledge into four distinct types. Using this foundation, we systematically review the field through three key lenses: the motivation for studying LLM knowledge boundaries, …
Colloquial Singaporean English Style Transfer With Fine-Grained Explainable Control, Jinggui Liang, Dung Vo, Yap Hong Xian, Hai Leong Chieu, Kian Ming A. Chai, Jing Jiang, Lizi Liao
Colloquial Singaporean English Style Transfer With Fine-Grained Explainable Control, Jinggui Liang, Dung Vo, Yap Hong Xian, Hai Leong Chieu, Kian Ming A. Chai, Jing Jiang, Lizi Liao
Research Collection School Of Computing and Information Systems
Colloquial Singaporean English (Singlish) is an informal English marked by a unique blend of languages reflecting Singapore’s multicultural identity. Style transfer between Singlish and Standard (formal) English is vital for various applications, yet existing methods often lack explainability and fine-grained control. To fill this gap, we contribute in two key ways. First, we construct a large, high-quality dataset of formal and informal sentences, annotated across six linguistic aspects—Syntax, Lexical Borrowing, Pragmatics, Prosody/Phonology, Emoticons/Punctuation, and Code-Switching—with detailed explanations. Starting with manually annotated cases, we scaled the dataset to 140K with ensured quality. Second, inspired by the “Society of Mind” theory, we …
Service With A Smile Or Salesperson Mirroring? Understanding The Flow Of Emotional Contagion In Sales Encounters, Vinh Quoc Trong Luong
Service With A Smile Or Salesperson Mirroring? Understanding The Flow Of Emotional Contagion In Sales Encounters, Vinh Quoc Trong Luong
Theses and Dissertations in Business Administration
This study examines the directionality of emotional contagion in sales interactions, addressing a critical gap in understanding whether emotions flow primarily from the salesperson to the customer, from the customer to the salesperson, or bidirectionally. While prior research emphasizes customer-driven emotional flow or bidirectional alignment, this study challenges these assumptions by employing categorical Cross-Recurrence Quantification Analysis (CRQA) to assess temporal emotional synchronization in sales dialogues. Leveraging automated sentiment analysis and multi-agent AI evaluation for performance metrics, the research analyzes 166 sales interactions to quantify emotional influence dynamics. Results reveal that salespeople predominantly lead emotional exchanges, exhibiting stronger and more stable …