Open Access. Powered by Scholars. Published by Universities.®
- Institution
-
- Singapore Management University (1121)
- TÜBİTAK (210)
- Wright State University (197)
- Technological University Dublin (192)
- University of New Mexico (165)
-
- Old Dominion University (143)
- Claremont Colleges (126)
- Missouri University of Science and Technology (125)
- University of Nebraska - Lincoln (125)
- San Jose State University (119)
- City University of New York (CUNY) (117)
- Brigham Young University (105)
- Neutrosophic Systems with Applications (92)
- University of Texas at El Paso (88)
- University of Northern Iowa (78)
- University of South Florida (77)
- Chulalongkorn University (73)
- Dartmouth College (71)
- MBZUAI (70)
- Kennesaw State University (66)
- Zayed University (62)
- Portland State University (61)
- Chapman University (59)
- New Jersey Institute of Technology (57)
- Boise State University (56)
- Edith Cowan University (56)
- University of Arkansas, Fayetteville (55)
- University of Nevada, Las Vegas (53)
- Purdue University (51)
- Montclair State University (50)
- Keyword
-
- Natural language processing (211)
- Machine learning (210)
- Artificial intelligence (156)
- Natural Language Processing (155)
- Machine Learning (147)
-
- Deep learning (132)
- Artificial Intelligence (101)
- Large language models (88)
- Computer Science (84)
- Social media (83)
- NLP (76)
- Twitter (70)
- Sentiment analysis (69)
- Mathematics (68)
- Deep Learning (67)
- Large Language Models (62)
- Text mining (59)
- Neural networks (58)
- Computational linguistics (54)
- Computer science (53)
- Department of Computer Science and Engineering (53)
- Education (49)
- Fuzzy logic (49)
- AI (48)
- Generative AI (48)
- Data mining (47)
- Linguistics (43)
- Classification (41)
- Social Media (39)
- Information retrieval (38)
- Publication Year
- Publication
-
- Research Collection School Of Computing and Information Systems (1037)
- Theses and Dissertations (224)
- Turkish Journal of Electrical Engineering and Computer Sciences (199)
- Branch Mathematics and Statistics Faculty and Staff Publications (150)
- Master's Projects (99)
-
- Conference papers (96)
- Neutrosophic Systems with Applications (92)
- Kno.e.sis Publications (84)
- Dissertations (83)
- Chulalongkorn University Theses and Dissertations (Chula ETD) (70)
- Computer Science Faculty Research & Creative Works (66)
- Electronic Theses and Dissertations (65)
- Journal of Humanistic Mathematics (63)
- All Works (62)
- Browse all Theses and Dissertations (62)
- Faculty Publications (59)
- Computer Science Faculty Publications (58)
- USF Tampa Graduate Theses and Dissertations (55)
- Publications and Research (51)
- Iowa Academy of Science Documents (50)
- Computer Science Faculty Publications and Presentations (45)
- Departmental Technical Reports (CS) (44)
- Dissertations, Theses, and Capstone Projects (44)
- Articles (42)
- Faculty, Staff and Student Publications (42)
- Open Access Theses & Dissertations (42)
- Journal of Informatics and Web Engineering (41)
- SMU Data Science Review (41)
- Walden Dissertations and Doctoral Studies (39)
- Computer Science and Engineering Faculty Publications (38)
- Publication Type
- File Type
Articles 1831 - 1860 of 6319
Full-Text Articles in Entire DC Network
Cheer: Centrality-Aware High-Order Event Reasoning Network For Document-Level Event Causality Identification, Meiqi Chen, Yixin Cao, Yan Zhang, Zhiwei Liu
Cheer: Centrality-Aware High-Order Event Reasoning Network For Document-Level Event Causality Identification, Meiqi Chen, Yixin Cao, Yan Zhang, Zhiwei Liu
Research Collection School Of Computing and Information Systems
Document-level Event Causality Identification (DECI) aims to recognize causal relations between events within a document. Recent studies focus on building a document-level graph for cross-sentence reasoning, but ignore important causal structures — there are one or two “central” events that prevail throughout the document, with most other events serving as either their cause or consequence. In this paper, we manually annotate central events for a systematical investigation and propose a novel DECI model, CHEER, which performs high-order reasoning while considering event centrality. First, we summarize a general GNN-based DECI model and provide a unified view for better understanding. Second, we …
Cone: An Efficient Coarse-To-Fine Alignment Framework For Long Video Temporal Grounding, Zhijian Hou, Wanjun Zhong, Lei Ji, Difei Gao, Kun Yan, Wing-Kwong Chan, Chong-Wah Ngo, Mike Z. Shou, Nan. Duan
Cone: An Efficient Coarse-To-Fine Alignment Framework For Long Video Temporal Grounding, Zhijian Hou, Wanjun Zhong, Lei Ji, Difei Gao, Kun Yan, Wing-Kwong Chan, Chong-Wah Ngo, Mike Z. Shou, Nan. Duan
Research Collection School Of Computing and Information Systems
This paper tackles an emerging and challenging problem of long video temporal grounding (VTG) that localizes video moments related to a natural language (NL) query. Compared with short videos, long videos are also highly demanded but less explored, which brings new challenges in higher inference computation cost and weaker multi-modal alignment. To address these challenges, we propose CONE, an efficient COarse-to-fiNE alignment framework. CONE is a plug-and-play framework on top of existing VTG models to handle long videos through a sliding window mechanism. Specifically, CONE (1) introduces a query-guided window selection strategy to speed up inference, and (2) proposes a …
Diaasq: A Benchmark Of Conversational Aspect-Based Sentiment Quadruple Analysis, Bobo Li, Hao Fei, Fei Li, Yuhan Wu, Jinsong Zhang, Shengqiong Wu, Jingye Li, Yijiang Liu, Lizi Liao, Tat-Seng Chua, Donghong Ji
Diaasq: A Benchmark Of Conversational Aspect-Based Sentiment Quadruple Analysis, Bobo Li, Hao Fei, Fei Li, Yuhan Wu, Jinsong Zhang, Shengqiong Wu, Jingye Li, Yijiang Liu, Lizi Liao, Tat-Seng Chua, Donghong Ji
Research Collection School Of Computing and Information Systems
The rapid development of aspect-based sentiment analysis (ABSA) within recent decades shows great potential for real-world society. The current ABSA works, however, are mostly limited to the scenario of a single text piece, leaving the study in dialogue contexts unexplored. To bridge the gap between fine-grained sentiment analysis and conversational opinion mining, in this work, we introduce a novel task of conversational aspect-based sentiment quadruple analysis, namely DiaASQ, aiming to detect the quadruple of target-aspect-opinion-sentiment in a dialogue. We manually construct a large-scale high-quality DiaASQ dataset in both Chinese and English languages. We deliberately develop a neural model to benchmark …
Take A Break In The Middle: Investigating Subgoals Towards Hierarhical Script Generation, Xinze Li, Yixin Cao, Muhao Chen, Aixin Sun
Take A Break In The Middle: Investigating Subgoals Towards Hierarhical Script Generation, Xinze Li, Yixin Cao, Muhao Chen, Aixin Sun
Research Collection School Of Computing and Information Systems
Goal-oriented Script Generation is a new task of generating a list of steps that can fulfill the given goal. In this paper, we propose to extend the task from the perspective of cognitive theory. Instead of a simple flat structure, the steps are typically organized hierarchically — Human often decompose a complex task into subgoals, where each subgoal can be further decomposed into steps. To establish the benchmark, we contribute a new dataset, propose several baseline methods, and set up evaluation metrics. Both automatic and human evaluation verify the high-quality of dataset, as well as the effectiveness of incorporating subgoals …
Synthesizing Speech Test Cases With Text-To-Speech? An Empirical Study On The False Alarms In Automated Speech Recognition Testing, Julia Kaiwen Lau, Kelvin Kai Wen Kong, Julian Hao Yong, Per Hoong Tan, Zhou Yang, Zi Qian Yong, Joshua Chern Wey Low, Chun Yong Chong, Mei Kuan Lim, David Lo
Synthesizing Speech Test Cases With Text-To-Speech? An Empirical Study On The False Alarms In Automated Speech Recognition Testing, Julia Kaiwen Lau, Kelvin Kai Wen Kong, Julian Hao Yong, Per Hoong Tan, Zhou Yang, Zi Qian Yong, Joshua Chern Wey Low, Chun Yong Chong, Mei Kuan Lim, David Lo
Research Collection School Of Computing and Information Systems
Recent studies have proposed the use of Text-To-Speech (TTS) systems to automatically synthesise speech test cases on a scale and uncover a large number of failures in ASR systems. However, the failures uncovered by synthetic test cases may not reflect the actual performance of an ASR system when it transcribes human audio, which we refer to as false alarms. Given a failed test case synthesised from TTS systems, which consists of TTS-generated audio and the corresponding ground truth text, we feed the human audio stating the same text to an ASR system. If human audio can be correctly transcribed, an …
Learning To Ask Clarification Questions With Spatial Reasoning, Yang Deng, Shuaiyi Li, Wai Lam
Learning To Ask Clarification Questions With Spatial Reasoning, Yang Deng, Shuaiyi Li, Wai Lam
Research Collection School Of Computing and Information Systems
Asking clarifying questions has become a key element of various conversational systems, allowing for an effective resolution of ambiguity and uncertainty through natural language questions. Despite the extensive applications of spatial information grounded dialogues, it remains an understudied area on learning to ask clarification questions with the capability of spatial reasoning. In this work, we propose a novel method, named SpatialCQ, for this problem. Specifically, we first align the representation space between textual and spatial information by encoding spatial states with textual descriptions. Then a multi-relational graph is constructed to capture the spatial relations and enable spatial reasoning with relational …
Towards Robust Personalized Dialogue Generation Via Order-Insensitive Representation Regularization, Liang Chen, Hongru Wang, Yang Deng, Wai-Chung Kwan, Zezhong Wang, Kam-Fai Wong
Towards Robust Personalized Dialogue Generation Via Order-Insensitive Representation Regularization, Liang Chen, Hongru Wang, Yang Deng, Wai-Chung Kwan, Zezhong Wang, Kam-Fai Wong
Research Collection School Of Computing and Information Systems
Generating persona consistent dialogue response is important for developing an intelligent conversational agent. Recent works typically fine-tune large-scale pre-trained models on this task by concatenating persona texts and dialogue history as a single input sequence to generate the target response. While simple and effective, our analysis shows that this popular practice is seriously affected by order sensitivity where different input orders of persona sentences significantly impact the quality and consistency of generated response, resulting in severe performance fluctuations (i.e., 29.4% on GPT2 and 83.2% on BART). To mitigate the order sensitivity problem, we propose a model-agnostic framework, ORder Insensitive Generation …
Information Screening Whilst Exploiting! Multimodal Relation Extraction With Feature Denoising And Multimodal Topic Modeling, Shengqiong Wu, Hao Fei, Yixin Cao, Lidong Bing, Tat-Seng Chua
Information Screening Whilst Exploiting! Multimodal Relation Extraction With Feature Denoising And Multimodal Topic Modeling, Shengqiong Wu, Hao Fei, Yixin Cao, Lidong Bing, Tat-Seng Chua
Research Collection School Of Computing and Information Systems
Existing research on multimodal relation extraction (MRE) faces two co-existing challenges, internal-information over-utilization and external-information under-exploitation. To combat that, we propose a novel framework that simultaneously implements the idea of internal-information screening and external-information exploiting. First, we represent the fine-grained semantic structures of the input image and text with the visual and textual scene graphs, which are further fused into a unified cross-modal graph (CMG). Based on CMG, we perform structure refinement with the guidance of the graph information bottleneck principle, actively denoising the less-informative features. Next, we perform topic modeling over the input image and text, incorporating latent multimodal …
Few-Shot Event Detection: An Empirical Study And A Unified View, Yubo Ma, Zehao Wang, Yixin Cao, Aixin Sun
Few-Shot Event Detection: An Empirical Study And A Unified View, Yubo Ma, Zehao Wang, Yixin Cao, Aixin Sun
Research Collection School Of Computing and Information Systems
Few-shot event detection (ED) has been widely studied, while this brings noticeable discrepancies, e.g., various motivations, tasks, and experimental settings, that hinder the understanding of models for future progress. This paper presents a thorough empirical study, a unified view of ED models, and a better unified baseline. For fair evaluation, we compare 12 representative methods on three datasets, which are roughly grouped into prompt-based and prototype-based models for detailed analysis. Experiments consistently demonstrate that prompt-based methods, including ChatGPT, still significantly trail prototype-based methods in terms of overall performance. To investigate their superior performance, we break down their design elements along …
Prompt To Be Consistent Is Better Than Self-Consistent? Few-Shot And Zero-Shot Fact Verification With Pre-Trained Language Models, Fengzhu Zeng, Wei Gao
Prompt To Be Consistent Is Better Than Self-Consistent? Few-Shot And Zero-Shot Fact Verification With Pre-Trained Language Models, Fengzhu Zeng, Wei Gao
Research Collection School Of Computing and Information Systems
Few-shot or zero-shot fact verification only relies on a few or no labeled training examples. In this paper, we propose a novel method called ProToCo, to Prompt pre-trained language models (PLMs) To be Consistent, for improving the factuality assessment capability of PLMs in the few-shot and zero-shot settings. Given a claim-evidence pair, ProToCo generates multiple variants of the claim with different relations and frames a simple consistency mechanism as constraints for making compatible predictions across these variants. We update PLMs by using parameter-efficient fine-tuning (PEFT), leading to more accurate predictions in few-shot and zero-shot fact verification tasks. Our experiments on …
Multi-View Hypergraph Contrastive Policy Learning For Conversational Recommendation, Sen Zhao, Wei Wei, Xian-Ling Mao, Shuai: Yang Zhu, Zujie Wen, Dangyang Chen, Feida Zhu, Feida Zhu
Multi-View Hypergraph Contrastive Policy Learning For Conversational Recommendation, Sen Zhao, Wei Wei, Xian-Ling Mao, Shuai: Yang Zhu, Zujie Wen, Dangyang Chen, Feida Zhu, Feida Zhu
Research Collection School Of Computing and Information Systems
Conversational recommendation systems (CRS) aim to interactively acquire user preferences and accordingly recommend items to users. Accurately learning the dynamic user preferences is of crucial importance for CRS. Previous works learn the user preferences with pairwise relations from the interactive conversation and item knowledge, while largely ignoring the fact that factors for a relationship in CRS are multiplex. Specifically, the user likes/dislikes the items that satisfy some attributes (Like/Dislike view). Moreover social influence is another important factor that affects user preference towards the item (Social view), while is largely ignored by previous works in CRS. The user preferences from these …
Generative Ai And Chatgpt: Applications, Challenges, And Ai-Human Collaboration, Fiona Nah, Ruilin Zheng, Jingyuan Cai, Keng Siau, Langtao Chen
Generative Ai And Chatgpt: Applications, Challenges, And Ai-Human Collaboration, Fiona Nah, Ruilin Zheng, Jingyuan Cai, Keng Siau, Langtao Chen
Research Collection School Of Computing and Information Systems
Artificial intelligence (AI) has elicited much attention across disciplines and industries (Hyder et al., Citation2019). AI has been defined as “a system’s ability to correctly interpret external data, to learn from such data, and to use those learnings to achieve specific goals and tasks through flexible adaptation” (Kaplan & Haenlein, Citation2019, p. 15). AI has gone through several development stages and AI winters. In the first two decades (i.e., 1950s and 1960s), AI demonstrated success which included programs such as General Problem Solver (Newell et al., Citation1959) and ELIZA (Weizenbaum, Citation1966). However, limitations in processing capacity and reduced spending on …
Security Of Text To Image Conversions, Zobaida Alssadi
Security Of Text To Image Conversions, Zobaida Alssadi
Theses and Dissertations
The use of images and icons to represent news or narratives has grown in popularity. Still, one critical problem is that they are not equivalent to language, making them vulnerable to adversary attacks. This study examines the impact of image-poisoning attacks based on polysemantic words and of image attacks based on cultural differences when converting text to images. Such attacks can lead to the loss of important information and create confusion and incorrect interpretations of the intended meaning, misinforming the general public. The study specifically focuses on possible effects in a news and story context. This study highlights the significance …
Artificial Intelligence-Based Smarter Accessibility Evaluations For Comprehensive And Personalized Assessment, Sayeda Farzana Aktar
Artificial Intelligence-Based Smarter Accessibility Evaluations For Comprehensive And Personalized Assessment, Sayeda Farzana Aktar
Dissertations (1934 -)
The research focuses on utilizing artificial intelligence (AI) and machine learning (ML) algorithms to enhance accessibility for people with disabilities (PwD) in three areas: public buildings, homes, and medical devices. The overarching goal is to improve the accuracy, reliability, and effectiveness of accessibility evaluation systems by leveraging smarter technologies. For public buildings, the challenge lies in developing an accurate and reliable accessibility evaluation system. AI can play a crucial role by analyzing data, identifying potential barriers, and assessing the accessibility of various features within buildings. By training ML algorithms on relevant data, the system can learn to make accurate predictions …
A Comparative Effectiveness Study On Opioid Use Disorder Prediction Using Artificial Intelligence And Existing Risk Models, Sajjad Fouladvand, Jeffery Talbert, Linda Phyliss Dwoskin, Heather M. Bush, Amy L. Meadows, Lars E. Peterson, Yash R. Mishra, Steven K. Roggenkamp, Fei Wang, Ramakanth Kavuluru, Jin Chen
A Comparative Effectiveness Study On Opioid Use Disorder Prediction Using Artificial Intelligence And Existing Risk Models, Sajjad Fouladvand, Jeffery Talbert, Linda Phyliss Dwoskin, Heather M. Bush, Amy L. Meadows, Lars E. Peterson, Yash R. Mishra, Steven K. Roggenkamp, Fei Wang, Ramakanth Kavuluru, Jin Chen
Markey Cancer Center Faculty Publications
Opioid use disorder (OUD) is a leading cause of death in the United States placing a tremendous burden on patients, their families, and health care systems. Artificial intelligence (AI) can be harnessed with available healthcare data to produce automated OUD prediction tools. In this retrospective study, we developed AI based models for OUD prediction and showed that AI can predict OUD more effectively than existing clinical tools including the unweighted opioid risk tool (ORT). Data include 474,208 patients’ data over 10 years; 269,748 were females with an average age of 56.78 years. Cases are prescription opioid users with at least …
Inter-Frame Video Compression Based On Adaptive Fuzzy Inference System Compression Of Multiple Frame Characteristics, Arief Bramanto Wicaksono Putra, Rheo Malani, Bedi Suprapty, Achmad Fanany Onnilita Gaffar, Roman Voliansky
Inter-Frame Video Compression Based On Adaptive Fuzzy Inference System Compression Of Multiple Frame Characteristics, Arief Bramanto Wicaksono Putra, Rheo Malani, Bedi Suprapty, Achmad Fanany Onnilita Gaffar, Roman Voliansky
Knowledge Engineering and Data Science
Video compression is used for storage or bandwidth efficiency in clip video information. Video compression involves encoders and decoders. Video compression uses intra-frame, inter-frame, and block-based methods. Video compression compresses nearby frame pairs into one compressed frame using inter-frame compression. This study defines odd and even neighboring frame pairings. Motion estimation, compensation, and frame difference underpin video compression methods. In this study, adaptive FIS (Fuzzy Inference System) compresses and decompresses each odd-even frame pair. First, adaptive FIS trained on all feature pairings of each odd-even frame pair. Video compression-decompression uses the taught adaptive FIS as a codec. The features utilized …
Research On Legal Text Matching Based On Pre-Training Model, Chuanming Yu, Yifan Jiang
Research On Legal Text Matching Based On Pre-Training Model, Chuanming Yu, Yifan Jiang
Journal of Scientific Information Research
[Purpose/significance]This study aims to solve the problem of traditional short text matching models being difficult to apply to long text matching tasks such as legal case retrieval. [Method/process]For the task of legal case matching, this paper proposes a Legal Text Matching model based on RoFormer （LTMR）. In the coding layer, the legal case is encoded through the RoFormer model and the legal feature extractor. In the reasoning layer, the context and interactive information of long text are further extracted by using interactive attention and self-attention mechanisms. We conducted the empirical research by applying the proposed model to the CAIL2019-SCM dataset. …
A Semantic Understanding Oriented Evaluation Of The Intelligent Q&A Service On Chinese Provincial Government Websites, Fang Wang, Zhonghan Wei, Zhixuan Lian, Jia Kang
A Semantic Understanding Oriented Evaluation Of The Intelligent Q&A Service On Chinese Provincial Government Websites, Fang Wang, Zhonghan Wei, Zhixuan Lian, Jia Kang
Journal of Scientific Information Research
[Purpose/significance]Intelligent question answering （Q&A） system has become an important facility for websites to provide consulting services. The complexity of government consultation issues poses higher requirements for the semantic understanding ability of intelligent Q&A systems on government websites.[Method/process]This study evaluates the Q&A systems of 30 Chinese provincial government websites from three aspects of problem solving quality,service interaction quality and basic construction quality by using the "Semantic Understanding based Evaluation Indicator System for Intelligent Q&A Service on Government Websites" developed by the Center for Network Society Governance of Nankai University and the supporting test sets.[Result/conclusion]The results show that Shanghai, Zhejiang and Beijing …
Humans Against Large Language Models On Hard Paraphrase Detection Tasks, Jamie C. Macbeth, Ella Chang, Jingyu Gin Chen, Yining Hua, Sandra Grandic, Winnie X. Zheng
Humans Against Large Language Models On Hard Paraphrase Detection Tasks, Jamie C. Macbeth, Ella Chang, Jingyu Gin Chen, Yining Hua, Sandra Grandic, Winnie X. Zheng
Computer Science: Faculty Publications
The ability to recognize that pairs or sets of language expressions “mean the same thing” is a cognitive task for which meaning representation is clearly a central issue. This paper uses the task of paraphrasing to study meaning representation in a cognitive system. The main claim is that a consequential part of the meaning representation for a natural language expression is a set of language-free structures that are not part of the expression in question. To support this claim, we construct a corpus of paraphrase pairs using a system that has a non-linguistic meaning represen- tation decoupled from the linguistic …
Impact Of Difficult Negatives On Twitter Crisis Detection, Yuhao Zhang, Siaw Ling Lo, Phyo Yi Win Myint
Impact Of Difficult Negatives On Twitter Crisis Detection, Yuhao Zhang, Siaw Ling Lo, Phyo Yi Win Myint
Research Collection School Of Computing and Information Systems
Twitter has become an alternative information source during a crisis. However, the short, noisy nature of tweets hinders information extraction. While models trained with standard Twitter crisis datasets accomplished decent performance, it remained a challenge to generalize to unseen crisis events. Thus, we proposed adding “difficult” negative examples during training to improve model generalization for Twitter crisis detection. Although adding random noise is a common practice, the impact of difficult negatives, i.e., negative data semantically similar to true examples, was never examined in NLP. Most of existing research focuses on the classification task, without considering the primary information need of …
Plan-And-Solve Prompting: Improving Zero-Shot Chain-Of-Thought Reasoning By Large Language Models, Lei Wang, Wanyu Xu, Yihuai Lan, Zhiqiang Hu, Yunshi Lan, Roy Ka-Wei Lee, Ee-Peng Lim
Plan-And-Solve Prompting: Improving Zero-Shot Chain-Of-Thought Reasoning By Large Language Models, Lei Wang, Wanyu Xu, Yihuai Lan, Zhiqiang Hu, Yunshi Lan, Roy Ka-Wei Lee, Ee-Peng Lim
Research Collection School Of Computing and Information Systems
Large language models (LLMs) have recently been shown to deliver impressive performance in various NLP tasks. To tackle multi-step reasoning tasks, few-shot chain-of-thought (CoT) prompting includes a few manually crafted step-by-step reasoning demonstrations which enable LLMs to explicitly generate reasoning steps and improve their reasoning task accuracy. To eliminate the manual effort, Zeroshot-CoT concatenates the target problem statement with “Let’s think step by step” as an input prompt to LLMs. Despite the success of Zero-shot-CoT, it still suffers from three pitfalls: calculation errors, missing-step errors, and semantic misunderstanding errors. To address the missing-step errors, we propose Planand-Solve (PS) Prompting. It …
Augmenting Low-Resource Text Classification With Graph-Grounded Pre-Training And Prompting, Zhihao Wen, Yuan Fang
Augmenting Low-Resource Text Classification With Graph-Grounded Pre-Training And Prompting, Zhihao Wen, Yuan Fang
Research Collection School Of Computing and Information Systems
ext classification is a fundamental problem in information retrieval with many real-world applications, such as predicting the topics of online articles and the categories of e-commerce product descriptions. However, low-resource text classification, with few or no labeled samples, poses a serious concern for supervised learning. Meanwhile, many text data are inherently grounded on a network structure, such as a hyperlink/citation network for online articles, and a user-item purchase network for e-commerce products. These graph structures capture rich semantic relationships, which can potentially augment low-resource text classification. In this paper, we propose a novel model called Graph-Grounded Pre-training and Prompting (G2P2) …
Do-Good: Towards Distribution Shift Evaluation For Pre-Trained Visual Document Understanding Models, Jiabang He, Yi Hu, Lei Wang, Xing Xu, Ning Liu, Hui Liu
Do-Good: Towards Distribution Shift Evaluation For Pre-Trained Visual Document Understanding Models, Jiabang He, Yi Hu, Lei Wang, Xing Xu, Ning Liu, Hui Liu
Research Collection School Of Computing and Information Systems
Numerous pre-training techniques for visual document understanding (VDU) have recently shown substantial improvements in performance across a wide range of document tasks. However, these pre-trained VDU models cannot guarantee continued success when the distribution of test data differs from the distribution of training data. In this paper, to investigate how robust existing pre-trained VDU models are to various distribution shifts, we first develop an out-of-distribution (OOD) benchmark termed Do-GOOD for the fine-Grained analysis on Document image-related tasks specifically. The Do-GOOD benchmark defines the underlying mechanisms that result in different distribution shifts and contains 9 OOD datasets covering 3 VDU related …
Discriminative Reasoning With Sparse Event Representation For Document-Level Event-Event Relation Extraction, Changsen Yuan, Heyan Huang, Yixin Cao, Yonggang Wen
Discriminative Reasoning With Sparse Event Representation For Document-Level Event-Event Relation Extraction, Changsen Yuan, Heyan Huang, Yixin Cao, Yonggang Wen
Research Collection School Of Computing and Information Systems
Document-level Event-Event Relation Extraction (DERE) aims to extract relations between events in a document. It challenges conventional sentence-level task (SERE) with difficult long-text understanding. In this paper, we propose a novel DERE model (SENDIR) for better document-level reasoning. Different from existing works that build an event graph via linguistic tools, SENDIR does not require any prior knowledge. The basic idea is to discriminate event pairs in the same sentence or span multiple sentences by assuming their different information density: 1) low density in the document suggests sparse attention to skip irrelevant information. Our module 1 designs various types of attention …
Modularized Zero-Shot Vqa With Pre-Trained Models, Rui Cao, Jing Jiang
Modularized Zero-Shot Vqa With Pre-Trained Models, Rui Cao, Jing Jiang
Research Collection School Of Computing and Information Systems
Large-scale pre-trained models (PTMs) show great zero-shot capabilities. In this paper, we study how to leverage them for zero-shot visual question answering (VQA).Our approach is motivated by a few observations. First, VQA questions often require multiple steps of reasoning, which is still a capability that most PTMs lack. Second, different steps in VQA reasoning chains require different skills such as object detection and relational reasoning, but a single PTM may not possess all these skills. Third, recent work on zero-shot VQA does not explicitly consider multi-step reasoning chains, which makes them less interpretable compared with a decomposition-based approach. We propose …
Large-Scale Correlation Analysis Of Automated Metrics For Topic Models, Jia Peng Lim, Hady Wirawan Lauw
Large-Scale Correlation Analysis Of Automated Metrics For Topic Models, Jia Peng Lim, Hady Wirawan Lauw
Research Collection School Of Computing and Information Systems
Automated coherence metrics constitute an important and popular way to evaluate topic models. Previous works present a mixed picture of their presumed correlation with human judgement. In this paper, we conduct a large-scale correlation analysis of coherence metrics. We propose a novel sampling approach to mine topics for the purpose of metric evaluation, and conduct the analysis via three large corpora showing that certain automated coherence metrics are correlated. Moreover, we extend the analysis to measure topical differences between corpora. Lastly, we examine the reliability of human judgement by conducting an extensive user study, which is designed as an amalgamation …
Strategy‑Aware Bundle Recommender System, Yinwei Wei, Xiaohao Liu, Yunshan Ma, Xiang Wang, Liqiang Nie, Tat‑Seng Chua
Strategy‑Aware Bundle Recommender System, Yinwei Wei, Xiaohao Liu, Yunshan Ma, Xiang Wang, Liqiang Nie, Tat‑Seng Chua
Research Collection School Of Computing and Information Systems
A bundle is a group of items that provides improved services to users and increased profits for sellers. However, locating the desired bundles that match the users' tastes still challenges us, due to the sparsity issue. Despite the remarkable performance of existing approaches, we argue that they seldom consider the bundling strategy (i.e., how the items within a bundle are associated with each other) in the bundle recommendation, resulting in the suboptimal user and bundle representations for their interaction prediction. Therefore, we propose to model the strategy-aware user and bundle representations for the bundle recommendation.Towards this end, we develop a …
Multi-Target Backdoor Attacks For Code Pre-Trained Models, Yanzhou Li, Shangqing Liu, Kangjie Chen, Xiaofei Xie, Tianwei Zhang, Yang Liu
Multi-Target Backdoor Attacks For Code Pre-Trained Models, Yanzhou Li, Shangqing Liu, Kangjie Chen, Xiaofei Xie, Tianwei Zhang, Yang Liu
Research Collection School Of Computing and Information Systems
Backdoor attacks for neural code models have gained considerable attention due to the advancement of code intelligence. However, most existing works insert triggers into task-specific data for code-related downstream tasks, thereby limiting the scope of attacks. Moreover, the majority of attacks for pre-trained models are designed for understanding tasks. In this paper, we propose task-agnostic backdoor attacks for code pre-trained models. Our backdoored model is pre-trained with two learning strategies (i.e., Poisoned Seq2Seq learning and token representation learning) to support the multi-target attack of downstream code understanding and generation tasks. During the deployment phase, the implanted backdoors in the victim …
Contrastive Video Question Answering Via Video Graph Transformer, Junbin Xiao Xiao, Pan Zhou, Angela Yao, Yicong Li, Richang Hong, Shuicheng Yan, Tat-Seng Chua
Contrastive Video Question Answering Via Video Graph Transformer, Junbin Xiao Xiao, Pan Zhou, Angela Yao, Yicong Li, Richang Hong, Shuicheng Yan, Tat-Seng Chua
Research Collection School Of Computing and Information Systems
We propose to perform video question answering (VideoQA) in a Contrastive manner via a Video Graph Transformer model (CoVGT). CoVGT’s uniqueness and superiority are three-fold: 1) It proposes a dynamic graph transformer module which encodes video by explicitly capturing the visual objects, their relations and dynamics, for complex spatio-temporal reasoning. 2) It designs separate video and text transformers for contrastive learning between the video and text to perform QA, instead of multi-modal transformer for answer classification. Fine-grained video-text communication is done by additional cross-modal interaction modules. 3) It is optimized by the joint fully- and self-supervised contrastive objectives between the …
Knowledge-Enhanced Mixed-Initiative Dialogue System For Emotional Support Conversations, Yang Deng, Wenxuan Zhang, Yifei Yuan, Wai Lam
Knowledge-Enhanced Mixed-Initiative Dialogue System For Emotional Support Conversations, Yang Deng, Wenxuan Zhang, Yifei Yuan, Wai Lam
Research Collection School Of Computing and Information Systems
Unlike empathetic dialogues, the system in emotional support conversations (ESC) is expected to not only convey empathy for comforting the help-seeker, but also proactively assist in exploring and addressing their problems during the conversation. In this work, we study the problem of mixed-initiative ESC where the user and system can both take the initiative in leading the conversation. Specifically, we conduct a novel analysis on mixed-initiative ESC systems with a tailor-designed schema that divides utterances into different types with speaker roles and initiative types. Four emotional support metrics are proposed to evaluate the mixed-initiative interactions. The analysis reveals the necessity …