Open Access. Powered by Scholars. Published by Universities.®
Physical Sciences and Mathematics Commons™
Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 2 of 2
Full-Text Articles in Physical Sciences and Mathematics
Knowledge-Aware Multimodal Dialogue Systems, Lizi Liao, Yunshan Ma, Xiangnan He, Richang Huang, Tat-Seng Chua
Knowledge-Aware Multimodal Dialogue Systems, Lizi Liao, Yunshan Ma, Xiangnan He, Richang Huang, Tat-Seng Chua
Research Collection School Of Computing and Information Systems
By offering a natural way for information seeking, multimodal dialogue systems are attracting increasing attention in several domains such as retail, travel etc. However, most existing dialogue systems are limited to textual modality, which cannot be easily extended to capture the rich semantics in visual modality such as product images. For example, in fashion domain, the visual appearance of clothes and matching styles play a crucial role in understanding the user’s intention. Without considering these, the dialogue agent may fail to generate desirable responses for users. In this paper, we present a Knowledge-aware Multimodal Dialogue (KMD) model to address the …
Knowledge-Aware Multimodal Dialogue Systems, Lizi Liao, Yunshan Ma, Xiangnan He, Richang Hong, Tat-Seng Chua
Knowledge-Aware Multimodal Dialogue Systems, Lizi Liao, Yunshan Ma, Xiangnan He, Richang Hong, Tat-Seng Chua
Research Collection School Of Computing and Information Systems
By offering a natural way for information seeking, multimodal dialogue systems are attracting increasing attention in several domains such as retail, travel etc. However, most existing dialogue systems are limited to textual modality, which cannot be easily extended to capture the rich semantics in visual modality such as product images. For example, in fashion domain, the visual appearance of clothes and matching styles play a crucial role in understanding the user's intention. Without considering these, the dialogue agent may fail to generate desirable responses for users. In this paper, we present a Knowledge-aware Multimodal Dialogue (KMD) model to address the …