Psychology Commons^™

Physical Engagement As A Way To Increase Emotional Rapport In Interactions With Embodied Conversational Agents, Ivan Gris Sepulveda

Open Access Theses & Dissertations

One of the major goals in research on embodied conversational agents (ECAs) is to increase the believability and perceived trustworthiness of agents. To improve the efficacy of the interaction between humans and ECAs, I focus on the development of rapport, which is a complex and extensive behavioral state of affinity, synchronicity, coordination and mutual understanding that is difficult to model, measure and interpret. I present our AGENT Framework and our ECA, Adriana, which is capable of speech recognition and gesture recognition over long periods of time. Our current system provides up to 60 minutes of human-ECA interaction in a jungle-survival …

Virtual Rapport With Extraverted Agents, Jacqueline Brixey

Open Access Theses & Dissertations

Studies from psychology conclude that "birds of a feather flock together"- or, in other words, people tend to seek companionship with those who have a similar personality to their own. Researchers in the fields of Linguistics and Psychology have found numerous markers that differentiate the dialogue of extroverts from that of introverts. Recent work in Human Computer Interaction has sought to understand the nature of creating and maintaining rapport between humans and Embodied Conversational Agents (ECAs).

Seeking an interdisciplinary approach that combines knowledge from HCI, Linguistics, and Psychology, I sought to establish whether introverted users report the highest level of …

Using Emotion As Inferred From Prosody In Language Modeling, Shreyas Ashok Karkhedkar

Open Access Theses & Dissertations

Research has focused on using prosody as an alternative source of information for language modeling. However, prosody is a surface phenomenon and to develop deeper models of language production, the underlying mental processes need to be considered. There are several cognitive factors, such as dialog-states and formulation, that have been given attention. However, emotion { as a cognitive factor, has been neglected so far. Speakers' emotional state plays an important role in spoken dialog. Participants seem to infer each others emotional state from multiple cues and react accordingly. In particular, these states manifest themselves moment-by-moment in the speakers voice. This …

Adding Within-Utterance Emotion Decay For More Human-Like Dialog, Michael Hans Durcholz

Open Access Theses & Dissertations

While spoken dialog systems have been used for commercial applications for several decades, most commercial spoken dialog systems provide only simple information exchange capabilities. Emotion synthesis in spoken dialog systems has become an active research area recently, and use of emotion-adaptive dialog systems has demonstrated improvements in user experience and rapport. This thesis seeks to improve how emotions are conveyed in dialog systems to enable robust emotional support that improves user experiences with dialog systems and models human speech characteristics more accurately than current dialog systems.

Prior work with Gracie (GRAduate Coordinator with Immediate response Emotions), an emotion-adaptive dialog system, …