Physical Sciences and Mathematics Commons^™

A Graphical Digital Personal Assistant That Grounds And Learns Autonomously, Casey Kennington, Aprajita Shukla

Computer Science Faculty Publications and Presentations

We present a speech-driven digital personal assistant that is robust despite little or no training data and autonomously improves as it interacts with users. The system is able to establish and build common ground between itself and users by signaling understanding and by learning a mapping via interaction between the words that users actually speak and the system actions. We evaluated our system with real users and found an overall positive response. We further show through objective measures that autonomous learning improves performance in a simple itinerary filling task.