Open Access. Powered by Scholars. Published by Universities.®
Physical Sciences and Mathematics Commons™
Open Access. Powered by Scholars. Published by Universities.®
Articles 1 - 3 of 3
Full-Text Articles in Physical Sciences and Mathematics
Rrsds: Towards A Robot-Ready Spoken Dialogue System, Casey Kennington, Daniele Moro, Lucas Marchand, Jake Carns, David Mcneill
Rrsds: Towards A Robot-Ready Spoken Dialogue System, Casey Kennington, Daniele Moro, Lucas Marchand, Jake Carns, David Mcneill
Computer Science Faculty Publications and Presentations
Spoken interaction with a physical robot requires a dialogue system that is modular, multimodal, distributive, incremental and temporally aligned. In this demo paper, we make significant contributions towards fulfilling these requirements by expanding upon the ReTiCo incremental framework. We outline the incremental and multimodal modules and how their computation can be distributed. We demonstrate the power and flexibility of our robot-ready spoken dialogue system to be integrated with almost any robot.
Learning Word Groundings From Humans Facilitated By Robot Emotional Displays, David Mcneill, Casey Kennington
Learning Word Groundings From Humans Facilitated By Robot Emotional Displays, David Mcneill, Casey Kennington
Computer Science Faculty Publications and Presentations
In working towards accomplishing a human-level acquisition and understanding of language, a robot must meet two requirements: the ability to learn words from interactions with its physical environment, and the ability to learn language from people in settings for language use, such as spoken dialogue. In a live interactive study, we test the hypothesis that emotional displays are a viable solution to the cold-start problem of how to communicate without relying on language the robot does not–indeed, cannot–yet know. We explain our modular system that can autonomously learn word groundings through interaction and show through a user study with 21 …
Detecting Phone-Related Pedestrian Distracted Behaviours Via A Two-Branch Convolutional Neural Network, Humberto Saenz, Huiming Sun, Lingtao Wu, Xuesong Zhou, Hongkai Yu
Detecting Phone-Related Pedestrian Distracted Behaviours Via A Two-Branch Convolutional Neural Network, Humberto Saenz, Huiming Sun, Lingtao Wu, Xuesong Zhou, Hongkai Yu
Computer Science Faculty Publications and Presentations
The distracted phone-use behaviours among pedestrians, like Texting, Game Playing and Phone Calls, have caused increasing fatalities and injuries. However, the research of phonerelated distracted behaviour by pedestrians has not been systemically studied. It is desired to improve both the driving and pedestrian safety by automatically discovering the phonerelated pedestrian distracted behaviours. Herein, a new computer vision-based method is proposed to detect the phone-related pedestrian distracted behaviours from a view of intelligent and autonomous driving. Specifically, the first end-to-end deep learning based Two-Branch Convolutional Neural Network (CNN) is designed for this task. Taking one synchronised image pair by two front …