Open Access. Powered by Scholars. Published by Universities.®

Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 3 of 3

Full-Text Articles in Engineering

Structural Descriptions In Human-Assisted Robot Visual Learning, Geert-Jan Kruijff, John D. Kelleher, Gregor Berginc, Ales Leonardis Jan 2006

Structural Descriptions In Human-Assisted Robot Visual Learning, Geert-Jan Kruijff, John D. Kelleher, Gregor Berginc, Ales Leonardis

Conference papers

The paper presents an approach to using structural descriptions, obtained through a human-robot tutoring dialogue, as labels for the visual ob ject models a robot learns. The paper shows how structural descriptions can relate models for different aspects of one and the same object, and how relating descriptions for visual models and discourse referents enables incremental updating of model descriptions through dialogue (either robot- or human-initiated). The approach has been implemented in an integrated architecture for human-assisted robot visual learning.


Information Fusion For Visual Reference Resolution In Dynamic Situated Dialogue., Geert-Jan Kruijff, John D. Kelleher, Nick Hawes Jan 2006

Information Fusion For Visual Reference Resolution In Dynamic Situated Dialogue., Geert-Jan Kruijff, John D. Kelleher, Nick Hawes

Conference papers

Human-Robot Interaction (HRI) invariably involves dialogue about objects in the environment in which the agents are situated. The paper focuses on the issue of resolving discourse references to such visual objects. The paper addresses the problem using strategies for intra-modal fusion (identifying that different occurrences concern the same object), and inter-modal fusion, (relating object references across different modalities). Core to these strategies are sensori-motoric coordination, and ontology-based mediation between content in different modalities. The approach has been fully implemented, and is illustrated with several working examples


Spatial Prepositions In Context: The Semantics Of Near In The Presence Of Distractor Objects., Fintan Costello, John D. Kelleher Jan 2006

Spatial Prepositions In Context: The Semantics Of Near In The Presence Of Distractor Objects., Fintan Costello, John D. Kelleher

Conference papers

The paper examines how people’s judgements of proximity between two objects are influenced by the presence of a third object. In an experiment participants were presented with images containing three shapes in different relative positions, and asked to rate the acceptability of a locative expression such as ‘the circle is near the triangle’ as descriptions of those images. The results showed an interaction between the relative positions of objects and the linguistic roles that those objects play in the locative expression: proximity was a decreasing function of the distance between the object in the head position in the expression and …