Open Access. Powered by Scholars. Published by Universities.®
Physical Sciences and Mathematics Commons™
Open Access. Powered by Scholars. Published by Universities.®
- Keyword
-
- Spatial Language (5)
- Prepositions (4)
- Situated Dialog (4)
- Spatial Templates (4)
- Artificial Intelligence (2)
-
- Potential Fields (2)
- Robotics (2)
- Design (1)
- Engagement (1)
- Experiential Learning (1)
- Fidelity (1)
- Game-Based Learning (1)
- Grounding (1)
- Human Robot Interaction (1)
- Human-Robot Interaction (1)
- Information Fusion (1)
- Language (1)
- Machine Learning (1)
- Motivation (1)
- Multimodal Interaction (1)
- Natural Language Generation (1)
- Perceptual Attention (1)
- Problem-Based Learning (1)
- Project Prepositions (1)
- Proximity (1)
- Reference (1)
- Serious Games (1)
- Situated Learning (1)
- Spatial Cognition (1)
- Topological Prepsoitions (1)
- Publication
Articles 1 - 9 of 9
Full-Text Articles in Physical Sciences and Mathematics
Mind The Gap: Situated Spatial Language A Case-Study In Connecting Perception And Language, John D. Kelleher
Mind The Gap: Situated Spatial Language A Case-Study In Connecting Perception And Language, John D. Kelleher
Other
This abstract reviews the literature on computational models of spatial semantics and the potential of deep learning models as an useful approach to this challenge.
A Model For Attention-Driven Judgements In Type Theory With Records, Simon Dobnik, John D. Kelleher
A Model For Attention-Driven Judgements In Type Theory With Records, Simon Dobnik, John D. Kelleher
Conference papers
This paper makes three contributions to the discussion on the applicability of Type Theory with Records (TTR) to embodied dialogue agents. First, it highlights the problem of type assignment or judgements in practical implementations which is resource intensive. Second, it presents a judgement control mechanism, which consists of grouping of types into clusters or states by their thematic relations and selection of types following two mechanisms inspired by the Load Theory of selective attention and cognitive control (Lavie et al., 2004), that addresses this problem. Third, it presents a computational framework, based on Bayesian inference, that offers a basis for …
A Theoretical Framework For Serious Game Design: Exploring Pedagogy, Play And Fidelity And Their Implications For The Design Process, Pauline Rooney
A Theoretical Framework For Serious Game Design: Exploring Pedagogy, Play And Fidelity And Their Implications For The Design Process, Pauline Rooney
Articles
It is widely acknowledged that digital games can provide an engaging, motivating and “fun” experience for students. However an entertaining game does not necessarily constitute a meaningful, valuable learning experience. For this reason, experts espouse the importance of underpinning serious games with a sound theoretical framework which integrates and balances theories from two fields of practice: pedagogy and game design (Kiili, 2005; Seeney & Routledge, 2009). Additionally, with the advent of sophisticated, immersive technologies, and increasing interest in the opportunities for constructivist learning offered by these technologies, concepts of fidelity and its impact on student learning and engagement, have emerged …
Situating Spatial Templates For Human-Robot Interaction, John D. Kelleher, Robert J. Ross, Brian Mac Namee, Colm Sloan
Situating Spatial Templates For Human-Robot Interaction, John D. Kelleher, Robert J. Ross, Brian Mac Namee, Colm Sloan
Conference papers
People often refer to objects by describing the object's spatial location relative to another object. Due to their ubiquity in situated discourse, the ability to use 'locative expressions' is fundamental to human-robot dialogue systems. A key component of this ability are computational models of spatial term semantics. These models bridge the grounding gap between spatial language and sensor data. Within the Artificial Intelligence and Robotics communities, spatial template based accounts, such as the Attention Vector Sum model (Regier and Carlson, 2001), have found considerable application in mediating situated human-machine communication (Gorniak, 2004; Brenner et a., 2007; Kelleher and Costello, 2009). …
Topology In Composite Spatial Terms, John D. Kelleher, Robert J. Ross
Topology In Composite Spatial Terms, John D. Kelleher, Robert J. Ross
Conference papers
People often refer to objects by describing the object's spatial location relative to another object, e.g. the book on the right of the table. This type of referring expression is called a spatial locative expression. Spatial locatives have three major components: (1) the target object that is being located (the book), (2) the landmark object relative to which the target is being located (the table), and (3) the description of the spatial relationship that exists between the target and the landmark (on the right of ). In English spatial relationships are often described using spatial prepositions. The set of English …
Proceedings Of The Sixth International Natural Language Generation Conference (Inlg 2010)., John D. Kelleher, Brian Mac Namee, Ielka Van Der Sluis
Proceedings Of The Sixth International Natural Language Generation Conference (Inlg 2010)., John D. Kelleher, Brian Mac Namee, Ielka Van Der Sluis
Conference papers
No abstract provided.
Applying Computational Models Of Spatial Prepositions To Visually Situated Dialog, John D. Kelleher, Fintan Costello
Applying Computational Models Of Spatial Prepositions To Visually Situated Dialog, John D. Kelleher, Fintan Costello
Articles
This article describes the application of computational models of spatial prepositions to visually situated dialog systems. In these dialogs, spatial prepositions are important because people often use them to refer to entities in the visual context of a dialog. We first describe a generic architecture for a visually situated dialog system and highlight the interactions between the spatial cognition module, which provides the interface to the models of prepositional semantics, and the other components in the architecture. Following this, we present two new computational models of topological and projective spatial prepositions. The main novelty within these models is the fact …
Proximity In Context: An Empirically Grounded Computational Model Of Proximity For Processing Topological Spatial Expression., John D. Kelleher, Geert-Jan Kruijff, Fintan Costello
Proximity In Context: An Empirically Grounded Computational Model Of Proximity For Processing Topological Spatial Expression., John D. Kelleher, Geert-Jan Kruijff, Fintan Costello
Conference papers
The paper presents a new model for context-dependent interpretation of linguistic expressions about spatial proximity between objects in a natural scene. The paper discusses novel psycholinguistic experimental data that tests and verifies the model. The model has been implemented, and enables a conversational robot to identify objects in a scene through topological spatial relations (e.g. ''X near Y''). The model can help motivate the choice between topological and projective prepositions.
A Context-Dependent Model Of Proximity In Physically Situated Environments, John D. Kelleher, Geert-Jan M. Kruijff
A Context-Dependent Model Of Proximity In Physically Situated Environments, John D. Kelleher, Geert-Jan M. Kruijff
Conference papers
The paper presents a computational model for a context-dependent analysis of a physical environment in terms of spatial proximity. The model provides a basis for grounding linguistic analyses of spatial expressions in visual perception. The model uses potential fields to model spatial proximity. It has been implemented, and when combined with a handcrafted grammar, is used to enable a conversational robot to carry out a situated dialogue with a human. The key concept in our approach is defining the region that is proximal to a landmark based on the spatial configuration of other objects in the scene. The model extends …