Physical Sciences and Mathematics Commons^™

An Examination Of A Theory Of Embodied Social Presence In Virtual Worlds, Brian E. Mennecke, Janea L. Triplett, Lesya M. Hassall, Zayira Jordán Conde, Rex Heer

Lesya Hassall

In this article, we discuss and empirically examine the importance of embodiment, context, and spatial proximity as they pertain to collaborative interaction and task completion in virtual environments. Specifically, we introduce the embodied social presence (ESP) theory as a framework to account for a higher level of perceptual engagement that users experience as they engage in activity-based social interaction in virtual environments. The ESP theory builds on the analysis of reflection data from Second Life users to explain the process by which perceptions of ESP are realized. We proceed to describe implications of ESP for collaboration and other organizational functions.

An Adaptive Time Reduction Technique For Video Lectures, Sreenivas P. Shenoy, Ashish Amresh, John Femiani

Ashish Amresh

A Period Examination Through Contemporary Energy Analysis Of Kevin Roche’S Fine Arts Center At University Of Massachusetts-Amherst, L Carl Fiocchi Jr

L. Carl Fiocchi

Studies of buildings belonging to a subset of Modernist architecture, Brutalism, have included discussions pertaining to social and architectural history, critical reception, tectonic form and geometry inspirations, material property selections, period technology limitations, and migration of public perceptions. Evaluations of Brutalist buildings’ energy related performances have been restricted to anecdotal observations with particular focus on the building type’s poor thermal performance, a result of the preferred construction method, i.e. monolithic reinforced concrete used as structure, interior finish and exterior finish. A valid criticism, but one that served to dismiss discussion that the possibility of other positive design strategies limiting energy …

Shining A Light On A University Special Collection With Data Visualization, Lisa Deluca, Katie M. Wissel

Kathryn Wissel, MBA, MI

An Application Of High Fidelity Ftds For Ab Initio Pilot Training: The Way Ahead, Nickolas D. Macchiarella, Tim Brady, Brandon S. Lyon

Tim Brady

"Decreases in simulation costs and increases in aircraft training costs led to the need for further investigation into the application of simulation-based training. Researchers conducted an eighteen-month study using ab initio student pilots as participants. This study applied a Federal Aviation Administration (FAA) approved, Part 142, flight-training curriculum that included 60% flight training device (FTD) use. Researchers identified five causal factors that warranted further investigation. The causal factors identified were visual fidelity, procedural similarity, dynamic flight environment, difficulty of task, and visual scanning and response. These causal factors have the potential to affect transfer of training (ToT) from simulated flight …

Marim: Mobile Augmented Reality For Interactive Manuals, Tam Nguyen, Dorothy Tan, Bilal Mirza, Jose Sepulveda

Tam Nguyen

In this work, we present a practical system which uses mobile devices for interactive manuals. In particular, there are two modes provided in the system, namely, expert/trainer and trainee modes. Given the expert/trainer editor, experts design the step-by-step interactive manuals. For each step, the experts capture the images by using phones/tablets and provide visual instructions such as interest regions, text, and action animations. In the trainee mode, the system utilizes the existing object detection and tracking algorithms to identify the step scene and retrieve the respective instruction to be displayed on the mobile device. The trainee then follows the displayed …

Static Saliency Vs. Dynamic Saliency: A Comparative Study, Tam Nguyen, Mengdi Xu, Guangyu Gao, Mohan Kankanhalli, Qi Tian, Shuicheng Yan

Tam Nguyen

Recently visual saliency has attracted wide attention of researchers in the computer vision and multimedia field. However, most of the visual saliency-related research was conducted on still images for studying static saliency. In this paper, we give a comprehensive comparative study for the first time of dynamic saliency (video shots) and static saliency (key frames of the corresponding video shots), and two key observations are obtained: 1) video saliency is often different from, yet quite related with, image saliency, and 2) camera motions, such as tilting, panning or zooming, affect dynamic saliency significantly.

Motivated by these observations, we propose a …

Seeing Human Weight From A Single Rgb-D Image, Tam Nguyen, Jiashi Feng, Shuicheng Yan

Tam Nguyen

Human weight estimation is useful in a variety of potential applications, e.g., targeted advertisement, entertainment scenarios and forensic science. However, estimating weight only from color cues is particularly challenging since these cues are quite sensitive to lighting and imaging conditions. In this article, we propose a novel weight estimator based on a single RGB-D image, which utilizes the visual color cues and depth information. Our main contributions are three-fold.

First, we construct the W8-RGBD dataset including RGB-D images of different people with ground truth weight.

Second, the novel sideview shape feature and the feature fusion model are proposed to facilitate …

Salient Object Detection Via Objectness Proposals, Tam Nguyen

Tam Nguyen

Salient object detection has gradually become a popular topic in robotics and computer vision research. This paper presents a real-time system that detects salient objects by integrating objectness, foreground, and compactness measures. Our algorithm consists of four basic steps. First, our method generates the objectness map via object proposals. Based on the objectness map, we estimate the background margin and compute the corresponding foreground map which prefers the foreground objects. From the objectness map and the foreground map, the compactness map is formed to favor the compact objects. We then integrate those cues to form a pixel-accurate saliency map which …

Salient Object Detection Via Augmented Hypotheses, Tam Nguyen, Jose Sepulveda

Tam Nguyen

In this paper, we propose using augmented hypotheses which consider objectness, foreground, and compactness for salient object detection. Our algorithm consists of four basic steps. First, our method generates the objectness map via objectness hypotheses. Based on the objectness map, we estimate the foreground margin and compute the corresponding foreground map which prefers the foreground objects. From the objectness map and the foreground map, the compactness map is formed to favor the compact objects. We then derive a saliency measure that produces a pixel-accurate saliency map which uniformly covers the objects of interest and consistently separates foreground and background.

We …

Towards Decrypting Attractiveness Via Multi-Modality Cue, Tam Nguyen, Si Liu, Bingbing Ni, Jun Tan, Yong Rui, Shuicheng Yan

Tam Nguyen

Decrypting the secret of beauty or attractiveness has been the pursuit of artists and philosophers for centuries. To date, the computational model for attractiveness estimation has been actively explored in the computer vision and multimedia community, yet with the focus mainly on facial features. In this article, we conduct a comprehensive study on female attractiveness conveyed by single/multiple modalities of cues, that is, face, dressing and/or voice; the aim is to discover how different modalities individually and collectively affect the human sense of beauty. To extensively investigate the problem, we collect the Multi-Modality Beauty (M2B) dataset, which is annotated with …

Adaptive Nonparametric Image Parsing, Tam Nguyen, Canyi Lu, Jose Sepulveda, Shuicheng Yan

Tam Nguyen

In this paper, we present an adaptive nonparametric solution to the image parsing task, namely, annotating each image pixel with its corresponding category label. For a given test image, first, a locality-aware retrieval set is extracted from the training data based on superpixel matching similarities, which are augmented with feature extraction for better differentiation of local superpixels. Then, the category of each superpixel is initialized by the majority vote of the k -nearest-neighbor superpixels in the retrieval set. Instead of fixing k as in traditional nonparametric approaches, here, we propose a novel adaptive nonparametric approach that determines the sample-specific k …

Gecka3d: A 3d Game Engine For Commonsense Knowledge Acquisition, Erik Cambria, Tam Nguyen, Brian Cheng, Kenneth Kwok, Jose Sepulveda

Tam Nguyen

Commonsense knowledge representation and reasoning is key for tasks such as artificial intelligence and natural language understanding. Since commonsense consists of information that humans take for granted, gathering it is an extremely difficult task. In this paper, we introduce a novel 3D game engine for commonsense knowledge acquisition (GECKA3D) which aims to collect commonsense from game designers through the development of serious games. GECKA3D integrates the potential of serious games and games with a purpose. This provides a platform for the acquisition of reusable and multi-purpose knowledge and also enables the development of games that can provide entertainment value and …

Hi, Magic Closet, Tell Me What To Wear!, Si Liu, Tam Nguyen, Jiashi Feng, Meng Wang, Shuicheng Yan

Tam Nguyen

In this demo, we present a practical system, "magic closet," for automatic occasion-oriented clothing pairing. Given a user-input occasion, e.g., wedding or shopping, the magic closet intelligently and automatically pairs the user-specified reference clothing (upper body or lower body) with the most suitable one from online shops. Two key criteria are explicitly considered for the magic closet system. One criterion is to dress properly, e.g., compared to suit pants, it is more decent to wear a cocktail dress for a banquet occasion. The other criterion is to dress aesthetically, e.g., a red T-shirt matches better with white pants than with …

A Language-Based Model For Specifying And Staging Mixed-Initiative Dialogs, Saverio Perugini, Joshua W. Buck

Saverio Perugini

Specifying and implementing flexible human-computer dialogs, such as those used in kiosks, is complex because of the numerous and varied directions in which each user might steer a dialog. The objective of this research is to improve dialog specification and implementation. To do so we developed a model for specifying and staging mixed-initiative dialogs. The model involves a dialog authoring notation, based on concepts from programming languages, for specifying a variety of unsolicited reporting, mixed-initiative dialogs in a concise representation that serves as a design for dialog implementation. Guided by this foundation, we built a dialog staging engine which operationalizes …

The Changing Values Of Digital Legacies: E-Books And The Challenges Of Data Mobility And The Perceived Value Of Books, Derani Nathasha Dissanayake, David M. Cook

Dr. David M Cook

Person Identification From Streaming Surveillance Video Using Mid-Level Features From Joint Action-Pose Distribution, Binu M. Nair, Vijayan K. Asari

Vijayan K. Asari

We propose a real time person identification algorithm for surveillance based scenarios from low-resolution streaming video, based on mid-level features extracted from the joint distribution of various types of human actions and human poses. The proposed algorithm uses the combination of an auto-encoder based action association framework which produces per-frame probability estimates of the action being performed, and a pose recognition framework which gives per-frame body part locations. The main focus in this manuscript is to effectively combine these per-frame action probability estimates and pose trajectories from a short temporal window to obtain mid-level features. We demonstrate that these mid-level …

State Preserving Extreme Learning Machine For Face Recognition, Md. Zahangir Alom, Paheding Sidike, Vijayan K. Asari, Tarek M. Taha

Vijayan K. Asari

Extreme Learning Machine (ELM) has been introduced as a new algorithm for training single hidden layer feed-forward neural networks (SLFNs) instead of the classical gradient-based algorithms. Based on the consistency property of data, which enforce similar samples to share similar properties, ELM is a biologically inspired learning algorithm with SLFNs that learns much faster with good generalization and performs well in classification applications. However, the random generation of the weight matrix in current ELM based techniques leads to the possibility of unstable outputs in the learning and testing phases. Therefore, we present a novel approach for computing the weight matrix …

Video-To-Video Pose And Expression Invariant Face Recognition Using Volumetric Directional Pattern, Vijayan K. Asari, Almabrok Essa

Vijayan K. Asari

Face recognition in video has attracted attention as a cryptic method of human identification in surveillance systems. In this paper, we propose an end-to-end video face recognition system, addressing a difficult problem of identifying human faces in video due to the presence of large variations in facial pose and expression, and poor video resolution. The proposed descriptor, named Volumetric Directional Pattern (VDP), is an oriented and multi-scale volumetric descriptor that is able to extract and fuse the information of multi frames, temporal (dynamic) information, and multiple poses and expressions of faces in input video to produce feature vectors, which are …

Brain Machine Interface Using Emotiv Epoc To Control Robai Cyton Robotic Arm, Daniel P. Prince, Mark J. Edmonds, Andrew J. Sutter, Matthew Thomas Cusumano, Wenjie Lu, Vijayan K. Asari

Vijayan K. Asari

The initial framework for an electroencephalography (EEG) thought recognition software suite is developed, built, and tested. This suite is designed to recognize human thoughts and pair them to actions for controlling a robotic arm. Raw EEG brain activity data is collected using an Emotiv EPOC headset. The EEG data is processed through linear discriminant analysis (LDA), where an intended action is identified. The EEG classification suite is being developed to increase the number of distinct actions that can be identified compared to the Emotiv recognition software. The EEG classifier was able to correctly distinguish between two separate physical movements. Future …

Constructing Virtual Asymmetric Opponents From Data And Models In The Literature: Case Of Crowd Rioting, Barry G. Silverman, Michael Johns, Kevin O'Brien, Ransom Weaver, Jason Cornwell

Barry G Silverman

This paper describes an effort to integrate human behavior models from a range of ability, stress, emotion, decision theoretic, and motivation literatures into a game-theoretic framework appropriate for representing synthetic asymmetric agents and scenarios. Our goal is to create a common mathematical framework (CMF) and an open agent architecture that allows one to research and explore alternative behavior models to add realism to software agents - e.g., physiology and stress, personal values and emotive states, and cultural influences. Our CMF is based on a dynamical, game-theoretic approach to evolution and equilibria in Markov chains representing states of the world that …

A Demonstration Of The Pmf-Extraction Approach: Modeling The Effects Of Sound On Crowd Behavior, Jason Cornwell, Barry G. Silverman, Kevin O'Brien, Michael Johns

Barry G Silverman

The vast majority of psychology, sociology, and other social-science literature describing human behavior and performance does not reach the eyes of those of us working in the modeling and simulation community. Our recent work has been concerned with the extraction and implementation of Human Behavior Models(HBMs)/ Performance Moderator Functions(PMFs) from this literature. This paper demonstrates how our methodology was applied to extract models of the effects of music and sound on both individuals and groups and to implement them in a simulated environment. PMFs describing how several classes of sound affect decision-making and performance were constructed based on well-established psychological …

A Demonstration Of The Pmf-Extraction Approach: Modeling The Effects Of Sound On Crowd Behavior, Jason Cornwell, Barry G. Silverman, Kevin O'Brien, Michael Johns

Barry G Silverman

The vast majority of psychology, sociology, and other social-science literature describing human behavior and performance does not reach the eyes of those of us working in the modeling and simulation community. Our recent work has been concerned with the extraction and implementation of Human Behavior Models(HBMs)/ Performance Moderator Functions(PMFs) from this literature. This paper demonstrates how our methodology was applied to extract models of the effects of music and sound on both individuals and groups and to implement them in a simulated environment. PMFs describing how several classes of sound affect decision-making and performance were constructed based on well-established psychological …

Constructing Virtual Asymmetric Opponents From Data And Models In The Literature: Case Of Crowd Rioting, Barry G. Silverman, Michael Johns, Kevin O'Brien, Ransom Weaver, Jason Cornwell

Barry G Silverman

This paper describes an effort to integrate human behavior models from a range of ability, stress, emotion, decision theoretic, and motivation literatures into a game-theoretic framework appropriate for representing synthetic asymmetric agents and scenarios. Our goal is to create a common mathematical framework (CMF) and an open agent architecture that allows one to research and explore alternative behavior models to add realism to software agents - e.g., physiology and stress, personal values and emotive states, and cultural influences. Our CMF is based on a dynamical, game-theoretic approach to evolution and equilibria in Markov chains representing states of the world that …

An Application Of High Fidelity Ftds For Ab Initio Pilot Training: The Way Ahead, Nickolas D. Macchiarella, Tim Brady, Brandon S. Lyon

Nickolas D. "Dan" Macchiarella

"Decreases in simulation costs and increases in aircraft training costs led to the need for further investigation into the application of simulation-based training. Researchers conducted an eighteen-month study using ab initio student pilots as participants. This study applied a Federal Aviation Administration (FAA) approved, Part 142, flight-training curriculum that included 60% flight training device (FTD) use. Researchers identified five causal factors that warranted further investigation. The causal factors identified were visual fidelity, procedural similarity, dynamic flight environment, difficulty of task, and visual scanning and response. These causal factors have the potential to affect transfer of training (ToT) from simulated flight …

User Interface Design, Moritz Stefaner, Sebastien Ferre, Saverio Perugini, Jonathan Koren, Yi Zhang

Saverio Perugini

As detailed in Chap. 1, system implementations for dynamic taxonomies and faceted search allow a wide range of query possibilities on the data. Only when these are made accessible by appropriate user interfaces, the resulting applications can support a variety of search, browsing and analysis tasks. User interface design in this area is confronted with specific challenges. This chapter presents an overview of both established and novel principles and solutions.

Program Transformations For Information Personalization, Saverio Perugini, Naren Ramakrishnan

Saverio Perugini

Personalization constitutes the mechanisms necessary to automatically customize information content, structure, and presentation to the end user to reduce information overload. Unlike traditional approaches to personalization, the central theme of our approach is to model a website as a program and conduct website transformation for personalization by program transformation (e.g., partial evaluation, program slicing). The goal of this paper is study personalization through a program transformation lens and develop a formal model, based on program transformations, for personalized interaction with hierarchical hypermedia. The specific research issues addressed involve identifying and developing program representations and transformations suitable for classes of hierarchical …

A Tool For Staging Mixed-Initiative Dialogs, Joshua W. Buck, Saverio Perugini

Saverio Perugini

We discuss and demonstrate a tool for prototyping dialog-based systems that, given a high-level specification of a human-computer dialog, stages the dialog for interactive use. The tool enables a dialog designer to evaluate a variety of dialogs without having to program each individual dialog, and serves as a proof-of-concept for our approach to mixed-initiative dialog modeling and implementation from a programming language-based perspective.

Interdisciplinary Translation Of Comparative Visualization, James Birt, Dirk Hovorka, Jonathan Nelson

James Birt

Spatial visualisation skills and interpretations are critical in the design professions, but traditionally difficult to effectively teach. Visualization and multimedia presentation studies show positive improvements in learner outcomes for specific learning domains. But the development and translation of a comparative visualization pedagogy between disciplines is poorly understood. This research seeks to identify an approach to developing comparable multimodal and interactive visualizations and attendant student reflections for curriculum designers in courses that can utilize visualizations and manipulations. Results from previous use of comparative multimodal visualization pedagogy in a multimedia 3D modelling class are used as a guide to translation of pedagogy …

Interdisciplinary Translation Of Comparative Visualization, James Birt, Dirk Hovorka, Jonathan Nelson

Jonathan J Nelson

Spatial visualisation skills and interpretations are critical in the design professions, but traditionally difficult to effectively teach. Visualization and multimedia presentation studies show positive improvements in learner outcomes for specific learning domains. But the development and translation of a comparative visualization pedagogy between disciplines is poorly understood. This research seeks to identify an approach to developing comparable multimodal and interactive visualizations and attendant student reflections for curriculum designers in courses that can utilize visualizations and manipulations. Results from previous use of comparative multimodal visualization pedagogy in a multimedia 3D modelling class are used as a guide to translation of pedagogy …