Computer Sciences Commons^™

The Use Of Visual-Based Simulated Environments In Teacher Preparation, Sharon Judge, Jonna Bobzien, Ann Maydosz, Sabra Gear, Petros Katsioloudis

Communication Disorders & Special Education Faculty Publications

While virtual technology for training in the simulation field has a long history in medicine, aviation, and the military, the application of similar emerging and innovative technologies in teacher preparation and education has been limited. TLE TeachLive™ (Teaching Learning Environment, Teaching in a Virtual Environment) [TLE] is an inventive mixed-reality environment (the blending of real and synthetic content) where prospective teachers can interact with a group of virtual students. The purpose of the virtual teaching environment of TLE is to strengthen teacher recruitment, preparation, and retention in education by allowing teachers to improve their skills with virtual students, providing a …

Circular Reranking For Visual Search, Ting Yao, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Search reranking is regarded as a common way to boost retrieval precision. The problem nevertheless is not trivial especially when there are multiple features or modalities to be considered for search, which often happens in image and video retrieval. This paper proposes a new reranking algorithm, named circular reranking, that reinforces the mutual exchange of information across multiple modalities for improving search performance, following the philosophy that strong performing modality could learn from weaker ones, while weak modality does benefit from interacting with stronger ones. Technically, circular reranking conducts multiple runs of random walks through exchanging the ranking scores among …

Searching Visual Instances With Topology Checking And Context Modeling, Wei Zhang, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Instance Search (INS) is a realistic problem initiated by TRECVID, which is to retrieve all occurrences of the querying object, location, or person from a large video collection. It is a fundamental problem with many applications, and also a challenging problem different from the traditional concept or near-duplicate (ND) search, since the relevancy is defined at instance level. True responses could exhibit various visual variations, such as being small on the image with different background, or showing a non-homography spatial configuration. Based on the Bag-of-Words model, we propose two techniques tailored for Instance Search. Specifically, we explore the use of …

An Investigation And Analysis Of The Vestibulo-Ocular Reflex In A Vibration Environment, Daniel J. Uribe

Theses and Dissertations

Forty years of innovations have greatly improved Helmet-Mounted Displays (HMDs) and their integration into military systems. However, a significant issue with HMDs is the effect of vibration and the associated Vestibulo-Ocular Reflex (VOR). When a human’s head is subject to low-frequency vibration, the VOR stabilizes the eye with respect to objects in the external environment. However, this response is inappropriate in HMDs as the display moves with the user’s head and the VOR blurs the image as it is projected on the human retina. Current compensation techniques suggest increasing the size of displayed graphics or text to compensate for the …

Senior Project Report - Doctest, Stephen Weessies

Computer Engineering

DocTest is a program that, simply put, allows a programmer or user to document STANAG 4586 (a standard for unmanned aerial vehicle interoperability) messages and test the vehicle system at Lockheed Martin [5]. The program is extensible to allow for further development aiding our software team to do what they do best and not get bogged down in tedious but necessary documentation. DocTest is also used to aid in testing, keeping track of the issues and bugs found and creating a document that captures each issue so an issue is not missed or forgotten. This program was made for use …

Amethyst: A 3d Adventure Game For Tablets, Ross Light

Computer Science and Software Engineering

Amethyst is a point-and-click science fiction adventure game for tablets, developed over two quarters to demonstrate applied principles of computer graphics and software engineering discipline. Using a novel interaction system, players can engage in environmental puzzles. Development of Amethyst required non-trivial quality assurance measures and workflow enhancements. The end result is a functional technical demo showcasing a single level, with the ability to rapidly produce more content.

Data Visualization On Interactive Surfaces: A Research Agenda, Petra Isenberg, Tobias Isenberg, Tobias Hesselmann, Bongshin Lee, Ulrich Von Zadow, Anthony Tang

Research Collection School Of Computing and Information Systems

Interactive tabletops and surfaces (ITSs) provide rich opportunities for data visualization and analysis and consequently are used increasingly in such settings. A research agenda of some of the most pressing challenges related to visualization on ITSs emerged from discussions with researchers and practitioners in human-computer interaction, computer-supported collaborative work, and a variety of visualization fields at the 2011 Workshop on Data Exploration for Interactive Surfaces (Dexis 2011)

Flip-Invariant Sift For Copy And Object Detection, Wan-Lei Zhao, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Scale-invariant feature transform (SIFT) feature has been widely accepted as an effective local keypoint descriptor for its invariance to rotation, scale, and lighting changes in images. However, it is also well known that SIFT, which is derived from directionally sensitive gradient fields, is not flip invariant. In real-world applications, flip or flip-like transformations are commonly observed in images due to artificial flipping, opposite capturing viewpoint, or symmetric patterns of objects. This paper proposes a new descriptor, named flip-invariant SIFT (or F-SIFT), that preserves the original properties of SIFT while being tolerant to flips. F-SIFT starts by estimating the dominant curl …

Improving Webide Through Delightful Design And Gamification, Michael Hilton

Master's Theses

WebIDE is a web-based online learning environment. WebIDE has been used

successfully to teach CS0 and CS1 students Java and C concepts and software

engineering best practices, specically Test Driven Development. Previous Web-

IDE development has concentrated on developing functionality. The main goal

of this eort is to improve two non-functional aspects of WebIDE. The rst is to

design a more delightful user interface. The second is to add a scoring mecha-

nism that encourages students to develop best practices. The scoring mechanism

rewards students who answer the question correctly on the rst attempt, dis-

couraging them from spamming the …

Game Design And Homemade Powerpoint Games: An Examination Of The Justifications And A Review Of The Research, Jason Paul Siko, Michael Barbour

Education Faculty Publications

Research on educational games often focuses on the benefits that playing games has on student achievement. however, there is a growing body of research examining the benefits of having students design games rather than play them. Problems with game design as an instructional tool include the additional instruction on the programming language itself as well as the potential costs associated with new software. One way to mitigate these problems is to use Microsoft PowerPoint as game design software. While not intended for this purpose, MS PowerPoint is ubiquitous in schools and requires little additional instruction before students can design games. …

Kinectarms: A Toolkit For Capturing And Displaying Arm Embodiments In Distributed Tabletop Groupware, Aaron Genest, Carl Gutwin, Anthony Tang, Michael Kalyn, Zenja Ivkovic

Research Collection School Of Computing and Information Systems

Gestures are a ubiquitous part of human communication over tables, but when tables are distributed, gestures become difficult to capture and represent. There are several problems: extracting arm images from video, representing the height of the gesture, and making the arm embodiment visible and understandable at the remote table. Current solutions to these problems are often expensive, complex to use, and difficult to set up. We have developed a new toolkit - KinectArms - that quickly and easily captures and displays arm embodiments. KinectArms uses a depth camera to segment the video and determine gesture height, and provides several visual …

Guest Editorial: Selected Papers From Icimcs 2011, Chong-Wah Ngo, Changsheng Xu, Xiao Wu, Abdulmotaleb El Saddik

Research Collection School Of Computing and Information Systems

International Conference on Internet Multimedia Computing and Services (ICIMCS) is an annual conference sponsored by ACM SIGMM China Chapter. The conference is especially interested in the latest technologies and applications that deal with the web-scale processing and management of heterogeneous data from the Internet for multimedia computing and service. ICIMCS 2011 held in Chengdu, China— the ancient hometown of lovely panda. The conference has attracted around 80 participants, including researchers from academia and industries across ten countries/regions, for sharing their recent works in the topics ranging from visual information analysis and mining, query processing and search, multimedia privacy and security.

Efficient Salient Region Detection With Soft Image Abstraction, Ming-Ming Cheng, Jonathan Warrell, Wen-Yan Lin, Shuai Zheng, Vibhav Vineet, Nigel Crook

Research Collection School Of Computing and Information Systems

Detecting visually salient regions in images is one of the fundamental problems in computer vision. We propose a novel method to decompose an image into large scale perceptually homogeneous elements for efficient salient region detection, using a soft image abstraction representation. By considering both appearance similarity and spatial distribution of image pixels, the proposed representation abstracts out unnecessary image details, allowing the assignment of comparable saliency values across similar regions, and producing perceptually accurate salient region detection. We evaluate our salient region detection approach on the largest publicly available dataset with pixel accurate annotations. The experimental results show that the …

Robust Non-Parametric Data Fitting For Correspondence Modeling, Wen-Yan Lin, Ming-Ming Cheng, Shuai Zheng, Jiangbo Lu, Nigel Crook

Research Collection School Of Computing and Information Systems

We propose a generic method for obtaining nonparametric image warps from noisy point correspondences. Our formulation integrates a huber function into a motion coherence framework. This makes our fitting function especially robust to piecewise correspondence noise (where an image section is consistently mismatched). By utilizing over parameterized curves, we can generate realistic nonparametric image warps from very noisy correspondence. We also demonstrate how our algorithm can be used to help stitch images taken from a panning camera by warping the images onto a virtual push-broom camera imaging plane.

Visualization Of Off-Screen Data On Tablets Using Context-Providing Bar Graphs And Scatter Plots, Peter S. Games, Alark Joshi

Computer Science

Visualizing data on tablets is challenging due to the relatively small screen size and limited user interaction capabilities. Standard data visualization apps provide support for pinch-and-zoom and scrolling operations, but do not provide context for data that is off-screen. When exploring data on tablets, the user must be able to focus on a region of interest and quickly find interesting patterns in the data. We present visualization techniques that facilitate seamless interaction with the region of interest on a tablet using context-providing bar graphs and scatter plots. Through aggregation, fisheye-style, and overview+detail representations, we provide context to the users as …

Visual Semantic Segmentation And Its Applications, Jizhou Gao

Theses and Dissertations--Computer Science

This dissertation addresses the difficulties of semantic segmentation when dealing with an extensive collection of images and 3D point clouds. Due to the ubiquity of digital cameras that help capture the world around us, as well as the advanced scanning techniques that are able to record 3D replicas of real cities, the sheer amount of visual data available presents many opportunities for both academic research and industrial applications. But the mere quantity of data also poses a tremendous challenge. In particular, the problem of distilling useful information from such a large repository of visual data has attracted ongoing interests in …

A Robust Rgb-D Slam System For 3d Environment With Planar Surfaces, Po-Chang Su

Theses and Dissertations--Electrical and Computer Engineering

Simultaneous localization and mapping is the technique to construct a 3D map of unknown environment. With the increasing popularity of RGB-depth (RGB-D) sensors such as the Microsoft Kinect, there have been much research on capturing and reconstructing 3D environments using a movable RGB-D sensor. The key process behind these kinds of simultaneous location and mapping (SLAM) systems is the iterative closest point or ICP algorithm, which is an iterative algorithm that can estimate the rigid movement of the camera based on the captured 3D point clouds. While ICP is a well-studied algorithm, it is problematic when it is used in …

Creating Scalable Location-Based Games: Lessons From Geocaching, Carman Neustaedter, Anthony Tang, Tejinder K. Judge

Research Collection School Of Computing and Information Systems

Location-based games seek to move computer gaming out from behind the PC and into the “real world” of cities, streets, parks, and other locations. This real-world physicality makes the experience fun for game players, yet it brings the unique challenge of creating and orchestrating such a game. That is, location-based games are often difficult to create, grow, and maintain over long periods of time. Our research investigates how location-based games can be designed to overcome this challenge of scalability. We studied the well-established location-based game of Geocaching through active participation and an online survey to better understand how it has …

Nextgen Flight Deck Data Comm: Auxiliary Synthetic Speech Phase I, Tracy Lennertz, Judith Bürki-Cohen, Andrea L. Sparko, Nickolas D. Macchiarella, Jason Kring, Mike Coman, Tom Haritos, Jeffry Alvarado

Publications

Data Comm—a text-based controller-pilot communication system—is critical to many NextGen improvements. With Data Comm, communication becomes a visual task. Interacting with a visual Data Comm display may yield an unsafe increase in head-down time, particularly for single-pilot operations. This study examined the feasibility of supplementing Data Comm with synthetic speech. To this end, thirty-two pilots flew two experimental scenarios in a Cessna 172 Flight Training Device. In one scenario, ATC communication was with a text-only Data Comm display, in the other, communication was with a text Data Comm display with synthetic speech that read aloud each message (i.e., text+speech). Pilots …

Electronic Device, Display And Touch-Sensitive User Interface (Dec 2012), Michael E. Miller, Jerald J. Muszak, Michael J. Telek

AFIT Patents

Display devices and methods for operating the same are provided. In one embodiment, the display device has an electronic display having an active area for presenting visual content; a housing holding the electronic display and having an opening allowing a person to view a first portion of the active area; and a bezel about the opening, the bezel covering a second portion of the active area and providing a window through which at least a part of the second portion can be viewed. A sensor system senses when a person is close to touching the bezel or when a person …

The Design And Implementation Of A Mobile Game Engine For The Android Platform, Jon Hammer

Computer Science and Computer Engineering Undergraduate Honors Theses

In this thesis, a two-dimensional game engine is proposed for the Android mobile platform that facilitates rapid development of those games by individual developers or hobbyists. The essential elements of game design are presented so as to introduce the reader to the concepts that are crucial for comprehension of the paper. A brief overview of the Android Operating System is also included for those unfamiliar with it. Three primary design goals are identified, and a prototype solution is described in detail. The prototype is then evaluated against those design goals to see how well it accomplishes each task. The results …

Investigating Intelligent Agents In A 3d Virtual World, Yilin Kang, Fiona Fui-Hoon Nah, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

Web 3.0 involves " intelligent " web applications that utilize natural language processing, machine-based learning and reasoning, and intelligent techniques to analyze and understand user behavior. In this research, we empirically assess a specific form of Web 3.0 application in the form of intelligent agents that offer assistance to users in the virtual world. Using media naturalness theory, we hypothesize that the use of intelligent agents in the virtual world can enhance user experience by offering a more natural way of communication and assistance to users. We are interested to test if media naturalness theory holds in the context of …

Agent-Based Virtual Humans In Co-Space: An Evaluative Study, Yilin Kang, Ah-Hwee Tan, Fiona Fui-Hoon Nah

Research Collection School Of Computing and Information Systems

Co-Space refers to interactive virtual environment modelled after the real world in terms of look-and-feel, functionalities and services. We have developed a 3D virtual world named Nanyang Technological University (NTU) CoSpace populated with virtual human characters. Three key requirements of realistic virtual humans in the virtual world have been identified, namely (1) autonomy: agents can function on their own; (2) interactivity: agents can interact naturally with players; and (3) personality: agents can exhibit human traits and characteristics. Working towards these challenges, we propose a brain-inspired agent architecture that integrates goal-directed autonomy, natural language interaction and human-like personality. We conducted an …

Eliciting Usable Gestures For Multi-Display Environments, Teddy Seyed, Chris Burns, Mario Costa Sousa, Frank Maurer, Anthony Tang

Research Collection School Of Computing and Information Systems

Multi-display environments (MDEs) have advanced rapidly in recent years, incorporating multi-touch tabletops, tablets, wall displays and even position tracking systems. Designers have proposed a variety of interesting gestures for use in an MDE, some of which involve a user moving their hands, arms, body or even a device itself. These gestures are often used as part of interactions to move data between the various components of an MDE, which is a longstanding research problem. But designers, not users, have created most of these gestures and concerns over implementation issues such as recognition may have influenced their design. We performed a …

Electronic Device, Display And Touch-Sensitive User Interface (Nov 2012), Michael E. Miller, Jerald J. Muszak, Michael J. Telek

AFIT Patents

Display devices and methods for operating the same are provided. In one embodiment, the display device has an electronic display having an active area for presenting visual content; a housing holding the electronic display and having an opening allowing a person to view a first portion of the active area; and a bezel about the opening, the bezel covering a second portion of the active area and providing a window through which at least a part of the second portion can be viewed. A sensor system senses when a person is close to touching the bezel or when a person …

Community As A Connector: Associating Faces With Celebrity Names In Web Videos, Zhineng Chen, Chong-Wah Ngo, Juan Cao, Wei Zhang

Research Collection School Of Computing and Information Systems

Associating celebrity faces appearing in videos with their names is of increasingly importance with the popularity of both celebrity videos and related queries. However, the problem is not yet seriously studied in Web video domain. This paper proposes a Community connected Celebrity Name-Face Association approach (CCNFA), where the community is regarded as an intermediate connector to facilitate the association. Specifically, with the names and faces extracted from Web videos, C-CNFA decomposes the association task into a three-step framework: community discovering, community matching and celebrity face tagging. To achieve the goal of efficient name-face association under this umbrella, algorithms such as …

Video Hyperlinking: Libraries And Tools For Threading And Visualizing Large Video Collection, Lei Pang, Wei Zhang, Hung-Khoon Tan, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

While HTML documents could be effortlessly hyperlinked by markup tags, creation of the hyperlinks for multimedia objects is by no means easy due to the involvement of various visual processing units and intensive computational overhead. This paper introduces an open source, named VIREO-VH, which provides end-to-end support for creating hyperlinks to thread and visualize collections of videos. The software components include video pre-processing, bag-ofwords based inverted file indexing for scalable near-duplicate keyframe search, localization of partial near-duplicate segments, and galaxy visualization of video collection. The open source has been internally used by VIREO research team since 2007, and was evolved …

Predicting Domain Adaptivity: Redo Or Recycle?, Ting Yao, Chong-Wah Ngo, Shiai Zhu

Research Collection School Of Computing and Information Systems

Over the years, the academic researchers have contributed various visual concept classifiers. Nevertheless, given a new dataset, most researchers still prefer to develop large number of classifiers from scratch despite expensive labeling efforts and limited computing resources. A valid question is why not multimedia community “embrace the green” and recycle off-the-shelf classifiers for new dataset. The difficulty originates from the domain gap that there are many different factors that govern the development of a classifier and eventually drive its performance to emphasize certain aspects of dataset. Reapplying a classifier to an unseen dataset may end up GIGO (garbage in, garbage …

Fashionask: Pushing Community Answers To Your Fingertips, Wei Zhang, Lei Pang, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

We demonstrate a multimedia-based question-answering system, named FashionAsk, by allowing users to ask questions referring to pictures snapped by mobile devices. Specifically, instead of asking verbose questions to depict visual instances, direct pictures are provided as part of questions. To answer these multi-modal questions, FashionAsk performs a large-scale instance search to infer the names of instances, and then matches with similar questions from communitycontributed QA websites as answers. The demonstration is conducted on a million-scale dataset of Web images and QA pairs in the domain of fashion products. Asking a multimedia question through FashionAsk can take as short as five …

Vireo@Trecvid 2012: Searching With Topology, Recounting Will Small Concepts, Learning With Free Examples, Wei Zhang, Chun-Chet Tan, Shi-Ai Zhu, Ting Yao, Lei Pang, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

The vireo group participated in four tasks: instance search, multimedia event recounting, multimedia event detection, and semantic indexing. In this paper, we will present our approaches and discuss the evaluation results.