Graphics and Human Computer Interfaces Commons^™

Project Writeup On Amethyst: A 3d Adventure Game For Tablets, Adam Hintz

Computer Science and Software Engineering

Amethyst is a point-and-click science fiction adventure game for tablets, developed over two quarters to demonstrate applied principles of computer graphics and software engineering discipline. Using a novel interaction system, players can engage in environmental puzzles. Development of Amethyst required non-trivial quality assurance measures and workflow enhancements. The end result is a functional technical demo showcasing a single level, with the ability to rapidly produce more content.

Searching Visual Instances With Topology Checking And Context Modeling, Wei Zhang, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Instance Search (INS) is a realistic problem initiated by TRECVID, which is to retrieve all occurrences of the querying object, location, or person from a large video collection. It is a fundamental problem with many applications, and also a challenging problem different from the traditional concept or near-duplicate (ND) search, since the relevancy is defined at instance level. True responses could exhibit various visual variations, such as being small on the image with different background, or showing a non-homography spatial configuration. Based on the Bag-of-Words model, we propose two techniques tailored for Instance Search. Specifically, we explore the use of …

The Use Of Visual-Based Simulated Environments In Teacher Preparation, Sharon Judge, Jonna Bobzien, Ann Maydosz, Sabra Gear, Petros Katsioloudis

Communication Disorders & Special Education Faculty Publications

While virtual technology for training in the simulation field has a long history in medicine, aviation, and the military, the application of similar emerging and innovative technologies in teacher preparation and education has been limited. TLE TeachLive™ (Teaching Learning Environment, Teaching in a Virtual Environment) [TLE] is an inventive mixed-reality environment (the blending of real and synthetic content) where prospective teachers can interact with a group of virtual students. The purpose of the virtual teaching environment of TLE is to strengthen teacher recruitment, preparation, and retention in education by allowing teachers to improve their skills with virtual students, providing a …

Circular Reranking For Visual Search, Ting Yao, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Search reranking is regarded as a common way to boost retrieval precision. The problem nevertheless is not trivial especially when there are multiple features or modalities to be considered for search, which often happens in image and video retrieval. This paper proposes a new reranking algorithm, named circular reranking, that reinforces the mutual exchange of information across multiple modalities for improving search performance, following the philosophy that strong performing modality could learn from weaker ones, while weak modality does benefit from interacting with stronger ones. Technically, circular reranking conducts multiple runs of random walks through exchanging the ranking scores among …

An Investigation And Analysis Of The Vestibulo-Ocular Reflex In A Vibration Environment, Daniel J. Uribe

Theses and Dissertations

Forty years of innovations have greatly improved Helmet-Mounted Displays (HMDs) and their integration into military systems. However, a significant issue with HMDs is the effect of vibration and the associated Vestibulo-Ocular Reflex (VOR). When a human’s head is subject to low-frequency vibration, the VOR stabilizes the eye with respect to objects in the external environment. However, this response is inappropriate in HMDs as the display moves with the user’s head and the VOR blurs the image as it is projected on the human retina. Current compensation techniques suggest increasing the size of displayed graphics or text to compensate for the …

Senior Project Report - Doctest, Stephen Weessies

Computer Engineering

DocTest is a program that, simply put, allows a programmer or user to document STANAG 4586 (a standard for unmanned aerial vehicle interoperability) messages and test the vehicle system at Lockheed Martin [5]. The program is extensible to allow for further development aiding our software team to do what they do best and not get bogged down in tedious but necessary documentation. DocTest is also used to aid in testing, keeping track of the issues and bugs found and creating a document that captures each issue so an issue is not missed or forgotten. This program was made for use …

Amethyst: A 3d Adventure Game For Tablets, Ross Light

Computer Science and Software Engineering

Amethyst is a point-and-click science fiction adventure game for tablets, developed over two quarters to demonstrate applied principles of computer graphics and software engineering discipline. Using a novel interaction system, players can engage in environmental puzzles. Development of Amethyst required non-trivial quality assurance measures and workflow enhancements. The end result is a functional technical demo showcasing a single level, with the ability to rapidly produce more content.

Data Visualization On Interactive Surfaces: A Research Agenda, Petra Isenberg, Tobias Isenberg, Tobias Hesselmann, Bongshin Lee, Ulrich Von Zadow, Anthony Tang

Research Collection School Of Computing and Information Systems

Interactive tabletops and surfaces (ITSs) provide rich opportunities for data visualization and analysis and consequently are used increasingly in such settings. A research agenda of some of the most pressing challenges related to visualization on ITSs emerged from discussions with researchers and practitioners in human-computer interaction, computer-supported collaborative work, and a variety of visualization fields at the 2011 Workshop on Data Exploration for Interactive Surfaces (Dexis 2011)

Flip-Invariant Sift For Copy And Object Detection, Wan-Lei Zhao, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Scale-invariant feature transform (SIFT) feature has been widely accepted as an effective local keypoint descriptor for its invariance to rotation, scale, and lighting changes in images. However, it is also well known that SIFT, which is derived from directionally sensitive gradient fields, is not flip invariant. In real-world applications, flip or flip-like transformations are commonly observed in images due to artificial flipping, opposite capturing viewpoint, or symmetric patterns of objects. This paper proposes a new descriptor, named flip-invariant SIFT (or F-SIFT), that preserves the original properties of SIFT while being tolerant to flips. F-SIFT starts by estimating the dominant curl …

Improving Webide Through Delightful Design And Gamification, Michael Hilton

Master's Theses

WebIDE is a web-based online learning environment. WebIDE has been used

successfully to teach CS0 and CS1 students Java and C concepts and software

engineering best practices, specically Test Driven Development. Previous Web-

IDE development has concentrated on developing functionality. The main goal

of this eort is to improve two non-functional aspects of WebIDE. The rst is to

design a more delightful user interface. The second is to add a scoring mecha-

nism that encourages students to develop best practices. The scoring mechanism

rewards students who answer the question correctly on the rst attempt, dis-

couraging them from spamming the …

Game Design And Homemade Powerpoint Games: An Examination Of The Justifications And A Review Of The Research, Jason Paul Siko, Michael Barbour

Education Faculty Publications

Research on educational games often focuses on the benefits that playing games has on student achievement. however, there is a growing body of research examining the benefits of having students design games rather than play them. Problems with game design as an instructional tool include the additional instruction on the programming language itself as well as the potential costs associated with new software. One way to mitigate these problems is to use Microsoft PowerPoint as game design software. While not intended for this purpose, MS PowerPoint is ubiquitous in schools and requires little additional instruction before students can design games. …

Kinectarms: A Toolkit For Capturing And Displaying Arm Embodiments In Distributed Tabletop Groupware, Aaron Genest, Carl Gutwin, Anthony Tang, Michael Kalyn, Zenja Ivkovic

Research Collection School Of Computing and Information Systems

Gestures are a ubiquitous part of human communication over tables, but when tables are distributed, gestures become difficult to capture and represent. There are several problems: extracting arm images from video, representing the height of the gesture, and making the arm embodiment visible and understandable at the remote table. Current solutions to these problems are often expensive, complex to use, and difficult to set up. We have developed a new toolkit - KinectArms - that quickly and easily captures and displays arm embodiments. KinectArms uses a depth camera to segment the video and determine gesture height, and provides several visual …

Guest Editorial: Selected Papers From Icimcs 2011, Chong-Wah Ngo, Changsheng Xu, Xiao Wu, Abdulmotaleb El Saddik

Research Collection School Of Computing and Information Systems

International Conference on Internet Multimedia Computing and Services (ICIMCS) is an annual conference sponsored by ACM SIGMM China Chapter. The conference is especially interested in the latest technologies and applications that deal with the web-scale processing and management of heterogeneous data from the Internet for multimedia computing and service. ICIMCS 2011 held in Chengdu, China— the ancient hometown of lovely panda. The conference has attracted around 80 participants, including researchers from academia and industries across ten countries/regions, for sharing their recent works in the topics ranging from visual information analysis and mining, query processing and search, multimedia privacy and security.

Robust Non-Parametric Data Fitting For Correspondence Modeling, Wen-Yan Lin, Ming-Ming Cheng, Shuai Zheng, Jiangbo Lu, Nigel Crook

Research Collection School Of Computing and Information Systems

We propose a generic method for obtaining nonparametric image warps from noisy point correspondences. Our formulation integrates a huber function into a motion coherence framework. This makes our fitting function especially robust to piecewise correspondence noise (where an image section is consistently mismatched). By utilizing over parameterized curves, we can generate realistic nonparametric image warps from very noisy correspondence. We also demonstrate how our algorithm can be used to help stitch images taken from a panning camera by warping the images onto a virtual push-broom camera imaging plane.

Efficient Salient Region Detection With Soft Image Abstraction, Ming-Ming Cheng, Jonathan Warrell, Wen-Yan Lin, Shuai Zheng, Vibhav Vineet, Nigel Crook

Research Collection School Of Computing and Information Systems

Detecting visually salient regions in images is one of the fundamental problems in computer vision. We propose a novel method to decompose an image into large scale perceptually homogeneous elements for efficient salient region detection, using a soft image abstraction representation. By considering both appearance similarity and spatial distribution of image pixels, the proposed representation abstracts out unnecessary image details, allowing the assignment of comparable saliency values across similar regions, and producing perceptually accurate salient region detection. We evaluate our salient region detection approach on the largest publicly available dataset with pixel accurate annotations. The experimental results show that the …

Visualization Of Off-Screen Data On Tablets Using Context-Providing Bar Graphs And Scatter Plots, Peter S. Games, Alark Joshi

Computer Science

Visualizing data on tablets is challenging due to the relatively small screen size and limited user interaction capabilities. Standard data visualization apps provide support for pinch-and-zoom and scrolling operations, but do not provide context for data that is off-screen. When exploring data on tablets, the user must be able to focus on a region of interest and quickly find interesting patterns in the data. We present visualization techniques that facilitate seamless interaction with the region of interest on a tablet using context-providing bar graphs and scatter plots. Through aggregation, fisheye-style, and overview+detail representations, we provide context to the users as …

Visual Semantic Segmentation And Its Applications, Jizhou Gao

Theses and Dissertations--Computer Science

This dissertation addresses the difficulties of semantic segmentation when dealing with an extensive collection of images and 3D point clouds. Due to the ubiquity of digital cameras that help capture the world around us, as well as the advanced scanning techniques that are able to record 3D replicas of real cities, the sheer amount of visual data available presents many opportunities for both academic research and industrial applications. But the mere quantity of data also poses a tremendous challenge. In particular, the problem of distilling useful information from such a large repository of visual data has attracted ongoing interests in …

A Robust Rgb-D Slam System For 3d Environment With Planar Surfaces, Po-Chang Su

Theses and Dissertations--Electrical and Computer Engineering

Simultaneous localization and mapping is the technique to construct a 3D map of unknown environment. With the increasing popularity of RGB-depth (RGB-D) sensors such as the Microsoft Kinect, there have been much research on capturing and reconstructing 3D environments using a movable RGB-D sensor. The key process behind these kinds of simultaneous location and mapping (SLAM) systems is the iterative closest point or ICP algorithm, which is an iterative algorithm that can estimate the rigid movement of the camera based on the captured 3D point clouds. While ICP is a well-studied algorithm, it is problematic when it is used in …

Creating Scalable Location-Based Games: Lessons From Geocaching, Carman Neustaedter, Anthony Tang, Tejinder K. Judge

Research Collection School Of Computing and Information Systems

Location-based games seek to move computer gaming out from behind the PC and into the “real world” of cities, streets, parks, and other locations. This real-world physicality makes the experience fun for game players, yet it brings the unique challenge of creating and orchestrating such a game. That is, location-based games are often difficult to create, grow, and maintain over long periods of time. Our research investigates how location-based games can be designed to overcome this challenge of scalability. We studied the well-established location-based game of Geocaching through active participation and an online survey to better understand how it has …

Nextgen Flight Deck Data Comm: Auxiliary Synthetic Speech Phase I, Tracy Lennertz, Judith Bürki-Cohen, Andrea L. Sparko, Nickolas D. Macchiarella, Jason Kring, Mike Coman, Tom Haritos, Jeffry Alvarado

Publications

Data Comm—a text-based controller-pilot communication system—is critical to many NextGen improvements. With Data Comm, communication becomes a visual task. Interacting with a visual Data Comm display may yield an unsafe increase in head-down time, particularly for single-pilot operations. This study examined the feasibility of supplementing Data Comm with synthetic speech. To this end, thirty-two pilots flew two experimental scenarios in a Cessna 172 Flight Training Device. In one scenario, ATC communication was with a text-only Data Comm display, in the other, communication was with a text Data Comm display with synthetic speech that read aloud each message (i.e., text+speech). Pilots …