Graphics and Human Computer Interfaces Commons^™

Click-Through-Based Subspace Learning For Image Search, Yingwei Pan, Ting Yao, Xinmei Tian, Houqiang Li, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

One of the fundamental problems in image search is to rank image documents according to a given textual query. We address two limitations of the existing image search engines in this paper. First, there is no straightforward way of comparing textual keywords with visual image content. Image search engines therefore highly depend on the surrounding texts, which are often noisy or too few to accurately describe the image content. Second, ranking functions are trained on query-image pairs labeled by human labelers, making the annotation intellectually expensive and thus cannot be scaled up. We demonstrate that the above two fundamental challenges …

Vireo @ Trecvid 2014: Instance Search And Semantic Indexing, Wei Zhang, Hao Zhang, Ting Yao, Yijie Lu, Jingjing Chen, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

This paper summarizes the following two tasks participated by VIREO group: instance search and semantic indexing. We will present our approaches and analyze the results obtained in TRECVID 2014 benchmark evaluation

Vireo-Tno @ Trecvid 2014: Multimedia Event Detection And Recounting (Med And Mer), Chong-Wah Ngo, Yi-Jie Lu, Hao Zhang, Ting Yao, Chun-Chet Tan, Lei Pang, Maaike De Boer, John Schavemaker, Klamer Schutte, Wessel Kraaij

Research Collection School Of Computing and Information Systems

This paper presents an overview and comparative analysis of our systems designed for TRECVID 2014 [1] multimedia event detection (MED) and recounting (MER) tasks, including all sub-tasks for Pre-Specified (PS) event detection, all sub-tasks except 100Ex for Ad-Hoc (AH) event detection, and 010Ex sub-task for both PS and AH event recounting. Multimedia Event Detection (MED) : Our main focus for the MED task is on the study of a new zero-example system, which aims to solve the 000Ex and SQ problems. The system can run either fully automatically or semi-automatically. Specifically, we test the automatic run in 000Ex submission and …

Taming The Software Chaos: True To Its Promise, Iftdss Eases The Burden Of Fuels Treatment Planning—And Does A Lot More Besides, Gail Wells

Joint Fire Science Program Digests

A key problem reported by the fuels treatment planning community is the difficulty and inefficiency of evaluating and then applying many planning tools and applications. Fuels specialists have struggled to find, load, and learn all the different fuels and fire planning models, not to mention the interface of running, adjusting, and inputting data specific to each model without the ability to easily share inputs/outputs between models.

The Interagency Fuels Treatment Decision Support System (IFTDSS) was conceived as a way for users to learn one interface, access a variety of data and models all in one place, and pass data (inputs …

Designing An Immersive And Entertaining Pervasive Gameplay Experience With Spheros As Game And Interface Elements, Brennan Jones, Kody Dillman, Setareh Aghel Manesh, Ehud Sharlin, Anthony Tang

Research Collection School Of Computing and Information Systems

The Sphero is a robotic remote-controlled ball capable of rolling around on its own in any direction at multiple speeds. Numerous games have been designed for the Sphero for smartphones and tablets. However, most of these games provide an interface for controlling the Sphero that is far from natural. These games also do not put a strong focus on the physical environment around the Sphero. This work discusses a control scheme used to control a Sphero with another Sphero, and a pervasive game leveraging this scheme that emphasizes physical properties of the environment to create an immersive experience.

Personality Profiles Of Software Engineers And Their Software Quality Preferences, Arif Raza, Luiz Fernando Capretz, Zaka Ul-Mustafa

Electrical and Computer Engineering Publications

Studies related to human aspects in software engineering (SE) have been performed from different perspectives. These perspectives include the study of human factors in different phases of software life cycle, effect of team performance in software development, how can a personality trait suit a particular task, and about some other miscellaneous issues. This research work aims to establish personality profiles of Pakistani software engineers using the Myers-Briggs Type Indicator (MBTI) instrument. In this survey, we have collected personality profiles of 110 software engineers. Moreover, their preferences of software quality attributes have also been collected. Analysis of the study shows that …

Seeing Human Weight From A Single Rgb-D Image, Tam Nguyen, Jiashi Feng, Shuicheng Yan

Computer Science Faculty Publications

Human weight estimation is useful in a variety of potential applications, e.g., targeted advertisement, entertainment scenarios and forensic science. However, estimating weight only from color cues is particularly challenging since these cues are quite sensitive to lighting and imaging conditions. In this article, we propose a novel weight estimator based on a single RGB-D image, which utilizes the visual color cues and depth information. Our main contributions are three-fold.

First, we construct the W8-RGBD dataset including RGB-D images of different people with ground truth weight.

Second, the novel sideview shape feature and the feature fusion model are proposed to facilitate …

Name-Face Association In Web Videos: A Large-Scale Dataset, Baselines, And Open Issues, Zhi-Neng Chen, Chong-Wah Ngo, Wei Zhang, Juan Cao, Yu-Gang Jiang

Research Collection School Of Computing and Information Systems

Associating faces appearing in Web videos with names presented in the surrounding context is an important task in many applications. However, the problem is not well investigated particularly under large-scale realistic scenario, mainly due to the scarcity of dataset constructed in such circumstance. In this paper, we introduce a Web video dataset of celebrities, named WebV-Cele, for name-face association. The dataset consists of 75 073 Internet videos of over 4 000 hours, covering 2 427 celebrities and 649 001 faces. This is, to our knowledge, the most comprehensive dataset for this problem. We describe the details of dataset construction, discuss …

Saliency Detection With Flash And No-Flash Image Pairs, Shengfeng He, Rynson W.H. Lau

Research Collection School Of Computing and Information Systems

In this paper, we propose a new saliency detection method using a pair of flash and no-flash images. Our approach is inspired by two observations. First, only the foreground objects are significantly brightened by the flash as they are relatively nearer to the camera than the background. Second, the brightness variations introduced by the flash provide hints to surface orientation changes. Accordingly, the first observation is explored to form the background prior to eliminate background distraction. The second observation provides a new orientation cue to compute surface orientation contrast. These photometric cues from the two observations are independent of visual …

A Method To Develop Neck Injury Criteria To Aid Design And Test Of Escape Systems Incorporating Helmet Mounted Displays, Jeffrey C. Parr

Theses and Dissertations

HMDs are becoming common human-machine interface equipment in manned military flight, but introducing this equipment into the overall aircraft escape system poses new and significant system design, development, and test concerns. Although HMDs add capabilities, which improve operator performance, the increased capability is often accompanied by increased head supported mass. The increased mass can amplify the risk of pilot neck injury during ejection when compared to lighter legacy helmets. Currently no adequate USAF neck injury criteria exist to effectively guide the requirements, design, and test of escape systems for pilots with HMDs. This research effort presents a novel method to …

Wireless Location Determination: Using Existing 802.11 Wireless Networks To Determine A Users Location, Travis Calvert

Journal of Undergraduate Research at Minnesota State University, Mankato

The ability to determine a user’s location through an existing 802.11 wireless network has vast implications in the area of context-aware and pervasive computing. Such abilities have been developed mainly in the Linux environment to date. To maximize its usefulness, a location determination system was developed for the more dominant Windows operation system. While being able to operate outdoors as well as indoors, this system succeeds where traditional GPS (Global Positioning Systems) fail, namely indoor environments. This system could benefit the large number of existing wireless networks and requires no additional hardware; only a few simple software downloads. The ability …

Mental Health Awareness Building Via Android Application, James Faraday, Joshua Martin

Journal of Undergraduate Research at Minnesota State University, Mankato

The goal of this project was to create a tool that provides students at Minnesota State University, Mankato with mental health information through a freely available smartphone application (App). Our approach used a software engineering design process that focused on who our customers are, what resources are available, and how we can best connect the two to improve student lives. We identified the stakeholders involved and worked with campus mental health professionals to help shape our App. While there is a broad range of mental health topics, we have focused on materials related to depression. The first process of the …

Data Visualization To Evaluate And Facilitate Targeted Data Acquisitions In Support Of A Real-Time Ocean Forecasting System, Edward A. Holmberg Iv

LSU New Orleans Theses and Dissertations

A robust evaluation toolset has been designed for Naval Research Laboratory’s Real-Time Ocean Forecasting System RELO with the purpose of facilitating an adaptive sampling strategy and providing a more educated guidance for routing underwater gliders. The major challenges are to integrate into the existing operational system, and provide a bridge between the modeling and operative environments. Visualization is the selected approach and the developed software is divided into 3 packages: The first package is to verify that the glider is actually following the waypoints and to predict the position of the glider for the next cycle’s instructions. The second package …

Spatiotemporal Crime Analysis, James Q. Tay, Abish Malik, Sherry Towers, David Ebert

The Summer Undergraduate Research Fellowship (SURF) Symposium

There has been a rise in the use of visual analytic techniques to create interactive predictive environments in a range of different applications. These tools help the user sift through massive amounts of data, presenting most useful results in a visual context and enabling the person to rapidly form proactive strategies. In this paper, we present one such visual analytic environment that uses historical crime data to predict future occurrences of crimes, both geographically and temporally. Due to the complexity of this analysis, it is necessary to find an appropriate statistical method for correlative analysis of spatiotemporal data, as well …

An Adaptive Educational Game To Help Students Learn How To Solve Systems Of Linear Equations, Wang Zhang

Theses and Dissertations

Educational games have been proven to be effective in developing problem solving skills in well-defined domain, such as Math and Physics. In this thesis, an educational game called Matrix was developed to foster problem solving skills in the domain of linear algebra, particularly solving a system of linear equations. Matrix is an adaptive educational game that uses intelligent tutoring modules to guide the student's learning process and provide feedback based on the student's performance. These modules are domain module, student module, pedagogical module and presentation module. The domain module contains all the concepts the student needs to learn and an …

Video Event Detection Using Motion Relativity And Feature Selection, Feng Wang, Zhanhu Sun, Yu-Gang Jiang, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Event detection plays an essential role in video content analysis. In this paper, we present our approach based on motion relativity and feature selection for video event detection. First, we propose a new motion feature, namely Expanded Relative Motion Histogram of Bag-of-Visual-Words (ERMH-BoW) to employ motion relativity for event detection. In ERMH-BoW, by representing what aspect of an event with Bag-of-Visual-Words (BoW), we construct relative motion histograms between different visual words to depict the objects' activities or how aspect of the event. ERMH-BoW thus integrates both what and how aspects for a complete event description. Meanwhile, we show that by …

Structure Preserving Large Imagery Reconstruction, Ju Shen, Jianjun Yang, Sami Taha Abu Sneineh, Bryson Payne, Markus Hitz

Computer Science Faculty Publications

With the explosive growth of web-based cameras and mobile devices, billions of photographs are uploaded to the internet. We can trivially collect a huge number of photo streams for various goals, such as image clustering, 3D scene reconstruction, and other big data applications. However, such tasks are not easy due to the fact the retrieved photos can have large variations in their view perspectives, resolutions, lighting, noises, and distortions. Furthermore, with the occlusion of unexpected objects like people, vehicles, it is even more challenging to find feature correspondences and reconstruct realistic scenes. In this paper, we propose a structure-based image …

Collaborative Error Reduction For Hierarchical Classification, Shiai Zhu, Xiao-Yong Wei, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Hierarchical classification (HC) is a popular and efficient way for detecting the semantic concepts from the images. The conventional method always selects the branch with the highest classification response. This branch selection strategy has a risk of propagating classification errors from higher levels of the hierarchy to the lower levels. We argue that the local strategy is too arbitrary, because the candidate nodes are considered individually, which ignores the semantic and context relationships among concepts. In this paper, we first propose a novel method for HC, which is able to utilize the semantic relationship among candidate nodes and their children …

Click-Through-Based Cross-View Learning For Image Search, Yingwei Pan, Ting Yao, Tao Mei, Houqiang Li, Chong-Wah Ngo, Yong Rui

Research Collection School Of Computing and Information Systems

One of the fundamental problems in image search is to rank image documents according to a given textual query. Existing search engines highly depend on surrounding texts for ranking images, or leverage the query-image pairs annotated by human labelers to train a series of ranking functions. However, there are two major limitations: 1) the surrounding texts are often noisy or too few to accurately describe the image content, and 2) the human annotations are resourcefully expensive and thus cannot be scaled up. We demonstrate in this paper that the above two fundamental challenges can be mitigated by jointly exploring the …

Libraries Respond To Mobile Ubiquity: Research And Assessment Of Mobile Device Usage Trends For Academic And Medical Libraries, Megan M. Hurst, Eleanor I. Cook, J. Michael Lindsay, Martha F. Earl

Charleston Library Conference

The authors consider trends in mobile device usage for the Internet as a whole, for EBSCO Discovery Service across all client libraries, and at two specific libraries: Preston Medical Library, serving the University of Tennessee (UT) Graduate School of Medicine and UT Medical Center, and the Joyner Library at East Carolina University, serving students and faculty on the main campus. Librarians at Preston Medical Library conducted a survey to determine which mobile devices, platforms, and apps were used by their patrons in 2012. East Carolina University piloted an iPad and e-reader lending program in 2010–2011. The results of each are …

Designing A Goal Journaling Application, Kevin Lufkin

Liberal Arts and Engineering Studies

Achieving a personal goal and making a positive change in one’s life can be a difficult and elusive task. Everyday people are creating and setting new goals for themselves, but more often than not these goals are never realized. Motivation, determination, and discipline are all key elements when it comes to accomplishing a goal, but if there is no clear idea as to how to connect the dots from where one is to where one wants to be these important qualities lose their effectiveness.

The applications that exist today largely fit in the realm of goal/task management and planners. This …

Virtual Reality Engine Development, Varun Varahamurthy

Master's Theses

With the advent of modern graphics and computing hardware and cheaper sensor and display technologies, virtual reality is becoming increasingly popular in the fields of gaming, therapy, training and visualization. Earlier attempts at popularizing VR technology were plagued by issues of cost, portability and marketability to the general public. Modern screen technologies make it possible to produce cheap, light head-mounted displays (HMDs) like the Oculus Rift, and modern GPUs make it possible to create and deliver a seamless real-time 3D experience to the user. 3D sensing has found an application in virtual and augmented reality as well, allowing for a …

Juiciness In Citizen Science Computer Games: Analysis Of A Prototypical Game, Eric D. Ebucktha Buckthal

Master's Theses

Incorporating the collective problem-solving skills of non-experts could ac- celerate the advancement of scientific research. Citizen science games leverage puzzles to present computationally difficult problems to players. Such games typ- ically map the scientific problem to game mechanics and visual feed-back helps players improve their solutions. Like games for entertainment, citizen science games intend to capture and retain player attention. “Juicy” game design refers to augmented visual feedback systems that give a game personality without modi- fying fundamental game mechanics. A “juicy” game feels alive and polished. This thesis explores the use of “juicy” game design applied to the citizen …

Coffee: Context Observer For Fast Enthralling Entertainment, Anthony M. Lenz

Master's Theses

Desktops, laptops, smartphones, tablets, and the Kinect, oh my! With so many devices available to the average consumer, the limitations and pitfalls of each interface are becoming more apparent. Swimming in devices, users often have to stop and think about how to interact with each device to accomplish the current tasks at hand. The goal of this thesis is to minimize user cognitive effort in handling multiple devices by creating a context aware hybrid interface. The context aware system will be explored through the hybridization of gesture and touch interfaces using a multi-touch coffee table and the next-generation Microsoft Kinect. …

A Proof Of Concept For Crowdsourcing Color Perception Experiments, Ryan Nathaniel Mcleod

Master's Theses

Accurately quantifying the human perception of color is an unsolved prob- lem. There are dozens of numerical systems for quantifying colors and how we as humans perceive them, but as a whole, they are far from perfect. The ability to accurately measure color for reproduction and verification is critical to indus- tries that work with textiles, paints, food and beverages, displays, and media compression algorithms. Because the science of color deals with the body, mind, and the subjective study of perception, building models of color requires largely empirical data over pure analytical science. Much of this data is extremely dated, …

Smarticles: A Method For Identifying And Correcting Instability And Error Caused By Explicit Integration Techniques In Physically Based Simulations, Susan Aileen Marano

Master's Theses

Using an explicit integration method in physically based animations has many advantages including conceptual and computational simplicity, however, it re- quires small time steps to ensure low numerical instability. Simulations with large numbers of individually interacting components such as cloth, hair, and fluid models, are limited by the sections of particles most susceptible to error. This results in the need for smaller time steps than required for the majority of the system. These sections can be diverse and dynamic, quickly changing in size and location based on forces in the system. Identifying and handling these trou- blesome sections could allow …

Games People Play: Exploring Depaul's Top-Rated Computer Game Development Program

DePaul Magazine

In March 2014, the Princeton Review, in conjunction with PC Gamer magazine, named the top 25 schools to study game design in the United States and Canada. DePaul's undergraduate program ranked 20th, a considerable leap from 2013’s honorable mention. The graduate program came in at 12th. DePaul's strong ranking reflects the game development program's extension of its basic game development, software engineering and programming to include art, design and storytelling, as well as computer graphics technology, networking, artificial intelligence and human-computer interaction. Examples of the award-winning games developed by students and now marketed by such going concerns as Sony PlayStation …

Gamification Of Education: A Review Of Literature, Fiona Fui-Hoon Nah, Qing Zeng, Venkata R. Telaprolu, Abhishek Padmanabhuni Ayyappa, Brenda Eschenbrenner

Research Collection School Of Computing and Information Systems

We synthesized the literature on gamification of education by conducting a review of the literature on gamification in the educational and learning context. Based on our review, we identified several game design elements that are used in education. These game design elements include points, levels/stages, badges, leaderboards, prizes, progress bars, storyline, and feedback. We provided examples from the literature to illustrate the application of gamification in the educational context.

Constructive Visualization, Samuel Huron, Sheelagh Carpendale, Alice Thudt, Anthony Tang, Michael Mauerer

Research Collection School Of Computing and Information Systems

If visualization is to be democratized, we need to provide means for non-experts to create visualizations that allow them to engage directly with datasets. We present constructive visualization a new paradigm for the simple creation of flexible, dynamic visualizations. Constructive visualization is simple—in that the skills required to build and manipulate the visualizations are akin to kindergarten play; it is expressive— in that one can build within the constraints of the chosen environment, and it also supports dynamics — in that these constructed visualizations can be rebuilt and adjusted. We describe the conceptual components and processes underlying constructive visualization, and …

Daisy Filter Flow: A Generalized Discrete Approach To Dense Correspondences, Hongsheng Yang, Wen-Yan Lin, Jiangbo Lu

Research Collection School Of Computing and Information Systems

No abstract provided.