Graphics and Human Computer Interfaces Commons^™

Hydrographic Surface Modeling Through A Raster Based Spline Creation Method, Julie G. Alexander

LSU New Orleans Theses and Dissertations

The United States Army Corp of Engineers relies on accurate and detailed surface models for various construction projects and preventative measures. To aid in these efforts, it is necessary to work for advancements in surface model creation. Current methods for model creation include Delaunay triangulation, raster grid interpolation, and Hydraulic Spline grid generation. While these methods produce adequate surface models, attempts for improved methods can still be made.

A method for raster based spline creation is presented as a variation of the Hydraulic Spline algorithm. By implementing Hydraulic Splines in raster data instead of vector data, the model creation process …

Automatic Objects Removal For Scene Completion, Jianjun Yang, Yin Wang, Honggang Wang, Kun Hua, Wei Wang, Ju Shen

Computer Science Faculty Publications

With the explosive growth of Web-based cameras and mobile devices, billions of photographs are uploaded to the Internet. We can trivially collect a huge number of photo streams for various goals, such as 3D scene reconstruction and other big data applications. However, this is not an easy task due to the fact the retrieved photos are neither aligned nor calibrated. Furthermore, with the occlusion of unexpected foreground objects like people, vehicles, it is even more challenging to find feature correspondences and reconstruct realistic scenes. In this paper, we propose a structure-based image completion algorithm for object removal that produces visually …

Celebrowser: An Example Of Browsing Big Data On Small Device, Song Tan, Chong-Wah Ngo, Jun Xu, Yong Rui

Research Collection School Of Computing and Information Systems

In this demonstration, we demonstrate a mobile-based celebrity video browsing system called CeleBrowser. Using this system, users can interactively switch among four views: people-centric, timeline-centric, month-centric and topic-centric, for browsing celebrity-related hot videos. A peculiarity of the demonstration is to highlight the advantage of multiperspective information organization and presentation in engaging users for exploratory browsing of large number of Web videos on a device with small screen. Technology-wise the demonstration shows how query logs collected for six months from two vertical search engines are leveraged for mining hot events and videos of celebrities.

Advances In Documentation, Digital Curation, Virtual Exhibition, And A Test Of 3d Geometric Morhpometrics: A Case Study Of The Vanderpool Vessels From The Ancestral Caddo Territory, Robert Z. Selden Jr., Timothy K. Perttula, Michael J. O'Brien

CRHR: Archaeology

Three-dimensional (3D) digital scanning of archaeological materials is typically used as a tool for artifact documentation. With the permission of the Caddo Nation of Oklahoma, 3D documentation of Caddo funerary vessels from the Vanderpool site (41SM77) was conducted with the initial goal of ensuring that these data would be publicly available for future research long after the vessels were repatriated. A digital infrastructure was created to archive and disseminate the resultant 3D datasets, ensuring that they would be accessible by both researchers and the general public (CRHR 2014a). However, 3D imagery can be used for much more than documentation. To …

Exploring Customer Specific Kpi Selection Strategies For An Adaptive Time Critical User Interface, Ingo Keck, Robert J. Ross

Conference papers

Rapid growth in the number of measures available to describe customer-organization relationships has presented a serious challenge for Business Intelligence (BI) interface developers as they attempt to provide business users with key customer information without requiring users to painstakingly sift through many interface windows and layers. In this paper we introduce a prototype Intelligent User Interface that we have deployed to partially address this issue. The interface builds on machine learning techniques to construct a ranking model of Key Performance Indicators (KPIs) that are used to select and present the most important customer metrics that can be made available to …

Partial Least Squares Regression On Grassmannian Manifold For Emotion Recognition, M. Liu, R. Wang, Zhiwu Huang, S. Shan, X. Chen

Research Collection School Of Computing and Information Systems

In this paper, we propose a method for video-based human emotion recognition. For each video clip, all frames are represented as an image set, which can be modeled as a linear subspace to be embedded in Grassmannian manifold. After feature extraction, Class-specific One-to-Rest Partial Least Squares (PLS) is learned on video and audio data respectively to distinguish each class from the other confusing ones. Finally, an optimal fusion of classifiers learned from both modalities (video and audio) is conducted at decision level. Our method is evaluated on the Emotion Recognition In The Wild Challenge (EmotiW 2013). The experimental results on …

Multimedia Modeling, Chong-Wah Ngo, Klaus Schoeffmann, Yiannis Andreopoulos, Christian Breiteneder

Research Collection School Of Computing and Information Systems

Multimedia modeling aims to study computational models for addressing real-world multimedia problems from various perspectives, including information fusion, perceptual understanding, performance evaluation and social media. The topic becomes increasingly important with the massive amount of data available over the Internet, representing different pieces of information in heterogeneous forms that need to be consolidated before being used for multimedia problems. On the other hand, the advancement in technologies such as mobile and sensing devices drive the needs for revisiting the existing models for not only dealing with audio-visual cues but also incorporating various sensory modalities that have potential in providing cheaper …

Vireo/Ecnu @ Trecvid 2013: A Video Dance Of Detection, Recounting And Search With Motion Relativity And Concept Learning From Wild, Chong-Wah Ngo, Feng Wang, Wei Zhang, Chun-Chet Tan, Zhanhu Sun, Shi-Ai Zhu, Ting Yao

Research Collection School Of Computing and Information Systems

The VIREO group participated in four tasks: instance search, multimedia event recounting, multimedia event detection, and semantic indexing. In this paper, we will present our approaches and discuss the evaluation results

The Vireo Team At Mediaeval 2013: Violent Scenes Detection By Mid-Level Concepts Learnt From Youtube, Chun Chet Tan, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

The Violent Scenes Detection task continues to pose challenge in detecting violent scenes in Hollywood movies. In this working notes paper, we present the framework of our system and briefly discuss the performance results obtained in both objective and subjective subtasks. Besides using the low-level features for training the SVM classifiers for violent scenes detection, we show the feasibility in using the concept detectors to infer the occurrence of violent scenes. External Youtube data is exploited in our implementation to provide more diverse definition to violent scene concepts. Furthermore, we explore the feasibility of using Conditional Random Fields (CRF) to …

Image Search By Graph-Based Label Propagation With Image Representation From Dnn, Yingwei Pan, Yao Ting, Kuiyuan Yang, Houqiang Li, Chong-Wah Ngo, Jingdong Wang, Tao Mei

Research Collection School Of Computing and Information Systems

Our objective is to estimate the relevance of an image to a query for image search purposes. We address two limitations of the existing image search engines in this paper. First, there is no straightforward way of bridging the gap between semantic textual queries as well as users’ search intents and image visual content. Image search engines therefore primarily rely on static and textual features. Visual features are mainly used to identify potentially useful recurrent patterns or relevant training examples for complementing search by image reranking. Second, image rankers are trained on query-image pairs labeled by human experts, making the …

A Robust Rgbd Slam System For 3d Environment With Planar Surfaces, Po-Chang Su, Ju Shen, Sen-Ching S. Cheung

Computer Science Faculty Publications

With the increasing popularity of RGB-depth (RGB-D) sensors such as the Microsoft Kinect, there have been much research on capturing and reconstructing 3D environments using a movable RGB-D sensor. The key process behind these kinds of simultaneous location and mapping (SLAM) systems is the iterative closest point or ICP algorithm, which is an iterative algorithm that can estimate the rigid movement of the camera based on the captured 3D point clouds. While ICP is a well-studied algorithm, it is problematic when it is used in scanning large planar regions such as wall surfaces in a room. The lack of depth …

Video Concept Detection By Learning From Web Images: A Case Study On Cross Domain Learning, Shiai Zhu, Ting Yao, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Concept detection is probably the most important research problem in the area of multimedia. The need to model with sufficient and diverse training instances, however, makes the task computationally and resourcefully expensive. Meanwhile, the popularity of social media has generated massive amount of weakly tagged images which could be leveraged for concept model learning. Therefore, in this paper, we consider exploring weakly taggedWeb images to shed some light on video concept detection. Particularly, two sets of Web images downloaded from Flickr are utilized as training data for concept detection on two real-world large-scale video datasets released by TRECVID. Our experiments …

Gamification Of Education Using Computer Games, Fiona Fui-Hoon Nah, Venkata Telaprolu, Shashank Rallapalli, Pavani R. Venkata

Research Collection School Of Computing and Information Systems

We review the literature on gamification and identify principles of gamification and system design elements for gamifying computer educational games. Gamification of education is expected to increase learners’ engagement, which in turn increases learning achievement. We propose a gamification framework that synthesizes findings from the literature. The gamification framework is comprised of principles of gamification, system design elements for gamification, and dimensions of user engagement.

Usability Of Performance Dashboards, Usefulness Of Operational And Tactical Support, And Quality Of Strategic Support: A Research Framework, Bih-Ru Lea, Fiona Fui-Hoon Nah

Research Collection School Of Computing and Information Systems

Performance dashboards are used as a strategic decision support tool in organizations. In this research, we examine the relationships between the usability of performance dashboards, the usefulness of operational and tactical support, and the quality of strategic support that they provide. We hypothesize that usability of performance dashboards will influence user perceptions of the usefulness of the operational and tactical support provided by the dashboards, which in turn influence the perceived quality of strategic support provided.

Usability Of Performance Dashboards, Usefulness Of Operational And Tactical Support, And Quality Of Strategic Support: A Research Framework, Bih-Ru Lea, Fiona Fui-Hoon Nah

Research Collection School Of Computing and Information Systems

Performance dashboards are used as a strategic decision support tool in organizations. In this research, we examine the relationships between the usability of performance dashboards, the usefulness of operational and tactical support, and the quality of strategic support that they provide. We hypothesize that usability of performance dashboards will influence user perceptions of the usefulness of the operational and tactical support provided by the dashboards, which in turn influence the perceived quality of strategic support provided.

Personal Informatics In Chronic Illness Management, Haley Macleod, Anthony Tang, Sheelagh Carpendale

Research Collection School Of Computing and Information Systems

Many people with chronic illness suffer from debilitating symptoms or episodes that inhibit normal day-to-day function. Pervasive tools offer the possibility to help manage these conditions, particularly by helping people understand their conditions. But, it is unclear how to design these tools, as prior designs have focused on effortful tracking and many see those tools as a burden to use. We report here on an interview study with 12 individuals with chronic illnesses who collect personal data. We learn that these people are motivated through self-discovery and curiosity. We explore how these concepts may support the design of tools that …

Unified Entity Search In Social Media Community, Ting Yao, Yuan Liu, Chong-Wah Ngo, Tao Mei

Research Collection School Of Computing and Information Systems

The search for entities is the most common search behavior on the Web, especially in social media communities where entities (such as images, videos, people, locations, and tags) are highly heterogeneous and correlated. While previous research usually deals with these social media entities separately, we are investigating in this paper a unified, multilevel, and correlative entity graph to represent the unstructured social media data, through which various applications (e.g., friend suggestion, personalized image search, image tagging, etc.) can be realized more effectively in one single framework. We regard the social media objects equally as “entities” and all of these applications …

Development Of A Comprehensive Database System For A Highway Safety Engineering And Management, Naveen Veeramisti, Justin Baker, Indira Khanal, Kenny Moupita, Alexander Paz

College of Engineering: Graduate Celebration Programs

In simple words, the objective of this study is to develop a comprehensive database system to provide a data for highway safety engineering and management.

Development Of A Smart Application For Police Crash Reports, Sebastien Bonnet, Victor Molano, Alexander Paz

College of Engineering: Graduate Celebration Programs

• Gaining a significant amount of time to help police work
• Developing a User Friendly Interface
• Optimizing the GPS Gaining a significant amount of time to help police work
• Developing a User Friendly Interface
• Optimizing the bar code scan technology
• Application for MC 75 mobile technology

A Visualization Tool For A Highway Safety Management System, Indira Khanal, Naveen Veeramisti, Justin Baker, Alexander Paz

College of Engineering: Graduate Celebration Programs

• With lot of research, Federal Highway Administration
  has released a highway Safety management System
  software called as SafetyAnalyst (SA)
• SA has a suite of analytical tools to identify and
  manage system-wide safety improvements:
  Network Screening
  Diagnosis and Countermeasure Selection
  Economic Analyses and priority Ranking
  Countermeasure Evaluation
• SA provides a very rudimentary approach to display
  results just in tabular and textual format
• This study proposes a visualization tool that expands
  the output capabilities provided by SafetyAnalyst

Data Visualization On Interactive Surfaces: A Research Agenda, Petra Isenberg, Tobias Isenberg, Tobias Hesselmann, Bongshin Lee, Ulrich Von Zadow, Anthony Tang

Research Collection School Of Computing and Information Systems

Interactive tabletops and surfaces (ITSs) provide rich opportunities for data visualization and analysis and consequently are used increasingly in such settings. A research agenda of some of the most pressing challenges related to visualization on ITSs emerged from discussions with researchers and practitioners in human-computer interaction, computer-supported collaborative work, and a variety of visualization fields at the 2011 Workshop on Data Exploration for Interactive Surfaces (Dexis 2011)

Guest Editorial: Selected Papers From Icimcs 2011, Chong-Wah Ngo, Changsheng Xu, Xiao Wu, Abdulmotaleb El Saddik

Research Collection School Of Computing and Information Systems

International Conference on Internet Multimedia Computing and Services (ICIMCS) is an annual conference sponsored by ACM SIGMM China Chapter. The conference is especially interested in the latest technologies and applications that deal with the web-scale processing and management of heterogeneous data from the Internet for multimedia computing and service. ICIMCS 2011 held in Chengdu, China— the ancient hometown of lovely panda. The conference has attracted around 80 participants, including researchers from academia and industries across ten countries/regions, for sharing their recent works in the topics ranging from visual information analysis and mining, query processing and search, multimedia privacy and security.

Cross-View Graph Embedding, Zhiwu Huang, S. Shan, H. Zhang, S. Lao, X. Chen

Research Collection School Of Computing and Information Systems

Recently, more and more approaches are emerging to solve the cross-view matching problem where reference samples and query samples are from different views. In this paper, inspired by Graph Embedding, we propose a unified framework for these cross-view methods called Cross-view Graph Embedding. The proposed framework can not only reformulate most traditional cross-view methods (e.g., CCA, PLS and CDFE), but also extend the typical single-view algorithms (e.g., PCA, LDA and LPP) to cross-view editions. Furthermore, our general framework also facilitates the development of new cross-view methods. In this paper, we present a new algorithm named Cross-view Local Discriminant Analysis (CLODA) …

Video Hyperlinking: Libraries And Tools For Threading And Visualizing Large Video Collection, Lei Pang, Wei Zhang, Hung-Khoon Tan, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

While HTML documents could be effortlessly hyperlinked by markup tags, creation of the hyperlinks for multimedia objects is by no means easy due to the involvement of various visual processing units and intensive computational overhead. This paper introduces an open source, named VIREO-VH, which provides end-to-end support for creating hyperlinks to thread and visualize collections of videos. The software components include video pre-processing, bag-ofwords based inverted file indexing for scalable near-duplicate keyframe search, localization of partial near-duplicate segments, and galaxy visualization of video collection. The open source has been internally used by VIREO research team since 2007, and was evolved …

Vireo@Trecvid 2012: Searching With Topology, Recounting Will Small Concepts, Learning With Free Examples, Wei Zhang, Chun-Chet Tan, Shi-Ai Zhu, Ting Yao, Lei Pang, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

The vireo group participated in four tasks: instance search, multimedia event recounting, multimedia event detection, and semantic indexing. In this paper, we will present our approaches and discuss the evaluation results.

The Shanghai-Hongkong Team At Mediaeval2012: Violent Scene Detection Using Trajectory-Based Features, Yu-Gang Jiang, Qi Dai, Chun Chet Tan, Xiangyang Xue, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

The Violent Scene Detection task offers a very practical challenge in detecting complex and diverse violent video clips in movies. In this working note paper, we will briefly describe our system and discuss the results, which achieved top performance in mAP@201 and runner-up in mAP@100, among all 35 submissions worldwide. The central component of our system is a set of features derived from the appearance and motion of local patch trajectories [2]. We use these features and SVM classifier as the baseline approach and add in a few other components to further improve the performance. Our findings indicate that the …

Trajectory-Based Modeling Of Human Actions With Motion Reference Points, Yu-Gang Jiang, Qi Dai, Xiangyang Xue, Wei Liu, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Human action recognition in videos is a challenging problem with wide applications. State-of-the-art approaches often adopt the popular bag-of-features representation based on isolated local patches or temporal patch trajectories, where motion patterns like object relationships are mostly discarded. This paper proposes a simple representation specifically aimed at the modeling of such motion relationships. We adopt global and local reference points to characterize motion information, so that the final representation can be robust to camera movement. Our approach operates on top of visual codewords derived from local patch trajectories, and therefore does not require accurate foreground-background separation, which is typically a …

Understanding Engagement In Educational Computer Games, Fiona Fui-Hoon Nah, Yunjie Zhou, Adeline Boey, Hanji Li

Research Collection School Of Computing and Information Systems

This paper presents an empirical study to understand engagement in educational computer games. Engagement is defined as an experience that occupies an individual’s attention and captures one’s interest. The nature of engagement is viewed as comprising conditions, actions, and outcomes of engagement. The data collection method includes in-depth interviews with 12 educational computer game players who have experienced engagement in playing these games. We used the Grounded Theory (GT) approach to develop an understanding of user engagement in the computer game-based learning context.

Semi-Supervised Hierarchical Clustering For Personalized Web Image Organization, Lei Meng, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

Existing efforts on web image organization usually transform the task into surrounding text clustering. However, Current text clustering algorithms do not address the problem of insufficient statistical information for image representation and noisy tags which greatly decreases the clustering performance while increases the computational cost. In this paper, we propose a two-step semi-supervised hierarchical clustering algorithm, Personalized Hierarchical Theme-based Clustering (PHTC), for web image organization. In the first step, the Probabilistic Fusion ART (PF-ART) is proposed for grouping semantically similar images and simultaneously learning the probabilistic distribution of tag occurrence for mining the key tags/topics of clusters. In this way, …

Spalendar: Visualizing A Group's Calendar Events Over A Geographic Space On A Public Display, Chen Xiang, Sebastian Boring, Sheelagh Carpendale, Anthony Tang, Saul Greenberg

Research Collection School Of Computing and Information Systems

Portable paper calendars (i.e., day planners and organizers) have greatly influenced the design of group electronic calendars. Both use time units (hours/days/weeks/etc.) to organize visuals, with useful information (e.g., event types, locations, attendees) usually presented as - perhaps abbreviated or even hidden - text fields within those time units. The problem is that, for a group, this visual sorting of individual events into time buckets conveys only limited information about the social network of people. For example, people’s whereabouts cannot be read ‘at a glance’ but require examining the text. Our goal is to explore an alternate visualization that can …