Open Access. Powered by Scholars. Published by Universities.®
Graphics and Human Computer Interfaces Commons™
Open Access. Powered by Scholars. Published by Universities.®
- Discipline
-
- Databases and Information Systems (314)
- Artificial Intelligence and Robotics (182)
- Software Engineering (82)
- Engineering (70)
- Computer Engineering (69)
-
- Data Storage Systems (61)
- OS and Networks (33)
- Social and Behavioral Sciences (26)
- Theory and Algorithms (22)
- Numerical Analysis and Scientific Computing (20)
- Communication (18)
- Business (17)
- Information Security (13)
- Medicine and Health Sciences (12)
- Education (11)
- Programming Languages and Compilers (10)
- Health Information Technology (9)
- Social Media (9)
- Educational Methods (5)
- Technology and Innovation (5)
- Asian Studies (4)
- Communication Technology and New Media (4)
- Data Science (4)
- E-Commerce (4)
- International and Area Studies (4)
- Computer and Systems Architecture (3)
- Digital Communications and Networking (3)
- Keyword
-
- Visualization (21)
- Computer vision (17)
- Graph Neural Networks (14)
- Deep learning (13)
- Task analysis (13)
-
- Feature extraction (12)
- Training (11)
- Accessibility (10)
- Deep Learning (10)
- Design (10)
- Face recognition (9)
- Graph neural networks (9)
- Semantics (9)
- Categorization (8)
- Gamification (8)
- Virtual reality (8)
- Codes (7)
- Data visualization (7)
- Domain adaptation (7)
- Few-shot learning (7)
- Human-centered computing (7)
- Recipe retrieval (7)
- Three-dimensional displays (7)
- Video search (7)
- Web video (7)
- Augmented reality (6)
- Cross-modal retrieval (6)
- Human-computer interaction (6)
- Image search (6)
- Knowledge Graph (6)
- Publication Year
- Publication
- Publication Type
Articles 751 - 780 of 959
Full-Text Articles in Graphics and Human Computer Interfaces
One Space: Shared Visual Scenes For Active Free Play, Maayan Cohen, Kody Dillman, Haley Macleod, Seth Hunter, Anthony Tang
One Space: Shared Visual Scenes For Active Free Play, Maayan Cohen, Kody Dillman, Haley Macleod, Seth Hunter, Anthony Tang
Research Collection School Of Computing and Information Systems
Children engage in free play for emotional, physical and social development; researchers have explored supporting free play between physically remote playmates using videoconferencing tools. We show that the configuration of the video conferencing setup affects play. Specifically, we show that a shared visual scene configuration promotes fundamentally active forms of engaged, co-operative play.
Exploring Video Streaming In Public Settings: Shared Geocaching Over Distance Using Mobile Video Chat, Jason Procyk, Carman Neustaedter, Carolyn Pang, Anthony Tang, Tejinder K. Judge
Exploring Video Streaming In Public Settings: Shared Geocaching Over Distance Using Mobile Video Chat, Jason Procyk, Carman Neustaedter, Carolyn Pang, Anthony Tang, Tejinder K. Judge
Research Collection School Of Computing and Information Systems
Our research explores the use of mobile video chat in public spaces by people participating in parallel experiences, where both a local and remote person are doing the same activity together at the same time. We prototyped a wearable video chat experience and had pairs of friends and family members participate in 'shared geocaching' over distance. Our results show that video streaming works best for navigation tasks but is more challenging to use for fine-grained searching tasks. Video streaming also creates a very intimate experience with a remote partner, but this can lead to distraction from the 'real world' and …
Medical Imaging Specialists And 3d: A Domain Perspective On Mobile 3d Interactions, Teddy Seyed, Frank Maurer, Francisco Marinho Rodrigues, Anthony Tang
Medical Imaging Specialists And 3d: A Domain Perspective On Mobile 3d Interactions, Teddy Seyed, Frank Maurer, Francisco Marinho Rodrigues, Anthony Tang
Research Collection School Of Computing and Information Systems
3D volumetric medical images, such as MRIs, are commonly explored and interacted with by medical imaging experts using systems that require keyboard and mouse-based techniques. These techniques have presented challenges for medical imaging specialists: 3D spatial navigation is difficult, in addition to the detailed selection and analysis of 3D medical images being difficult due to depth perception and occlusion issues. In this work, we explore a potential solution to these challenges by using tangible interaction techniques with a mobile device to simplify 3D interactions for medical imaging specialists. We discuss preliminary observations from our design sessions with medical imaging specialists …
Celebrowser: An Example Of Browsing Big Data On Small Device, Song Tan, Chong-Wah Ngo, Jun Xu, Yong Rui
Celebrowser: An Example Of Browsing Big Data On Small Device, Song Tan, Chong-Wah Ngo, Jun Xu, Yong Rui
Research Collection School Of Computing and Information Systems
In this demonstration, we demonstrate a mobile-based celebrity video browsing system called CeleBrowser. Using this system, users can interactively switch among four views: people-centric, timeline-centric, month-centric and topic-centric, for browsing celebrity-related hot videos. A peculiarity of the demonstration is to highlight the advantage of multiperspective information organization and presentation in engaging users for exploratory browsing of large number of Web videos on a device with small screen. Technology-wise the demonstration shows how query logs collected for six months from two vertical search engines are leveraged for mining hot events and videos of celebrities.
Sketch: Pen And Touch Recognition [Workshop Summary], Richard C. Davis, Aaron Adler
Sketch: Pen And Touch Recognition [Workshop Summary], Richard C. Davis, Aaron Adler
Research Collection School Of Computing and Information Systems
Sketch recognition has technically been around for 40 years, but it has come and gone several times due to the difficulty of the problem. With the rise of touch and pen enabled phones and tablets, sketch recognition is regaining popularity and public presence, and more people are becoming aware of and interested in this difficult, but valuable, problem. It is important to harness the Sketch Recognition community at this time to encourage the flourishing of this topic.
Visual Typo Correction By Collocative Optimization: A Case Study On Merchandize Images, Xiao-Yong Wei, Zhen-Qun Yang, Chong-Wah Ngo, Wei Zhang
Visual Typo Correction By Collocative Optimization: A Case Study On Merchandize Images, Xiao-Yong Wei, Zhen-Qun Yang, Chong-Wah Ngo, Wei Zhang
Research Collection School Of Computing and Information Systems
Near-duplicate retrieval (NDR) in merchandize images is of great importance to a lot of online applications on e-Commerce websites. In those applications where the requirement of response time is critical, however, the conventional techniques developed for a general purpose NDR are limited, because expensive post-processing like spatial verification or hashing is usually employed to compromise the quantization errors among the visual words used for the images. In this paper, we argue that most of the errors are introduced because of the quantization process where the visual words are considered individually, which has ignored the contextual relations among words. We propose …
Partial Least Squares Regression On Grassmannian Manifold For Emotion Recognition, M. Liu, R. Wang, Zhiwu Huang, S. Shan, X. Chen
Partial Least Squares Regression On Grassmannian Manifold For Emotion Recognition, M. Liu, R. Wang, Zhiwu Huang, S. Shan, X. Chen
Research Collection School Of Computing and Information Systems
In this paper, we propose a method for video-based human emotion recognition. For each video clip, all frames are represented as an image set, which can be modeled as a linear subspace to be embedded in Grassmannian manifold. After feature extraction, Class-specific One-to-Rest Partial Least Squares (PLS) is learned on video and audio data respectively to distinguish each class from the other confusing ones. Finally, an optimal fusion of classifiers learned from both modalities (video and audio) is conducted at decision level. Our method is evaluated on the Emotion Recognition In The Wild Challenge (EmotiW 2013). The experimental results on …
Dense Image Correspondence Under Large Appearance Variations, Linlin Liu, Kok-Lim Low, Wen-Yan Lin
Dense Image Correspondence Under Large Appearance Variations, Linlin Liu, Kok-Lim Low, Wen-Yan Lin
Research Collection School Of Computing and Information Systems
This paper addresses the difficult problem of finding dense correspondence across images with large appearance variations. Our method uses multiple feature samples at each pixel to deal with the appearance variations based on our observation that pre-defined single feature sample provides poor results in nearest neighbor matching. We apply the idea in a flow-based matching framework and utilize the best feature sample for each pixel to determine the flow field. We propose a novel energy function and use dual-layer loopy belief propagation to minimize it where the correspondence, the feature scale and rotation parameters are solved simultaneously. Our method is …
Symmetry Robust Descriptor For Non-Rigid Surface Matching, Zhiyuan Zhang, Kangkang Yin, Kelvin W. C. Foong
Symmetry Robust Descriptor For Non-Rigid Surface Matching, Zhiyuan Zhang, Kangkang Yin, Kelvin W. C. Foong
Research Collection School Of Computing and Information Systems
In this paper, we propose a novel shape descriptor that is robust in differentiating intrinsic symmetric points on geometric surfaces. Our motivation is that even the state-of-theart shape descriptors and non-rigid surface matching algorithms suffer from symmetry flips. They cannot differentiate surface points that are symmetric or near symmetric. Hence a left hand of one human model may be matched to a right hand of another. Our Symmetry Robust Descriptor (SRD) is based on a signed angle field, which can be calculated from the gradient fields of the harmonic fields of two point pairs. Experiments show that the proposed shape …
Search Of Small Objects By Topology Matching, Context Modeling, And Pattern Mining, Wei Zhang, Chong-Wah Ngo
Search Of Small Objects By Topology Matching, Context Modeling, And Pattern Mining, Wei Zhang, Chong-Wah Ngo
Research Collection School Of Computing and Information Systems
No abstract provided.
Vireo/Ecnu @ Trecvid 2013: A Video Dance Of Detection, Recounting And Search With Motion Relativity And Concept Learning From Wild, Chong-Wah Ngo, Feng Wang, Wei Zhang, Chun-Chet Tan, Zhanhu Sun, Shi-Ai Zhu, Ting Yao
Vireo/Ecnu @ Trecvid 2013: A Video Dance Of Detection, Recounting And Search With Motion Relativity And Concept Learning From Wild, Chong-Wah Ngo, Feng Wang, Wei Zhang, Chun-Chet Tan, Zhanhu Sun, Shi-Ai Zhu, Ting Yao
Research Collection School Of Computing and Information Systems
The VIREO group participated in four tasks: instance search, multimedia event recounting, multimedia event detection, and semantic indexing. In this paper, we will present our approaches and discuss the evaluation results
Multimedia Modeling, Chong-Wah Ngo, Klaus Schoeffmann, Yiannis Andreopoulos, Christian Breiteneder
Multimedia Modeling, Chong-Wah Ngo, Klaus Schoeffmann, Yiannis Andreopoulos, Christian Breiteneder
Research Collection School Of Computing and Information Systems
Multimedia modeling aims to study computational models for addressing real-world multimedia problems from various perspectives, including information fusion, perceptual understanding, performance evaluation and social media. The topic becomes increasingly important with the massive amount of data available over the Internet, representing different pieces of information in heterogeneous forms that need to be consolidated before being used for multimedia problems. On the other hand, the advancement in technologies such as mobile and sensing devices drive the needs for revisiting the existing models for not only dealing with audio-visual cues but also incorporating various sensory modalities that have potential in providing cheaper …
Image Search By Graph-Based Label Propagation With Image Representation From Dnn, Yingwei Pan, Yao Ting, Kuiyuan Yang, Houqiang Li, Chong-Wah Ngo, Jingdong Wang, Tao Mei
Image Search By Graph-Based Label Propagation With Image Representation From Dnn, Yingwei Pan, Yao Ting, Kuiyuan Yang, Houqiang Li, Chong-Wah Ngo, Jingdong Wang, Tao Mei
Research Collection School Of Computing and Information Systems
Our objective is to estimate the relevance of an image to a query for image search purposes. We address two limitations of the existing image search engines in this paper. First, there is no straightforward way of bridging the gap between semantic textual queries as well as users’ search intents and image visual content. Image search engines therefore primarily rely on static and textual features. Visual features are mainly used to identify potentially useful recurrent patterns or relevant training examples for complementing search by image reranking. Second, image rankers are trained on query-image pairs labeled by human experts, making the …
The Vireo Team At Mediaeval 2013: Violent Scenes Detection By Mid-Level Concepts Learnt From Youtube, Chun Chet Tan, Chong-Wah Ngo
The Vireo Team At Mediaeval 2013: Violent Scenes Detection By Mid-Level Concepts Learnt From Youtube, Chun Chet Tan, Chong-Wah Ngo
Research Collection School Of Computing and Information Systems
The Violent Scenes Detection task continues to pose challenge in detecting violent scenes in Hollywood movies. In this working notes paper, we present the framework of our system and briefly discuss the performance results obtained in both objective and subjective subtasks. Besides using the low-level features for training the SVM classifiers for violent scenes detection, we show the feasibility in using the concept detectors to infer the occurrence of violent scenes. External Youtube data is exploited in our implementation to provide more diverse definition to violent scene concepts. Furthermore, we explore the feasibility of using Conditional Random Fields (CRF) to …
Annotation For Free: Video Tagging By Mining User Search Behavior, Yao Ting, Tao Mei, Chong-Wah Ngo, Shipeng Li
Annotation For Free: Video Tagging By Mining User Search Behavior, Yao Ting, Tao Mei, Chong-Wah Ngo, Shipeng Li
Research Collection School Of Computing and Information Systems
The problem of tagging is mostly considered from the perspectives of machine learning and data-driven philosophy. A fundamental issue that underlies the success of these approaches is the visual similarity, ranging from the nearest neighbor search to manifold learning, to identify similar instances of an example for tag completion. The need to searching for millions of visual examples in high-dimensional feature space, however, makes the task computationally expensive. Moreover, the results can suffer from robustness problem, when the underlying data, such as online videos, are rich of semantics and the similarity is difficult to be learnt from low-level features. This …
Error Recovered Hierarchical Classification, Shiai Zhu, Xiao-Yong Wei, Chong-Wah Ngo
Error Recovered Hierarchical Classification, Shiai Zhu, Xiao-Yong Wei, Chong-Wah Ngo
Research Collection School Of Computing and Information Systems
Hierarchical classification (HC) is a popular and efficient way for detecting the semantic concepts from the images. However, the conventional HC, which always selects the branch with the highest classification response to go on, has the risk of propagating serious errors from higher levels of the hierarchy to the lower levels. We argue that the highestresponse-first strategy is too arbitrary, because the candidate nodes are considered individually which ignores the semantic relationship among them. In this paper, we propose a novel method for HC, which is able to utilize the semantic relationship among candidate nodes and their children to recover …
Sitting On The Digital Divide, Singapore Management University
Sitting On The Digital Divide, Singapore Management University
Perspectives@SMU
Persuading the ‘digital resistant’ while balancing the digital:traditional media budget is a challenge for marketers
Click-Boosting Random Walk For Image Search Reranking, Xiaopeng Yang, Yongdong Zhang, Ting Yao, Zheng-Jun Zha, Chong-Wah Ngo
Click-Boosting Random Walk For Image Search Reranking, Xiaopeng Yang, Yongdong Zhang, Ting Yao, Zheng-Jun Zha, Chong-Wah Ngo
Research Collection School Of Computing and Information Systems
Image reranking is an effective way for improving the retrieval performance of keyword-based image search engines. A fundamental issue underlying the success of existing image reranking approaches is the ability in identifying potentially useful recurrent patterns or relevant training examples from the initial search results. Ideally, these patterns and examples can be leveraged to upgrade the ranks of visually similar images, which are also likely to be relevant. The challenge, nevertheless, originates from the fact that keyword-based queries are used to be ambiguous, resulting in difficulty in predicting the search intention. Mining useful patterns and examples without understanding query is …
Video Concept Detection By Learning From Web Images: A Case Study On Cross Domain Learning, Shiai Zhu, Ting Yao, Chong-Wah Ngo
Video Concept Detection By Learning From Web Images: A Case Study On Cross Domain Learning, Shiai Zhu, Ting Yao, Chong-Wah Ngo
Research Collection School Of Computing and Information Systems
Concept detection is probably the most important research problem in the area of multimedia. The need to model with sufficient and diverse training instances, however, makes the task computationally and resourcefully expensive. Meanwhile, the popularity of social media has generated massive amount of weakly tagged images which could be leveraged for concept model learning. Therefore, in this paper, we consider exploring weakly taggedWeb images to shed some light on video concept detection. Particularly, two sets of Web images downloaded from Flickr are utilized as training data for concept detection on two real-world large-scale video datasets released by TRECVID. Our experiments …
Gamification Of Education Using Computer Games, Fiona Fui-Hoon Nah, Venkata Telaprolu, Shashank Rallapalli, Pavani R. Venkata
Gamification Of Education Using Computer Games, Fiona Fui-Hoon Nah, Venkata Telaprolu, Shashank Rallapalli, Pavani R. Venkata
Research Collection School Of Computing and Information Systems
We review the literature on gamification and identify principles of gamification and system design elements for gamifying computer educational games. Gamification of education is expected to increase learners’ engagement, which in turn increases learning achievement. We propose a gamification framework that synthesizes findings from the literature. The gamification framework is comprised of principles of gamification, system design elements for gamification, and dimensions of user engagement.
Usability Of Performance Dashboards, Usefulness Of Operational And Tactical Support, And Quality Of Strategic Support: A Research Framework, Bih-Ru Lea, Fiona Fui-Hoon Nah
Usability Of Performance Dashboards, Usefulness Of Operational And Tactical Support, And Quality Of Strategic Support: A Research Framework, Bih-Ru Lea, Fiona Fui-Hoon Nah
Research Collection School Of Computing and Information Systems
Performance dashboards are used as a strategic decision support tool in organizations. In this research, we examine the relationships between the usability of performance dashboards, the usefulness of operational and tactical support, and the quality of strategic support that they provide. We hypothesize that usability of performance dashboards will influence user perceptions of the usefulness of the operational and tactical support provided by the dashboards, which in turn influence the perceived quality of strategic support provided.
Usability Of Performance Dashboards, Usefulness Of Operational And Tactical Support, And Quality Of Strategic Support: A Research Framework, Bih-Ru Lea, Fiona Fui-Hoon Nah
Usability Of Performance Dashboards, Usefulness Of Operational And Tactical Support, And Quality Of Strategic Support: A Research Framework, Bih-Ru Lea, Fiona Fui-Hoon Nah
Research Collection School Of Computing and Information Systems
Performance dashboards are used as a strategic decision support tool in organizations. In this research, we examine the relationships between the usability of performance dashboards, the usefulness of operational and tactical support, and the quality of strategic support that they provide. We hypothesize that usability of performance dashboards will influence user perceptions of the usefulness of the operational and tactical support provided by the dashboards, which in turn influence the perceived quality of strategic support provided.
Personal Informatics In Chronic Illness Management, Haley Macleod, Anthony Tang, Sheelagh Carpendale
Personal Informatics In Chronic Illness Management, Haley Macleod, Anthony Tang, Sheelagh Carpendale
Research Collection School Of Computing and Information Systems
Many people with chronic illness suffer from debilitating symptoms or episodes that inhibit normal day-to-day function. Pervasive tools offer the possibility to help manage these conditions, particularly by helping people understand their conditions. But, it is unclear how to design these tools, as prior designs have focused on effortful tracking and many see those tools as a burden to use. We report here on an interview study with 12 individuals with chronic illnesses who collect personal data. We learn that these people are motivated through self-discovery and curiosity. We explore how these concepts may support the design of tools that …
Onespace: Shared Depth-Corrected Video Interaction, David Ledo, Bon Adriel Aseniero, Sebastian Boring, Anthony Tang
Onespace: Shared Depth-Corrected Video Interaction, David Ledo, Bon Adriel Aseniero, Sebastian Boring, Anthony Tang
Research Collection School Of Computing and Information Systems
Video conferencing commonly employs a video portal metaphor to connect individuals from remote spaces. In this work, we explore an alternate metaphor, a shared depth mirror, where video images of two spaces are merged into a single shared, depth-corrected video. Just as seeing one’s mirror image causes reflective interaction, the shared video space changes the nature of interaction in the video space. We realize this metaphor in OneSpace, where the space respects virtual spatial relationships between people and objects, and in so doing, encourages cross-site, full-body interactions. We report preliminary observations of OneSpace in use, describing the role of depth …
An Architecture For Online Semantic Labeling On Ugvs, Arne Suppe, Luis Navarro-Serment, Daniel Munoz, Drew Bagnell, Martial Hebert
An Architecture For Online Semantic Labeling On Ugvs, Arne Suppe, Luis Navarro-Serment, Daniel Munoz, Drew Bagnell, Martial Hebert
Research Collection School Of Computing and Information Systems
We describe an architecture to provide online semantic labeling capabilities to field robots operating in urban environments. At the core of our system is the stacked hierarchical classifier developed by Munoz et al.,1 which classifies regions in monocular color images using models derived from hand labeled training data. The classifier is trained to identify buildings, several kinds of hard surfaces, grass, trees, and sky. When taking this algorithm into the real world, practical concerns with difficult and varying lighting conditions require careful control of the imaging process. First, camera exposure is controlled by software, examining all of the image’s pixels, …
Unified Entity Search In Social Media Community, Ting Yao, Yuan Liu, Chong-Wah Ngo, Tao Mei
Unified Entity Search In Social Media Community, Ting Yao, Yuan Liu, Chong-Wah Ngo, Tao Mei
Research Collection School Of Computing and Information Systems
The search for entities is the most common search behavior on the Web, especially in social media communities where entities (such as images, videos, people, locations, and tags) are highly heterogeneous and correlated. While previous research usually deals with these social media entities separately, we are investigating in this paper a unified, multilevel, and correlative entity graph to represent the unstructured social media data, through which various applications (e.g., friend suggestion, personalized image search, image tagging, etc.) can be realized more effectively in one single framework. We regard the social media objects equally as “entities” and all of these applications …
Circular Reranking For Visual Search, Ting Yao, Chong-Wah Ngo
Circular Reranking For Visual Search, Ting Yao, Chong-Wah Ngo
Research Collection School Of Computing and Information Systems
Search reranking is regarded as a common way to boost retrieval precision. The problem nevertheless is not trivial especially when there are multiple features or modalities to be considered for search, which often happens in image and video retrieval. This paper proposes a new reranking algorithm, named circular reranking, that reinforces the mutual exchange of information across multiple modalities for improving search performance, following the philosophy that strong performing modality could learn from weaker ones, while weak modality does benefit from interacting with stronger ones. Technically, circular reranking conducts multiple runs of random walks through exchanging the ranking scores among …
Searching Visual Instances With Topology Checking And Context Modeling, Wei Zhang, Chong-Wah Ngo
Searching Visual Instances With Topology Checking And Context Modeling, Wei Zhang, Chong-Wah Ngo
Research Collection School Of Computing and Information Systems
Instance Search (INS) is a realistic problem initiated by TRECVID, which is to retrieve all occurrences of the querying object, location, or person from a large video collection. It is a fundamental problem with many applications, and also a challenging problem different from the traditional concept or near-duplicate (ND) search, since the relevancy is defined at instance level. True responses could exhibit various visual variations, such as being small on the image with different background, or showing a non-homography spatial configuration. Based on the Bag-of-Words model, we propose two techniques tailored for Instance Search. Specifically, we explore the use of …
Flip-Invariant Sift For Copy And Object Detection, Wan-Lei Zhao, Chong-Wah Ngo
Flip-Invariant Sift For Copy And Object Detection, Wan-Lei Zhao, Chong-Wah Ngo
Research Collection School Of Computing and Information Systems
Scale-invariant feature transform (SIFT) feature has been widely accepted as an effective local keypoint descriptor for its invariance to rotation, scale, and lighting changes in images. However, it is also well known that SIFT, which is derived from directionally sensitive gradient fields, is not flip invariant. In real-world applications, flip or flip-like transformations are commonly observed in images due to artificial flipping, opposite capturing viewpoint, or symmetric patterns of objects. This paper proposes a new descriptor, named flip-invariant SIFT (or F-SIFT), that preserves the original properties of SIFT while being tolerant to flips. F-SIFT starts by estimating the dominant curl …
Data Visualization On Interactive Surfaces: A Research Agenda, Petra Isenberg, Tobias Isenberg, Tobias Hesselmann, Bongshin Lee, Ulrich Von Zadow, Anthony Tang
Data Visualization On Interactive Surfaces: A Research Agenda, Petra Isenberg, Tobias Isenberg, Tobias Hesselmann, Bongshin Lee, Ulrich Von Zadow, Anthony Tang
Research Collection School Of Computing and Information Systems
Interactive tabletops and surfaces (ITSs) provide rich opportunities for data visualization and analysis and consequently are used increasingly in such settings. A research agenda of some of the most pressing challenges related to visualization on ITSs emerged from discussions with researchers and practitioners in human-computer interaction, computer-supported collaborative work, and a variety of visualization fields at the 2011 Workshop on Data Exploration for Interactive Surfaces (Dexis 2011)