Physical Sciences and Mathematics Commons^™

Tracking Web Video Topics: Discovery, Visualization, And Monitoring, Juan Cao, Chong-Wah Ngo, Yong-Dong Zhang, Jin-Tao Li

Research Collection School Of Computing and Information Systems

Despite the massive growth of web-shared videos in Internet, efficient organization and monitoring of videos remains a practical challenge. While nowadays broadcasting channels are keen to monitor online events, identifying topics of interest from huge volume of user uploaded videos and giving recommendation to emerging topics are by no means easy. Specifically, such process involves discovering of new topic, visualization of the topic content, and incremental monitoring of topic evolution. This paper studies the problem from three aspects. First, given a large set of videos collected over months, an efficient algorithm based on salient trajectory extraction on a topic evolution …

Galaxy Browser: Exploratory Search Of Web Videos, Lei Pang, Song Tan, Hung-Khoon Tan, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Most search engines return a ranked list of items in response to a query. The list however tells very little about the relationship among items. For videos especially, users often read to spend significant amount of time to navigate the search result. Exploratory search presents a new paradigm for browsing where the browser takes up the role of information exploring and presents a well-organized browsing structure for users to navigate. The proposed interface Galaxy Browser adopts the recent advances in near-duplicate detection and then synchronizes the detected near-duplicate information with comprehensive background knowledge derived from online external resources. The result …

Towards Textually Describing Complex Video Contents With Audio-Visual Concept Classifiers, Chun Chet Tan, Yu-Gang Jiang, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Automatically generating compact textual descriptions of complex video contents has wide applications. With the recent advancements in automatic audio-visual content recognition, in this paper we explore the technical feasibility of the challenging issue of precisely recounting video contents. Based on cutting-edge automatic recognition techniques, we start from classifying a variety of visual and audio concepts in video contents. According to the classification results, we apply simple rule-based methods to generate textual descriptions of video contents. Results are evaluated by conducting carefully designed user studies. We find that the state-of-the-art visual and audio concept classification, although far from perfect, is able …

Cross Media Hyperlinking For Search Topic Browsing, Song Tan, Chong-Wah Ngo, Hung-Khoon Tan, Lei Pang

Research Collection School Of Computing and Information Systems

With the rapid growth of social media, there are plenty of information sources freely available online for use. Nevertheless, how to synchronize and leverage these diverse forms of information for multimedia applications remains a problem yet to be seriously studied. This paper investigates the synchronization of multiple media content in the physical form of hyperlinking them. The ultimate goal is to develop browsing systems that author search results with rich media information mined from various knowledge sources. The authoring enables the vivid visualization and exploration of different information landscapes inherent in search results. Several key techniques are studied in this …

On The Pooling Of Positive Examples With Ontology For Visual Concept Learning, Shiai Zhu, Chong-Wah Ngo, Yu-Gang Jiang

Research Collection School Of Computing and Information Systems

A common obstacle in effective learning of visual concept classifiers is the scarcity of positive training examples due to expensive labeling cost. This paper explores the sampling of weakly tagged web images for concept learning without human assistance. In particular, ontology knowledge is incorporated for semantic pooling of positive examples from ontologically neighboring concepts. This effectively widens the coverage of the positive samples with visually more diversified content, which is important for learning a good concept classifier. We experiment with two learning strategies: aggregate and incremental. The former strategy re-trains a new classifier by combining existing and newly collected examples, …

Vireo@Trecvid 2011: Instance Search, Semantic Indexing, Multimedia Event Detection And Known-Item Search, Chong-Wah Ngo, Shi-Ai Zhu, Wei Zhang, Chun-Chet Tan, Ting Yao, Lei Pang, Hung-Khoon Tan

Research Collection School Of Computing and Information Systems

The vireo group participated in four tasks: instance search, semantic indexing, multimedia event detection and known-item search. In this paper,we will present our approaches and discuss the evaluation results.

Webtailor: Internet Service For Salient And Automatic User Interest Profiles, John Anderson

Computer Science and Computer Engineering Undergraduate Honors Theses

Website personalization systems seek to give users unique, tailored content and experiences on the Internet. A key feature of these systems is a user profile that represents each user in a way that distinguishes them from others. In current personalization systems, the data used to create these profiles is extremely limited, which leads to a host of problems and ineffectual personalization. The main goal of this thesis is to improve these personalization systems by addressing their lack of data and its poor quality, breadth, and depth. This is accomplished by analyzing and classifying the content of each user's Internet browsing …

Making An Impact On The Obesity Epidemic By Deploying A Mobile Fitness Suite On The Android Market, Chad Richards

Computer Science and Computer Engineering Undergraduate Honors Theses

The Mobile Fitness Suite aims to make an impact on the obesity epidemic by deploying a set of mobile fitness applications on the Android Market. The thesis details the health and financial issues with the obesity epidemic, along with its causes, and how a set of fitness applications can aid with the obesity epidemic. It also explains the reasons for releasing the program on the Android Market and details each step in the process of deploying a mobile application to the Android Market. Further, it discusses the design and architecture that went into the development of the Mobile Fitness Suite …

Powersearch: Augmenting Mobile Phone Search Through Personalization, Xiangyu Liu

Computer Science and Computer Engineering Undergraduate Honors Theses

Cell phone has become a fundamental element of people's life. People use it to call each other, browse websites, send text messages, etc. Among all the functionalities, the most important and frequently used is the search functionality. Based on ComScore, in July 2008, Google was estimated to host 235 millions searches per day. However, unlike the search on desktop, the search on cell phone has one critical constrain: battery. Cell phone performing a normal Google search, the battery drains very fast. The reason is that when sending a query to and fetching the results from Google, cell phone keeps communicating …

Context-Based Friend Suggestion In Online Photo-Sharing Community, Ting Yao, Chong-Wah Ngo, Tao Mei

Research Collection School Of Computing and Information Systems

With the popularity of social media, web users tend to spend more time than before for sharing their experience and interest in online photo-sharing sites. The wide variety of sharing behaviors generate different metadata which pose new opportunities for the discovery of communities. We propose a new approach, named context-based friend suggestion, to leverage the diverse form of contextual cues for more effective friend suggestion in the social media community. Different from existing approaches, we consider both visual and geographical cues, and develop two user-based similarity measurements, i.e., visual similarity and geo similarity for characterizing user relationship. The problem of …

Defining, Executing And Visualizing Representative Workflows In A Retail Domain, May Zeineldin

Graduate Theses and Dissertations

Our lives are filled with routine activities that we do more or less on auto-pilot such as driving to work and cooking. This thesis explores a workflow representation as a way to represent such activities of daily living. The domain of a retail store environment is used. Workflows are initially expressed in a structured English representation, then translated into a Petri net notation and implemented in mix of Petri nets, Lua, and C so that the resulting workflows can be displayed as the actions of collections of avatarbots (avatars controlled by programs) in a 3D virtual world, Second Life. One …

Mining Interesting Link Formation Rules In Social Networks, Cane Wing-Ki Leung, Ee Peng Lim, David Lo, Jianshu Weng

David LO

Link structures are important patterns one looks out for when modeling and analyzing social networks. In this paper, we propose the task of mining interesting Link Formation rules (LF-rules) containing link structures known as Link Formation patterns (LF-patterns). LF-patterns capture various dyadic and/or triadic structures among groups of nodes, while LF-rules capture the formation of a new link from a focal node to another node as a postcondition of existing connections between the two nodes. We devise a novel LF-rule mining algorithm, known as LFR-Miner, based on frequent subgraph mining for our task. In addition to using a support-confidence framework …

Classification Of Software Behaviors For Failure Detection: A Discriminative Pattern Mining Approach, David Lo, Hong Cheng, Jiawei Han, Siau-Cheng Khoo, Chengnian Sun

David LO

Software is a ubiquitous component of our daily life. We often depend on the correct working of software systems. Due to the difficulty and complexity of software systems, bugs and anomalies are prevalent. Bugs have caused billions of dollars loss, in addition to privacy and security threats. In this work, we address software reliability issues by proposing a novel method to classify software behaviors based on past history or runs. With the technique, it is possible to generalize past known errors and mistakes to capture failures and anomalies. Our technique first mines a set of discriminative features capturing repetitive series …

A Representation Of Selected Nonmanual Signals In American Sign Language, Jerry C. Schnepp

College of Computing and Digital Media Dissertations

Computer-generated three-dimensional animation holds great promise for synthesizing utterances in American Sign Language (ASL) that are not only grammatical, but believable by members of the Deaf community. Animation poses several challenges stemming from the massive amounts of data necessary to specify the movement of three-dimensional geometry, and there is no current system that facilitates the synthesis of nonmanual signals. However, the linguistics of ASL can aid in surmounting the challenge by providing structure and rules for organizing the data.

This work presents a first method for representing ASL linguistic and extralinguistic processes that involve the face. Any such representation must …

Beyond Search: Event-Driven Summarization For Web Videos, Richard Hong, Jinhui Tang, Hung-Khoon Tan, Chong-Wah Ngo, Shuicheng Yan, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

The explosive growth of Web videos brings out the challenge of how to efficiently browse hundreds or even thousands of videos at a glance. Given an event-driven query, social media Web sites usually return a large number of videos that are diverse and noisy in a ranking list. Exploring such results will be time-consuming and thus degrades user experience. This article presents a novel scheme that is able to summarize the content of video search results by mining and threading "key" shots, such that users can get an overview of main content of these videos at a glance. The proposed …

Learning Human Emotion Patterns For Modeling Virtual Humans, Shu Feng, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

Emotion modeling is a crucial part in modeling virtual humans. Although various emotion models have been proposed, most of them focus on designing specific appraisal rules. As there is no unified framework for emotional appraisal, the appraisal variables have to be defined beforehand and evaluated in a subjective way. In this paper, we propose an emotion model based on machine learning methods by taking the following position: an emotion model should mirror actual human emotion in the real world and connect tightly with human inner states, such as drives, motivations and personalities. Specifically, a self-organizing neural model called Emotional Appraisal …

Classic Mosaics And Visual Correspondence Via Graph-Cut Based Energy Optimization, Yu Liu

Electronic Thesis and Dissertation Repository

Computer graphics and computer vision were traditionally two distinct research fields focusing on opposite topics. Lately, they have been increasingly borrowing ideas and tools from each other. In this thesis, we investigate two problems in computer vision and graphics that rely on the same tool, namely energy optimization with graph cuts.

In the area of computer graphics, we address the problem of generating artificial classic mosaics, still and animated. The main purpose of artificial mosaics is to help a user to create digital art. First we reformulate our previous static mosaic work in a more principled global optimization framework. Then, …

Engaging Game Design Students Using Peer Evaluation, Amber Settle, Charles Wilcox, Chad Settle

Amber Settle

Wii Remote-Based Collaborative Interfaces For Music, Adriano Baratè, Luca A. Ludovico, Davide Andrea Mauro

Computer Sciences and Electrical Engineering Faculty Research

Wii Remote is the main controller for Nintendo's Wii con- sole. Thanks to the use of accelerometer and optical sensor technology, it presents motion sensing capability, which implies gesture recognition and intuitive pointing. Such a controller is user-friendly, inexpensive and easily available, due to growing Wii console's popularity. These features make Wii Remote a good device to create and manipulate both music and audio in a home entertainment environment. In this paper, the most interesting characteristics of the controller will be reviewed. A case study will be presented, namely the creation of a virtual music instrument to be controlled in …

The Human Computer Interaction Issues Associated With The Creation Of Personalized Role Playing Simulations, Eileen O'Donnell, Catherine Mulwa, Mary Sharp, Vincent Wade

Eileen O'Donnell

The human computer interaction issues associated with the creation of personalized role playing simulations are discussed in this paper. This paper is aimed at those who are interested in building authoring applications which enable educators to build role playing simulated e-learning resources to use with their students. One of the main issues which have come to our attention is that many learning designers and educators do not understand what exactly it is we are trying to achieve by creating personalized role playing simulations. Also, how to gauge the pedagogic merits which can be achieved by using these e-learning resources. Potential …

Psychosocial Indicators Via Hand Tremor, Ted Selker, Patricia Collins, Will Dayton

Ted Selker

We propose hand tremor as a new type of input that can corroborate psychosocial conditions An Android application was able to distinguish tremor variability differences between people with and without diagnosed hand tremor. Tremor measurements also corroborated self-assessment of sleep quality. Hand tremor evaluation can be considered to be a monitorable, implicit input to systems that respond to various psychosocial states. We encourage researchers to consider how interface design changes when using implicit sensors such as tremor sensing.

Improving Brain-Computer Interface Performance: Giving The P300 Speller Some Color., David B. Ryan

Electronic Theses and Dissertations

Individuals who suffer from severe motor disabilities face the possibility of the loss of speech. A Brain-Computer Interface (BCI) can provide a means for communication through non-muscular control. Current BCI systems use characters that flash from gray to white (GW), making adjacent character difficult to distinguish from the target. The current study implements two types of color stimulus (grey to color [GC] and color intensification [CI]) and I hypotheses that color stimuli will; (1) reduce distraction of nontargets (2) enhance target response (3) reduce eye strain. Online results (n=21) show that GC has increased information transfer rate over CI. Mean …

A Case Study Of The Effects Of A Web Interface Redesign Based On Usability Guidelines., Paromita Bhattacharya

Electronic Theses and Dissertations

Usability guidelines for user interface (UI) design formulated by Nielsen and other authorities were used to redesign the web interface for a web based distance education course. The website's original UI, as judged by a group of web design professionals, violated standard guidelines for usability, readability, learnability, consistency, efficiency of use and flexibility. The original and redesigned UIs were tested using thinking aloud testing, a user satisfaction survey, and usability inspection. The results of user testing and heuristic evaluation suggest that the use of these guidelines in website redesign had a positive impact on user performance. A more conclusive result …

Rock Porosity Analysis Using High Resolution X-Ray Tomography, Leo Groner, Dula Parkinson, Katya Bazilevskaya

STAR Program Research Presentations

Understanding rock porosity, the fraction of rock volume that is in pores, is a key to modeling weathering and flow of water, petroleum and CO2 through geological structures. Weathering of rocks affects the CO2 cycle, nutrient cycle and soil formation. Rock porosity affects water flow rates and, in turn, affects weathering. Avizo software was used to explore, visualize and measure the reconstructed high-resolution X-ray micro-tomography data collected from scanned rocks. Many Avizo approaches were tried before arriving at an acceptable process to determine their porosity characteristics. Porosity dynamics are affected by weathering and lithification. At micron resolution, the image is …

Trends In Web Typography, Heather Mcintosh

Graphic Communication

No abstract provided.

Image Processing – I: Research Design For Evaluation Of Finger Input Properties On Multi-Touch Screen, Ahsan Ullah, Ahmad Kamil B. Mahmood, Suziah Sulaiman, Muzafar Khan

International Conference on Information and Communication Technologies

Interactive tabletop display provides a collaborative workspace to users around a table. Users sit in front of each other and they perform direct and collaborative multi-touch interaction simultaneously. Users access the interactive elements using their bare fingers. The finger works as a pointer device, and it has direct relation with the size, shape, and configuration of the interactive elements on sensitive displays. It is found that there is lack of precise selection of small size interactive elements owing to users' fat fingers. In this regard, it is aimed to propose a research design to evaluate the finger input properties in …

Automatic Content Generation For Video Self Modeling, Ju Shen, Anusha Raghunathan, Sen-Ching S. Cheung, Ravi R. Patel

Computer Science Faculty Publications

Video self modeling (VSM) is a behavioral intervention technique in which a learner models a target behavior by watching a video of him or herself. Its effectiveness in rehabilitation and education has been repeatedly demonstrated but technical challenges remain in creating video contents that depict previously unseen behaviors. In this paper, we propose a novel system that re-renders new talking-head sequences suitable to be used for VSM treatment of patients with voice disorder. After the raw footage is captured, a new speech track is either synthesized using text-to-speech or selected based on voice similarity from a database of clean speeches. …

Does Lecture Capture Make A Difference For Students In Traditional Classrooms, Amber Settle, Lucia Dettori, Mary Jo Davidson

Amber Settle

Developing Digital Field Guides For Plants: A Study From The Perspective Of Users, Emily Roseanne Schwarz

Master's Theses

A field guide is a tool to identify an object of natural history. Field guides
cover a wide range of topics from plants to fungi, birds to mammals, and shells to minerals. Traditionally, field guides are books, usually small enough to be carried outdoors . They enjoy wide popularity in modern life; almost every American home and library owns at least one field guide, and the same is also true for other areas of the world.

At this time, companies, non-profits, and universities are developing computer
technologies to replace printed field guides for identifying plants. This thesis
examines the state …

Pedagogical Tool For Usability Science Final Project Report, Daniel D. Mendelsohn

Honors Theses

A Sophomore Research Seminar (SRS) at Union College teaches about usability science, the study of designing interfaces that allow the user to accomplish a given task with less time and frustration. In this context, an interface can be anything that allows interaction with a physical or virtual device such as a web browser or the knobs on a stove. In this SRS, students design interface mockups, called prototypes, out of inexpensive material such as cardboard. Students use these prototypes to test their interfaces on real people, who are asked to perform a task that would be performed on a real …