Graphics and Human Computer Interfaces Commons^™

Statistics Notes, Saverio Perugini

Computer Science Working Papers

A collection of terms, definitions, formulas and explanations about statistics.

Games People Play: Exploring Depaul's Top-Rated Computer Game Development Program

DePaul Magazine

In March 2014, the Princeton Review, in conjunction with PC Gamer magazine, named the top 25 schools to study game design in the United States and Canada. DePaul's undergraduate program ranked 20th, a considerable leap from 2013’s honorable mention. The graduate program came in at 12th. DePaul's strong ranking reflects the game development program's extension of its basic game development, software engineering and programming to include art, design and storytelling, as well as computer graphics technology, networking, artificial intelligence and human-computer interaction. Examples of the award-winning games developed by students and now marketed by such going concerns as Sony PlayStation …

Exploring Customer Specific Kpi Selection Strategies For An Adaptive Time Critical User Interface, Ingo Keck, Robert J. Ross

Conference papers

Rapid growth in the number of measures available to describe customer-organization relationships has presented a serious challenge for Business Intelligence (BI) interface developers as they attempt to provide business users with key customer information without requiring users to painstakingly sift through many interface windows and layers. In this paper we introduce a prototype Intelligent User Interface that we have deployed to partially address this issue. The interface builds on machine learning techniques to construct a ranking model of Key Performance Indicators (KPIs) that are used to select and present the most important customer metrics that can be made available to …

Symmetry Robust Descriptor For Non-Rigid Surface Matching, Zhiyuan Zhang, Kangkang Yin, Kelvin W. C. Foong

Research Collection School Of Computing and Information Systems

In this paper, we propose a novel shape descriptor that is robust in differentiating intrinsic symmetric points on geometric surfaces. Our motivation is that even the state-of-theart shape descriptors and non-rigid surface matching algorithms suffer from symmetry flips. They cannot differentiate surface points that are symmetric or near symmetric. Hence a left hand of one human model may be matched to a right hand of another. Our Symmetry Robust Descriptor (SRD) is based on a signed angle field, which can be calculated from the gradient fields of the harmonic fields of two point pairs. Experiments show that the proposed shape …

Traveltant: Social Interaction Based Personalized Recommendation System, Sultan Dawood Alfarhood

Graduate Theses and Dissertations

Trip planning is a time consuming task that most people do before going to any destination. Traveltant is an intelligent system that analyzes a user's Social network and suggests a complete trip plan detailed for every single day based on the user's interests extracted from the Social network. Traveltant also considers the interests of friends the user interacts with most by building a ranked friends list of interactivity, and then uses the interests of those people in this list to enrich the recommendation results. Traveltant provides a smooth user interface through a Windows Phone 7 application while doing most of …

Misheard Me Oronyminator: Using Oronyms To Validate The Correctness Of Frequency Dictionaries, Jennifer G. Hughes

Master's Theses

In the field of speech recognition, an algorithm must learn to tell the difference between "a nice rock" and "a gneiss rock". These identical-sounding phrases are called oronyms. Word frequency dictionaries are often used by speech recognition systems to help resolve phonetic sequences with more than one possible orthographic phrase interpretation, by looking up which oronym of the root phonetic sequence contains the most-common words.

Our paper demonstrates a technique used to validate word frequency dictionary values. We chose to use frequency values from the UNISYN dictionary, which tallies each word on a per-occurance basis, using a proprietary text corpus, …

Visual Semantic Segmentation And Its Applications, Jizhou Gao

Theses and Dissertations--Computer Science

This dissertation addresses the difficulties of semantic segmentation when dealing with an extensive collection of images and 3D point clouds. Due to the ubiquity of digital cameras that help capture the world around us, as well as the advanced scanning techniques that are able to record 3D replicas of real cities, the sheer amount of visual data available presents many opportunities for both academic research and industrial applications. But the mere quantity of data also poses a tremendous challenge. In particular, the problem of distilling useful information from such a large repository of visual data has attracted ongoing interests in …

Agent-Based Virtual Humans In Co-Space: An Evaluative Study, Yilin Kang, Ah-Hwee Tan, Fiona Fui-Hoon Nah

Research Collection School Of Computing and Information Systems

Co-Space refers to interactive virtual environment modelled after the real world in terms of look-and-feel, functionalities and services. We have developed a 3D virtual world named Nanyang Technological University (NTU) CoSpace populated with virtual human characters. Three key requirements of realistic virtual humans in the virtual world have been identified, namely (1) autonomy: agents can function on their own; (2) interactivity: agents can interact naturally with players; and (3) personality: agents can exhibit human traits and characteristics. Working towards these challenges, we propose a brain-inspired agent architecture that integrates goal-directed autonomy, natural language interaction and human-like personality. We conducted an …

Cross-Talk: A Shared Parameter Space For Gesturally Extended Human/Machine Improvisation, William Brent, Adam James Wilson

Publications and Research

This paper describes Cross-talk, a piece of music and performance system for two instruments augmented with infrared motion-tracking capability, and an artificial software improviser. Cross-talk was commissioned by the Ammerman Center for Arts and Technology at Connecticut College, for the 13th Biennial Symposium on Arts and Technology. The work is part of an ongoing collaboration focused on developing integrated hardware and software performance systems to extend the timbral and expressive capabilities of traditional musical instruments and to generate musical structure in response to information retrieved from human performers in real-time. Artistic motivations and prior related work are presented here, along …

Towards Textually Describing Complex Video Contents With Audio-Visual Concept Classifiers, Chun Chet Tan, Yu-Gang Jiang, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Automatically generating compact textual descriptions of complex video contents has wide applications. With the recent advancements in automatic audio-visual content recognition, in this paper we explore the technical feasibility of the challenging issue of precisely recounting video contents. Based on cutting-edge automatic recognition techniques, we start from classifying a variety of visual and audio concepts in video contents. According to the classification results, we apply simple rule-based methods to generate textual descriptions of video contents. Results are evaluated by conducting carefully designed user studies. We find that the state-of-the-art visual and audio concept classification, although far from perfect, is able …

Functional Reactive Musical Performers, Justin M. Phillips

Master's Theses

Computers have been assisting in recording, sound synthesis and other fields of music production for quite some time. The actual performance of music continues to be an area in which human players are chosen over computer performers. Musical performance is an area in which personalization is more important than consistency. Human players play with each other, reacting to phrases and ideas created by the players that they are playing with. Computer performers lack the ability to react to the changes in the performance that humans perceive naturally, giving the human players an advantage over the computer performers.

This thesis creates …

Semi-Autonomous Virtual Valet Parking, Arne Suppe, Luis Navarro-Serment, Aaron Steinfeld

Research Collection School Of Computing and Information Systems

Despite regulations specifying parking spots that support wheelchair vans, it is not uncommon for end users to encounter problems with clearance for van ramps. Even if a driver elects to park in the far reaches of a parking lot as a precautionary measure, there is no guarantee that the spot next to their van will be empty when they return. Likewise, the prevalence of older drivers who experience significant difficulty with ingress and egress from vehicles is nontrivial and the ability to fully open a car door is important. This work describes a method and user interaction for low cost, …

Motion In Augmented Reality Games: An Engine For Creating Plausible Physical Interactions In Augmented Reality Games, Brian Mac Namee, David Beaney, Qingqing Dong

Articles

The next generation of Augmented Reality (AR) games will require real and virtual objects to coexist in motion in immersive game environments. This will require the illusion that real and virtual objects interact physically together in a plausible way. The Motion in Augmented Reality Games (MARG) engine described in this paper has been developed to allow these kinds of game environments. The paper describes the design and implementation of the MARG engine and presents two proof-of-concept AR games that have been developed using it. Evaluations of these games have been performed and are presented to show that the MARG engine …

Cbtv: Visualising Case Bases For Similarity Measure Design And Selection, Brian Mac Namee, Sarah Jane Delany

Conference papers

In CBR the design and selection of similarity measures is paramount. Selection can benefit from the use of exploratory visualisation- based techniques in parallel with techniques such as cross-validation ac- curacy comparison. In this paper we present the Case Base Topology Viewer (CBTV) which allows the application of different similarity mea- sures to a case base to be visualised so that system designers can explore the case base and the associated decision boundary space. We show, using a range of datasets and similarity measure types, how the idiosyncrasies of particular similarity measures can be illustrated and compared in CBTV allowing …

Inside The Selection Box: Visualising Active Learning Selection Strategies, Brian Mac Namee, Rong Hu, Sarah Jane Delany

Conference papers

Visualisations can be used to provide developers with insights into the inner workings of interactive machine learning techniques. In active learning, an inherently interactive machine learning technique, the design of selection strategies is the key research question and this paper demonstrates how spring model based visualisations can be used to provide insight into the precise operation of various selection strategies. Using sample datasets, this paper provides detailed examples of the differences between a range of selection strategies.

Localizing Volumetric Motion For Action Recognition In Realistic Videos, Xiao Wu, Chong-Wah Ngo, Jintao Li, Yongdong Zhang

Research Collection School Of Computing and Information Systems

This paper presents a novel motion localization approach for recognizing actions and events in real videos. Examples include StandUp and Kiss in Hollywood movies. The challenge can be attributed to the large visual and motion variations imposed by realistic action poses. Previous works mainly focus on learning from descriptors of cuboids around space time interest points (STIP) to characterize actions. The size, shape and space-time position of cuboids are fixed without considering the underlying motion dynamics. This often results in large set of fragmentized cuboids which fail to capture long-term dynamic properties of realistic actions. This paper proposes the detection …

Energetic Path Finding Across Massive Terrain Data, Andrew N. Tsui

Master's Theses

Before there were airplanes, cars, trains, boats, or bicycles, the primary means of transportation was on foot. Unfortunately, many of the trails used by ancient travelers have long since been abandoned. We present a software tool which can help visualize and predict where these forgotten trails might lie through the use of a human-centered cost metric. By comparing the paths generated by our software with known historical trails, we demonstrate how the tool can indicate likely trails used by ancient travelers. In addition, this new tool provides novel visualizations to better help the user understand alternate paths, effect of terrain, …

Forked:A Demonstration Of Physics Realism In Augmented Reality, David Beaney, Brian Mac Namee

Conference papers

In making fully immersive augmented reality (AR) applications, real and virtual objects will have to be seen to physically interact together in a realistic and believable way. This paper describes Forked! a system that has been developed to show how physical interactions between real and virtual objects can be simulated re- alistically and believably through appropriate use of a physics en- gine. The system allows users control a robotic forklift to manipu- late virtual crates in an AR environment. The paper also describes a evaluation experiment in which it is shown that the physical inter- actions between the forklift and …

Widening The Evaluation Net, Brian Mac Namee, Mark Dunne

Conference papers

Intelligent Virtual Agent (IVA) systems are notoriously difficult to evaluate, particularly due to the subjectivity involved. From the various efforts to develop standard evaluation schemes for IVA systems the scheme proposed by Isbister & Doyle, which evaluates systems across five categories, seems particularly appropriate. To examine how these categories are being used, the evaluations presented in the proceedings of IVA '07 and IVA '08 are summarised and the extent to which the five categories in the Isbister & Doyle scheme are used is highlighted. Finally, to illustrate how the full scheme can be used, an evaluation of an IVA system …

Stepping Off The Stage, Brian Mac Namee, John D. Kelleher

Conference papers

Mixed-reality virtual agents are an attractive solution to the problems associated with human-robot interaction, allowing all the expressiveness of virtual characters to be married with the advantages of a physical artifact which exists in a shared environment with the user. However, common approaches to achieving this restrict the virtual characters appearing on top of, or encompassing the robot. This paper describes the Stepping Off the Stage system in which mixed-reality agents are allowed to step off the robot stage and move to other parts of the environment, offering compelling new interaction possibilities.

Video Event Detection Using Motion Relativity And Visual Relatedness, Feng Wang, Yu-Gang Jiang, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Event detection plays an essential role in video content analysis. However, the existing features are still weak in event detection because: i) most features just capture what is involved in an event or how the event evolves separately, and thus cannot completely describe the event; ii) to capture event evolution information, only motion distribution over the whole frame is used which proves to be noisy in unconstrained videos; iii) the estimated object motion is usually distorted by camera movement. To cope with these problems, in this paper, we propose a new motion feature, namely Expanded Relative Motion Histogram of Bag-ofVisual-Words …

Rushes Video Summarization By Object And Event Understanding, Feng Wang, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

This paper explores a variety of visual and audio analysis techniques in selecting the most representative video clips for rushes summarization at TRECVID 2007. These techniques include object detection, camera motion estimation, keypoint matching and tracking, audio classification and speech recognition. Our system is composed of two major steps. First, based on video structuring, we filter undesirable shots and minimize the inter-shot redundancy by repetitive shot detection. Second, a representability measure is proposed to model the presence of objects and four audio-visual events: motion activity of objects, camera motion, scene changes, and speech content, in a video clip. The video …

Using Computer Vision To Create A 3d Representation Of A Snooker Table For Televised Competition Broadcasting, Hao Guo, Brian Mac Namee

Conference papers

The Snooker Extraction and 3D Builder (SE3DB) is designed to be used as a viewer aid in televised snooker broadcasting. Using a single camera positioned over a snooker table, the system creates a virtual 3D model of the table which can be used to allow audiences view the table from any angle. This would be particularly useful in allowing viewers to determine if particular shots are possible or not. This paper will describe the design, development and evaluation of this system. Particular focus in the paper will be given to the techniques used to recognise and locate the balls on …

Rapid Prototyping For The Design Of Virtual Worlds, Prabhu V. Krishnan

Electrical & Computer Engineering Theses & Dissertations

Development of Virtual Reality (VR) applications is challenging where application developers are required to have expertise in the target VR technologies along with the problem domain expertise. New VR technologies impose a significant learning curve to even the most experienced VR developer. The proposed solution relies on synthesis to automate the migration of a VR application to a new unfamiliar VR platform/technology. To solve the problem, the Common Scene Definition Framework (CSDF) was developed, that serves as a superset/model representation of the target virtual world. Input modules were developed to populate the framework with the capabilities of the virtual world …

Trends. War On Personality And Personality And War: Comments On Nass And Lee (2002), Ibpp Editor

International Bulletin of Political Psychology

This Trends article discusses another article – Identity and deconstruction, by Clifford Nass and Kwan Min Yee – published in volume 3 (2002) of Archives of Psychiatry & Psychotherapy in which the authors demonstrate that people reliably attribute personality characteristics to computer-synthesized speech, exploring the ramifications in a political psychological context.

Kiosk Pintar Haji Dan Umrah, Othman Nor Azlina

Student Works (2000-2009)

Perkataan kiosk web dan kiosk multimedia mungkin sudah biasa didengari bagi mereka yang sering mengikuti perkembangan tekno1ogi. Wa1au pun kiosk-kiosk tersebut direkabentuk supaya ianya menepati spesifikasi terkini, namun ia tetap dikenali sebagai kiosk biasa kerana kebolehannya hanya terhad untuk memberikan maklumat kepada pengguna. Justeru itu, sejenis lagi kiosk yang menggunakan pendekatan kepintaran buatan bakal diperkenalkan dan ianya diaplikasikan di dalam perlaksanaan ibadat haji dan umrah bagi umat Islam. Bersesuaian dengan pendekatan yang digunakan, sistem ini dinamakan Kiosk Pintar Haji dan Umrah. Kiosk ini menggunakan konsep Case-based Reasoning dan memuatkan pengetahuan yang diwakilkan oleh kes-kes ke dalam sistemnya. Konsep Casebased Reasoning …

Tools For Jawi Character Recognition, Hassan Nur Hassinah

Student Works (2000-2009)

Huruf jawi terdiri daripada 36 huruf. Ia merupakan huruf-huruf yang kebanyakannya lahir daripada huruf arab.Tulisannya adalah unik kerana mempunyai aksara yang bersambung dalam sesuatu perkataan. lni menyebabkan pengecaman terhadap tulisan jawi tangan menjadi lebih kompleks apabila aksara perlu dipecahkan. Selain itu, perwakilan bagi sesuatu aksara jawi mempunyai bentuk yang berlainan bergantung kepada kedudukannya dalam perkataan. Perisian alatan teknikal iaitu MATLAB digunakan untuk membina atatan yang terdiri daripada pemprosesan imej, pensegmenan, dan pengecaman aksara jawi. Input adatah satu perkataan jawi yang diimbas. lmej dalam bentuk digitaJ akan melalui pemprosesan imej untuk tujuan pengurangan kebisingan dan peningkatan kualiti. lmej seterusnya dipecabkan kepada …

Homepage For Medical Image Processing, Nawot Nomansia

Student Works (2000-2009)

Homepage for Medical image Processing is a web site development project done to fulfills the requirement of Bachelor of Information Technology course. This homepage is about the current research in medical image processing area done by the research group in Neural Network Lab at Faculty of Computer Science and Intonation Technology University of Malaya. The architecture of this homepage based on client-server architecture model. Nowadays, many researchers use the Internet to storing, retrieving, and displaying information in a networked environment. Those who offer information through the Web must establish a homepage, a text and graphical screen display that usually welcomes …

Interactive 3d Human-Head Multimedia System, Ahmad Shah Reezal

Student Works (2000-2009)

This document was organized in order to give to the reader or user a complete overview about the upcoming project, in the sense that the user should learn the theoretical concepts first and then be aware of how the concepts be applied, being presented meanwhile, some introduction, literation research, methodology, system analysis, system design, system development, system testing, the discussion on the problems occur and examples related with "Interactive 30 human Head Multimedia System". My advisor and supervisor for this thesis is Pn. Nurul Fazmidar Mohd. Noor and the moderator is Dr. Phang Keat Keong. The topic I chose is …

Rucker, Rudy Rucker

SWITCH

In this article, Rudy Rucker shares his thoughts on hacking. He summarizes it as normal actions, such as building a car, or kneading clay. He compares hacking to things that are buildable by hand, and views creating computer programs the same way. One of the benefits of creating your own computer programs is that you can customize themn however you want. However customizing software on your own is extremely time consuming. He then goes into further detail about artificial life and how hyperspace works. Hacking bends the cyber reality that we are accustomed to, and modifying programs outside of what …