Physical Sciences and Mathematics Commons^™

Open Source Foundations For Spatial Decision Support Systems, Jochen Albrecht

Publications and Research

Spatial Decision Support Systems (SDSS) were a hot topic in the 1990s, when researchers tried to imbue GIS with additional decision support features. Successful practical developments such as HAZUS or CommunityViz have since been built, based on commercial desktop software and without much heed for theory other than what underlies their process models. Others, like UrbanSim, have been completely overhauled twice but without much external scrutiny. Both the practical and the theoretical foundations of decision support systems have developed considerably over the past 20 years. This article presents an overview of these developments and then looks at what corresponding tools …

Historical Effects Of Electronic Interfaces, G James Mitchell

Publications and Research

Electronic interfaces are a primary tool for most professional and personal communication currently happening. Electronics, like the human mind, are limited by the understanding of executing will, or commands. This can be characterized as “interface limitations” of digital technology. Identifying this bottleneck in technological development has been critical in historical changes to both hardware and software technology. Recent medical research examines a novel user interface to reduce task load. I hypothesize, interface developments that take cues from nonverbal human communication enhance and sustain the significance of those technologies in society. By examining pivotal moments of historical technology we can identify …

The Living Wall Display: Physical Augmentation Of Interactive Content Using An Autonomous Mobile Display, Yuki Onishi, Yoshiki Kudo, Kazuki Takashima, Anthony Tang, Yoshifumi Kitamura

Research Collection School Of Computing and Information Systems

The Living Wall Display displays interactive content on a mobile wall screen that moves in concert with content animation. To augment the interaction experience, the display dynamically changes its position and orientation, responding to the content animation triggered by user interactions. We implement three proof of concept prototypes that represent pseudo force impact of the interactive content using physical screen movement. Pilot studies show that the Living Wall augments content expressiveness, and increases the sense of presence of the screen content.

Vr Safari Park: A Concept-Based World Building Interface Using Blocks And World Tree, Shotaro Ichikawa, Anthony Tang, Kazuki Takashima, Yoshifumi Kitamura

Research Collection School Of Computing and Information Systems

We present a concept-based world building approach, realized in a system called VR Safari Park, which allows users to rapidly create and manipulate a world simulation. Conventional world building tools focus on the manipulation and arrangement of entities to set up the simulation, which is time consuming as it requires frequent view and entity manipulations. Our approach focuses on a far simpler mechanic, where users add virtual blocks which represent world entities (e.g. animals, terrain, weather, etc.) to a World Tree, which represents the simulation. In so doing, the World Tree provides a quick overview of the simulation, and users …

Active Matting, Xin Yang, Ke Xu, Shaozhe Chen, Shengfeng He, Baocai Yin, Rynson Lau

Research Collection School Of Computing and Information Systems

Image matting is an ill-posed problem. It requires a user input trimap or some strokes to obtain an alpha matte of the foreground object. A fine user input is essential to obtain a good result, which is either time consuming or suitable for experienced users who know where to place the strokes. In this paper, we explore the intrinsic relationship between the user input and the matting algorithm to address the problem of where and when the user should provide the input. Our aim is to discover the most informative sequence of regions for user input in order to produce …

Cross Euclidean-To-Riemannian Metric Learning With Application To Face Recognition From Video, Zhiwu Huang, R. Wang, S. Shan, Gool L Van

Research Collection School Of Computing and Information Systems

Riemannian manifolds have been widely employed for video representations in visual classification tasks including video-based face recognition. The success mainly derives from learning a discriminant Riemannian metric which encodes the non-linear geometry of the underlying Riemannian manifolds. In this paper, we propose a novel metric learning framework to learn a distance metric across a Euclidean space and a Riemannian manifold to fuse average appearance and pattern variation of faces within one video. The proposed metric learning framework can handle three typical tasks of video-based face recognition: Video-to-Still, Still-to-Video and Video-to-Video settings. To accomplish this new framework, by exploiting typical Riemannian …

Project Management Madness: 3 Key Programs For Communication, Personal Tasks And Large Projects, Rachel S. Evans

Presentations

No matter what member of a team you are, be it content editor, web designer, database manager or systems administrator, getting things done and meeting goals depends largely on how you communicate with one another, handle your time and effectively collaborate on small and big projects. This session will use our own team's preferred platforms to show specific examples of how we are managing our taskflow across three different programs to tackle business as usual, short and long term work, and major special projects.

The three programs that will be compared for pros, cons, and their integration with one another …

Cross-Modal Recipe Retrieval With Stacked Attention Model, Jing-Jing Chen, Lei Pang, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Taking a picture of delicious food and sharing it in social media has been a popular trend. The ability to recommend recipes along will benefit users who want to cook a particular dish, and the feature is yet to be available. The challenge of recipe retrieval, nevertheless, comes from two aspects. First, the current technology in food recognition can only scale up to few hundreds of categories, which are yet to be practical for recognizing tens of thousands of food categories. Second, even one food category can have variants of recipes that differ in ingredient composition. Finding the best-match recipe …

Designing A Tangible Interface For Manager Awareness In Wilderness Search And Rescue, Brennan Jones, Anthony Tang, Carman Neustaedter, Alissa N. Antle, Elgin-Skye Mclaren

Research Collection School Of Computing and Information Systems

We present a tangible interface for supporting wilderness search-and-rescue (SAR) managers in maintaining awareness of a large SAR incident, where there are numerous field teams searching for a lost person in a wilderness area. This interface consists of physical and digital representations of the search area and elements of the search activity (e.g., the locations of search teams, weather information, and clues from the field). It is intended to allow SAR managers to inspect information about the response and search area from different perspectives and aid them in planning by allowing them to physically manipulate the representations and explore the …

Gesture Recognition With Transparent Solar Cells, Dong Ma, Guohao Lan, Mahbub Hassan, Wen Hu, B. Mushfika Upama, Ashraf Uddin, Youseef, Moustafa

Research Collection School Of Computing and Information Systems

Transparent solar cell is an emerging solar energy harvesting technology that allows us to see through these cells. This revolutionary discovery is creating unique opportunities to turn any mobile device screen into solar energy harvester. In this paper, we consider the possibility of using such energy harvesting screens as a sensor to detect hand gestures. As different gestures impact the incident light on the screen in a different way, they are expected to create unique energy generation patterns for the transparent solar cell. Our goal is to recognize gestures by detecting these solar energy patterns. A key uncertainty we face …

Joint Representation Learning Of Cross-Lingual Words And Entities Via Attentive Distant Supervision, Yixin Cao, Lei Hou, Juanzi Li, Zhiyuan Liu, Chengjiang Li, Xu Chen, Tiansi Dong

Research Collection School Of Computing and Information Systems

Joint representation learning of words and entities benefits many NLP tasks, but has not been well explored in cross-lingual settings. In this paper, we propose a novel method for joint representation learning of cross-lingual words and entities. It captures mutually complementary knowledge, and enables cross-lingual inferences among knowledge bases and texts. Our method does not require parallel corpora, and automatically generates comparable data via distant supervision using multi-lingual knowledge bases. We utilize two types of regularizers to align cross-lingual words and entities, and design knowledge attention and crosslingual attention to further reduce noises. We conducted a series of experiments on …

Amino Acid Pop-Set: Model File Name: Amino-Acid-Wgrp-Pop_Sc3.Stl, Michelle Howell, Rebecca Roston

3-D Printed Model Structural Files

This is a teaching model for protein primary structure. It consists of four amino acids (tryptophan, proline, arginine, and glycine) depicted in stick and space-fill representations, five peptide bonds depicted in space-fill, and an N-terminus and a C-terminus depicted in space-fill. It is designed so that students can make various peptides to explore the amount of space of the electron clouds of the amino acids and bonds, and explore the psi and phi angles for the peptides. The printable model is already uploaded to Shapeways.com in the MacroMolecules shop under the name “Amino acid pop-set”. This model has …

Lipoprotein Signal Peptidase Ii: Model File Name: 5dir-Lipoii-Reps_Sc1-5.Stl, Michelle Howell, Rebecca Roston

3-D Printed Model Structural Files

This is a teaching model of lipoprotein signal peptidase II (PDB: 5DIR). It is designed with different regions of the protein depicted in space-filling, ribbon, stick, and backbone-only representations to explore protein secondary structure and illustrate how much space the protein takes up. The printable model is already uploaded to Shapeways.com in the MacroMolecules shop under the name “Lipoprotein signal peptidase II” and is intended to accompany the “Crambin”, “Cytochrome c” and “3 water molecules” models. This model has been printed successfully using these parameters on Shapeways’ laser sintering printer in …

3 Water Molecules: Model File Name: 3hoh-Final.Stl, Michelle Howell, Rebecca Roston

3-D Printed Model Structural Files

This is a teaching model of 3 water molecules depicted in space-fill. It is designed to the same scale as the “Lipoprotein signal peptidase II”, “Crambin”, and “Cytochrome c” models to illustrate the amount of space taken up by proteins. The printable model is already uploaded to Shapeways.com in the MacroMolecules shop under the name “3 water molecules” and is intended to accompany the “Lipoprotein signal peptidase II”, “Crambin”, and “Cytochrome c” models. This model has been printed successfully using these parameters on Shapeways’ laser sintering …

Crambin: Model File Name: 2fd7-Crambin-Stick_Sc1-5.Stl, Michelle Howell, Rebecca Roston

3-D Printed Model Structural Files

This is a teaching model of cytochrome c (PDB: 2FD7). It is designed in a stick representation to explore protein secondary structure and how much space the protein takes up. The printable model is already uploaded to Shapeways.com in the MacroMolecules shop under the name “Crambin” and is intended to accompany the “Lipoprotein signal peptidase II”, “Cytochrome c”, and “3 water molecules” models. This model has been printed successfully using these parameters on Shapeways’ laser sintering printer in the following material: Processed Versatile Plastic (Strong & Flexible Plastic).

Cytochrome C: Model File Name: 1b7v-Cytc-Stick_Sc1-5.Stl, Michelle Howell, Rebecca Roston

3-D Printed Model Structural Files

This is a teaching model of cytochrome c (PDB: 1B7V). It is designed in a stick representation to explore protein secondary structure and how much space the protein takes up. The printable model is already uploaded to Shapeways.com in the MacroMolecules shop under the name “Cytochrome c” and is intended to accompany the “Lipoprotein signal peptidase II”, “Crambin”, and “3 water molecules” models. This model has been printed successfully using these parameters on Shapeways’ laser sintering printer in the following material: Processed Versatile Plastic (Strong & Flexible Plastic).

Developing A Contemporary Operating Systems Course, Saverio Perugini, David J. Wright

Computer Science Faculty Publications

The objective of this tutorial presentation is to foster innovation in the teaching of operating systems (os) at the undergraduate level as part of a three-year NSF-funded IUSE (Improving Undergraduate STEM Education) project titled “Engaged Student Learning: Reconceptualizing and Evaluating a Core Computer Science Course for Active Learning and STEM Student Success” (2017–2020).

Chameleon: A Customizable Language For Teaching Programming Languages, Saverio Perugini, Jack L. Watkin

Computer Science Faculty Publications

ChAmElEoN is a programming language for teaching students the concepts and implementation of computer languages. We describe its syntax and semantics, the educational aspects involved in the implementation of a variety of interpreters for it, its malleability, and student feedback to inspire its use for teaching languages.

An Application Of The Actor Model Of Concurrency In Python: A Euclidean Rhythm Music Sequencer, Daniel P. Prince, Saverio Perugini

Computer Science Faculty Publications

We present a real-time sequencer, implementing the Euclidean rhythm algorithm, for creative generation of drum sequences by musicians or producers. We use the Actor model of concurrency to simplify the communication required for interactivity and musical timing, and generator comprehensions and higher-order functions to simplify the implementation of the Euclidean rhythm algorithm. The resulting application sends Musical Instrument Digital Interface (MIDI) data interactively to another application for sound generation.

Geometry-Aware Similarity Learning On Spd Manifolds For Visual Recognition, Zhiwu Huang, R. Wang, X. Li, W. Liu, S. Shan, Gool L. Van, X Chen

Research Collection School Of Computing and Information Systems

Symmetric positive definite (SPD) matrices have been employed for data representation in many visual recognition tasks. The success is mainly attributed to learning discriminative SPD matrices encoding the Riemannian geometry of the underlying SPD manifolds. In this paper, we propose a geometry-aware SPD similarity learning (SPDSL) framework to learn discriminative SPD features by directly pursuing a manifold-manifold transformation matrix of full column rank. Specifically, by exploiting the Riemannian geometry of the manifolds of fixed-rank positive semidefinite (PSD) matrices, we present a new solution to reduce optimization over the space of column full-rank transformation matrices to optimization on the PSD manifold, …

Knowledge-Aware Multimodal Fashion Chatbot, Lizi Liao, You Zhou, Yunshan Ma, Richang Hong, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

Multimodal fashion chatbot provides a natural and informative way to fulfill customers’ fashion needs. However, making it ‘smart’ in generating substantive responses remains a challenging problem. In this paper, we present a multimodal domain knowledge enriched fashion chatbot. It forms a taxonomy-based learning module to capture the fine-grained semantics in images and leverages an endto-end neural conversational model to generate responses based on the conversation history, visual semantics, and domain knowledge. To avoid inconsistent dialogues, deep reinforcement learning method is used to further optimize the model.

Disruptive Technology: Can The Banking Industry Harness Disruption For Competitive Edge?, Edgar Low

MITB Thought Leadership Series

Disruptive innovation was identified as a phenomenon more than two decades ago by prominent Harvard scholar Clayton Christensen. So you may wonder why established industries are only now waking up to the prospect of digital transformation - the banking industry in particular.

The Design Of An Emerging/Multi-Paradigm Programming Languages Course, Saverio Perugini

Computer Science Faculty Publications

We present the design of a new special topics course, Emerging/Multi-paradigm Languages, on the recent trend toward more dynamic, multi-paradigm languages. To foster course adoption, we discuss the design of the course, which includes language presentations/papers and culminating, 􀏐inal projects/papers. The goal of this article is to inspire and facilitate course adoption.

Deep Understanding Of Cooking Procedure For Cross-Modal Recipe Retrieval, Jingjing Chen, Chong-Wah Ngo, Fu-Li Feng, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

Finding a right recipe that describes the cooking procedure for a dish from just one picture is inherently a difficult problem. Food preparation undergoes a complex process involving raw ingredients, utensils, cutting and cooking operations. This process gives clues to the multimedia presentation of a dish (e.g., taste, colour, shape). However, the description of the process is implicit, implying only the cause of dish presentation rather than the visual effect that can be vividly observed on a picture. Therefore, different from other cross-modal retrieval problems in the literature, recipe search requires the understanding of textually described procedure to predict its …

Mixed-Reality For Object-Focused Remote Collaboration, Martin Feick, Anthony Tang, Scott Bateman

Research Collection School Of Computing and Information Systems

In this paper we outline the design of a mixed-reality system to support object-focused remote collaboration. Here, being able to adjust collaborators' perspectives on the object as well as understand one another's perspective is essential to support effective collaboration over distance. We propose a low-cost mixed-reality system that allows users to: (1) quickly align and understand each other's perspective; (2) explore objects independently from one another, and (3) render gestures in the remote's workspace. In this work, we focus on the expert's role and we introduce an interaction technique allowing users to quickly manipulation 3D virtual objects in space.

Predicting Visual Context For Unsupervised Event Segmentation In Continuous Photo-Streams, Ana García Del Molino, Joo-Hwee Lim, Ah-Hwee Tan

Research Collection School Of Computing and Information Systems

Segmenting video content into events provides semantic structures for indexing, retrieval, and summarization. Since motion cues are not available in continuous photo-streams, and annotations in lifelogging are scarce and costly, the frames are usually clustered into events by comparing the visual features between them in an unsupervised way. However, such methodologies are ineffective to deal with heterogeneous events, e.g. taking a walk, and temporary changes in the sight direction, e.g. at a meeting. To address these limitations, we propose Contextual Event Segmentation (CES), a novel segmentation paradigm that uses an LSTM-based generative network to model the photo-stream sequences, predict their …

Human Hexokinase I - Allosteric Regulation: Model File Name: 1dgk-Editb22-Allostery_Sc06.Stl, Michelle Howell, Rebecca Roston

3-D Printed Model Structural Files

This is a teaching model of human Hexokinase I in a surface representation with small molecules ADP and G6P included (PDB: 1DGK). It is designed to be hollow with a lever to mimic allosteric regulation. The printable model is already uploaded to Shapeways.com in the MacroMolecules shop under the name “Human Hexokinase I - Allosteric regulation model”. This model has been printed successfully using these parameters on Shapeways’ laser sintering printer in the following material: Processed Versatile Plastic (Strong & Flexible Plastic).

Wasserstein Divergence For Gans, J. Wu, Zhiwu Huang, J. Thoma, D. Acharya, Gool L. Van

Research Collection School Of Computing and Information Systems

In many domains of computer vision, generative adversarial networks (GANs) have achieved great success, among which the family of Wasserstein GANs (WGANs) is considered to be state-of-the-art due to the theoretical contributions and competitive qualitative performance. However, it is very challenging to approximate the k-Lipschitz constraint required by the Wasserstein-1 metric (W-met). In this paper, we propose a novel Wasserstein divergence (W-div), which is a relaxed version of W-met and does not require the k-Lipschitz constraint. As a concrete application, we introduce a Wasserstein divergence objective for GANs (WGAN-div), which can faithfully approximate W-div through optimization. Under various settings, including …

A Vector Field Design Approach To Animated Transitions, Yong Wang, Daniel Archambault, Carlos E. Scheidegger, Huamin Qu

Research Collection School Of Computing and Information Systems

Animated transitions can be effective in explaining and exploring a small number of visualizations where there are drastic changes in the scene over a short interval of time. This is especially true if data elements cannot be visually distinguished by other means. Current research in animated transitions has mainly focused on linear transitions (all elements follow straight line paths) or enhancing coordinated motion through bundling of linear trajectories. In this paper, we introduce animated transition design, a technique to build smooth, non-linear transitions for clustered data with either minimal or no user involvement. The technique is flexible and simple to …

Visualization Of Geospatial Data As An Analytical And Educational Tool, Richard A. Vu

STAR Program Research Presentations

World Wind is an open-source API developed for Java, Android, and browsers that is designed to visualize and interact with geospatial data. The Web World Wind client is composed of four major components: the HTML template, the globe, geospatial features, and application features. The template was implemented using Bootstrap and hosts the globe provided by World Wind. This globe draws its data from multiple imagery sources, including the Open Geospatial Consortium (OGC) Web Map Service and Web Map Tile Service. This enables the application to perform and visualize complex calculations with multiple types of data such as weather and terrain. …