Viscene: A Collaborative Authoring Tool For Scene Descriptions In Videos,
2020
Singapore Management University
Viscene: A Collaborative Authoring Tool For Scene Descriptions In Videos, Rosiana Natalie, Ebrima Jarjue, Hernisa Kacorri, Kotaro Hara
Research Collection School Of Computing and Information Systems
Audio descriptions can make the visual content in videos accessible to people with visual impairments. However, the majority of the online videos lack audio descriptions due in part to the shortage of experts who can create high-quality descriptions. We present ViScene, a web-based authoring tool that taps into the larger pool of sighted non-experts to help them generate high-quality descriptions via two feedback mechanisms - succinct visualizations and comments from an expert. Through a mixed-design study with N = 6 participants, we explore the usability of ViScene and the quality of the descriptions created by sighted non-experts with and without …
The Virtual Reality Questionnaire Toolkit,
2020
DFKI Saarbrucken
The Virtual Reality Questionnaire Toolkit, Martin Feick, Niko Kleer, Anthony Tang, Anthonio Kruger
Research Collection School Of Computing and Information Systems
In this work, we present the VRQuestionnaire Toolkit, which enables the research community to easily collect subjective measures within virtual reality (VR). We contribute a highly customizable and reusable open-source toolkit which can be integrated in existing VR projects rapidly. The toolkit comes with a pre-installed set of standard questionnaires such as NASA TLX, SSQ and SUS Presence questionnaire. Our system aims to lower the entry barrier to use questionnaires in VR and to significantly reduce development time and cost needed to run pre-, in between- and post-study questionnaires.
Multi-Modal Cooking Workflow Construction For Food Recipes,
2020
Singapore Management University
Multi-Modal Cooking Workflow Construction For Food Recipes, Liangming Pan, Jingjing Chen, Jianlong Wu, Shaoteng Liu, Chong-Wah Ngo, Min-Yen Kan, Yugang Jiang, Tat-Seng Chua
Research Collection School Of Computing and Information Systems
Understanding food recipe requires anticipating the implicit causal effects of cooking actions, such that the recipe can be converted into a graph describing the temporal workflow of the recipe. This is a non-trivial task that involves common-sense reasoning. However, existing efforts rely on hand-crafted features to extract the workflow graph from recipes due to the lack of large-scale labeled datasets. Moreover, they fail to utilize the cooking images, which constitute an important part of food recipes. In this paper, we build MM-ReS, the first large-scale dataset for cooking workflow construction, consisting of 9,850 recipes with human-labeled workflow graphs. Cooking steps …
Interpretable Embedding For Ad-Hoc Video Search,
2020
Singapore Management University
Interpretable Embedding For Ad-Hoc Video Search, Jiaxin Wu, Chong-Wah Ngo
Research Collection School Of Computing and Information Systems
Answering query with semantic concepts has long been the mainstream approach for video search. Until recently, its performance is surpassed by concept-free approach, which embeds queries in a joint space as videos. Nevertheless, the embedded features as well as search results are not interpretable, hindering subsequent steps in video browsing and query reformulation. This paper integrates feature embedding and concept interpretation into a neural network for unified dual-task learning. In this way, an embedding is associated with a list of semantic concepts as an interpretation of video content. This paper empirically demonstrates that, by using either the embedding features or …
Person-Level Action Recognition In Complex Events Via Tsd-Tsm Networks,
2020
Singapore Management University
Person-Level Action Recognition In Complex Events Via Tsd-Tsm Networks, Yanbin Hao, Zi-Niu Liu, Hao Zhang, Bin Zhu, Jingjing Chen, Yu-Gang Jiang, Chong-Wah Ngo
Research Collection School Of Computing and Information Systems
The task of person-level action recognition in complex events aims to densely detect pedestrians and individually predict their actions from surveillance videos. In this paper, we present a simple yet efficient pipeline for this task, referred to as TSD-TSM networks. Firstly, we adopt the TSD detector for the pedestrian localization on each single keyframe. Secondly, we generate the sequential ROIs for a person proposal by replicating the adjusted bounding box coordinates around the keyframe. Particularly, we propose to conduct straddling expansion and region squaring on the original bounding box of a person proposal to widen the potential space of motion …
Opinion-Aware Answer Generation For Review-Driven Question Answering In E-Commerce,
2020
Singapore Management University
Opinion-Aware Answer Generation For Review-Driven Question Answering In E-Commerce, Yang Deng, Wenxuan Zhang, Wai Lam
Research Collection School Of Computing and Information Systems
Product-related question answering (QA) is an important but challenging task in E-Commerce. It leads to a great demand on automatic review-driven QA, which aims at providing instant responses towards user-posted questions based on diverse product reviews. Nevertheless, the rich information about personal opinions in product reviews, which is essential to answer those product-specific questions, is underutilized in current generation-based review-driven QA studies. There are two main challenges when exploiting the opinion information from the reviews to facilitate the opinion-aware answer generation: (i) jointly modeling opinionated and interrelated information between the question and reviews to capture important information for answer generation, …
Gym Usage Behavior & Desired Digital Interventions: An Empirical Study,
2020
Singapore Management University
Gym Usage Behavior & Desired Digital Interventions: An Empirical Study, Meeralakshmi Radhakrishnan, Archan Misra, Rajesh Krishna Balan, Youngki Lee
Research Collection School Of Computing and Information Systems
Understanding individual’s exercise motives, participation patterns in a gym and reasons for dropout are essential for designing strategies to help gym-goers with long-term exercise adherence. In this work, we derive insights on various exercise-related behaviors of gymgoers, including evidence of a significant number of individuals exhibiting early dropout and also describing their attitudes towards digital technologies for sustained gym participation. By utilizing gym visitation data logs of 6513 individuals over a longitudinal period of 16 months in a campus gym, we show the retention and dropout rates of gym-goers. Our data indicates that 32% of the people quit their gym …
The Future Of Work Now: Ai-Driven Transaction Surveillance At Dbs Bank,
2020
Babson College
The Future Of Work Now: Ai-Driven Transaction Surveillance At Dbs Bank, Thomas H. Davenport, Steven M. Miller
Research Collection School Of Computing and Information Systems
One of the most frequently-used phrases at business events these days is “the future of work.” It’s increasingly clear that artificial intelligence and other new technologies will bring substantial changes in work tasks and business processes. But while these changes are predicted for the future, they’re already present in many organizations for many different jobs. The job and incumbents described below are an example of this phenomenon. Steve Miller of Singapore Management University and I co-authored the story.
The Future Of Work Now: Automl At 84.51°And Kroger,
2020
Babson College
The Future Of Work Now: Automl At 84.51°And Kroger, Thomas H. Davenport, Steven M. Miller
Research Collection School Of Computing and Information Systems
One of the most frequently-used phrases at business events these days is “the future of work.” It’s increasingly clear that artificial intelligence and other new technologies will bring substantial changes in work tasks and business processes. But while these changes are predicted for the future, they’re already present in many organizations for many different jobs. The job and incumbents described below are an example of this phenomenon.
Foodbot: A Goal-Oriented Just-In-Time Healthy Eating Interventions Chatbot,
2020
Singapore Management University
Foodbot: A Goal-Oriented Just-In-Time Healthy Eating Interventions Chatbot, Philips Kokoh Prasetyo, Palakorn Achananuparp, Ee-Peng Lim
Research Collection School Of Computing and Information Systems
Recent research has identified a few design flaws in popular mobile health (mHealth) applications for promoting healthy eating lifestyle, such as mobile food journals. These include tediousness of manual food logging, inadequate food database coverage, and a lack of healthy dietary goal setting. To address these issues, we present Foodbot, a chatbot-based mHealth application for goal-oriented just-in-time (JIT) healthy eating interventions. Powered by a large-scale food knowledge graph, Foodbot utilizes automatic speech recognition and mobile messaging interface to record food intake. Moreover, Foodbot allows users to set goals and guides their behavior toward the goals via JIT notification prompts, interactive …
Did Our Course Design On Software Architecture Meet Our Student’S Learning Expectations?,
2020
Singapore Management University
Did Our Course Design On Software Architecture Meet Our Student’S Learning Expectations?, Eng Lieh Ouh, Benjamin Gan, Yunghans Irawan
Research Collection School Of Computing and Information Systems
This Innovative Practice Full Paper discusses our course design on software architecture to meet the learning expectations of two groups of software engineers. Software engineers with working experiences frequently find themselves the need to upskill in their lifelong learning journey. Their learning expectations are shaped not just by their need to know but also other learning characteristics such as their working experiences. In many cases, we design courses based on the required learning outcomes and assessment criteria. In this paper, we wish to find out whether our course design on software architecture has met the learning expectations of our students …
Experience Report On The Use Of Technology To Manage Capstone Course Projects,
2020
Singapore Management University
Experience Report On The Use Of Technology To Manage Capstone Course Projects, Benjamin Gan, Eng Lieh Ouh
Research Collection School Of Computing and Information Systems
This full paper presents an experience report describing lessons learnt from innovative practice use of technologies in an undergraduate computing capstone course. At our school, around fifty-five teams comprising of around 300 students take this course every year. With fifty-five teams, we needed a system to schedule presentations; improve communications; collaborate between stakeholders; share knowledge; monitor progress; team up students; match students to projects; improve grading process; showcase posters; and track improvements using analytics. The Learning Management Systems (LMS) is great to manage course content and grade submission. On the other hand, students are required to conduct agile sprint reviews …
Co2vec: Embeddings Of Co-Ordered Networks Based On Mutual Reinforcement,
2020
Singapore Management University
Co2vec: Embeddings Of Co-Ordered Networks Based On Mutual Reinforcement, Meng-Fen Chiang, Ee-Peng Lim, Wang-Chien Lee, Philips Kokoh Prasetyo
Research Collection School Of Computing and Information Systems
We study the problem of representation learning for multiple types of entities in a co-ordered network where order relations exist among entities of the same type, and association relations exist across entities of different types. The key challenge in learning co-ordered network embedding is to preserve order relations among entities of the same type while leveraging on the general consistency in order relations between different entity types. In this paper, we propose an embedding model, CO2Vec, that addresses this challenge using mutually reinforced order dependencies. Specifically, CO2Vec explores in-direct order dependencies as supplementary evidence to enhance order representation learning across …
Visual Sentiment Analysis For Review Images With Item-Oriented And User-Oriented Cnn: Reproducibility Companion Paper,
2020
Singapore Management University
Visual Sentiment Analysis For Review Images With Item-Oriented And User-Oriented Cnn: Reproducibility Companion Paper, Quoc Tuan Truong, Hady W. Lauw, Martin Aumuller, Naoko Nitta
Research Collection School Of Computing and Information Systems
We revisit our contributions on visual sentiment analysis for online review images published at ACM Multimedia 2017, where we develop item-oriented and user-oriented convolutional neural networks that better capture the interaction of image features with specific expressions of users or items. In this work, we outline the experimental claims as well as describe the procedures to reproduce the results therein. In addition, we provide artifacts including data sets and code to replicate the experiments.
Dual-Slam: A Framework For Robust Single Camera Navigation,
2020
Singapore Management University
Dual-Slam: A Framework For Robust Single Camera Navigation, Huajian Huang, Wen-Yan Lin, Siying Liu, Dong Zhang, Sai-Kit Yeung
Research Collection School Of Computing and Information Systems
SLAM (Simultaneous Localization And Mapping) seeks to provide a moving agent with real-time self-localization. To achieve real-time speed, SLAM incrementally propagates position estimates. This makes SLAM fast but also makes it vulnerable to local pose estimation failures. As local pose estimation is ill-conditioned, local pose estimation failures happen regularly, making the overall SLAM system brittle. This paper attempts to correct this problem. We note that while local pose estimation is ill-conditioned, pose estimation over longer sequences is well-conditioned. Thus, local pose estimation errors eventually manifest themselves as mapping inconsistencies. When this occurs, we save the current map and activate two …
Cover Song Identification - A Novel Stem-Based Approach To Improve Song-To-Song Similarity Measurements,
2020
Southern Methodist University
Cover Song Identification - A Novel Stem-Based Approach To Improve Song-To-Song Similarity Measurements, Lavonnia Newman, Dhyan Shah, Chandler Vaughn, Faizan Javed
SMU Data Science Review
Music is incorporated into our daily lives whether intentional or unintentional. It evokes responses and behavior so much so there is an entire study dedicated to the psychology of music. Music creates the mood for dancing, exercising, creative thought or even relaxation. It is a powerful tool that can be used in various venues and through advertisements to influence and guide human reactions. Music is also often "borrowed" in the industry today. The practices of sampling and remixing music in the digital age have made cover song identification an active area of research. While most of this research is focused …
A Novel Low-Power Synchronous Preamble Data Line Chip Design For Oscillator Control Interface,
2020
CYCU, Chung Yuan Christian University
A Novel Low-Power Synchronous Preamble Data Line Chip Design For Oscillator Control Interface, Shih-Lun Chen, Tsun-Kuang Chi, Min-Chun Tuan, Chiung-An Chen, Liang-Hung Wang, Wei-Yuan Chiang, Ming-Yi Lin, Patricia Angela R. Abu
Department of Information Systems & Computer Science Faculty Publications
In this paper, a novel low-power synchronous preamble data line protocol chip design for serial communication is proposed. The serial communication only uses two wires, chip select (CS) and secure digital (SD), to transmit and receive data between two devices. The proposed protocol aims to use a fewer number of wires for the interface, therefore reducing the complexity as well as the area of the chip design. Moreover, it increases the efficiency through a synchronous serial communication-controlled oscillator. The low-power synchronous preamble data line protocol design was successfully verified using a field-programmable gate array (FPGA) as a master device and …
Low Cost Aip Design In 5g Flexible Antenna Phase Array System Application,
2020
Shenzhen Jaguar Wave Technology, China
Low Cost Aip Design In 5g Flexible Antenna Phase Array System Application, Wei-Shin Tung, Wei-Yuan Chiang, Chih-Kai Liu, Chiung-An Chen, Pei-Zong Rao, Patricia Angela R. Abu, Wan-Ming Chen, Faisal Asadi, Shih-Lun Chen
Department of Information Systems & Computer Science Faculty Publications
In this paper, a low cost 28 GHz Antenna-in-Package (AIP) for a 5G communication system is designed and investigated. The antenna is implemented on a low-cost FR4 substrate with a phase shift control integrated circuit, AnokiWave phasor integrated circuit (IC). The unit cell where the array antenna and IC are integrated in the same plate constructs a flexible phase array system. Using the AIP unit cell, the desired antenna array can be created, such as 2 × 8, 8 × 8 or 2 × 64 arrays. The study design proposed in this study is a 2 × 2 unit cell …
An Enhancement Of Age And Gender Classification Accuracy With Hybrid Handcrafted And Deep Features Using Hierarchical Extreme Learning Machine,
2020
Universiti Malaya
An Enhancement Of Age And Gender Classification Accuracy With Hybrid Handcrafted And Deep Features Using Hierarchical Extreme Learning Machine, Mohammad Javidan Darugar
Student Works (2020-2029)
Age and gender classification are some of the essential algorithms that have many use cases in our everyday life. For example, in robotics, field robots can interact with a human base on their gender in data analysis, to have statistics about age and gender of audiences in social events, YouTube video analysis, and many other applications. In this research, we have addressed limitations in deep neural networks, which by overcoming this limitation, we can gain better accuracy and performance. Our study has several other possible applications which are not limited only to age and gender classification. This dissertation is about …
London Heathrow Airport Uses Real-Time Analytics For Improving Operations,
2020
Singapore Management University
London Heathrow Airport Uses Real-Time Analytics For Improving Operations, Xiaojia Guo, Yael Grushka-Cockayne, Bert De Reyck
Research Collection Lee Kong Chian School Of Business
Improving airport collaborative decision making is at the heart of airport operations centers (APOCs) recently established in several major European airports. In this paper, we describe a project commissioned by Eurocontrol, the organization in charge of the safety and seamless flow of European air traffic. The project’s goal was to examine the opportunities offered by the colocation and real-time data sharing in the APOC at London’s Heathrow airport, arguably the most advanced of its type in Europe. We developed and implemented a pilot study of a real-time data-sharing and collaborative decision-making process, selected to improve the efficiency of Heathrow’s operations. …
