Graphics and Human Computer Interfaces Commons^™

The Basil Technique: Bias Adaptive Statistical Inference Learning Agents For Learning From Human Feedback, Jonathan Indigo Watson

Theses and Dissertations--Computer Science

We introduce a novel approach for learning behaviors using human-provided feedback that is subject to systematic bias. Our method, known as BASIL, models the feedback signal as a combination of a heuristic evaluation of an action's utility and a probabilistically-drawn bias value, characterized by unknown parameters. We present both the general framework for our technique and specific algorithms for biases drawn from a normal distribution. We evaluate our approach across various environments and tasks, comparing it to interactive and non-interactive machine learning methods, including deep learning techniques, using human trainers and a synthetic oracle with feedback distorted to varying degrees. …

Digital Transformation, Applications, And Vulnerabilities In Maritime And Shipbuilding Ecosystems, Rafael Diaz, Katherine Smith

VMASC Publications

The evolution of maritime and shipbuilding supply chains toward digital ecosystems increases operational complexity and needs reliable communication and coordination. As labor and suppliers shift to digital platforms, interconnection, information transparency, and decentralized choices become ubiquitous. In this sense, Industry 4.0 enables "smart digitalization" in these environments. Many applications exist in two distinct but interrelated areas related to shipbuilding design and shipyard operational performance. New digital tools, such as virtual prototypes and augmented reality, begin to be used in the design phases, during the commissioning/quality control activities, and for training workers and crews. An application relates to using Virtual Prototypes …

The Implementation Of Augmented Reality And Low Latency Protocols In Musical Instrumental Collaborations, Qixiao Zhu

Honors Theses

Past projects involving musical software have been completely virtual, while these software do well in entertainment and education, there is the question of whether these software are playable to the same extent as physical musical instruments. The software presented in this paper, "AR Jam", utilizes various software and hardware tools to form a networked mixed reality system for the users to play music on. The intention of this project is to seek new ways to explore more playable musical instruments in the digital world. The paper presents the software's implementation, challenges such as optimization problems of the synthesizer, and the …

Relation Preserving Triplet Mining For Stabilising The Triplet Loss In Re-Identification Systems, Adhiraj Ghosh, Kuruparan Shanmugalingam, Wen-Yan Lin

Research Collection School Of Computing and Information Systems

Object appearances change dramatically with pose variations. This creates a challenge for embedding schemes that seek to map instances with the same object ID to locations that are as close as possible. This issue becomes significantly heightened in complex computer vision tasks such as re-identification(reID). In this paper, we suggest that these dramatic appearance changes are indications that an object ID is composed of multiple natural groups, and it is counterproductive to forcefully map instances from different groups to a common location. This leads us to introduce Relation Preserving Triplet Mining (RPTM), a feature matching guided triplet mining scheme, that …

Reinforcement Learning Enhanced Pichunter For Interactive Search, Zhixin Ma, Jiaxin Wu, Weixiong Loo, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

With the tremendous increase in video data size, search performance could be impacted significantly. Specifically, in an interactive system, a real-time system allows a user to browse, search and refine a query. Without a speedy system quickly, the main ingredient to engage a user to stay focused, an interactive system becomes less effective even with a sophisticated deep learning system. This paper addresses this challenge by leveraging approximate search, Bayesian inference, and reinforcement learning. For approximate search, we apply a hierarchical navigable small world, which is an efficient approximate nearest neighbor search algorithm. To quickly prune the search scope, we …

Exploration Of Digital Synthesis, Angelo Indre

Williams Honors College, Honors Research Projects

“An Exploration of Digital Synthesis” is a comprehensive investigation into the world of digital audio and music production. The paper explores the fundamental concepts of sound synthesis, including MIDI, virtual instruments (VSTs), and the JUCE framework. The central focus of the paper is the implementation of a custom synthesizer, which serves as a case study for the practical application of digital synthesis. The paper addresses the key question of how to create a functioning synthesizer from scratch, providing detailed insights into the programming and design process. Overall, the paper represents a significant contribution to the fields of digital audio and …

Fridge Tracker And Recipe Provider : Fridgechamp, Matt Dudek

Williams Honors College, Honors Research Projects

FridgeChamp is a website to allow people to track their fridge/pantry contents while providing them recipes they can make with said ingredients. Currently there are few ingredient trackers and recipe matchers that exist as websites, and of those many lack simplistic recipes that a home chef would use. In addition to lacking some recipes, many tracker/recipe apps do not have a function to remove from your stock what a recipe requires, making you tediously update the stock every time you cook/use something.

Development Of Tangible Code Blocks For The Blind And Visually Impaired, Hyun Woo Kim

Theses and Dissertations

The fields of Science, Technology, Engineering, and Mathematics (STEM) have been growing at an accelerating rate in recent times. Knowing how to program has become one key skill for entering all of these STEM fields. However, many students find programming difficult. The block based programming language, Scratch, was specifically designed to lower hurdles to learning how to program for sighted students. Unfortunately, although very effective and widely used in K12 classrooms, Scratch, similar to other block based languages, is inaccessible to students who are blind and visually impaired (BVI). This thesis is part of a larger project to make the …

Simulating Incompressible Thin-Film Fluid With A Moving Eulerian-Lagrangian Particle Method, Yitong Deng

Dartmouth College Master’s Theses

In this thesis, we introduce a Moving Eulerian-Lagrangian Particle (MELP) method, a mesh-free method to simulate incompressible thin-film fluid systems: soap bubbles, bubble clusters, and foams. The realistic simulation of such systems depends upon the successful treatment of three aspects: (1) the soap film's deformation due to the tendency to minimize the surface energy, giving rise to the bouncy characteristics of soap bubbles, (2) the tangential fluid flow on the thin film, causing the thickness to vary spatially, which in conjunction with thin-film interference creates evolving and highly sophisticated iridescent color patterns, (3) the topological changes due to collision, separation, …

An Interactive System For Generating Music From Moving Images, Hanlin Wang

Dartmouth College Master’s Theses

Moving images contain a wealth of information pertaining to motion. Motivated by the interconnectedness of music and movement, we present a framework for transforming the kinetic qualities of moving images into music. We developed an interactive software system that takes video as input and maps its motion attributes into the musical dimension based on perceptually grounded principles. The system combines existing sonification frameworks with theories and techniques of generative music. To evaluate the system, we conducted a two-part experiment. First, we asked participants to make judgements on video-audio correspondence from clips generated by the system. Second, we asked participants to …

Modelling The Relationship Between Personality Traits And Basic Emotions: A Multi-Modal And Affective Computing Approach, Brendan Ryan Donovan

Theses

In the field of Psychology, it has long been assumed that one’s personality traits are linked to one’s emotional states. Yet there is a scarce amount of research that has directly quantified the relationships between basic emotional states and Big Five personality traits. Most empirical research has investigated how attributes of emotional states map to a narrow selection of personality traits (Extraversion and Neuroticism) via a single modality (questionnaires). This narrow focus restricts the field’s understanding of the relationship between emotional states and personality traits.

In this research, the Personality Emotion Mapping (PEM) model was developed to map the relationships …

Co-Design Of An Interactive Wellness Park: Exploring Design Requirements For A Multimodal Outdoor Physical Web Installation With Older Adults, Fatima Badmos

Academic Posters Collection

The global demographic landscape is experiencing a notable shift, characterised by a growing proportion of adults over 60. According to projections, the proportion of individuals aged 60 and above is expected to reach one-sixth of the global population by 2030. Furthermore, by 2050, this demographic is projected to exceed a staggering two billion people. Amidst this shift, there is an urgent need to develop interactive and innovative solutions to address older adults' unique challenges, particularly in outdoor physical activity.

A co-design methodology involving older adults’ participation from the idea generation to the application development process will be adopted to address …

Distance Based Image Classification: A Solution To Generative Classification’S Conundrum?, Wen-Yan Lin, Siying Liu, Bing Tian Dai, Hongdong Li

Research Collection School Of Computing and Information Systems

Most classifiers rely on discriminative boundaries that separate instances of each class from everything else. We argue that discriminative boundaries are counter-intuitive as they define semantics by what-they-are-not; and should be replaced by generative classifiers which define semantics by what-they-are. Unfortunately, generative classifiers are significantly less accurate. This may be caused by the tendency of generative models to focus on easy to model semantic generative factors and ignore non-semantic factors that are important but difficult to model. We propose a new generative model in which semantic factors are accommodated by shell theory’s [25] hierarchical generative process and non-semantic factors by …

Taurus: Towards A Unified Force Representation And Universal Solver For Graph Layout, Mingliang Xue, Zhi Wang, Fahai Zhong, Yong Wang, Mingliang Xu, Oliver Deussen, Yunhai Wang

Research Collection School Of Computing and Information Systems

Over the past few decades, a large number of graph layout techniques have been proposed for visualizing graphs from various domains. In this paper, we present a general framework, Taurus, for unifying popular techniques such as the spring-electrical model, stress model, and maxent-stress model. It is based on a unified force representation, which formulates most existing techniques as a combination of quotient-based forces that combine power functions of graph-theoretical and Euclidean distances. This representation enables us to compare the strengths and weaknesses of existing techniques, while facilitating the development of new methods. Based on this, we propose a new balanced …

The Impact Of Pre-Experiment Walking On Distance Perception In Vr, Soheil Sepahyar

Dissertations, Master's Theses and Master's Reports

While individuals can accurately estimate distances in the real world, this ability is often diminished in virtual reality (VR) simulations, hampering performance across training, entertainment, prototyping, and education domains. To assess distance judgments, the direct blind walking method—having participants walk blindfolded to targets—is frequently used. Typically, direct blind walking measurements are performed after an initial practice phase, where people become comfortable with walking while blindfolded. Surprisingly, little research has explored how such pre-experiment walking impacts subsequent VR distance judgments. Our initial investigation revealed increased pre-experiment blind walking reduced distance underestimations, underscoring the importance of detailing these preparatory procedures in research—details …

An Ambiguous Technique For Nonvisual Text Entry, Dylan C. Gaines

Dissertations, Master's Theses and Master's Reports

Text entry is a common daily task for many people, but it can be a challenge for people with visual impairments when using virtual touchscreen keyboards that lack physical key boundaries. In this thesis, we investigate using a small number of gestures to select from groups of characters to remove most or all dependence on touch locations. We leverage a predictive language model to select the most likely characters from the selected groups once a user completes each word.

Using a preliminary interface with six groups of characters based on a Qwerty keyboard, we find that users are able to …

Mwirgan: Unsupervised Visible-To Mwir Image Translation With Generative Adversarial Network, Mohammad Shahab Uddin, Chiman Kwan, Jiang Li

Electrical & Computer Engineering Faculty Publications

Unsupervised image-to-image translation techniques have been used in many applications, including visible-to-Long-Wave Infrared (visible-to-LWIR) image translation, but very few papers have explored visible-to-Mid-Wave Infrared (visible-to-MWIR) image translation. In this paper, we investigated unsupervised visible-to-MWIR image translation using generative adversarial networks (GANs). We proposed a new model named MWIRGAN for visible-to-MWIR image translation in a fully unsupervised manner. We utilized a perceptual loss to leverage shape identification and location changes of the objects in the translation. The experimental results showed that MWIRGAN was capable of visible-to-MWIR image translation while preserving the object’s shape with proper enhancement in the translated images and …

Directional Speaker Poster, Eugene Ng, Bryan Wong, Ruhaan Das

Student Works

Changi Airport is set to expand with a new terminal, Terminal 5. Currently, many of the airport's processes are manual, requiring a high dependence on staff. This proposal aims to incorporate automation and AI for a smoother passenger experience.

Hybrid Life Cycles In Software Development, Eric Vincent Schoenborn

Masters Projects

This project applied software specification gathering, architecture, work planning, and development to a real-world development effort for a local business. This project began with a feasibility meeting with the owner of Zeal Aerial Fitness. After feasibility was assessed the intended users, needed functionality, and expected user restrictions were identified with the stakeholders. A hybrid software lifecycle was selected to allow a focus on base functionality up front followed by an iterative development of expectations of the stakeholders. I was able to create various specification diagrams that express the end projects goals to both developers and non-tech individuals using a standard …

Augmented Reality Fonts With Enhanced Out-Of-Focus Text Legibility, Mohammed Safayet Arefin

Theses and Dissertations

In augmented reality, information is often distributed between real and virtual contexts, and often appears at different distances from the viewer. This raises the issues of (1) context switching, when attention is switched between real and virtual contexts, (2) focal distance switching, when the eye accommodates to see information in sharp focus at a new distance, and (3) transient focal blur, when information is seen out of focus, during the time interval of focal distance switching. This dissertation research has quantified the impact of context switching, focal distance switching, and transient focal blur on human performance and eye fatigue in …

Transfer Of Personality Through Text Style, Michael O'Mahony, Robert Ross

Other resources

The style of generated text is how something is said rather than what is said. We hypothesize that changing the style of generated text can change the perceived personality of the text generation agent. Dialogue systems that aim to imitate a human agent can appear to have a consistent personality through a consistent, controllable style of conversation. Some recent work on the style of generated text [1] performs impressively in the small number of domains selected for their experiments using transformer and LSTM-based models. Lin et al. [1] used weak supervised learning as their data set lacks parallel data. The …

Movie Reviews Sentiment Analysis Using Bert, Gibson Nkhata

Graduate Theses and Dissertations

Sentiment analysis (SA) or opinion mining is analysis of emotions and opinions from texts. It is one of the active research areas in Natural Language Processing (NLP). Various approaches have been deployed in the literature to address the problem. These techniques devise complex and sophisticated frameworks in order to attain optimal accuracy with their focus on polarity classification or binary classification. In this paper, we aim to fine-tune BERT in a simple but robust approach for movie reviews sentiment analysis to provide better accuracy than state-of-the-art (SOTA) methods. We start by conducting sentiment classification for every review, followed by computing …

Disease Recognition In X-Ray Images With Doctor Consultation-Inspired Model, Kim Anh Phung, Thuan Trong Nguyen, Nileshkumar Wangad, Samah Baraheem, Nguyen D. Vo, Khang Nguyen

Computer Science Faculty Publications

The application of chest X-ray imaging for early disease screening is attracting interest from the computer vision and deep learning community. To date, various deep learning models have been applied in X-ray image analysis. However, models perform inconsistently depending on the dataset. In this paper, we consider each individual model as a medical doctor. We then propose a doctor consultation-inspired method that fuses multiple models. In particular, we consider both early and late fusion mechanisms for consultation. The early fusion mechanism combines the deep learned features from multiple models, whereas the late fusion method combines the confidence scores of all …

Make Your Own Sprites: Aliasing-Aware And Cell-Controllable Pixelization, Zongwei Wu, Liangyu Chai, Nanxuan Zhao, Bailin Deng, Yongtuo Liu, Qiang Wen, Junle Wang, Shengfeng He

Research Collection School Of Computing and Information Systems

Pixel art is a unique art style with the appearance of low resolution images. In this paper, we propose a data-driven pixelization method that can produce sharp and crisp cell effects with controllable cell sizes. Our approach overcomes the limitation of existing learning-based methods in cell size control by introducing a reference pixel art to explicitly regularize the cell structure. In particular, the cell structure features of the reference pixel art are used as an auxiliary input for the pixelization process, and for measuring the style similarity between the generated result and the reference pixel art. Furthermore, we disentangle the …

Vr Computing Lab: An Immersive Classroom For Computing Learning, Shawn Pang, Kyong Jin Shim, Yi Meng Lau, Swapna Gottipati

Research Collection School Of Computing and Information Systems

In recent years, virtual reality (VR) is gaining popularity amongst educators and learners. If a picture is worth a thousand words, a VR session is worth a trillion words. VR technology completely immerses users with an experience that transports them into a simulated world. Universities across the United States, United Kingdom, and other countries have already started using VR for higher education in areas such as medicine, business, architecture, vocational training, social work, virtual field trips, virtual campuses, helping students with special needs, and many more. In this paper, we propose a novel VR platform learning framework which maps elements …

Multi-Relation Extraction Via A Global-Local Graph Convolutional Network, Harry Cheng, Lizi Liao, Linmei Hu, Liqiang Nie

Research Collection School Of Computing and Information Systems

Relation extraction (RE) extracts the semantic relations among entities in a sentence, which converts the unstructured text into structured and easy-to-understand information. Although RE has been studied over decades, it still faces two kinds of research challenges that are not well addressed thus far: 1) joint consideration of the global sentence structure and the local entity interaction, and 2) effective solution to the overlapping triplets within the same sentence. To tackle these issues, in this paper, we present globallocal graph-based convolutional network towards multi-relation extraction, GAME for short. In particular, we devise two layers of graph convolutional network (GCN) with …

Prompting For Multimodal Hateful Meme Classification, Rui Cao, Roy Ka-Wei Lee, Wen-Haw Chong, Jing Jiang

Research Collection School Of Computing and Information Systems

Hateful meme classification is a challenging multimodal task that requires complex reasoning and contextual background knowledge. Ideally, we could leverage an explicit external knowledge base to supplement contextual and cultural information in hateful memes. However, there is no known explicit external knowledge base that could provide such hate speech contextual information. To address this gap, we propose PromptHate, a simple yet effective prompt-based model that prompts pre-trained language models (PLMs) for hateful meme classification. Specifically, we construct simple prompts and provide a few in-context examples to exploit the implicit knowledge in the pretrained RoBERTa language model for hateful meme classification. …

Developing And Facilitating Temporary Team Mental Models Through An Information-Sharing Recommender System, Geoffrey Musick

All Dissertations

It is well understood that teams are essential and common in many aspects of life, both work and leisure. Due to the importance of teams, much research attention has focused on how to improve team processes and outcomes. Of particular interest are the cognitive aspects of teamwork including team mental models (TMMs). Among many other benefits, TMMs involve team members forming a compatible understanding of the task and team in order to more efficiently make decisions. This understanding is sometimes classified using four TMM domains: equipment (e.g., operating procedures), task (e.g., strategies), team interactions (e.g., interdependencies) and teammates (e.g., tendencies). …

Design And Comparison Of Asynchronous Fft Implementations, Julie Bigot

Graduate Theses and Dissertations

Fast Fourier Transform (FFT) is a widely used digital signal processing technology in a large variety of applications. For battery-powered embedded systems incorporating FFT, its physical implementation is constrained by strict power consumption, especially during idle periods. Compared to the prevailing clocked synchronous counterpart, quasi-delay insensitive asynchronous circuits offer a series of advantages including flexible timing requirement and lower leakage power, making them ideal choices for these systems. In this thesis work, various FFT configurations were implemented in the low-power Multi-Threshold NULL Convention Logic (MTNCL) paradigm. Analysis illustrates the area and power consumption trends along the changing of the number …

Electrical Modeling For Dynamic Performance Prediction And Optimization Of Mcpms Layout, Quang Minh Le

Graduate Theses and Dissertations

In recent years, the fast development of Multichip Power Modules (MCPM) packaging and Wide Bandgap (WBG) technology has enabled higher voltage and current ratings, better thermal performance, lower parasitic parameters, and higher mechanical reliability. However, the design of the MCPM layout is a multidisciplinary problem leading to many time-consuming analyses and tedious design processes. Because of these challenges, the design automation tool for MCPM layout has become an emerging research area and gained much attention from the power electronics community. The two critical objectives of a design automation tool for MCPM layout are fast and accurate models for design insights …