Engineering Commons^™

Advancing Omnimodality: Expanding Human Creativity Through Adaptable And Accessible Multimodal Computing Systems, Joshua Urban Davis

Dartmouth College Ph.D Dissertations

Emerging technologies have given us a whole host of new ways for people to be

creative. From the immersive worlds of AR/VR to the synthesis powers of largelanguage

models and generative AI, these new tools hold the potential to reshape

human expression and creativity. But how can we ensure that these new modalities

are accessible to everyone, even those who aren’t able bodied? This thesis advocates

for a human-centered approach to the development of many-modal systems. I will

probe how our machines support, direct, or inhibit creativity as a mode of problem

solving through 6 novel multimodal prototype interfaces and …

Diegetic Sonification For Low Vision Gamers, Jhané Dawes

Master's Theses

There are not many games designed for all players that provide accommodations for low vision users. This means that low vision users may not get to engage with the gaming community in the same way as their sighted peers. In this thesis, I explore how diegetic sonification can be used as a tool to support these low vision gamers in the typical gaming environment. I asked low vision players to engage with a prototype game level with two diegetic sonification techniques applied, without the use of their corrective lenses. I found that participants had more enjoyment and experienced less difficulty …

Computer Enabled Interventions To Communication And Behavioral Problems In Collaborative Work Environments, Ashutosh Shivakumar

Browse all Theses and Dissertations

Task success in co-located and distributed collaborative work settings is characterized by clear and efficient communication between participating members. Communication issues like 1) Unwanted interruptions and 2) Delayed feedback in collaborative work based distributed scenarios have the potential to impede task coordination and significantly decrease the probability of accomplishing task objective. Research shows that 1) Interrupting tasks at random moments can cause users to take up to 30% longer to resume tasks, commit up to twice the errors, and experience up to twice the negative effect than when interrupted at boundaries 2) Skill retention in collaborative learning tasks improves with …

Computational Modeling Of Facial Response For Detecting Differential Traits In Autism Spectrum Disorders, Manar D. Samad

Electrical & Computer Engineering Theses & Dissertations

This dissertation proposes novel computational modeling and computer vision methods for the analysis and discovery of differential traits in subjects with Autism Spectrum Disorders (ASD) using video and three-dimensional (3D) images of face and facial expressions. ASD is a neurodevelopmental disorder that impairs an individual’s nonverbal communication skills. This work studies ASD from the pathophysiology of facial expressions which may manifest atypical responses in the face. State-of-the-art psychophysical studies mostly employ na¨ıve human raters to visually score atypical facial responses of individuals with ASD, which may be subjective, tedious, and error prone. A few quantitative studies use intrusive sensors on …

Graph-Based Data Visualization In Virtual Reality: A Comparison Of User Experiences, Paul Andrew Sullivan

Master's Theses

Virtual reality is currently in the spotlight, attracting intense scrutiny by the press, technology companies, and consumers. After twenty years of dormancy, the technology has experienced a renaissance following advancements in both hardware and software. Most of these developments, and thus press attention, have been centered on entertainment. However, if the technology is going to continue to grow, it must be useful in a wide variety of situations. This paper explores the effectiveness of visualizing data in virtual reality in comparison to traditional presentations.

In this thesis, we present an approach to displaying data in a virtual reality environment. We …

Facilitating Information Retrieval In Social Media User Interfaces, Anthony Costello

Electronic Theses and Dissertations

As the amount of computer mediated information (e.g., emails, documents, multi-media) we need to process grows, our need to rapidly sort, organize and store electronic information likewise increases. In order to store information effectively, we must find ways to sort through it and organize it in a manner that facilitates efficient retrieval. The instantaneous and emergent nature of communications across networks like Twitter makes them suitable for discussing events (e.g., natural disasters) that are amorphous and prone to rapid changes. It can be difficult for an individual human to filter through and organize the large amounts of information that can …

Gesture Based Home Automation For The Physically Disabled, Alexander Hugh Nelson

Graduate Theses and Dissertations

Paralysis and motor-impairments can greatly reduce the autonomy and quality of life of a patient while presenting a major recurring cost in home-healthcare. Augmented with a non-invasive wearable sensor system and home-automation equipment, the patient can regain a level of autonomy at a fraction of the cost of home nurses. A system which utilizes sensor fusion, low-power digital components, and smartphone cellular capabilities can extend the usefulness of such a system to allow greater adaptivity for patients with various needs. This thesis develops such a system as a Bluetooth enabled glove device which communicates with a remote web server to …

Bridging The Gap Between Fun And Fitness: Instructional Techniques And Real-World Applications For Full-Body Dance Games, Emiko Charbonneau

Electronic Theses and Dissertations

Full-body controlled games offer the opportunity for not only entertainment, but education and exercise as well. Refined gameplay mechanics and content can boost intrinsic motivation and keep people playing over a long period of time, which is desirable for individuals who struggle with maintaining a regular exercise program. Within this gameplay genre, dance rhythm games have proven to be popular with game console owners. Yet, while other types of games utilize story mechanics that keep players engaged for dozens of hours, motion-controlled dance games are just beginning to incorporate these elements. In addition, this control scheme is still young, only …

Mac's Fiesta: A Foreign Language Game For The Sifteo Platform, Karina Cordon

Computer Engineering

Mac’s Fiesta is a Spanish learning game designed on the Sifteo gaming platform for children ages four and up. The Sifteo gaming platform provides a new way of interacting with computers by giving users a set of tangible and interactive cubes. Each Sifteo cube has a clickable colored screen and can sense motion and adjacent blocks. Games on this platform are designed to encourage the development of core thinking skills. This project aims to explore how Sifteo cubes can be used for language learning as well as observe how effective they are as educational tools.

Development Of A Cognitive Work Analysis Framework Tutorial Using Systems Modeling Language, Wilfred Henry Wells

Electronic Theses and Dissertations

At the present time, most systems engineers do not have access to cognitive work analysis information or training in terms they can understand. This may lead to a disregard of the cognitive aspect of system design. The impact of this issue is system requirements that do not account for the cognitive strengths and limitations of users. Systems engineers cannot design effective decision support systems without defining cognitive work requirements. In order to improve system requirements, integration of cognitive work requirements into the systems engineering process has to be improved. One option to address this gap is the development of a …

Multi-Touch For General-Purpose Computing An Examination Of Text Entry, Paul David Varcholik

Electronic Theses and Dissertations

In recent years, multi-touch has been heralded as a revolution in humancomputer interaction. Multi-touch provides features such as gestural interaction, tangible interfaces, pen-based computing, and interface customization – features embraced by an increasingly tech-savvy public. However, multi-touch platforms have not been adopted as "everyday" computer interaction devices; that is, multi-touch has not been applied to general-purpose computing. The questions this thesis seeks to address are: Will the general public adopt these systems as their chief interaction paradigm? Can multi-touch provide such a compelling platform that it displaces the desktop mouse and keyboard? Is multi-touch truly the next revolution in human-computer …

Automated Semantic Understanding Of Human Emotions In Writing And Speech, Ricardo A. Calix

LSU Doctoral Dissertations

Affective Human Computer Interaction (A-HCI) will be critical for the success of new technologies that will prevalent in the 21st century. If cell phones and the internet are any indication, there will be continued rapid development of automated assistive systems that help humans to live better, more productive lives. These will not be just passive systems such as cell phones, but active assistive systems like robot aides in use in hospitals, homes, entertainment room, office, and other work environments. Such systems will need to be able to properly deduce human emotional state before they determine how to best interact with …

Episodic Memory Model For Embodied Conversational Agents, Miguel Elvir

Electronic Theses and Dissertations

Embodied Conversational Agents (ECA) form part of a range of virtual characters whose intended purpose include engaging in natural conversations with human users. While works in literature are ripe with descriptions of attempts at producing viable ECA architectures, few authors have addressed the role of episodic memory models in conversational agents. This form of memory, which provides a sense of autobiographic record-keeping in humans, has only recently been peripherally integrated into dialog management tools for ECAs. In our work, we propose to take a closer look at the shared characteristics of episodic memory models in recent examples from the field. …

Communication Blades: Modular Communications For Tangible And Embedded Interfaces, Karun Kumar Kallakuri

LSU Master's Theses

Bladed Tiles is a modular hardware toolkit for building tangible and embedded interface devices. It includes “function blades” and “interaction tiles,” which can provide a flexible, inexpensive, open-ended platform for constructing a wide variety of tangible and embedded interfaces. In this paper, we propose Communication Blades. These are a class of electronic modules with varied computational capabilities for interfacing devices built using bladed tiles toolkit and also for interfacing embedded devices as adapters with external communication networks. These blades provide flexibility by offering the ability to select between different communication technologies and connectivity by providing devices with interoperability over different …

The Contextable: Building And Testing An Intelligent, Context-Aware Kitchen Table, Daniel Matthew Hoopes

Theses and Dissertations

The purpose of this thesis was to design and evaluate The ContexTable, a context-aware system built into a kitchen table. After establishing the current status of the field of context-aware systems and the hurdles and problems being faced, a functioning prototype system was designed and built. The prototype makes it possible to explore established, untested theory and novel solutions to problems faced in the field.

A Comparison Of Alphanumeric, Direct Manipulation Graphic, And Equivalent Interface Design For A Production Scheduling Task, Ann C. Fulop

Psychology Theses & Dissertations

Scheduling is an essential factor influencing the efficiency of any production system. The effectiveness of the scheduling system depends upon the interaction of the human and machine. Thus, to effectively design the interface between the human and the machine, the human factors professional must understand scheduling behavior and the information requirements of the scheduling task. The present study modeled human scheduling behavior and determined the information requirements of the scheduling task. The study also compared alphanumeric, direct manipulation graphic, and equivalent interfaces to determine which interface best supports scheduling. The results of the study show that schedulers monitor the current …