Human-Computer Interaction Commons^™

The Self-Aware Room: A Framework For Operational Self-Awareness In Evolvable Blended Environments, David B. Smith

Publications and Research

The Self-Aware Room (SAR) is a room-scale research environment developed within the larger Balanced Blended Space and Blended Reality Performance System research trajectory. Rather than treating the room as a conventional “smart” environment composed of fixed automation technologies, SAR approaches it as an evolvable blended environment made from physical, virtual, conceptual, sensory, computational, and performative relationships. Its defining feature is not any particular sensor, model, or output device, but the set of transformations through which physical activity becomes structured observation, bounded representation, interpreted state, governed decision, and mediated response.

This paper develops the conceptual and methodological foundations of SAR as …

Understanding The Correlation Between Prediction Performance And Trust In Ai Through Scenario-Based Tasks, Likhitha Kammara

Theses and Dissertations

Trust in artificial intelligence is commonly assessed through self-reported scales or behavioral reliance, yet behavioral reliance is retrospective and can only be observed after a decision has already been made. This thesis examines whether prediction accuracy — a user's ability to predict what an AI system will recommend before its output is revealed — can serve as a prospective correlate of trust in the same empirical sense as behavioral reliance. The study was conducted in two phases using scenario-based AI decision tasks across disaster response, healthcare, and infrastructure restoration contexts, employing a between-group design in which participants either predicted AI …

Improving Urban Search And Rescue Team Coordination Through Adaptive Context Awareness, Daniel Reyes Duran

Doctoral Dissertations and Master's Theses

Modern multi-agent Urban Search and Rescue (USAR) operations heavily rely on mobile geospatial Common Operating Pictures (COPs) to maintain team coordination and Situational Awareness (SA). However, the proliferation of high-frequency sensor telemetry at the tactical edge has introduced a data saturation paradox challenge: while information theoretically drives informed decision-making, unmanaged data surges induce increased operator cognitive overload and alert fatigue on mobile End-User Devices (EUDs), while downstream data-broadcasting models inherently strain edge processing and viewport environments.

To resolve these constraints, this dissertation presents a context-aware Value of Information (VoI) data-management framework integrated directly with a custom, event-driven Android Team Awareness …

A Webcam Eye Tracking Infrastructure For Software Engineering Tasks, Zachary M. Kozak

School of Computing: Dissertations, Theses, and Student Research

Performing eye tracking utilizing commodity webcams has been explored for over a decade, but limited camera quality and sensitivity to head movements have hindered its adoption in research settings. Recent advances in consumer-grade webcams and machine learning methods present an opportunity to improve the accuracy of webcam eye tracking and extend the feasibility of studies beyond controlled laboratory environments.

Current popular webcam eye tracking methods restrict implementations to the browser and rely on continuous user interactions for calibration, limiting the kinds of studies that can be conducted. This thesis presents a feature-based gaze prediction system that incorporates eye geometry and …

Designing Narrative-Based Ai Assistance For Sensemaking In Collaborative Environments: Case Studies In Education And Dementia Care, Dylan Edward Moore

Dartmouth College Ph.D Dissertations

This thesis addresses a gap in the human-computer interaction literature regarding the design, development, and evaluation of narrative-based AI assistance for collaborative, complex problem solving. I explore this design space through three case studies across the domains of education and dementia care. This work encompasses multi-year industry partnerships and longitudinal fieldwork, user-centered design, dataset curation, model training, and system evaluation.

Specifically, the first case study considers a story-based web platform for teaching AI literacy through peer-generated, personalized narrative scaffolding. Learners on the platform showed significant knowledge gains and other learning-related outcomes. To describe the novel design of this system, I …

Handwriting Recognition In Vr, Dominique Mosley

EWU Masters Thesis Collection

Virtual Reality (VR) is slowly becoming more popular for more than just entertainment. VR can be found in educational, office, and even healthcare settings to help discover more intuitive ways to teach, collaborate, and treat patients. Outside of the virtual world, these environments typically rely on writing for communicating or note-taking. Currently, VR input forces users to rely on clunky on-screen keyboards which disrupts the user’s immersion and breaks the flow of natural interaction. This thesis explores the potential of VR as a learning platform by combining it with artificial intelligence (AI). It aims to develop a VR-enhanced handwriting practicing …