Human-Computer Interaction Commons^™

Designing Classifact: Towards A Transparent And Secure Platform For Stakeholder-In-The-Loop Data Annotation, Philippine Waisvisz

Communications of the IIMA

AI systems depend on human judgment, yet many annotation workflows are either designed for data-science specialists or managed through external commercial platforms. The first approach may demand more technical skills than relevant stakeholders possess. The second can require organizations to transfer data, expertise, and governance to an outside provider. Both can limit the involvement of people who understand what data means in its real-world context. Human-in-the-loop approaches introduce human judgment. Stakeholder-in-the-loop annotation focuses on selecting and organizing people whose contextual knowledge fits the AI application.

This paper presents Classifact, a transparent and secure platform for stakeholder-in-the-loop data annotation and validation. …

From Retrieval To Generation: Building And Evaluating An Ai Accompanist For Piano Duets With An Anticipatory Music Transformer, Sai Ruthvik Uppala

Masters Theses

Systems that accompany a live musician, such as ACCompanion, work by retrieval: they hold a written accompaniment and stretch its timing to follow the soloist, so they can only accompany music whose second part already exists as a score. This thesis asks whether that second part can instead be generated, and specifically whether a machine learning model can write an accompaniment for a piece whose score it has never seen. A player performs the primo, the melody; a model produces the secondo, the accompaniment; and a score follower places the generated notes against the live performance. If this works, a …

The Self-Aware Room: A Framework For Operational Self-Awareness In Evolvable Blended Environments, David B. Smith

Publications and Research

The Self-Aware Room (SAR) is a room-scale research environment developed within the larger Balanced Blended Space and Blended Reality Performance System research trajectory. Rather than treating the room as a conventional “smart” environment composed of fixed automation technologies, SAR approaches it as an evolvable blended environment made from physical, virtual, conceptual, sensory, computational, and performative relationships. Its defining feature is not any particular sensor, model, or output device, but the set of transformations through which physical activity becomes structured observation, bounded representation, interpreted state, governed decision, and mediated response.

This paper develops the conceptual and methodological foundations of SAR as …

Ai Cyber First Responders: Bottleneck Analysis Of Heterogeneous Cpu–Gpu Pipelines For Security Operations Center Triage, Christine Pierce

Harrisburg University Other Works

Abstract — Modern Security Operations Centers (SOCs) must continuously process massive volumes of heterogeneous security telemetry while meeting stringent throughput, latency, and operational continuity requirements. Although transformer-based artificial intelligence has significantly improved threat detection and alert prioritization, most cybersecurity research evaluates model accuracy rather than the end-to-end behavior of AI-enabled operational pipelines. Consequently, relatively little is known about how heterogeneous CPU–GPU coordination, scheduling overhead, memory movement, and synchronization collectively influence operational SOC performance. This paper presents the AI Cyber First Responder, a heterogeneous SOC triage architecture that integrates GPU-accelerated transformer inference with CPU-based doctrine-driven reasoning to investigate end-to-end pipeline behavior …

The Electric Crackdown: Exploring The Human Factors Impacts Of Controls & Displays In Evs Across The Market, Rae Okada, Robin Hanen, Liam Brennan

Discovery Day - Daytona Beach

Title: The Electric Crackdown: Exploring the Human Factors Impacts of Controls & Displays in Electric Vehicles Across the Market   Despite a global adoption of electric vehicles (EVs) with partial driving automation (i.e., advanced driver assistance systems; ADAS), differences exist at societal (i.e., legislation, regulation), individual (i.e., use of), and system (i.e., vehicle-to-vehicle) levels surrounding these vehicles. While these former societal divergences can be considered based on the: (1) mechanisms promoting or limiting EV adoption, (2) number of EVs on the road, and (3) respective incident reports; system differences require investigation for each vehicle based on its make and model. In …

Understanding The Correlation Between Prediction Performance And Trust In Ai Through Scenario-Based Tasks, Likhitha Kammara

Theses and Dissertations

Trust in artificial intelligence is commonly assessed through self-reported scales or behavioral reliance, yet behavioral reliance is retrospective and can only be observed after a decision has already been made. This thesis examines whether prediction accuracy — a user's ability to predict what an AI system will recommend before its output is revealed — can serve as a prospective correlate of trust in the same empirical sense as behavioral reliance. The study was conducted in two phases using scenario-based AI decision tasks across disaster response, healthcare, and infrastructure restoration contexts, employing a between-group design in which participants either predicted AI …

Enhancing Virtual Reality Cockpit Procedure Training With Haptic Feedback, Christian K. Jaedicke

Doctoral Dissertations and Master's Theses

Pilot training is time-consuming and costly, and not all phases require full-flight simulators or actual aircraft. Virtual reality (VR) offers a potential means to reduce cost and duration while supporting practical cockpit procedure training. While prior research in the VR domain suggests that providing haptic feedback can support training of muscular control and increase perceived immersion, it remains unclear whether haptic feedback improves spatial cognition in an unfamiliar VR environment. This study examined whether haptic feedback and cockpit complexity affected response time and position error under limited-visibility, time-constrained conditions in a VR cockpit environment (i.e., a quasi-blindfold cockpit check).

Grounded …

Improving Urban Search And Rescue Team Coordination Through Adaptive Context Awareness, Daniel Reyes Duran

Doctoral Dissertations and Master's Theses

Modern multi-agent Urban Search and Rescue (USAR) operations heavily rely on mobile geospatial Common Operating Pictures (COPs) to maintain team coordination and Situational Awareness (SA). However, the proliferation of high-frequency sensor telemetry at the tactical edge has introduced a data saturation paradox challenge: while information theoretically drives informed decision-making, unmanaged data surges induce increased operator cognitive overload and alert fatigue on mobile End-User Devices (EUDs), while downstream data-broadcasting models inherently strain edge processing and viewport environments.

To resolve these constraints, this dissertation presents a context-aware Value of Information (VoI) data-management framework integrated directly with a custom, event-driven Android Team Awareness …

System Integration And Validation Of The Cal Poly Spacecraft Attitude Dynamics Simulator Mk. Iv, Bricen S. Rigby

Master's Theses

The Cal Poly Spacecraft Attitude Dynamics Simulator (SADS) is an ongoing project that seeks to enable the simulation and validation of sensors, actuators, and control logic related to spacecraft attitude control. The SADS platform rests atop a spher- ical air-bearing device which allows for nearly frictionless rotation in all three axes. The orientation of the platform is controlled by four reaction wheels arranged in a pyramidal configuration. Over the past few years, there have been significant updates to the reaction wheel subsystem, as well as requests for a more capable central com- puter. Therefore, a new system architecture for the …

Ai-Augmented Financial Advisors: Comparing Ai And Human Analyst Investment Recommendations In Agreement, Performance, And Firm Size Effects, Crystal Chen

Honors College Theses

This study examines the level of agreement and performance between artificial intelligence (AI) generated investment recommendations and human analyst recommendations across U.S. publicly traded firms. Using a sample of twelve companies categorized by firm size (large, mid, and small), the study collects buy, hold, or sell recommendations from generative AI systems and human analysts. Agreement between AI-to-AI and AI-to-human recommendations is measured using Cohen’s Kappa agreement. Portfolio performance is evaluated by constructing equal-weighted portfolios for each recommendation source and size category. Risk-adjusted returns are measured using the Sharpe ratio over 1-, 2-, and 3-month periods. Furthermore, the study tests whether …

A Webcam Eye Tracking Infrastructure For Software Engineering Tasks, Zachary M. Kozak

School of Computing: Dissertations, Theses, and Student Research

Performing eye tracking utilizing commodity webcams has been explored for over a decade, but limited camera quality and sensitivity to head movements have hindered its adoption in research settings. Recent advances in consumer-grade webcams and machine learning methods present an opportunity to improve the accuracy of webcam eye tracking and extend the feasibility of studies beyond controlled laboratory environments.

Current popular webcam eye tracking methods restrict implementations to the browser and rely on continuous user interactions for calibration, limiting the kinds of studies that can be conducted. This thesis presents a feature-based gaze prediction system that incorporates eye geometry and …

Designing Narrative-Based Ai Assistance For Sensemaking In Collaborative Environments: Case Studies In Education And Dementia Care, Dylan Edward Moore

Dartmouth College Ph.D Dissertations

This thesis addresses a gap in the human-computer interaction literature regarding the design, development, and evaluation of narrative-based AI assistance for collaborative, complex problem solving. I explore this design space through three case studies across the domains of education and dementia care. This work encompasses multi-year industry partnerships and longitudinal fieldwork, user-centered design, dataset curation, model training, and system evaluation.

Specifically, the first case study considers a story-based web platform for teaching AI literacy through peer-generated, personalized narrative scaffolding. Learners on the platform showed significant knowledge gains and other learning-related outcomes. To describe the novel design of this system, I …

Handwriting Recognition In Vr, Dominique Mosley

EWU Masters Thesis Collection

Virtual Reality (VR) is slowly becoming more popular for more than just entertainment. VR can be found in educational, office, and even healthcare settings to help discover more intuitive ways to teach, collaborate, and treat patients. Outside of the virtual world, these environments typically rely on writing for communicating or note-taking. Currently, VR input forces users to rely on clunky on-screen keyboards which disrupts the user’s immersion and breaks the flow of natural interaction. This thesis explores the potential of VR as a learning platform by combining it with artificial intelligence (AI). It aims to develop a VR-enhanced handwriting practicing …