Graphics and Human Computer Interfaces Commons^™

Using Ai-Enabled Gaze Tracking System To Understand Comprehension Patterns Of Computer Science Students, Bradley Boswell

College of Graduate Studies: Theses & Dissertations

Academic institutions and instructors lack the ability to accurately assess the moment-to-moment attentiveness of students in classrooms where students’ faces are obscured by computer monitors. This can cause the lectures of Computer Science, Information Technology, or other lab-based courses to be incorrectly-paced, which can lead to students having an overall poorer grasp of the subject material. We propose a system for real-time accurate detection of classroom attentiveness using monitor-mounted webcams and eye trackers, along with a Convolutional Neural Network machine learning model (NiCATS). Through the use of a neural network, we produce an initial attentiveness score based on student webcam …

Can I Touch The Clothes On The Screen? The Touch Effect In Online Shopping, Ha Kyung Lee, Dooyoung Choi

STEMPS Faculty Publications

We examined the interplay effects of device types (touch vs. non-touch) and the tactile sensitivity (fur vs. woven) on the product attitudes mediated by the mental simulation for touch. The participants from MTurk were randomly assigned to one of two tactile conditions. Responses from those who used tablets (n=83, touch device) and laptops (n=96, non-touch device) were included in the analysis. The main effects of device types and tactile-sensitivity on the mental simulation for touch were significant. The interaction effect of device types and tactile sensitivity was also significant. Those participants seeing the less tactile-sensitive product showed greater mental simulation …

Augmented Reality Integrated Welder Training For Mechanical Engineering Technology, Aditya Akundi, Hamid Eisazadeh, Mona Torabizadeh

Engineering Technology Faculty Publications

The shortage of welders is well documented and projected to become more severe for various industries such as shipbuilding in coming years. It is mainly because welding training is a critical and often costly endeavor. This study examines the training potential using augmented reality technology as a critical part of welder training for mechanical engineering technology students. This study assessed the performance of two groups of MET students trained with two different methods. One group received training with the traditional method in three sessions. The second group acquired training initially with an augmented reality welding system for three sessions. Then, …

The Effect Of Touch Simulation In Virtual Reality Shopping, Ha Kyung Lee, Namhee Yoon, Dooyoung Choi

STEMPS Faculty Publications

This study aims to explore the effect of touch simulation on virtual reality (VR) store satisfaction mediated by VR shopping self-efficacy and VR shopping pleasure. The moderation effects of the autotelic and instrumental need for touch between touch simulation and VR store satisfaction are also explored. Participants wear a head-mounted display VR device (Oculus Go) in a controlled laboratory environment, and their VR store experience is recorded as data. All participants’ responses (n = 58) are analyzed using SPSS 20.0 for descriptive statistics, reliability analysis, exploratory factor analysis, and the Process macro model analysis. The results show that touch simulation …

"What's In A Name?”: The Use Of Instructional Design In Overcoming Terminology Barriers Associated With Dark Patterns, Andrea Curley, Damian Gordon, Dympna O'Sullivan

Conference Papers

Many users experience a phenomena when they are shopping on-line where they feel they are being pressured to either spend more money than they had intended, or to share more personal data than they wanted. In academic circles we use the term “Dark Patterns” to describe these deceptive practices, and categorize them as being within the discipline of User Experience (Narayanan, 2020). As academics it is important to name phenomena, and to categorize them, so that we can discuss and analyze these issues. However, this particular topic is one that all users should be made aware of when interacting online, …

Eye Movement And Pupil Measures: A Review, Bhanuka Mahanama, Yasith Jayawardana, Sundararaman Rengarajan, Gavindya Jayawardena, Leanne Chukoskie, Joseph Snider, Sampath Jayarathna

Computer Science Faculty Publications

Our subjective visual experiences involve complex interaction between our eyes, our brain, and the surrounding world. It gives us the sense of sight, color, stereopsis, distance, pattern recognition, motor coordination, and more. The increasing ubiquity of gaze-aware technology brings with it the ability to track gaze and pupil measures with varying degrees of fidelity. With this in mind, a review that considers the various gaze measures becomes increasingly relevant, especially considering our ability to make sense of these signals given different spatio-temporal sampling capacities. In this paper, we selectively review prior work on eye movements and pupil measures. We first …

Toward A Real-Time Index Of Pupillary Activity As An Indicator Of Cognitive Load, Gavindya Jayawardena, Yasith Jayawardana, Sampath Jayarathna, Jonas Högström, Thomas Papa, Deepak Akkil, Andrew T. Duchowski, Vsevolod Peysakhovich, Izabela Krejtz, Nina Gehrer, Krzysztof Krejtz

Computer Science Faculty Publications

The Low/High Index of Pupillary Activity (LHIPA), an eye-tracked measure of pupil diameter oscillation, is redesigned and implemented to function in real-time. The novel Real-time IPA (RIPA) is shown to discriminate cognitive load in re-streamed data from earlier experiments. Rationale for the RIPA is tied to the functioning of the human autonomic nervous system yielding a hybrid measure based on the ratio of Low/High frequencies of pupil oscillation. The paper's contribution is drawn from provision of documentation of the calculation of the RIPA. As with the LHIPA, it is possible for researchers to apply this metric to their own experiments …

Utilization Of Virtual Reality For General Education Purposes, Amit Lal

University of the Pacific Theses and Dissertations

The use of Virtual Reality (VR) in a variety of professional, military, governmental, and educational fields has continued to expand over the past several decades, and the recent Covid-19 pandemic has brought attention to this field. This study surveys 154 college students over 23 questions that include various demographics that can be used to look for discriminators, multiple-choice VR-related questions, as well as a few free-form questions about use of VR in learning environments. The students’ experience with, interest in, and thoughts on how to best use VR vary considerably. The Covid-19 pandemic is found to have limited impact thus …

Multi-User Eye-Tracking, Bhanuka Mahanama

Computer Science Faculty Publications

The human gaze characteristics provide informative cues on human behavior during various activities. Using traditional eye trackers, assessing gaze characteristics in the wild requires a dedicated device per participant and therefore is not feasible for large-scale experiments. In this study, we propose a commodity hardware-based multi-user eye-tracking system. We leverage the recent advancements in Deep Neural Networks and large-scale datasets for implementing our system. Our preliminary studies provide promising results for multi-user eye-tracking on commodity hardware, providing a cost-effective solution for large-scale studies.

Temporally Sliced Photon Primitives For Volumetric Time-Of-Flight Rendering, Yang Liu

Dartmouth College Master’s Theses

Traditional steady-state rendering assumes that the light transport has already reached equilibrium. In contrast, time-of-flight rendering removes this assumption and recovers the pattern of light at extremely high temporal resolutions. This novel rendering modality not only provides a way to visualize the propagation of light, but can also empower the advances in time-of-flight imaging and its corresponding applications.

Building on previous work in steady-state volumetric rendering, this thesis introduces a novel framework for deriving new Monte Carlo estimators for solving the time-of-flight rendering problem in participating media. Conceptually, our method starts with any steady-state photon primitive, like a photon plane …

Attempts To Measure Nanosecond Resolved Electronic Dynamics Of Charge Density Wave Phase Transition In 1t-Tas2, Ben Campbell

Honors Theses and Capstones

Scanning tunneling microscopes allow for atomic spatial resolution but the resulting images are necessarily time-averaged and fast dynamics are lost. Pump-probe spectroscopy is a common optical technique used to measure ultrafast electronic dynamics but the integration of optical pump-probe spectroscopy into an STM requires specialized knowledge and equipment. Alternatively, an all-electronic pump-probe spectroscopy technique has recently been developed for use with an STM that replaces the laser pulses of optical pump-probe with voltage pulses. In this paper, I implemented an all-electronic pump-probe scheme into an existing scanning tunneling microscope using an arbitrary waveform generator and a lock-in amplifier. I developed …

Realtime Event Detection In Sports Sensor Data With Machine Learning, Mallory Cashman

Honors Theses and Capstones

Machine learning models can be trained to classify time series based sports motion data, without reliance on assumptions about the capabilities of the users or sensors. This can be applied to predict the count of occurrences of an event in a time period. The experiment for this research uses lacrosse data, collected in partnership with SPAITR - a UNH undergraduate startup developing motion tracking devices for lacrosse. Decision Tree and Support Vector Machine (SVM) models are trained and perform with high success rates. These models improve upon previous work in human motion event detection and can be used a reference …

Humans And The Core Partition: An Agent-Based Modeling Experiment, Andrew J. Collins, Sheida Etemadidavan

Engineering Management & Systems Engineering Faculty Publications

Although strategic coalition formation is traditionally modeled using cooperative game theory, behavioral game theorists have repeatedly shown that outcomes predicted by game theory are different from those generated by actual human behavior. To further explore these differences, in a cooperative game theory context, we experiment to compare the outcomes resulting from human participants’ behavior to those generated by a cooperative game theory solution mechanism called the core partition. Our experiment uses an interactive simulation of a glove game, a particular type of cooperative game, to collect the participant’s decision choices and their resultant outcomes. Two different glove games are considered, …

User Experience Design Practices In Industry (Case Study From Indonesian Information Technology Companies), Isnan Nugraha, Agung Fatwanto

Elinvo (Electronics, Informatics, and Vocational Education)

User Experience (UX) is a term that has received a lot of attention in the last decade. The number of industries whose consider the importance of implementing the UX design process within their development cycle has increased. Therefore, we think it is important to investigate how UX design processes are implemented in the industries. In this research, we take a qualitative approach with descriptive methods by investigating six information technology companies in Indonesia. As a result, we found that most of these information technology companies implement the UX design process as part of their operation and consider that the UX …

Evaluating Technology-Mediated Collaborative Workflows For Telehealth, Christopher Bondy Ph.D., Pengcheng Shi, Pamela Grover Md, Vicki Hanson, Linlin Chen, Rui Li

Articles

Goals: This paper discusses the need for a predictable method to evaluate gains and gaps of collaborative technology-mediated workflows and introduces an evaluation framework to address this need. Methods: The Collaborative Space Analysis Framework (CS-AF), introduced in this research, is a cross-disciplinary evaluation method designed to evaluate technology-mediated collaborative workflows. The 5-step CS-AF approach includes: (1) current-state workflow definition, (2) current-state (baseline) workflow assessment, (3) technology-mediated workflow development and deployment, (4) technology-mediated workflow assessment, (5) analysis, and conclusions. For this research, a comprehensive, empirical study of hypertension exam workflow for telehealth was conducted using the CS-AF approach. Results: The CS-AF …

What Interactive Web Features Are Most Used, Travis Tyler

Experiential Learning Projects

The use of interactive features in websites has become common place on the internet. People use these tools to help navigate and understand the content related to that website. However, due the large variety of websites it can be tricky to understand what features are best to utilize based on the topic of your site. This paper seeks to address this issue by researching how users interact and utilized different features on different websites. Research is gathered via scholarly articles and direct data gathered from volunteers. This data shows users tend to favor more interactive tools to help with navigation, …

Evaluation Of Gpu Acceleration For Wrf–Sfire, Joshua Benz

Master's Projects

WRF–SFIRE is an open source, atmospheric–wildfire model that couples the WRF model with the level set fire spread model to simulate wildfires in real time. This model has many applications and more scientific questions can be asked and answered if the model can be run faster. Nvidia has put a lot of effort into easing the barrier of entry for accelerating applications with their tools to be run on GPUs. Various physical simulations have been successfully ported to utilize GPUs and have benefited from the speed increase. In this research, we take a look at WRF-SFIRE and try to use …

Winter 2021

In The Loop

2021 Emmy Nominees; Animator Tapped by Cartoon Network; IndieCade Horizons 2021; Hack4Space; Security Daemons Prevail; Role Models: DePaul Originals Game Studio students build industry-level skills that benefit themselves and others; Frames and Fortune: Eugene Bush programmed his indie video studio with patience and planning; Reality Check: Heather Snyder Quinn augments reality to question systems of unchecked power

Comparative Analysis Of Rgb-Based Eye-Tracking For Large-Scale Human-Machine Applications, Brett Thaman, Trung Cao

Posters-at-the-Capitol

Gaze tracking has become an established technology that enables using an individual’s gaze as an input signal to support a variety of applications in the context of Human-Computer Interaction. Gaze tracking primarily relies on sensing devices such as infrared (IR) cameras. Nevertheless, in the recent years, several attempts have been realized at detecting gaze by acquiring and processing images acquired from standard RGB cameras. Nowadays, there are only a few publicly available open-source libraries and they have not been tested extensively. In this paper, we present the result of a comparative analysis that studied a commercial eye-tracking device using IR …

Markdown To Question & Test Interoperability, Su Kim

Master's Projects

As the classroom setting shifted to a virtual one as a result of Covid-19, numerous software are readily available to accommodate for the change, including Canvas, the online course management system. Canvas has a core feature that allows teachers to generate and administer quizzes for students through their interface, but it does not fully utilize the potential with online exams. The first step to exploring this potential is this project, known as Markdown to Question & Test Interoperability (M2QTI). Based on the QTI specifications, this tool lets users to plan and write quizzes in Markdown format. Combined with Canvas’s ability …