Graphics and Human Computer Interfaces Commons^™

Experimental Analysis Of Satellite Operator Training Using Game-Based Virtual Reality Simulation, Lana Laskey

Doctoral Dissertations and Master's Theses

Satellite data plays a vital role in modern global infrastructure by enabling communications, navigation, and weather forecasting. As demand for satellite technology grows, so does the need for highly trained satellite ground operators. Traditional training regimens for satellite operators employ simulation using two-dimensional computer console displays paired with the varied ability of trainees to generate abstract mental imagery of the scenario. However, this development of mental imagery imposes a considerable learning curve and cognitive workload on the trainee, which may negatively impact the user experience and knowledge gained during the training scenario.

This experimental study investigated the effects of game-based …

Empowering Weight Loss: A Pragmatic Randomized Controlled Trial Of A Theory-Driven Self-Regulation Mobile App For Young Adults With Excess Body Weight, H. S. J. Chew, J. W. Ngooi, R. C. Du, P. Z. Chan, M. Jansson, B. Zhu, Y. Cao, Chong-Wah Ngo, R. Foo, A. Shabbir, D. Ho, N. Sevdalis, K. Y. Ngiam

Research Collection School Of Computing and Information Systems

Background/Introduction: Obesity is projected to affect more than half of the global population by 2035, posing significant health and economic challenges. While lifestyle modification is considered a cornerstone of weight management, its effectiveness often relies on substantial support systems. Purpose: This study aimed to evaluate the effectiveness of a 12-week, standalone Temporal Self-Regulation Theory (TST)-based weight loss mobile application, which integrates self-regulation techniques, food logging, and dietary nudging, in promoting weight loss among young adults with excess body weight. Methods: A two-arm, parallel-group, 1:1 randomized controlled trial was conducted, adhering to the CONSORT-Outcomes 2022 Extension guidelines. Participants completed a face-to-face …

Hdifftg: A Lightweight Hybrid Diffusion-Transformer-Gcn Architecture For 3d Human Pose Estimation, Yajie Fu, Chaorui Huang, Junwei Li, Hui Kong, Yibin Tian, Huakang Li, Zhiyuan Zhang

Research Collection School Of Computing and Information Systems

We propose HDiffTG, a novel 3D Human Pose Estimation (3DHPE) method that integrates Transformer, Graph Convolutional Network (GCN), and diffusion model into a unified framework. HDiffTG leverages the strengths of these techniques to significantly improve pose estimation accuracy and robustness while maintaining a lightweight design. The Transformer captures global spatiotemporal dependencies, the GCN models local skeletal structures, and the diffusion model provides step-by-step optimization for fine-tuning, achieving a complementary balance between global and local features. This integration enhances the model’s ability to handle pose estimation under occlusions and in complex scenarios. Furthermore, we introduce lightweight optimizations to the integrated model …

Retrieval Augmented Generation For Dynamic Graph Modeling, Yuxia Wu, Lizi Liao, Yuan Fang

Research Collection School Of Computing and Information Systems

Modeling dynamic graphs, such as those found in social networks, recommendation systems, and e-commerce platforms, is crucial for capturing evolving relationships and delivering relevant insights over time. Traditional approaches primarily rely on graph neural networks with temporal components or sequence generation models, which often focus narrowly on the historical context of target nodes. This limitation restricts the ability to adapt to new and emerging patterns in dynamic graphs. To address this challenge, we propose a novel framework, Retrieval-Augmented Generation for Dy namic Graph modeling (RAG4DyG ), which enhances dynamic graph predictions by incorporating contextually and temporally relevant examples from broader …

Robust Relevance Feedback For Interactive Known-Item Video Search, Zhixin Ma, Chong-Wah Ngo

Research Collection School Of Computing and Information Systems

Known-item search (KIS) involves only a single search target, making relevance feedback-typically a powerful technique for efficiently identifying multiple positive examples to infer user intent-inapplicable. PicHunter addresses this issue by asking users to select the top-k most similar examples to the unique search target from a displayed set. Under ideal conditions, when the user's perception aligns closely with the machine's perception of similarity, consistent and precise judgments can elevate the target to the top position within a few iterations. However, in practical scenarios, expecting users to provide consistent judgments is often unrealistic, especially when the underlying embedding features used for …

Grokformer: Graph Fourier Kolmogorov‑Arnold Transformers, Guoguo Ai, Guansong Pang, Hezhe Qiao, Yuan Gao, Hui Yan

Research Collection School Of Computing and Information Systems

Graph Transformers (GTs) have demonstrated remarkable performance in graph representation learning over popular graph neural networks (GNNs). However, self-attention, the core module of GTs, preserves only low-frequency signals in graph features, leading to ineffectiveness in capturing other important signals like high-frequency ones. Some recent GT models help alleviate this issue, but their flexibility and expressiveness are still limited since the filters they learn are fixed on predefined graph spectrum or spectral order. To tackle this challenge, we propose a Graph Fourier Kolmogorov-Arnold Transformer (GrokFormer), a novel GT model that learns highly expressive spectral filters with adaptive graph spectrum and spectral …

Advancing Food Nutrition Estimation Via Visual-Ingredient Feature Fusion, Huiyan Qi, Bin Zhu, Chong-Wah Ngo, Jingjing Chen, Ee-Peng Lim

Research Collection School Of Computing and Information Systems

Nutrition estimation is an important component of promoting healthy eating and mitigating diet-related health risks. Despite advances in tasks such as food classification and ingredient recognition, progress in nutrition estimation is limited due to the lack of datasets with nutritional annotations. To address this issue, we introduce FastFood, a dataset with 84,446 images across 908 fast food categories, featuring ingredient and nutritional annotations. In addition, we propose a new model-agnostic Visual-Ingredient Feature Fusion (VIF2 ) method to enhance nutrition estimation by integrating visual and ingredient features. Ingredient robustness is improved through synonym replacement and resampling strategies during training. The ingredient-aware …

Cracking Aegis: An Adversarial Llm-Based Game For Raising Awareness Of Vulnerabilities In Privacy Protection, Jiaying Fu, Yiyang Lu, Zehua Yang, Fiona Fui-Hoon Nah, Ray Lc

Research Collection School Of Computing and Information Systems

Traditional methods for raising awareness of privacy protection often fail to engage users or provide hands-on insights into how privacy vulnerabilities are exploited. To address this, we incorporate an adversarial mechanic in the design of the dialogue-based serious game Cracking Aegis. Leveraging LLMs to simulate natural interactions, the game challenges players to impersonate characters and extract sensitive information from an AI agent, Aegis. A user study (n=22) revealed that players employed diverse deceptive linguistic strategies, including storytelling and emotional rapport, to manipulate Aegis. After playing, players reported connecting in-game scenarios with real-world privacy vulnerabilities, such as phishing and impersonation, and …

Full-Stack Web Applications: Infrastructure, Development Pipelines & Devsecops, Yassine Chahid, Patrick Slattery

Publications and Research

This research explores emerging development methodologies and technologies which facilitate the deployment and maintenance of software applications. It evaluates architectural styles for the development of software such as monolithic (legacy) and microservice models, with a focus on their key differences such as scalability or project structure through to the development of an application. By examining methodologies such as Agile and continuous integration/continuous development pipelines along with the deployment tools Docker and Git for version/release control, the study analyzes how these innovations speed up development, improve existing practices, and serve as the foundation for development operations. Cloud solutions for tasks such …

Instruct2see: Learning To Remove Any Obstructions Across Distributions, Junhang Li, Yu Guo, Chuhua Xian, Shengfeng He

Research Collection School Of Computing and Information Systems

Images are often obstructed by various obstacles due to capture limitations, hindering the observation of objects of interest. Most existing methods address occlusions from specific elements like fences or raindrops, but are constrained by the wide range of real-world obstructions, making comprehensive data collection impractical. To overcome these challenges, we propose Instruct2See, a novel zero-shot framework capable of handling both seen and unseen obstacles. The core idea of our approach is to unify obstruction removal by treating it as a soft-hard mask restoration problem, where any obstruction can be represented using multi-modal prompts, such as visual semantics and textual instructions, …

Action Dubber: Timing Audible Actions Via Inflectional Flow, Wenlong Wan, Weiying Zheng, Tianyi Xiang, Guiqing Li, Shengfeng He

Research Collection School Of Computing and Information Systems

We introduce the task of Audible Action Temporal Localization, which aims to identify the spatiotemporal coordinates of audible movements. Unlike conventional tasks such as action recognition and temporal action localization, which broadly analyze video content, our task focuses on the distinct kinematic dynamics of audible actions. It is based on the premise that key actions are driven by inflectional movements; for example, collisions that produce sound often involve abrupt changes in motion. To capture this, we propose T A2Net, a novel architecture that estimates inflectional flow using the second derivative of motion to determine collision timings without relying on audio …

Unambiguous Granularity Distillation For Asymmetric Image Retrieval, Hongrui Zhang, Yi Xie, Haoquan Zhang, Cheng Xu, Xuandi Luo, Donglei Chen, Xuemiao Xu, Huaidong Zhang, Pheng Ann Heng, Shengfeng He

Research Collection School Of Computing and Information Systems

Previous asymmetric image retrieval methods based on knowledge distillation have primarily focused on aligning the global features of two networks to transfer global semantic information from the gallery network to the query network. However, these methods often fail to effectively transfer local semantic information, limiting the fine-grained alignment of feature representation spaces between the two networks. To overcome this limitation, we propose a novel approach called Layered-Granularity Localized Distillation (GranDist). GranDist constructs layered feature representations that balance the richness of contextual information with the granularity of local features. As we progress through the layers, the contextual information becomes more detailed, …

Classification Of Human Trust In Ai Using Brain Activity Data, Danushka Bandara, Ruhuan Liao, Fatima Chowdhury, Leslie Abbott

Northeast Journal of Complex Systems (NEJCS)

Trust plays a crucial role in human-computer interaction, particularly in scenarios involving artificial intelligence (AI) systems. This study explores the feasibility of using functional near-infrared spectroscopy (fNIRS) data to classify trust levels in human-AI interaction scenarios. A total of 18 participants completed an image classification task with an AI team member while their hemodynamic responses were recorded using fNIRS. Preprocessing of fNIRS data involved motion artifact removal, filtering, and normalization. Exploratory analysis identified significant associations between hemodynamic responses in the prefrontal cortex and trust levels. An across-subject binary trust classification model was developed using machine learning techniques, achieving an F1 …

Multi-Level Differentiable Moving Particles With Partition Of Unity, Jinjin He

Dartmouth College Master’s Theses

Representing implicit geometry with intricate features has long been a challenge. Recent advances in Implicit Neural Representations (INRs) have shown great promise in applications such as 3D reconstruction, inverse rendering, and dynamic surface evolution. These methods leverage neural networks to model complex shapes continuously, offering advantages in resolution and flexibility over traditional discrete representations. Despite their success, efficiently handling fine geometric details and evolving dynamic scenes remains an open problem.

We introduce a differentiable moving particle representation based on the multi-level partition of unity (MPU) to model dynamic implicit geometries efficiently. Our approach employs two types of particles—feature particles and …

Tellings Of The Pacific Ocean: A Landscape-Based Approach For Multispecies Design And Hci, Maliheh Ghajargar

Engineering Faculty Articles and Research

Environmental disturbances induced by climate change have caused significant changes in our ecosystems and are threatening the health of our environments. As a response to this issue, a growing body of work has emerged in HCI and design, which seeks to foreground more-than-human stories in support of making more sustainable and just futures. This research contributes to this broad agenda by probing graphic novels as a multispecies storytelling method for design and HCI. Combining ideas from Anna Tsing’s adventures of landscape and from HCI and design’s use of sequential art (e.g., storyboards), we use landscape as the main protagonist of …

The Impact Of Accessibility Features On Player Experience In Video Games, Christine M. Widden

Master's Theses

While video game accessibility is a growing research topic, few studies investigate how players perceive the presence versus the absence of accessibility features, or how non-disabled players react to the option of accessibility features. This study explores these research gaps, investigating how access to accessibility features affects the experience of both disabled and non-disabled players. For the purposes of this study, a small platformer game was developed with as many accessibility features as feasible for the scope of the project. An A vs.\ B study was conducted in the game, with anonymous participants randomly assigned to version A, with all …

A Digital Dive: Redesigning The Cabrillo High School Aquarium Website, Jacob V. Cacho

Graphic Communication

Tucked away on the Central Coast in Lompoc, you’ll find the Cabrillo High School (CHS) Aquarium. Started in 1986, the CHS Aquarium is the only high school aquarium of its kind in the nation run entirely by high school students. This 10,000+ square foot aquarium serves an underserved community at a Title I school, where students manage all aspects of animal care, nutrition, breeding, educational curriculum development, and visitor tours.

This program is truly one-of-a-kind and deserves the spotlight for just how unique it is. As a CHS graduate, I felt the current website lacked in many areas and could …

Community Detection In Heterogeneous Information Networks Without Materialization, Jiaxin Jiang, Siyuan Yao, Yuhang Chen, Bingsheng He, Yudong Niu, Yuchen Li, Shixuan Sun, Yongchao Liu

Research Collection School Of Computing and Information Systems

Community detection in heterogeneous information networks (HINs) poses significant challenges due to the diversity of entity types and the complexity of their interrelations. While traditional algorithms may perform adequately in some scenarios, many struggle with the high memory usage and computational demands of large-scale HINs. To address these challenges, we introduce a novel framework, SCAR, which efficiently uncovers community structures in HINs without requiring network materialization. SCAR leverages insights from meta-paths to interpret multi-relational data through compact vertex-based sketches, significantly reducing computational overhead and materialization overhead. We propose a sketch-based technique for estimating changes in modularity, improving both the precision …

Nexusgs: Sparse View Synthesis With Epipolar Depth Priors In 3d Gaussian Splatting, Yulong Zheng, Zicheng Jiang, Shengfeng He, Yandu Sun, Junyu Dong, Huaidong Zhang, Yong Du

Research Collection School Of Computing and Information Systems

Neural Radiance Field (NeRF) and 3D Gaussian Splatting (3DGS) have noticeably advanced photo-realistic novel view synthesis using images from densely spaced camera viewpoints. However, these methods struggle in few-shot scenarios due to limited supervision. In this paper, we present NexusGS, a 3DGS-based approach that enhances novel view synthesis from sparse-view images by directly embedding depth information into point clouds, without relying on complex manual regularizations. Exploiting the inherent epipolar geometry of 3DGS, our method introduces a novel point cloud densification strategy that initializes 3DGS with a dense point cloud, reducing randomness in point placement while preventing over-smoothing and overfitting. Specifically, …

Event-Based Eye Tracking: Event-Based Vision Workshop 2025, Qinyu Chen, Et. Al.

Research Collection School Of Computing and Information Systems

No abstract provided.