Graphics and Human Computer Interfaces Commons^™

Spatial Future Ahead! Augmented Reality And Anticipated Life Consequences, Sergio Barta, Reto Felix, Chris Hinsch, Mahdokht Kalantari, Nina Krey, Philipp A. Rauschnabel

Marketing Faculty Publications

Purpose: This study explores how initial exposure to immersive spatial computing experiences using AR headsets generates lasting inspiration and shapes consumers expected long-term life consequences (i.e., enhancement of reality, perceived substitutability and social impact).

Design/methodology/approach: The study uses a time-lagged research design based on 148 first-time users of spatial computing devices (AR headsets). Respondents were interviewed once shortly after being exposed to AR and a few days later. Data is analyzed using partial least squares structural equation modeling (PLS-SEM).

Findings: Users' immediate “inspired-by” experiences predict increased “inspired-to” intentions days later. Such inspiration translates into anticipated consequences such as virtually customizing …

Chopchop: The Digital Cookbook, Dominc Mcdevitt, Shane Misley, Katie Cerda, Kobie Henson, Adolfo Duran

Presentations - 2026

Problem With traditional recipe organization methods,

● Recipes are scattered across paper, PDFs, Word docs, and notes

● Paper recipes can be lost, damaged, or left at home

● Digital recipes are difficult to edit, store, and organize

● Manually typing or updating recipes is time-consuming

● Sharing recipes is inconvenient and often confusing

● Limited or inconsistent cloud access reduces accessibility

● Formatting is messy and inconsistent across platforms

● No simple, centralized system for managing recipes

Match-A-Fit, Adan Diaz De Leon, Juan Marco Saca Dada, Brianna Mendoza, Arsalan Kataneh, Theophile Nsabimana, Pedro Jacobo

Presentations - 2026

Welcome to Match-a-Fit! Match-a-Fit is an iOS application that allows the user to create a digital closet by uploading images of their clothing items. With AI, the program can generate outfits based on the digital closet, the time, and the occasion. Match-a-Fit’s purpose is designed to help users who struggle to get ready, run out of time, or can’t decide on an outfit, by easily generating outfit options based on the occasion.

Ai-Assisted 3d Pre-Visualization: Streamlining Animatics For Filmmakers, Nishit Thapa

Honors Theses

Pre-visualization is a core part of film pre-production. Creators use it to test blocking, lighting, camera movement, and spatial relationships before committing to a shot. Despite this, three-dimensional pre-visualization remains out of reach for many entry-level filmmakers, as the software is expensive and takes substantial time to learn.

Recent AI developments have produced generative systems capable of creating highly re-alistic imagery and video from text prompts. These systems open new possibilities for visual sto-rytelling but are not built for the iterative, hands-on process that pre-visualization requires, where creators must adjust scene parameters, camera logic, and spatial configurations throughout.

This thesis …

Match-A-Fit, Brianna Mendoza, Adan Diaz De Leon, Pedro Jacobo, Juan Marco Saca Dada

Posters - 2026

Welcome to Match-a-Fit! Match-a-Fit is an iOS application that allows the user to create a digital closet by uploading images of their clothing items. With AI, the program can generate outfits based on the digital closet, the time, and the occasion. Match-a-Fit’s purpose is designed to help users who struggle to get ready, run out of time, or can’t decide on an outfit, by easily generating outfit options based on the occasion.

Harvest Scanner, Alexander Murphy

Posters - 2026

In current times, people can find themselves at the whims of markets and may be spending more than they realize or want to on regular, everyday goods. New tools can help users keep track of the goods they are paying for. Harvest Scanner was developed to scan and track local grocery prices from stores using their publicly available website information. It was developed in Python using PyQt5 for GUI. The database is stored as an SQL file with Python using SQLite engine. Users will be able to view local grocery prices in a database interface (GUI). There are many features …

Topshelf, Ayden Jay Soliz

Posters - 2026

With so many great video games releasing each year, it becomes challenging to keep up with the latest. Players find it difficult to maintain an updated list of future games to play, and many existing online trackers have become too complicated to use. TopShelf is designed to be a simple video game backlogging website that will track games for the player. By connecting to an online video game database API, users can add/drop games from their personal list and enable tracking and receive emails for platform releasing. Gamers can leave all the tracking and updates responsibilities to TopShelf

Super Lidar Intensity For Robotic Perception, Wei Gao, Jie Zhang, Mingle Zhao, Zhiyuan Zhang, Shu Kong, Maani Ghaffari, Dezhen Song, Chengzhong Xu, Hui Kong

Research Collection School Of Computing and Information Systems

Conventionally, human intuition defines vision as a modality of passive optical sensing, relying on ambient light to perceive the environment. However, active optical sensing, which involves emitting and receiving signals, offers unique advantages by capturing both radiometric and geometric properties of the environment, independent of external illumination conditions. This work focuses on advancing active optical sensing using Light Detection and Ranging (LiDAR), which captures intensity data, enabling the estimation of surface reflectance that remains invariant under varying illumination. Such properties are crucial for robotic perception tasks, including detection, recognition, segmentation, and Simultaneous Localization and Mapping (SLAM). A key challenge with …

Learning Feature Inversion For Multi-Class Anomaly Detection Under General-Purpose Coco-Ad Benchmark, Jiangning Zhang, Chengjie Wang, Xiangtai Li, Guanzhong Tian, Zhucun Xue, Yong Liu, Guansong Pang, Dacheng Tao

Research Collection School Of Computing and Information Systems

Anomaly detection (AD) is often focused on detecting anomaly areas for industrial quality inspection and medical lesion examination. However, due to the specific scenario targets, the data scale for AD is relatively small, and evaluation metrics are still deficient compared to classic vision tasks, such as object detection and semantic segmentation. To fill these gaps, this work first constructs a large-scale and general-purpose COCO-AD dataset by extending COCO to the AD field. This enables fair evaluation and sustainable development for different methods on this challenging benchmark. Moreover, current metrics such as AU-ROC have nearly reached saturation on simple datasets, which …

From Spatial To Actions: Grounding Vision-Language-Action Model In Spatial Foundation Priors, Zhengshen Zhang, Hao Li, Yalun Dai, Zhengbang Zhu, Lei Zhou, Chenchen Liu, Dong Wang, Francis E. H. Tay, Sijin Chen, Ziwei Liu, Yuxiao Liu, Xinghang Li, Pan Zhou

Research Collection School Of Computing and Information Systems

Existing vision-language-action (VLA) models act in 3D real-world but are typically built on 2D encoders, leaving a spatial reasoning gap that limits generalization and adaptability. Recent 3D integration techniques for VLAs either require specialized sensors and transfer poorly across modalities, or inject weak cues that lack geometry and degrade vision-language alignment. In this work, we introduce FALCON (From Spatial to Action), a novel paradigm that injects rich 3D spatial tokens into the action head. FALCON leverages spatial foundation models to deliver strong geometric priors from RGB alone, and includes an Embodied Spatial Model that can optionally fuse depth, or pose …

Fallen Light (Video Game), Joshua Do

Presentations - 2026

Problem:

•People misunderstand Lucifer’s deception

•(shown through Temptation of Jesus in Matthew 4) •Lack of engaging ways to teach theological concepts   •Background: Lucifer corrupts not through force, but subtle self-elevation and doubt   Motivation:   •Just initially wanted to make a game of how sin entered the world for fun   •Just thought it was a cool idea in general.

Solution:

•Dialogue-driven narrative game   •6+ story chapters   •10+ regions   •Focused on spiritual conflict, deception, and discernment   •Uses event-based progression   •Presents Lucifer through subtle manipulation, by being a false light by choosing self-pleasure over what is right.

Fisheasy, Jake Rankin

Presentations - 2026

Problem: 
Inexperienced and experienced anglers lack necessary tools to begin fishing

Motivation:
Fishing is a fun hobby everyone should be able to enjoy – the lack of resources makes that difficult

Solution:
An application that integrates learning tutorials with helpful practices tools for both novice and experienced anglers

Foxbuddy, Luis Eduardo Garza Jr.

Presentations - 2026

Problem:
•Many people are still unprepared incase of an emergency. (42%-46% are prepared for an emergency)
•Supplies can be scattered, expired, or forgotten.   •Reliable guidance is often not easy to access.

Spinlock Game Engine, Shane Misley

Posters - 2026

Modern game engines prioritize developer convenience at the cost of performance and transparency. Large frameworks like Unity and Unreal Engine abstract away implementation details, which simplifies development but introduces computational overhead—often 40-50% of CPU and memory usage goes to engine infrastructure rather than the actual game. For developers targeting low-end hardware, older systems, or performance-critical applications, this overhead becomes prohibitive. The Spinlock Engine addresses this problem by adopting a "close-to-the-metal" philosophy, stripping away unnecessary abstraction layers to deliver raw speed and predictable behavior. Built in C++ with SDL3 and Raylib, Spinlock prioritizes memory efficiency, CPU optimization, and developer transparency—allowing you …

Chopchop: The Digital Cookbook, Dominc Mcdevitt, Shane Misley, Adolfo Duran, Katie Cerda, Kobie Henson

Posters - 2026

Many of today's home chefs still use the same limited methods of saving recipes that have been used for decades, i.e. handwritten notes, disorganized pdfs, screenshots, saved text messages, etc. Not only are these formats hard to keep track of and easily lost, but they also suffer the risk of becoming irrevocably damaged or stained in the cooking process. They are also notoriously hard to edit, which limits a chef's ability to tailor recipes to their taste, their available ingredients, or even just a different serving size. Another major issue with these approaches is the lack of easy sharing. Giving …

Semat: Semantic Enhanced Natural Image Interactive Matting, Ruihao Xia, Yu Liang, Peng-Tao Jiang, Hao Zhang, Qianru Sun, Yang Tang, Bo Li, Pan Zhou

Research Collection School Of Computing and Information Systems

Recent approaches attempt to adapt powerful interactive segmentation models, such as SAM, to interactive matting and fine-tune the models based on synthetic matting datasets. However, models trained on synthetic data fail to generalize to complex and occlusion scenes. We address this challenge by proposing a new matting dataset based on the COCO dataset, namely COCO-Matting. It selects real-world complex images from COCO and converts semantic segmentation masks to matting labels. The built COCO-Matting comprises an extensive collection of 36,980 human instance-level alpha mattes in complex natural scenarios. Furthermore, existing SAM-based matting methods extract intermediate features and masks from a frozen …

Weakly Supervised Video Anomaly Detection And Localization With Spatio-Temporal Prompts, Peng Wu, Xuerong Zhou, Guansong Pang, Zhiwei Yang, Qingsen Yan, Peng Wang, Yanning Zhang

Research Collection School Of Computing and Information Systems

Current weakly supervised video anomaly detection (WSVAD) task aims to achieve frame-level anomalous event detection with only coarse video-level annotations available. Existing works typically involve extracting global features from full-resolution video frames and training frame-level classifiers to detect anomalies in the temporal dimension. However, most anomalous events tend to occur in localized spatial regions rather than the entire video frames, which implies existing frame-level feature based works may be misled by the dominant background information and lack the interpretation of the detected anomalies. To address this dilemma, this paper introduces a novel method called STPrompt that learns spatio-temporal prompt embeddings …

Portrait Shadow Removal Via Self-Exemplar Illumination Equalization, Qian Huang, Cheng Xu, Guiqing Li, Ziheng Wu, Shengxin Liu, Shengfeng He

Research Collection School Of Computing and Information Systems

We introduce the Self-Exemplar Illumination Equalization Network, designed specifically for effective portrait shadow removal. The core idea of our method is that partially shadowed portraits can find ideal exemplars within their non-shadowed facial regions. Rather than directly fusing two distinct classes of facial features, our approach utilizes non-shadowed regions as an illumination indicator to equalize the shadowed regions, generating deshadowed results without boundary-merging artifacts. Our network comprises cascaded Self-Exemplar Illumination Equalization Blocks (SExmBlock), each containing two modules: a self-exemplar feature matching module and a feature-level illumination rectification module. The former identifies and applies internal illumination exemplars to shadowed areas, producing …

Dragging With Geometry: From Pixels To Geometry-Guided Image Editing, Xinyu Pu, Hongsong Wang, Jie Gui, Pan Zhou

Research Collection School Of Computing and Information Systems

Interactive point-based image editing serves as a controllable editor, enabling precise and flexible manipulation of image content. However, most drag-based methods operate primarily on the 2D pixel plane with limited use of 3D cues. As a result, they often produce imprecise and inconsistent edits, particularly in geometry-intensive scenarios such as rotations and perspective transformations. To address these limitations, we propose a novel geometry-guided drag-based image editing method—GeoDrag, which addresses three key challenges: 1) incorporating 3D geometric cues into pixel-level editing, 2) mitigating discontinuities caused by geometry-only guidance, and 3) resolving conflicts arising from multi-point dragging. Built upon a unified displacement …

Dreamcs: Geometry-Aware Text-To-3d Generation With Unpaired 3d Reward Supervision, Xiandong Zou, Ruihao Xia, Hongsong Wang, Pan Zhou

Research Collection School Of Computing and Information Systems

While text-to-3D generation has attracted growing interest, existing methods often struggle to produce 3D assets that align well with human preferences. Current preference alignment techniques for 3D content typically rely on hardly-collected preference-paired multi-view 2D images to train 2D reward models, when then guide 3D generation — leading to geometric artifacts, such as the Janus face problem and geometric incompleteness, due to their inherent 2D bias. To address these limitations, we construct 3D-MeshPref, the first large-scale unpaired 3D preference dataset, featuring diverse 3D meshes annotated by a large language model and refined by human evaluators. We then develop RewardCS, the …

Teamwise: Exploring Virtually Embodied Ai Facilitation For Video-Based Team Onboarding, Venkata Akhila Rani Obilisetty, Mikkeline Elleby, Anthony Tang, April Yi Wang

Research Collection School Of Computing and Information Systems

AI-mediated facilitation has emerged as a scalable approach to supporting onboarding and coordination in newly formed remote teams, yet existing systems are predominantly text-based. To explore how video-based, virtually embodied AI facilitators shape team experiences, we present TeamWise, which joins video-based onboarding meetings as an on-screen avatar. TeamWise guides teams through a structured facilitation flow of low-stakes activities to foster rapport, mutual awareness, and shared identity. While the overall sequence of activities and facilitation goals is predefined, the facilitator’s turn-by-turn utterances are generated dynamically by an LLM in response to participant input. We conducted a formative study of TeamWise to …

Who You Explain To Matters: Learning By Explaining To Conversational Agents With Different Pedagogical Roles, Zhengtao Xu, Junti Zhang, Anthony Tang, Yi-Chieh Lee

Research Collection School Of Computing and Information Systems

Conversational agents are increasingly used in education for learning support. An application is “learning by explaining”, where learners explain their understanding to an agent. However, existing research focuses on single roles, leaving it unclear how different pedagogical roles influence learners’ interaction patterns, learning outcomes and experiences. We conducted a between-subjects study (N=96) comparing agents with three pedagogical roles (Tutee, Peer, Challenger) and a control condition while learning an economics concept. We found that different pedagogical roles shaped learning dynamics, including interaction patterns and experiences. Specifically, the Tutee agent elicited the most cognitive investment but led to high pressure. The Peer …

Visual Loop: Bridging The Cognitive Gap In Software Development Through Visual-Ai Collaboration, Luis Filipe Fernandes Gomes, Xin Zhou, David Lo, Rui Abreu

Research Collection School Of Computing and Information Systems

Software development remains predominantly text-centric, despite decades of evidence showing that developers think and communicate visually. While sketches and diagrams externalize developers’ mental models, they remain disconnected from source code and quickly become outdated. Recent advances in foundation models, capable of both code and visual reasoning, create an opportunity to unify these representations. In this vision paper, we introduce Visual Loop, a continuous visual development environment that keeps code and informal sketches in bidirectional synchronization. Our prototype connects a code editor with a tablet-based visualization workspace, allowing developers to explore, annotate, and modify systems through freehand sketches interpreted by multimodal …

Enhancing Low-Light And Noisy Images Using Gaussian Denoising And Clahe (Contrast-Limited Adaptive Histogram Equalization)., Daniel Adesoji

SACAD: Scholarly Activities

Abstract

In digital imaging Low light image improvement is a crucial issue, with applications in medical imaging, surveillance and digital imaging. Images captured under substandard illumination usually appear dark and noisy: contrast is lower, hiding crucial details, while ISO (international Organization for Standardization) settings introduce grainy noise that devalue quality. These issues make images a problem for both human interpretation and automated vision system.

Traditional improvement methods such as histogram equalization and Retinex -based techniques enhance brightness but usually cause artifacts to boost noise. Deep learning approaches achieve strong results but require large datasets, heavy computation, and may fail to …

Invert Your Prompt: Editing-Aware Diffusion Inversion, Yangyang Xu, Wenqi Shao, Yong Du, Haiming Zhu, Yang Zhou, Jiayuan Xie, Ping Luo, Shengfeng He

Research Collection School Of Computing and Information Systems

Recent advancements in text-guided diffusion models have enabled powerful image manipulation capabilities. However, balancing reconstruction fidelity and editability for real images remains a significant challenge. In this work, we introduce Editing Inversion (EditInv), a novel framework that inverts and edits real images for specific editing tasks by optimizing specific prompt embeddings within the extended  space. By leveraging distinct embeddings across different U-Net layers and time steps, EditInv seamlessly integrates inversion and editing through reciprocal optimization, ensuring both high fidelity and precise editability. This hierarchical editing mechanism classifies tasks into structure, appearance, and global edits, optimizing only those embeddings that are …

Cylindformer: Image-To-Point Cloud Registration With Cylindrical Transformer, Jingtao Wang, Hao Tang, Yanpeng Sun, Shengfeng He, Zechao Li

Research Collection School Of Computing and Information Systems

Accurate correspondence extraction between distinctive pixel-wise and point-wise features is critical for image-to-point cloud (I2P) registration. Recent efforts leveraging Transformers for I2P feature representation have demonstrated potential, primarily by first capturing intra-modality global contextual dependencies via self-attention, and then learning cross-modality correlations via cross-attention. The strength of vanilla Transformers lies in modeling cross-modality global feature correlations. However, such mechanisms often struggle with the structural disparity between dense image pixels and sparse 3D points, hindering the establishment of fine-grained correspondences. Moreover, global attention may introduce ambiguity, as interactions with many inconsistent regions of intra-modality may degrade feature distinctiveness. To address these …

Designing For Trust In Chat-Based Question Answering Systems: An Exchange-Based Retrieval Approach, Nathan Mccutchen

Master's Theses

Community chat platforms such as Discord and Slack support spontaneous, collaborative communication but make it difficult to retrieve previously discussed information. As conversations accumulate, valuable exchanges become buried, leading to repeated questions and sustained burden on experienced community members.

This work contributes a set of design requirements for question-answering systems operating over unstructured chat data, a Discord bot prototype implementing those requirements named Echo, and an empirical evaluation of how such a system affects user trust. Rather than encoding discrete question-answer pairs or generating synthetic responses with a language model, Echo indexes conversation topics for semantic retrieval and presents results …

Edgeclip: Injecting Edge-Awareness Into Visual-Language Models For Zero-Shot Semantic Segmentation, Jiaxiang Fang, Shiqiang Ma, Guihua Duan, Fei Guo, Shengfeng He

Research Collection School Of Computing and Information Systems

Effective segmentation of unseen categories in zero-shot semantic segmentation is hindered by models’ limited ability to interpret edges in unfamiliar contexts. In this paper, we propose EdgeCLIP, which addresses this by integrating CLIP with explicit edge-awareness. Based on the premise that edge variation patterns are similar across both seen and unseen class objects, EdgeCLIP introduces the Contextual Edge Sensing module. This module accurately discerns and utilizes edge information, which is crucial in complex border areas where conventional models struggle. Further, our Text-Guided Dense Feature Matching strategy precisely aligns text encodings with corresponding visual edge features, effectively distinguishing them from background …

Cellscout: Visual Analytics For Mining Biomarkers In Cell State Discovery, Rui Sheng, Zelin Zang, Jiachen Wang, Yan Luo, Zixin Chen, Yan Zhou, Shaolun Ruan, Huamin Qu

Research Collection School Of Computing and Information Systems

Cell state discovery is crucial for understanding biological systems and enhancing medical outcomes. A key aspect of this process is identifying distinct biomarkers that define specific cell states. However, difficulties arise from the co-discovery process of cell states and biomarkers: biologists often use dimensionality reduction to visualize cells in a two-dimensional space. Then they usually interpret visually clustered cells as distinct states, from which they seek to identify unique biomarkers. However, this assumption is often this assumption often fails to hold due to internal inconsistencies in a cluster, making the process trial-and-error and highly uncertain. Therefore, biologists urgently need effective …

Courts Of New York: A Visual Atlas Of The City’S Public Basketball Spaces, Nathaniel Rattner

Dissertations, Theses, and Capstone Projects

Basketball courts in New York City are recreation facilities, community anchors and part of the city’s cultural image. In the basketball capital of the world, New Yorkers are rarely more than a few blocks away from a court. The visual diversity of these courts, however, is not widely documented in systematic ways.

This project makes that diversity visible to the public, combining open data, aerial imagery and computational analysis to document this important public space across the five boroughs. It is a narrative story and digital atlas of New York City’s public basketball courts, using surface color as a way …