Graphics and Human Computer Interfaces Commons^™

Weakly Supervised Video Anomaly Detection And Localization With Spatio-Temporal Prompts, Peng Wu, Xuerong Zhou, Guansong Pang, Zhiwei Yang, Qingsen Yan, Peng Wang, Yanning Zhang

Research Collection School Of Computing and Information Systems

Current weakly supervised video anomaly detection (WSVAD) task aims to achieve frame-level anomalous event detection with only coarse video-level annotations available. Existing works typically involve extracting global features from full-resolution video frames and training frame-level classifiers to detect anomalies in the temporal dimension. However, most anomalous events tend to occur in localized spatial regions rather than the entire video frames, which implies existing frame-level feature based works may be misled by the dominant background information and lack the interpretation of the detected anomalies. To address this dilemma, this paper introduces a novel method called STPrompt that learns spatio-temporal prompt embeddings …

Visual Loop: Bridging The Cognitive Gap In Software Development Through Visual-Ai Collaboration, Luis Filipe Fernandes Gomes, Xin Zhou, David Lo, Rui Abreu

Research Collection School Of Computing and Information Systems

Software development remains predominantly text-centric, despite decades of evidence showing that developers think and communicate visually. While sketches and diagrams externalize developers’ mental models, they remain disconnected from source code and quickly become outdated. Recent advances in foundation models, capable of both code and visual reasoning, create an opportunity to unify these representations. In this vision paper, we introduce Visual Loop, a continuous visual development environment that keeps code and informal sketches in bidirectional synchronization. Our prototype connects a code editor with a tablet-based visualization workspace, allowing developers to explore, annotate, and modify systems through freehand sketches interpreted by multimodal …

Enhancing Low-Light And Noisy Images Using Gaussian Denoising And Clahe (Contrast-Limited Adaptive Histogram Equalization)., Daniel Adesoji

SACAD: Scholarly Activities

Abstract

In digital imaging Low light image improvement is a crucial issue, with applications in medical imaging, surveillance and digital imaging. Images captured under substandard illumination usually appear dark and noisy: contrast is lower, hiding crucial details, while ISO (international Organization for Standardization) settings introduce grainy noise that devalue quality. These issues make images a problem for both human interpretation and automated vision system.

Traditional improvement methods such as histogram equalization and Retinex -based techniques enhance brightness but usually cause artifacts to boost noise. Deep learning approaches achieve strong results but require large datasets, heavy computation, and may fail to …

Designing For Trust In Chat-Based Question Answering Systems: An Exchange-Based Retrieval Approach, Nathan Mccutchen

Master's Theses

Community chat platforms such as Discord and Slack support spontaneous, collaborative communication but make it difficult to retrieve previously discussed information. As conversations accumulate, valuable exchanges become buried, leading to repeated questions and sustained burden on experienced community members.

This work contributes a set of design requirements for question-answering systems operating over unstructured chat data, a Discord bot prototype implementing those requirements named Echo, and an empirical evaluation of how such a system affects user trust. Rather than encoding discrete question-answer pairs or generating synthetic responses with a language model, Echo indexes conversation topics for semantic retrieval and presents results …

Invert Your Prompt: Editing-Aware Diffusion Inversion, Yangyang Xu, Wenqi Shao, Yong Du, Haiming Zhu, Yang Zhou, Jiayuan Xie, Ping Luo, Shengfeng He

Research Collection School Of Computing and Information Systems

Recent advancements in text-guided diffusion models have enabled powerful image manipulation capabilities. However, balancing reconstruction fidelity and editability for real images remains a significant challenge. In this work, we introduce Editing Inversion (EditInv), a novel framework that inverts and edits real images for specific editing tasks by optimizing specific prompt embeddings within the extended  space. By leveraging distinct embeddings across different U-Net layers and time steps, EditInv seamlessly integrates inversion and editing through reciprocal optimization, ensuring both high fidelity and precise editability. This hierarchical editing mechanism classifies tasks into structure, appearance, and global edits, optimizing only those embeddings that are …

Cylindformer: Image-To-Point Cloud Registration With Cylindrical Transformer, Jingtao Wang, Hao Tang, Yanpeng Sun, Shengfeng He, Zechao Li

Research Collection School Of Computing and Information Systems

Accurate correspondence extraction between distinctive pixel-wise and point-wise features is critical for image-to-point cloud (I2P) registration. Recent efforts leveraging Transformers for I2P feature representation have demonstrated potential, primarily by first capturing intra-modality global contextual dependencies via self-attention, and then learning cross-modality correlations via cross-attention. The strength of vanilla Transformers lies in modeling cross-modality global feature correlations. However, such mechanisms often struggle with the structural disparity between dense image pixels and sparse 3D points, hindering the establishment of fine-grained correspondences. Moreover, global attention may introduce ambiguity, as interactions with many inconsistent regions of intra-modality may degrade feature distinctiveness. To address these …

Cellscout: Visual Analytics For Mining Biomarkers In Cell State Discovery, Rui Sheng, Zelin Zang, Jiachen Wang, Yan Luo, Zixin Chen, Yan Zhou, Shaolun Ruan, Huamin Qu

Research Collection School Of Computing and Information Systems

Cell state discovery is crucial for understanding biological systems and enhancing medical outcomes. A key aspect of this process is identifying distinct biomarkers that define specific cell states. However, difficulties arise from the co-discovery process of cell states and biomarkers: biologists often use dimensionality reduction to visualize cells in a two-dimensional space. Then they usually interpret visually clustered cells as distinct states, from which they seek to identify unique biomarkers. However, this assumption is often this assumption often fails to hold due to internal inconsistencies in a cluster, making the process trial-and-error and highly uncertain. Therefore, biologists urgently need effective …

Courts Of New York: A Visual Atlas Of The City’S Public Basketball Spaces, Nathaniel Rattner

Dissertations, Theses, and Capstone Projects

Basketball courts in New York City are recreation facilities, community anchors and part of the city’s cultural image. In the basketball capital of the world, New Yorkers are rarely more than a few blocks away from a court. The visual diversity of these courts, however, is not widely documented in systematic ways.

This project makes that diversity visible to the public, combining open data, aerial imagery and computational analysis to document this important public space across the five boroughs. It is a narrative story and digital atlas of New York City’s public basketball courts, using surface color as a way …

Lagrangian Motion Fields For Long-Term Motion Generation, Yifei Yang, Zikai Huang, Chenshu Xu, Shengfeng He

Research Collection School Of Computing and Information Systems

Long-term motion generation is a challenging task that requires producing coherent and realistic sequences over extended durations. Current methods primarily rely on framewise motion representations, which capture only static spatial details and overlook temporal dynamics. This approach leads to significant redundancy across the temporal dimension, complicating the generation of effective long-term motion. To overcome these limitations, we introduce the novel concept of Lagrangian Motion Fields, specifically designed for long-term motion generation. By treating each joint as a Lagrangian particle with uniform velocity over short intervals, our approach condenses motion representations into a series of "supermotions" (analogous to superpixels). This method …

Zero-Shot Video Translation Via Token Warping, Haiming Zhu, Yangyang Xu, Jun Yu, Shengfeng He

Research Collection School Of Computing and Information Systems

With the revolution of generative AI, video-related tasks have been widely studied. However, current state-of-the-art video models still lag behind image models in visual quality and user control over generated content. In this paper, we introduce TokenWarping, a novel framework for temporally coherent video translation. Existing diffusion-based video editing approaches rely solely on key and value patches in self-attention to ensure temporal consistency, often sacrificing the preservation of local and structural regions. Critically, these methods overlook the significance of the query patches in achieving accurate feature aggregation and temporal coherence. In contrast, TokenWarping leverages complementary token priors by constructing temporal …

A Virtual-Reality-Based Dental Simulator For Endodontics With Automated Formative Feedback, Yousef Salah Abo El Ela

Theses and Dissertations

Advancements in virtual reality (VR) and haptic technology are transforming the landscape of medical and dental education, offering new avenues for safe, immersive, and repeatable training experiences. Within dentistry, endodontics presents unique challenges for preclinical education due to anatomical complexity, limited access to extracted teeth, ethical concerns, and the shortcomings of conventional plastic models. Despite endodontics specific plastic teeth being available, they fall short of replicating the hardness of real extracted teeth, are relatively costly compared to generic plastic teeth, and are ultimately a disposable item which makes them inadequate as a sustainable long-term solution. Extracted teeth do a much …

A Macrocognitive Design Taxonomy For Simulation-Based Training Systems: Bridging Cognitive Theory And Human-Computer Interaction, Jessica M. Johnson

Virginia Digital Maritime Center (VDMC) Faculty Publications

Simulation-based training systems are increasingly deployed to prepare learners for complex, safety-critical, and dynamic work environments. While advances in computing have enabled immersive and data-rich simulations, many systems remain optimized for procedural accuracy and surface-level task performance rather than the macrocognitive processes that underpin adaptive expertise. Macrocognition encompasses higher-order cognitive processes that are essential for performance transfer beyond controlled training conditions. When these processes are insufficiently supported, training systems risk fostering brittle strategies and negative training effects. This paper introduces a macrocognitive design taxonomy for simulation-based training systems derived from a large-scale meta-analysis examining the transfer of macrocognitive skills from …

Shaping The Future: Emerging Technologies And Their Role In Industry 4.0 And Beyond, Liuliu Qin

Information Technology & Decision Sciences Faculty Publications

This paper provides a comprehensive review of emerging technologies driving the transition from Industry 4.0 to Industry 5.0. It examines the foundational concepts and pillars of Industry 4.0 and explores the transformative roles of Artificial Intelligence (AI), Extended Reality (XR), Collaborative Cobots (Cobots), Brain–Computer Interfaces (BCIs), quantum technologies, and next-generation connectivity (5G/6G). By integrating technological, human-centric, and sustainability perspectives, the study outlines how these emerging technologies reshape industrial systems and enable intelligent, adaptive, and inclusive futures.

Trustworthy Multimodal Ai For Medical Imaging: Enhancing Diagnosis, Reasoning, And Human-Agent Interaction In Extended Reality, Jai Prakash Veerla

Computer Science and Engineering Dissertations

The transition from traditional microscopy to digital pathology has digitized diagnostic data, yet clinical workflows remain constrained by two-dimensional screens and passive, opaque analysis tools that fail to capture the spatial complexity of biological systems. While Foundation Models now promise to reason across histology and genomics, a critical disconnect persists between the richness of this data and the limited cognitive bandwidth of clinicians, who currently lack the immersive interfaces and trustworthy agents necessary to utilize it effectively. This dissertation presents a unified framework for "Embodied Agentic AI," establishing a pipeline that augments physician capabilities through immersive visualization, robust security, and …

Improving Medical Diagnostics With Vision-Language Models: Convex Hull-Based Uncertainty Analysis, Ferhat Ozgur Catak, Murat Kuzlu, Taylor Patrick, Michel Audette

Engineering Technology Faculty Publications

In recent years, vision-language models (VLMs) have been applied to various fields, including healthcare, education, finance, and manufacturing, with remarkable performance. However, concerns remain regarding VLMs' consistency and uncertainty, particularly in critical applications such as healthcare, which demand a high level of trust and reliability. This paper proposes a novel approach to evaluate uncertainty in VLMs' responses using a convex hull approach on a healthcare application for visual question answering (VQA). For any VLM, temperature refers to a sampling parameter used in probabilistic generation, which controls the randomness of the model's output. The LLM-CXR model is selected as the medical …

Qualitative Study For Llm-Assisted Design Study Process: Strategies, Challenges, And Roles, Shaolun Ruan, Rui Sheng, Xiaolin Wen, Jiachen Wang, Tianyi Zhang, Yong Wang, Tim Dwyer, Jiannan Li

Research Collection School Of Computing and Information Systems

Design studies aim to develop visualization solutions for real-world problems across various application domains. Recently, the emergence of large language models (LLMs) has introduced new opportunities to enhance the design study process, providing capabilities such as creative problem-solving, data handling, and insightful analysis. However, despite their growing popularity, there remains a lack of systematic understanding of how LLMs can effectively assist researchers in visualization-specific design studies. In this paper, we conducted a rnulti-stage qualitative study to fill this gap, which involved 30 design study researchers from diverse backgrounds and expertise levels. Through in-depth interviews and carefully-designed questionnaires, we investigated strategies …

Look, Compare And Draw: Differential Query Transformer For Automatic Oil Painting, Lingyu Liu, Yaxiong Wang, Li Zhu, Lizi Liao, Zhedong Zheng

Research Collection School Of Computing and Information Systems

This work introduces a new approach to automatic oil painting that emphasizes the creation of dynamic and expressive brushstrokes. A pivotal challenge lies in mitigating the duplicate and common-place strokes, which often lead to less aesthetic outcomes. Inspired by the human painting process, i.e., observing, comparing, and drawing, we incorporate differential image analysis into a neural oil painting model, allowing the model to effectively concentrate on the incremental impact of successive brushstrokes. To operationalize this concept, we propose the Differential Query Transformer (DQ-Transformer), a new architecture that leverages differentially derived image representations enriched with positional encoding to guide the stroke …

A Novel Lightweight Framework For Low-Light Image Enhancement Via Gaussian Denoising And Clahe, Daniel Oluwaseun Adesoji

Master's Theses or Doctor of Nursing Practice

Low-light image enhancement is a major challenge in digital imaging, especially in medical imaging, surveillance, and autonomous vision systems. Images captured under poor illumination often appear dark, noisy, and low in contrast, which makes it hard to observe important details. Traditional enhancement methods can improve brightness but usually introduce artifacts or increase noise. Although deep learning methods have shown strong performance, they usually require large datasets, and high computational resources. This creates a need for simpler and more efficient enhancement techniques. This study proposes a lightweight framework that incorporates Gaussian denoising with Contrast Limited Adaptive Histogram Equalization (CLAHE) to enhance …

Artificial Intelligence And Consumer Well-Being: A Cross Domain Systemic Review, Setar Lytle, Mahesh Gopinath

Marketing Faculty Publications

Artificial intelligence (AI) is increasingly embedded in everyday consumption, yet evidence on its longer-term implications for consumer eudaimonic well-being remains dispersed across disciplines and application contexts. This review integrates that literature to clarify the domains, theoretical explanations, and conditions through which AI shapes consumer well-being. Following PRISMA and SPAR-4-SLR procedures, we reviewed research published from January 2010 to January 2026. From 6058 records, 480 studies across psychology, business, and human-technology interaction met the inclusion criteria. The evidence is organised through psychological, social, and technological perspectives and identifies six interconnected domains: mental health, cognitive development, physical health, personal growth, autonomy and …

Learning Design To Advance Human-Ai Collaboration In K-12 Education, Wing Sha Chan, Jinhee Kim, Seongryeong Yu, Rita Kay Detrick

STEMPS Faculty Publications

This chapter explores key components for designing effective Human-AI Collaboration (HAC) in K–12 education, addressing the current lack of theoretical and conceptual frameworks for structuring and implementing HAC in teaching and learning. It examines four essential areas: curriculum design, student and teacher–AI interaction, learning environments, and the evolution of HAC over time. The chapter introduces the concept of HAC in K–12 contexts, highlighting how humans and AI can leverage each other's strengths through co-evolutionary processes that foster mutual learning and collaboration. It reviews current HAC practices in schools and discusses their contributions to both teaching and learning. Finally, it presents …