Vadclip: Adapting Vision-Language Models For Weakly Supervised Video Anomaly Detection,
2024
Singapore Management University
Vadclip: Adapting Vision-Language Models For Weakly Supervised Video Anomaly Detection, Peng Wu, Xuerong Zhou, Guansong Pang, Lingru Zhou, Qingsen Yan, Peng Wang, Yanning Zhang
Research Collection School Of Computing and Information Systems
The recent contrastive language-image pre-training (CLIP) model has shown great success in a wide range of image-level tasks, revealing remarkable ability for learning powerful visual representations with rich semantics. An open and worthwhile problem is efficiently adapting such a strong model to the video domain and designing a robust video anomaly detector. In this work, we propose VadCLIP, a new paradigm for weakly supervised video anomaly detection (WSVAD) by leveraging the frozen CLIP model directly without any pre-training and fine-tuning process. Unlike current works that directly feed extracted features into the weakly supervised classifier for frame-level binary classification, VadCLIP makes …
Learning From Machines: How Negative Feedback From Machines Improves Learning Between Humans,
2024
Zhejiang University
Learning From Machines: How Negative Feedback From Machines Improves Learning Between Humans, Tengjian Zou, Gokhan Ertug, Thomas Roulet
Research Collection Lee Kong Chian School Of Business
Prior studies on learning from failure primarily focus on how individuals learn from failure feedback given by other individuals. It is unclear whether and how the advent of machine feedback may influence individuals’ learning from failures. We suggest that failure feedback provided by machines facilitates learning in two ways. First, it focuses individuals’ attention on their failures, leading them to learn from these failures. Second, it serves as a catalyzer, motivating individuals to learn more from failure feedback given to them by other individuals as well. In addition, this catalyzing effect is stronger if the failure feedback from machines and …
Digitizing Delphi: Educating Audiences Through Virtual Reconstruction,
2024
Purdue University
Digitizing Delphi: Educating Audiences Through Virtual Reconstruction, Kate Koury
The Journal of Purdue Undergraduate Research
Implementing a 3D model into a virtual space allows the general public to engage critically with archaeological processes. There are many unseen decisions that go into reconstructing an ancient temple. Analysis of available materials and techniques, predictions of how objects were used, decisions of what sources to reference, puzzle piecing broken remains together, and even educated guesses used to fill gaps in information often go unobserved by the public. This work will educate users about those choices by allowing the side-by-side comparison of conflicting theories on the reconstruction of the Tholos at Delphi, which is an ideal site because of …
Piecing Together Performance: Collaborative, Participatory Research-Through-Design For Better Diversity In Games,
2024
Chapman University
Piecing Together Performance: Collaborative, Participatory Research-Through-Design For Better Diversity In Games, Daniel L. Gardner, Louanne Boyd, Reginald T. Gardner
Engineering Faculty Articles and Research
Digital games are a multi-billion-dollar industry whose production and consumption extend globally. Representation in games is an increasingly important topic. As those who create and consume the medium grow ever more diverse, it is essential that player or user-experience research, usability, and any consideration of how people interface with their technology is exercised through inclusive and intersectional lenses. Previous research has identified how character configuration interfaces preface white-male defaults [39, 40, 67]. This study relies on 1-on-1 play-interviews where diverse participants attempt to create “themselves” in a series of games and on group design activities to explore how participants may …
Are Academia And Industry Listening To Each Other? A Citation Analysis Of Ux Research Methods Resources,
2024
Minnesota State University, Mankato
Are Academia And Industry Listening To Each Other? A Citation Analysis Of Ux Research Methods Resources, Abigail Bakke, Leonard Dibono
English Department Publications
Technical and Professional Communication (TPC) has been facing concerns of viability, in both its relationship with industry and its ability to build a relevant and valid body of research. TPC’s disconnection with industry may be reflected in its relationship to UX as well, despite both fields’ shared values. To better understand how TPC and User Experience (UX) are relating to each other, we conducted a citation analysis of a sample of SIGDOC papers and a sample of Nielsen Norman Group (NN/g) practitioner articles focused on research methods. The SIGDOC papers tended to cite TPC sources, while the NN/g articles cited …
Dung Dkar Cloak: Exploring Soft Interfaces For Sonic Interactions,
2024
EJ Tech
Dung Dkar Cloak: Exploring Soft Interfaces For Sonic Interactions, Judit Eszter Kárpáti, Esteban De La Torre
Textile Society of America: Symposium Proceedings
The importance of crossmodal interaction within the contemporary cultural, technological and scientific panorama has evidently gained significant attention due to its remarkable advantages in creating a meaningful, interwoven, and integrated experience. The use and recontextualization of textiles in such exploratory quest into the human senses has proven to be critical. Computational science, algorithmic logic and digital devices have always been rooted and closely interwoven with textile crafts and practices. Recent technological advancements have further combined technology and textile, generating interactive textile surfaces, constructing endless possibilities for multisensorial experiences. In this presentation we will examine how we can weave a sensitive …
How Economically Marginalized Adolescents Of Color Negotiate Critical Pedagogy In A Computing Classroom,
2024
Carleton College
How Economically Marginalized Adolescents Of Color Negotiate Critical Pedagogy In A Computing Classroom, Jean Salac, Lena Armstrong, Megumi Kivuva, Jayne Everson, Amy J. Ko
Computer Science Faculty Work
Background and Context: With the growing movement to adopt critical framings of computing, scholars have worked to reframe computing education from the narrow development of programming skills to skills in identifying and resisting oppressive structures in computing. However, we have little guidance on how these framings may manifest in classroom practice. Objectives: To better understand the processes and practice of critical pedagogy in a computing classrooms, we taught a critically conscious computing elective within a summer academic program at a northwest United States university targeted at secondary students (ages 14–18) from low-income backgrounds and would be the first …
Advancing Policy Insights: Opinion Data Analysis And Discourse Structuring Using Llms,
2024
University of Central Florida
Advancing Policy Insights: Opinion Data Analysis And Discourse Structuring Using Llms, Aaditya Bhatia
Graduate Thesis and Dissertation 2023-2024
The growing volume of opinion data presents a significant challenge for policymakers striving to distill public sentiment into actionable decisions. This study aims to explore the capability of large language models (LLMs) to synthesize public opinion data into coherent policy recommendations. We specifically leverage Mistral 7B and Mixtral 8x7B models for text generation and have developed an architecture to process vast amounts of unstructured information, integrate diverse viewpoints, and extract actionable insights aligned with public opinion. Using a retrospective data analysis of the Polis platform debates published by the Computational Democracy Project, this study examines multiple datasets that span local …
Living Datasets: Towards Data-Centric Ai Explainability And Bias Mitigation,
2024
University of Texas at Arlington
Living Datasets: Towards Data-Centric Ai Explainability And Bias Mitigation, Akib Zaman
Computer Science and Engineering Dissertations - Archive
Benchmark datasets are critical to the evolution of AI efforts yet often embed unintended biases that influence the models that drive human-AI interactions. A deeper inspection and awareness of data is needed to understand the biases datasets may contain. In this dissertation, I introduce the Tag-and-Release method, inspired from wildlife research, that treats data as an organism and examines how different environments (i.e., CNNs) select for unique traits or characteristics that ultimately impact data's survival. Using the canonical MNIST handwritten digit dataset as a case study, I describe how the Tag-and-Release method can be used to analyze how dataset imbalance …
A Unified Cross-Modal Interactive System For Assisting Vision Impaired In Human Navigation And Indoor Based Human Robot Interaction,
2024
University of Texas at Arlington
A Unified Cross-Modal Interactive System For Assisting Vision Impaired In Human Navigation And Indoor Based Human Robot Interaction, Harish Ram Nambiappan
Computer Science and Engineering Dissertations - Archive
People who are blind and vision impaired often require assistance in performing various tasks. With new technologies emerging in the recent years, vision impaired people either require assistance in accessing those technologies or in using those technologies to perform different tasks in real life. Previous works have focused on assisting vision impaired people in different scenarios such as navigation, accessing smartphone interfaces etc. With the recent developments in robotics, a new research has emerged where new systems can be developed for vision impaired people to interact with robots to perform various human robot interactive tasks. But with developing new and …
Towards Dynamic Context Detection From Voice Commands And Conversations With Smart Assistants In Smart Homes,
2024
Missouri State University
Towards Dynamic Context Detection From Voice Commands And Conversations With Smart Assistants In Smart Homes, Jeniya Sultana
Graduate Theses/Dissertations
Voice-enabled interactions have become increasingly popular with the rise of voice assistants. Identifying contexts or meanings from voice commands and conversations with smart assistants can contribute to the autonomous control of smart home devices and appliances. To improve automation, there is a growing need for efficient context detection that eliminates the need to memorize voice commands. To address this need, I followed a two-step approach in my research. In the first step, I developed a unique context recognition model using a transformer, an attention mechanism, and a fully connected neural network. I trained this model on a conversational dataset of …
Scene Understanding And Spatial Analysis Using Scene Graph Enhanced By Hall's Proxemics Zones In Smart Homes,
2024
Missouri State University
Scene Understanding And Spatial Analysis Using Scene Graph Enhanced By Hall's Proxemics Zones In Smart Homes, Debaleen Das Spandan
Graduate Theses/Dissertations
Voice-controlled smart assistants have received widespread popularity. It plays a pivotal role in smart homes by providing a natural and convenient interface for interacting with smart devices. However, these assistants are unable to serve persons with physical disabilities and speech impairments. Therefore, non-verbal communication methods, such as eye tracking, gesture recognition, and context awareness can complement and overcome some of these limitations to enhance user experience in smart homes. To address this issue, I am investigating non-verbal communication methods to make smart home technology more accessible and intuitive. In this research, I focus on proxemics, i.e., the study of distance …
Flexible Attenuation Fields: Tomographic Reconstruction From Heterogeneous Datasets,
2024
University of Kentucky
Flexible Attenuation Fields: Tomographic Reconstruction From Heterogeneous Datasets, Clifford S. Parker
Theses and Dissertations--Computer Science
Traditional reconstruction methods for X-ray computed tomography (CT) are highly constrained in the variety of input datasets they admit. Many of the imaging settings -- the incident energy, field-of-view, effective resolution -- remain fixed across projection images, and the only real variance is in the detector's position and orientation with respect to the scene. In contrast, methods for 3D reconstruction of natural scenes are extremely flexible to the geometric and photometric properties of the input datasets, readily accepting and benefiting from images captured under varying lighting conditions, with different cameras, and at disparate points in time and space. Extending CT …
Escape The Planet: Revolutionizing Game Design With Novel Oop Techniques,
2024
Minnesota State University, Mankato
Escape The Planet: Revolutionizing Game Design With Novel Oop Techniques, Qusai Kamal Fannoun
All Graduate Theses, Dissertations, and Other Capstone Projects
Mobile devices are continuously evolving and greater computing power and graphics capabilities are being introduced every year. As a result, there is an increasing demand for challenging and engaging mobile games that leverage these advanced features. This project explores best design practices using the development of Escape the Planet, which is an intricate maze game for mobile devices in which players navigate using a spaceship that is trapped in a hostile planet’s maze while avoiding obstacles and enemy attacks. The goal is to safely guide the spaceship out of the maze without colliding into walls or taking bullets from defensive …
Predicting An Optimal Medication/Prescription Regimen For Patient Discordant Chronic Comorbidities Using Multi-Output Models,
2024
University of Dayton
Predicting An Optimal Medication/Prescription Regimen For Patient Discordant Chronic Comorbidities Using Multi-Output Models, Ichchha Pradeep Sharma, Tam Nguyen, Shruti Ajay Singh, Tom Ongwere
Computer Science Faculty Publications
This paper focuses on addressing the complex healthcare needs of patients struggling with discordant chronic comorbidities (DCCs). Managing these patients within the current healthcare system often proves to be a challenging process, characterized by evolving treatment needs necessitating multiple medical appointments and coordination among different clinical specialists. This makes it difficult for both patients and healthcare providers to set and prioritize medications and understand potential drug interactions. The primary motivation of this research is the need to reduce medication conflict and optimize medication regimens for individuals with DCCs. To achieve this, we allowed patients to specify their health conditions and …
The Process Of Video Game Development: Watermelon Willy,
2024
Northeastern Illinois University
The Process Of Video Game Development: Watermelon Willy, Jade Westgor
University Honors Program Senior Projects
Developing a video game requires and provides skills that can be very helpful for computer science students, as well as skills that relate to storytelling/worldbuilding, organization, and artistic expression. This paper goes over the process I have taken in order to design, develop, and evaluate the game Watermelon Willy from the very start to alpha testing. The process started some time ago with the idea being present in my head for a while, however the project started with some basic storyboards to map out some of the fundamental aspects of the game. Coding began with a simple template, which was …
(Meta-)Physical Artworks: Digital Augmentation In Art Observation,
2024
Dartmouth College
(Meta-)Physical Artworks: Digital Augmentation In Art Observation, Macy A. Toppan
Dartmouth College Master’s Theses
Augmented art— the subgenre of art that incorporates physical and digital artwork— is a rapidly growing field driven by advancing technology and a new generation for whom that tech is a given. Yet the presence of media like augmented and virtual reality in exhibition remains a controversial subject. Rather than focusing on the many theoretical debates about whether digital pieces can qualify as "good" art, we study it in practice through the eyes of the casual art observer. This paper highlights the audience in a within-participant study that asked viewers to take in a physical sculpture intentionally built with virtual …
A-Disetrac Advanced Analytic Dashboard For Distributed Eye Tracking,
2024
Old Dominion University
A-Disetrac Advanced Analytic Dashboard For Distributed Eye Tracking, Yasasi Abeysinghe, Bhanuka Mahanama, Gavindya Jayawardena, Yasith Jayawardena, Mohan Sunkara, Andrew T. Duchowski, Vikas Ashok, Sampath Jayarathna
Computer Science Faculty Publications
Understanding how individuals focus and perform visual searches during collaborative tasks can help improve user engagement. Eye tracking measures provide informative cues for such understanding. This article presents A-DisETrac, an advanced analytic dashboard for distributed eye tracking. It uses off-the-shelf eye trackers to monitor multiple users in parallel, compute both traditional and advanced gaze measures in real-time, and display them on an interactive dashboard. Using two pilot studies, the system was evaluated in terms of user experience and utility, and compared with existing work. Moreover, the system was used to study how advanced gaze measures such as ambient-focal coefficient K …
All In One Place: Ensuring Usable Access To Online Shopping Items For Blind Users,
2024
Old Dominion University
All In One Place: Ensuring Usable Access To Online Shopping Items For Blind Users, Yash Prakash, Akshay Kolgar Nayak, Mohan Sunkara, Sampath Jayarathna, Hae-Na Lee, Vikas Ashok
Computer Science Faculty Publications
Perusing web data items such as shopping products is a core online user activity. To prevent information overload, the content associated with data items is typically dispersed across multiple webpage sections over multiple web pages. However, such content distribution manifests an unintended side effect of significantly increasing the interaction burden for blind users, since navigating to-and-fro between different sections in different pages is tedious and cumbersome with their screen readers. While existing works have proposed methods for the context of a single webpage, solutions enabling usable access to content distributed across multiple webpages are few and far between. In this …
Enhancing Research Productivity: Seamless Integration Of Personal Devices And Hpc Resources With The Cybershuttle Notebook Gateway,
2024
Old Dominion University
Enhancing Research Productivity: Seamless Integration Of Personal Devices And Hpc Resources With The Cybershuttle Notebook Gateway, Yasith Jayawardana, Dimuthu Wannipurage, Eroma Abeysinghe, Suresh Marru
Computer Science Faculty Publications
Scientists often utilize personal laptops and workstations for initial research stages and turn to high-performance computing (HPC) supercomputers for compute-intensive tasks. However, seamless transitions between these environments are vital for enhancing productivity and accelerating research progress. Our paper presents the Cybershuttle Notebook Gateway, an open-source framework crafted to streamline this transition, optimize resource utilization, and reduce time-to-science for researchers. Leveraging JupyterLab, the framework extends kernel mechanics for seamless provisioning and connection to remote HPC cluster kernels. We delve into its architecture, which separates user authentication, kernel provisioning, and remote file system access. Additionally, we highlight practical capabilities like analyzing network …
