Computer Sciences Commons^™

Reducing Token Redundancy In Video-Language Models Via Memory Consolidation Algorithm, Matt Couts

Electrical Engineering and Computer Science Undergraduate Honors Theses

Video Question Answering (VideoQA) focuses on developing mod- els capable of engaging in natural language conversations about video con- tent. Current state-of-the-art typically analyze videos frame-by-frame, a process that is both computationally and memory-intensive. Integrating the Atkinson-Shiffrin memory model with Video Language Models has demon- strated potential for enhancing video understanding capabilities. Reducing the number of frames processed by the model is a crucial operation in this approach, which is achieved by a memory consolidation algorithm. This al- gorithm condenses a video sequence into a small set of representative frames which capture the essence of the video content. However, due …

Decoding Emotions: Unveiling Facial Expressions Through Acoustic Sensing With Contrastive Attention, Guangjing Wang, Juexing Wang, Ce Zhou, Weikang Ding, Huacheng Zeng, Tianxing Li, Qiben Yan

Computer Science Faculty Research & Creative Works

Expression recognition holds great promise for applications such as content recommendation and mental healthcare by accurately detecting users’ emotional states. Traditional methods often rely on cameras or wearable sensors, which raise privacy concerns and add extra device burdens. In addition, existing acoustic-based methods struggle to maintain satisfactory performance when there is a distribution shift between the training dataset and the inference dataset. In this paper, we introduce FacER+, an active acoustic facial expression recognition system, which eliminates the requirement for external microphone arrays. FacER+ extracts facial expression features by analyzing the echoes of near-ultrasound signals emitted between the 3D facial …

The Algorithm Of Fear: Unpacking Prejudice Against Ai And The Mistrust Of Technology, James Hutson, Daniel Plate

Faculty Scholarship

The mistrust of AI seen in the media, industry and education reflects deep-seated cultural anxieties, often comparable to societal prejudices like racism and sexism. Throughout history, literature and media have portrayed machines as antagonists, amplifying fears of technological obsolescence and identity loss. Despite the recent remarkable advancements in AI—particularly in creative and decision-making capacities—human resistance to its adoption persists, rooted in a combination of technophobia, algorithm aversion, and cultural narratives of dystopia. This review investigates the origins of this prejudice, focusing on the parallels between current attitudes toward AI and historical resistance to new technologies. Drawing on examples from popular …

From Concept To Creation: The Role Of Generative Artificial Intelligence In The New Age Of Digital Marketing, Andrew Smith, James Hutson

Faculty Scholarship

Artificial intelligence (AI) has been extensively used in digital marketing. Still, the recent advances in generative AI (GAI) have revolutionized social media marketing and content creation, lowering barriers that once restricted high-quality design to professionals well versed in expensive and complex software like Adobe Suite. GAI tools enable anyone, from students to marketers, to generate logos, branding, and multimedia content without extensive training. This shift has empowered more people to engage in creative expression, expanding the pool of ideas and creativity. However, the abundance of AI-generated content raises questions about the evolving definition of “art” and the emergence of a …

Algotric: Symmetric And Asymmetric Encryption Algorithms For Cryptography – A Comparative Analysis In Ai Era, Naresh Kshetri, Mir Mehedi Rahman, Md Masud Rana, Omar Faruq Osama, James Hutson

Faculty Scholarship

The increasing integration of artificial intelligence (AI) within cybersecurity has necessitated stronger encryption methods to ensure data security. This paper presents a comparative analysis of symmetric (SE) and asymmetric encryption (AE) algorithms, focusing on their role in securing sensitive information in AI-driven environments. Through an in-depth study of various encryption algorithms such as AES, RSA, and others, this research evaluates the efficiency, complexity, and security of these algorithms within modern cybersecurity frameworks. Utilizing both qualitative and quantitative analysis, this research explores the historical evolution of encryption algorithms and their growing relevance in AI applications. The comparison of SE and AE …

Human Vs. Ai Counseling: College Students' Perspectives, Mohammad Amin Kuhail, Nazik Alturki, Justin Thomas, Amal K. Alkhalifa

All Works

Transitioning to college life while navigating the complexities of emerging adulthood can be stressful. In some instances, it may even lead to the onset of mental health problems or the exacerbation of existing issues. While therapeutic resources are typically available in tertiary educational contexts, social stigma may lead to service underutilization. Additionally, high student-to-therapist ratios can create bottlenecks to access when such services are sought. Offering an adjunct to traditional campus counseling services, AI chatbots can potentially address such issues. Chatbots can provide flexible, accessible, anonymous, and cost-effective first-line support, improving access and extending traditional treatment methodologies. This study evaluates …

Robust Learning With Probabilistic Relaxation Using Hypothesis-Test-Based Sampling, Zilin Wang

Dissertations and Theses Collection (Open Access)

In recent years, deep learning has been a vital tool in various tasks. The performance of a neural network is usually evaluated by empirical risk minimization. However, robustness issues have gained great concern which can be fatal in safety-critical applications. Adversarial training can mitigate the issue by minimizing the loss of worst-case perturbations of data. It is effective in improving the robustness of the model, but it is too conservative, and the plain performance of the model can be unsatisfying. Probabilistic Robust Learning (PRL) empirically balances the average- and worst-case performance while the robustness of the model is not provable …

Forward And Backward Private Searchable Encryption For Cloud-Assisted Industrial Iot, Tianqi Peng, Bei Gong, Shanshan Tu, Abdallah Namoun, Sami Alshmrany, Muhammad Waqas, Hisham Alasmary, Sheng Chen

Research outputs 2022 to 2026

In the cloud-assisted industrial Internet of Things (IIoT), since the cloud server is not always trusted, the leakage of data privacy becomes a critical problem. Dynamic symmetric searchable encryption (DSSE) allows for the secure retrieval of outsourced data stored on cloud servers while ensuring data privacy. Forward privacy and backward privacy are necessary security requirements for DSSE. However, most existing schemes either trade the server’s large storage overhead for forward privacy or trade efficiency/overhead for weak backward privacy. These schemes cannot fully meet the security requirements of cloud-assisted IIoT systems. We propose a fast and firmly secure SSE scheme called …

Enhancing Low-Resource Language Performance In Multilingual Large Language Models, Mingqi Li

All Dissertations

The large language models play an important role in many natural language tasks. However, training these models requires large amounts of data, which is not available for many languages. A noticeable performance gap exists between English and other languages, with low-resource languages showcasing this gap prominently. Therefore, it becomes imperative to improve large language models for low-resource languages. To address these challenges, we developed knowledge distillation and strategic prompt-learning, and attention alignment methods to improve the representation capabilities of large language models for low-resource language, and then enhanced their performance in downstream tasks.

In our first study, we developed a …

Video Game Development 3.0: Ai-Driven Collaborative Co-Creation, Jay Ratican, James Hutson

Faculty Scholarship

The evolution of game development has transitioned from manual coding (Software 1.0) to data-driven Artificial Intelligence (AI) (Software 2.0), and now to a more advanced stage—video game development 3.0. This phase is characterized by AI-driven processes leveraging large language models (LLMs), neural networks, and other AI techniques that autonomously generate code, content, and narratives. This paper explores the foundational technologies underpinning this paradigm shift, including customizable AI modules, dynamic asset creation, and intelligent non player characters (NPCs) that adapt to player interactions. It also highlights the integration of AI with emerging technologies like Virtual Reality (VR), Augmented Reality (AR), and …

Mitigating Code Reuse Attacks On Risc-V Binaries: Minimizing Gadget Availability Using The Compressed Extension, Heitor Vieira

Theses and Dissertations

Embedded systems are vital in civilian and military applications, requiring high performance and security. The open RISC-V Instruction Set Architecture (ISA) offers significant advantages, including security through community review and strategic independence in microchip supplies. Brazil’s recent partnership with RISC-V highlights its potential for national technological sovereignty. However, RISC-V is not inherently resistant to code reuse attacks (CRAs), highlighting the need to integrate security measures early in development. The RISC-V Compressed extension, while beneficial for optimizing performance and code flexibility, introduces security trade-offs. As RISC-V adoption grows, particularly in critical systems, addressing these security challenges from the start is crucial …

Patterns Of Interactions In Human-Machine Teams, Kazuhiko Momose

Theses and Dissertations

Increasingly capable machines, including Artificial Intelligence (AI) agents are playing a more important role in a wide range of applications, including human daily activities and safety-critical systems. They can benefit even more when humans and such machines agents work together as a team by leveraging each other's strengths and complementing each other to enhance overall performance. To design high-performing teams, it is critical to analyze the team dynamics and understand how humans and machines interact with each other. Collaboration, Coordination, and Cooperation (3Cs) are terms typically used to describe the behavior of teams. However, these terms tend to be used …

Exploring The Cognitive Sense Of Self In Ai: Ethical Frameworks And Technological Advances For Enhanced Decision-Making, Emily Barnes, James Hutson

Faculty Scholarship

The burgeoning field of Artificial Intelligence (AI) increasingly focuses on developing systems capable of self-awareness, merging technological innovation with deep ethical and philosophical considerations. This article explores the cognitive sense of self within AI, examining mechanisms through which AI systems may mirror human-like consciousness and self-perception. Despite significant advances, substantial gaps remain in the understanding and practical implementation of self-aware characteristics in AI, particularly in applying theoretical models and ethical frameworks to real-world scenarios. There is a pressing need for comprehensive research to explore these theoretical underpinnings and translate them into operational systems capable of ethical and adaptable behaviors. This …

Gamified Learning: Applying Game Design Thinking In Education, Qiaoxin Deng

ART 108: Introduction to Games Studies

Gamification is an Education Strategy It has gained popularity in recent years. Gamification is a means to foster student engagement and improve their learning journeys. It's about applying game design elements in non-game contexts. This is primarily used in educational settings. Gamification of learning makes it more engaging and fun by introducing rewards, challenges, and competition. By adding rewards, challenges, and competition, gamification makes learning more interesting and interactive (2020).In this essay, I will be discussing the concept of gamification. Its advantages and disadvantages will be explored. It will also give examples, including Duolingo and Quizlet, to illustrate how it …

The Evolution And Preservation Of Video Games: An Artistic And Cultural Journey, Dhru Fuletra

ART 108: Introduction to Games Studies

From the first time I held a game controller, video games have been a fundamental part of my life. They started as simple, pixel-filled adventures on early consoles and have grown into the vast, immersive worlds we explore on today’s advanced systems. For me, they’ve always been more than just a way to pass the time; they’ve been gateways to alternate realities where creativity, interaction, and storytelling seamlessly come together. Over the years, video games have transformed from casual hobbies into intricate cultural phenomena and, importantly, into a recognized art form. In this essay, I contend that video games are …

Valorant's Interlinked To Theory Of Representation (Race And Culture) And Feminist Coflict Theory, Gerald Susanteo

ART 108: Introduction to Games Studies

A brief introduction to Valorant to new ears and eyes is that Valorant is a video game and what I will be calling a media that was released by Riot Games in 2020, Valorant is a tactical FPS (first person shooter) game that blends strategic gameplay with an immersive sci-fi narrative. The setting of the game takes place in a world destabilized by the mysterious "First Light" event which gives these agents called Radiants their powers and abilities. The game first introduces the organization called Kingdom Corporation as a central antagonist exploiting the Radiants who, like I explained earlier, are …

The Evolution Of Artificial Intelligence In Gaming, Aditi Jorapur

ART 108: Introduction to Games Studies

No abstract provided.

Deep Learning Framework For Inverse Problems In Computational Imaging: A Lensless Imaging And Super-Resolution Magnetic Resonance Imaging Case, Arpan Poudel

Graduate Theses and Dissertations

Inverse problems in computer vision involve reconstructing an original scene or image from incomplete, noisy, or indirect measurements. These problems are critical in tasks such as image denoising, deblurring, super-resolution, and lensless imaging, where the goal is to recover high-quality images from degraded or partial measurements. This thesis introduces novel approaches to address two specific real-world inverse problems: (1) image super-resolution in medical imaging and (2) lensless image reconstruction . In the first part of this work, we tackle the problem of image super-resolution in Magnetic Resonance Imaging (MRI). High-resolution MRI scans are often limited by hardware constraints, patient movement, …

Regulating Robo-Advisors In An Age Of Generative Artificial Intelligence, Daniel Schwarcz, Tom Baker

Law & Economics Working Papers

New generative Artificial Intelligence (AI) tools can increasingly engage in personalized, sustained and natural conversations with users. This technology has the capacity to reshape the financial services industry, making customized expert financial advice broadly available to consumers. However, AI’s ability to convincingly mimic human financial advisors also creates significant risks of large-scale financial misconduct. Which of these possibilities becomes reality will depend largely on the legal and regulatory rules governing “robo-advisors” that supply fully automated financial advice to consumers. This Article consequently critically examines this evolving regulatory landscape, arguing that current U.S. rules fail to adequately limit the risk that …

Basic Safety Message Generation Through A Video-Based Analytics For Potential Safety Application, Abyad Enan

All Theses

With the advancement of modern artificial intelligence techniques, computer vision can play a vital role in enhancing roadway safety by reducing the risk of imminent collisions. To do so, a vision-based safety application is required, where a roadside camera can monitor the roadway traffic and predict potential risks of crashes in real-time. If any risky situation or behavior is observed that may lead to a crash, then a safety application can send warnings to the vehicles at risk. For vision-based safety applications on a roadway section, it is important to accurately monitor each vehicle’s location, speed, acceleration, heading direction, etc. …

Unsupervised Moving Object Segmentation With Atmospheric Turbulence, Dehao Qin

All Theses

Moving object segmentation in the presence of atmospheric turbulence is a highly challenging task due to the irregular and time-varying distortions induced by the atmospheric turbulence. This thesis presents an unsupervised approach for segmenting moving objects in videos affected by such atmospheric turbulence. The proposed methodology is grounded in a detect-then-grow scheme: the algorithm begins by identifying a small set of moving object pixels (seed points) with high confidence and progressively expanding a foreground mask from these seed points to segment all moving objects. The proposed approach capitalizes on rigid geometric consistency across video frames to disentangle different types of …

Counting Catalan: An Experimental Evaluation Of The Mixing Time For The Triangulation Markov Chain, Roy Gotlieb

Master's Theses

Monte Carlo Markov chains (MCMCs) are used in many areas as a way to model a system’s behavior. By running a probabilistic simulation on a system’s state space, we can estimate properties of the system that could be untenable to directly compute. It is of interest to determine how quickly a Markov chain mixes\textemdash that is, settles into its stationary distribution. One such chain is induced by taking a binary search tree and performing a rotation or flip on one of its edges. We know that this chain eventually settles into the uniform distribution, but the time complexity bounds on …

Deep Learning Approach For Accurate Segmentation Of Oil Spills In Marine Systems, Mohamed Elsheref

LSU New Orleans Theses and Dissertations

Oil spills present critical environmental hazards, threatening marine ecosystems and necessitating fast, accurate detection for effective mitigation. Synthetic Aperture Radar (SAR) imagery has been instrumental in detecting oil spills, but manual interpretation is often inefficient and prone to errors. This study addresses the limitations of manual methods by proposing a deep learning approach for automated oil spill detection and segmentation.

Utilizing a novel transfer learning-based semantic segmentation model, this research focuses on detecting oil slicks on the sea surface with higher accuracy and efficiency. The model leverages pre-trained networks and incorporates U-Net variants, including UNet++ and MultiResUNet, to optimize spatial …

Enhancing Password Security And Memorability Using Machine Learning And Linguistic Patterns, Jared Wise

LSU New Orleans Theses and Dissertations

In the digital age, text-based passwords remain a primary method for securing online accounts. Yet, users frequently face a dilemma between creating passwords that are easy to remember and sufficiently secure against cyberattacks. This research introduces an approach to password generation that bridges this gap by utilizing linguistic patterns, particularly song lyrics, to develop highly secure and naturally memorable passwords. Using large lyric datasets gained from web scrapes from popular song lyric websites (AZ Lyrics, Genius), features are extracted from a corpus of over 5 million lyrics using sentence structure and natural language processing in a novel way. In using …

Cmos-Based Rotational Spectroscopy: Massive Spectral Fingerprint Generation And Molecular Detection With Deep Learning, Yasamin Fozouni

Computer Science and Engineering Theses and Dissertations

Rotational Spectroscopy is a powerful spectral fingerprinting approach that can be used for identifying different gas molecules in a sample. Gas molecules are free to rotate, with inertia, in fixed states of quantized energy. In Rotational Spectroscopy, radiative beams are shown onto a sample to cause an energy-based transition between quantized rotational states. By sweeping the frequency of the radiative beams and monitoring the absorption with a sensor, one can profile the different rotational states, monitoring for energy based transitions. These transitions are dependent on unique properties of the molecules, thus presenting a unique molecular identification fingerprint (in the form …

Innovations In Full-Stack Web Development: Front-End To Back-End, Yassine Chahid, Patrick Slattery

Publications and Research

This research explores emerging technologies within full-stack web development and their potential impact on current front-end and back-end solutions. Both areas employ crucial technologies that determine how end-users access information and navigate web services. Front-end solutions include HTML, JavaScript, and CSS which shape user interaction on websites. Back-end solutions use technologies such as SQL and PHP for the foundation of data processing, retrieval, and storage. The research method involves examining official documentation for these technologies to better understand their key components and to understand how their use in cyberspace has changed. The research will observe several high-traffic websites and domains …

Exploring The Capabilities Of Classifier-Free Guidance In Recommendation Tasks, Noah Buchanan

Graduate Theses and Dissertations

This thesis addresses the problem of recommending items to users based on their ratings of items through a diffusion recommender system. Regular recommender systems are already capable of efficient recommendation through conventional methods such as collaborative or content-based filtering. Diffusion is a new type of generative AI that aims to improve our previous AI's shortcomings in the generative domain, like Variational Autoencoders (VAEs) and Generative Adversarial Networks (GANs). We use diffusion to create a recommender system that mirrors the sequence users take when browsing and rating items. The current methods of recommendation with diffusion do not use the new innovation …

Towards Comprehensive And Interpretable Video Understanding, Khoa Vo

Graduate Theses and Dissertations

Video understanding is a critical domain in computer vision, focusing on analysis of sequential visual data to extract meaningful spatiotemporal information for tasks such as action recognition, video captioning, video retrieval, and temporal action localization, etc. Despite significant advancements with spatio-temporal convolutional neural networks and attention-based video models, current methods face limitations, including inadequate representation of main actors, lack of fine-grained modeling of relevant objects, and limited interpretability.
This thesis addresses these challenges by proposing novel approaches that enhance video understanding through modeling interactions among entities (actors and objects) and between entities and the environment, while improving interpretability in the …

Investigation Of Social Networks Upon Academic Performance And Mental Health, Rachel Izenson

Master's Theses

It has been shown that computing students have a statistically significantly lower overall sense of belongingness compared to other science students. A sense of community is important for many reasons. For example, there are studies that show that a student's sense of belonging correlates with improved academic performance. Our research aims to analyze the sense of belonging among computing students at Cal Poly San Luis Obispo through a network science lens. We surveyed for their sense of belonging, as well as their social network, to understand how friendships impact one's sense of belonging. When student responses were split by gender, …

Clusteredlog: Optimizing Log Structures For Efficient Data Recovery And Integrity Management In Database Systems, Mariha Siddika Ahmad, Brajendra Panda

Electrical Engineering and Computer Science Faculty Publications and Presentations

In modern database systems, efficient log management is crucial for ensuring data integrity and facilitating swift recovery from potential data corruption or system failures. Traditional log structures, which store operations sequentially as they occur, often lead to significant delays in accessing and recovering specific data objects due to their scattered nature across the log. ClusteredLog addresses the limitations of traditional logging methods by implementing a novel logical organization of log entries. Instead of simply storing operations sequentially, it groups related operations for each data item into clusters. As a result, ClusteredLog enables faster identification and recovery of damaged data items …