Computer Sciences Commons^™

Mermaid: A Dataset And Framework For Multimodal Meme Semantic Understanding, Shaun Toh, Adriel Kuek, Wen Haw Chong, Roy Ka Wei Lee

Research Collection School Of Computing and Information Systems

Memes are widely used to convey cultural and societal issues and have a significant impact on public opinion. However, little work has been done on understanding and explaining the semantics expressed in multimodal memes. To fill this research gap, we introduce MERMAID, a dataset consisting of 3,633 memes annotated with their entities and relations, and propose a novel MERF pipeline that extracts entities and their relationships in memes. Our framework combines state-of-the-art techniques from natural language processing and computer vision to extract text and image features and infer relationships between entities in memes. We evaluate the proposed framework on a …

Multitasking Scheduling With Shared Processing, Bin Fu, Yumei Huo, Hairong Zhao

Computer Science Faculty Publications

Recently, the problem of multitasking scheduling has raised a lot of interest in the service industries. Hall et al. (Discrete Applied Mathematics, 2016) proposed a shared processing multitasking scheduling model which allows a team to continue to work on the primary tasks while processing the routinely scheduled activities as they occur. With a team being modeled as a single machine, the processing sharing of the machine is achieved by allocating a fraction of the processing capacity to routine jobs and the remaining fraction, which we denote as sharing ratio, to the primary jobs. In this paper, we generalize this model …

A Hybrid Cognitive Model For Machine Agents In Project And Action Teams, Joshua A. Lapso

Theses and Dissertations

High performing human teams transcend complex domain uncertainty by achieving an emergent state of shared cognition, in which knowledge is organized, represented, and distributed to team members for rapid execution. However, this requires that individuals emit perceivable qualities upon which other members can make inferences about intent. In pursuit of future human and machine team studies, this research presents a hybrid cognitive model for machine agents in fully cooperative and semi-cooperative action and project teams. The hybrid cognitive model unifies the characteristics of the shared mental model and transactive memory system. The resultant model facilitates anytime selection over the two …

Federated Active Learning For Network Intrusion Detection, Matthew D. R. Sauer

Theses and Dissertations

This thesis addresses challenges with detecting attacks on computer networks within a Federated Learning (FL) framework, when labeled instances are few. We explore the integration of active learning (AL) and semi-supervised learning (SSL). AL efficiently uses data that would otherwise be wasted or require substantial time for labeling. SSL provides capacity to train models that have a limited amount of labeled data, by utilizing additional unlabeled data that is available. We show how FL combined with AL or SSL can realize a detection system that adapts and trains quickly to new networks, reducing the total amount of data labeling needed. …

Marss: Multi-Agent Reinforcement Learning For Satellite Swarms, Nicholas J. Yielding

Theses and Dissertations

Multi-agent systems and swarms in spacecraft formation flying are of ever-increasing importance in a contested space environment—use of multiple spacecraft to contribute to a cooperative mission potentially increases positive outcomes on orbit, while autonomy becomes an ever more important requirement to reduce reaction time in dynamic situations and lower the burden on space operators. This research explores difficult swarm Guidance Navigation and Control (GNC) scenarios using Deep Reinforcement Learning (DRL). DRL polices are trained to provide guidance inputs to agents in multi-agent swarm environments for completing complex, teamwork focused objectives in geosynchronous orbit. An example scenario is explored for a …

Cvii: Enhancing Interpretability In Intelligent Sensor Systems Via Computer Vision Interpretability Index, Hossein Mohammadi, Krishnaprasad Thirunarayan, Lingwei Chen

Computer Science and Engineering Faculty Publications

In the realm of intelligent sensor systems, the dependence on Artificial Intelligence (AI) applications has heightened the importance of interpretability. This is particularly critical for opaque models such as Deep Neural Networks (DNN), as understanding their decisions is essential, not only for ethical and regulatory compliance, but also for fostering trust in AI-driven outcomes. This paper introduces the novel concept of a Computer Vision Interpretability Index (CVII). The CVII framework is designed to emulate human cognitive processes, specifically in tasks related to vision. It addresses the intricate challenge of quantifying interpretability, a task that is inherently subjective and varies across …

Towards A Model Of The Mapping Between English And Spanish Prosody, Jonathan Avila

Open Access Theses & Dissertations

Current speech-to-speech translation systems face challenges in effectively translating the nuances of prosody, which plays a pivotal role in conveying speaker intent and stance in dialog. This limitation restricts cross-lingual communication, especially in situations demanding deeper interpersonal understanding. To address this, this research delves into the relationships between prosody and its pragmatic functions, in English and Spanish. First, I discuss a data collection protocol in which bilingual speakers re-enact utterances from an earlier conversation in their other language, then describe an English-Spanish corpus, consisting of 3816 matched utterance pairs. Second, I describe a prosodic dissimilarity metric based on Euclidean distance …

Security Analysis Of Holystone Drones: Examining Attack Vectors And Data Extraction Techniques, Sandesh Ambadas More

Theses and Dissertations

In recent years, the surge in popularity of small-scale Unmanned Aerial Vehicles (UAVs), especially Holy Stone models, has raised significant security concerns. This study examines specific Holy Stone drone models, including the HS 175D, HS 430, HS 360S, and HS720, focusing on sub-250g drones exempt from FAA registration and those requiring registration and Remote ID. Despite advancements in drone technology, our research reveals persistent vulnerabilities that could be exploited by malicious actors for illicit purposes, posing a substantial security risk. Our comprehensive analysis involved simulated attacks in identifying and exploiting these vulnerabilities, leading to the successful acquisition of flight logs, …

Leveraging Generative Agents: Autonomous Ai With Simulated Personas For Interactive Simulacra And Collaborative Research, James Hutson, Jay Ratican

Faculty Scholarship

The advent of large language models (LLMs) and AI learning have fundamentally reshaped the research landscape, paving the way for novel problem-solving approaches. This paper introduces a unique framework that leverages the capabilities of autonomous AI agents with simulated personas to drive collaborative research in groundbreaking ways. Inspired by a recent study of autonomous agents mirroring human behavior, this concept encourages the use of a cadre of AI agents, each possessing specialized expertise for collective endeavors. By replicating human diversity in teamwork, this approach targets complex and hitherto unsolvable issues. The key to this strategy is persona and emotional simulation, …

The Use Of Deception In Dementia-Care Robots: Should Robots Tell "White Lies" To Limit Emotional Distress?, Samuel R. Cox, Grace Cheong, Wei Tsang Ooi

ROSA Journal Articles and Publications

With projections of ageing populations and increasing rates of dementia, there is need for professional caregivers. Assistive robots have been proposed as a solution to this, as they can assist people both physically and socially. However, caregivers often need to use acts of deception (such as misdirection or white lies) in order to ensure necessary care is provided while limiting negative impacts on the cared-for such as emotional distress or loss of dignity. We discuss such use of deception, and contextualise their use within robotics.

Data-Centric Image Super-Resolution In Magnetic Resonance Imaging: Challenges And Opportunities, Mamata Shrestha

Graduate Theses and Dissertations

Super-resolution has emerged as a crucial research topic in the field of Magnetic Resonance Imaging (MRI) where it plays an important role in understanding and analysis of complex, qualitative, and quantitative characteristics of tissues at high resolutions. Deep learning techniques have been successful in achieving state-of-the-art results for super-resolution. These deep learning-based methods heavily rely on a substantial amount of data. Additionally, they require a pair of low-resolution and high-resolution images for supervised training which is often unavailable. Particularly in MRI super-resolution, it is often impossible to have low-resolution and high-resolution training image pairs. To overcome this, existing methods for …

The Analysis And Impact Of Artificial Intelligence On Job Loss, Ava Baratz

Cybersecurity Undergraduate Research Showcase

This paper illustrates the analysis and impact of Artificial Intelligence (AI) on job loss across various industries. This paper will discuss an overview of AI technology, a brief history of AI in industry, the positive impacts of AI, the negative impacts of AI on employment, AI considerations that contribute to job loss, the future outlook of AI, and employment loss mitigation strategies Various professional source articles and reputable blog posts will be used to finalize research on this topic.

Perception Of Bias In Chatgpt: Analysis Of Social Media Data, Abdullah Wahbeh, Mohammad A. Al-Ramahi, Omar El-Gayar, Ahmed El Noshokaty, Tareq Nasralah

Computer Information Systems Faculty Publications (Archived)

In this study, we aim to analyze the public perception of Twitter users with respect to the use of ChatGPT and the potential bias in its responses. Sentiment and emotion analysis were also analyzed. Analysis of 5,962 English tweets showed that Twitter users were concerned about six main types of biases, namely: political, ideological, data & algorithmic, gender, racial, cultural, and confirmation biases. Sentiment analysis showed that most of the users reflected a neutral sentiment, followed by negative and positive sentiment. Emotion analysis mainly reflected anger, disgust, and sadness with respect to bias concerns with ChatGPT use.

Discourses Across Periods Of Time, Amanda Raquel Moreno

Theses

This literature review explores the revolutionary effect of generative artificial intelligence (AI) and virtual reality (VR) on digital art history, specifically concentrating on their capacity to enable dialogical exchanges with historical figures and deepen the understanding of artworks. This study considers the current state of research, detecting key methodologies, areas of improvement, and possible challenges and ethical concerns. The example historical figure used in this analysis is the iconic Mexican artist Frida Kahlo. Kahlo’s refusal to correspond to a specific artistic style makes her an ideal subject for generative AI and VR-based investigation, offering fresh insights into her work. The …

Security Compliance And Work-Issued Mobile Devices: Out Of Sight, Out Of Mind?, Kent Marett, Shan Xiao, Sumin Kim

Business and Information Technology Faculty Research & Creative Works

For security, economic, and efficiency reasons, many businesses supply mobile devices to employees to use both in the workplace and remotely, accompanied by policies governing their appropriate use. Extant research has shown that work-issued mobile devices can disrupt employees' perceptions of work-life balance (WLB) and, indeed, WLB can impact employees' job satisfaction and performance. The global COVID-19 pandemic meant that more employees than usual performed their work remotely, but this situation may have not fit the preferred WLB for some. Did this encroachment mean that appropriate use policies were forgotten? We conducted two rounds of surveys, one pre-pandemic and the …

Electronic Note-String Detector, Gavin Garcia-Rossi, Tommy Smail

Electrical Engineering

As the virtual space has become a dominant part of everyone’s day-to-day lives, many normal face-to-face interactions and services have not yet been facilitated by adapting technology. One of these prevailing areas is music lessons. Over Zoom meetings, or other virtual platforms, it is tremendously challenging to teach students. These challenges include recognizing student mistakes audibly and visually, and being able to give confident feedback on the incorrect notes played by learning musicians. Without having to delve into improving the complex systems that would be required to improve audio, video, and connection quality of these connections, we have another solution …

Dropped Objects Recognition In Offshore Operations Based On Computer Vision And Artificial Intelligence, Xiaochuan Yu

LSU New Orleans Theses and Dissertations

We are more interested in recovering and salvaging containers which may be loaded with either valuable or harmful substances. Therefore, we designed various container models to account for different loading conditions and then exported them to a 3D printer. Six small container models were dropped into the trailer pool at the University of New Orleans (UNO) as planned at angles of 0°, 45°, and 90°.

After collecting all the videos using a high-definition camera set outside the tank, we perform pre-processing tasks on the videos in preparation for model training. The two-phase angle classification method uses a pretrained ResNet50 model …

Janus: Toward Preventing Counterfeits In Supply Chains Utilizing A Multi-Quorum Blockchain, Vika Crossland, Connor Dellwo, Golam Bashar, Gaby G. Dagher

Computer Science Faculty Publications and Presentations

The modern pharmaceutical supply chain lacks transparency and traceability, resulting in alarming rates of counterfeit products entering the market. These illegitimate products cause harm to end users and wreak havoc on the supply chain itself, costing billions of dollars in profit loss. In this paper, in response to the Drug Supply Chain Security Act (DSCSA), we introduce Janus, a novel pharmaceutical track-and-trace system that utilizes blockchain and cloning-resistant hologram tags to prevent counterfeits from entering the pharmaceutical supply chain. We design a multi-quorum consensus protocol that achieves load balancing across the network. We perform a security analysis to show robustness …

Preventing Inferences Through Data Dependencies On Sensitive Data, Primal Pappachan, Shufan Zhang, Xi He, Sharad Mehrotra

Computer Science Faculty Publications and Presentations

Simply restricting the computation to non-sensitive part of the data may lead to inferences on sensitive data through data dependencies. Inference control from data dependencies has been studied in the prior work. However, existing solutions either detect and deny queries which may lead to leakage – resulting in poor utility, or only protects against exact reconstruction of the sensitive data – resulting in poor security. In this paper, we present a novel security model called full deniability. Under this stronger security model, any information inferred about sensitive data from non-sensitive data is considered as a leakage. We describe algorithms for …

Use Of Ai To Recreate And Repatriate Lost, Destroyed Or Stolen Paintings: The 1785 Parisian Salon Case Study, Charles E. O'Brien, James Hutson, Trent Olsen, Jay Ratican

Faculty Scholarship

This study investigates the efficacy of artificial intelligence (AI) in the field of artwork restoration, focusing on lost, stolen, or destroyed artworks. Employing a dual approach that combines traditional manual restoration techniques with advanced generative AI tools, the research centers on a case study of the 1785 Parisian Salon. It specifically examines the reconstitution of Antoine François Callet's painting, Achilles Dragging the Body of Hector, unveiled alongside Jacques-Louis David's Oath of the Horatii. The study utilizes Easy Diffusion and Stable Diffusion 2.1 technologies for inpainting and colorization processes. These AI tools are employed in concert with manual restoration practices to …

Ensuring Non-Repudiation In Long-Distance Constrained Devices, Ethan Blum

Honors Theses

Satellite communication is essential for the exploration and study of space. Satellites allow communications with many devices and systems residing in space and on the surface of celestial bodies from ground stations on Earth. However, with the rise of Ground Station as a Service (GsaaS), the ability to efficiently send action commands to distant satellites must ensure non-repudiation such that an attacker is unable to send malicious commands to distant satellites. Distant satellites are also constrained devices and rely on limited power, meaning security on these devices is minimal. Therefore, this study attempted to propose a novel algorithm to allow …

Cloud Computing In The World Of Generative Ai, Yassine Chahid, Patrick Slattery

Publications and Research

The purpose of this research is to evaluate the progress of cloud computation and generative artificial intelligence, and how the improvements in these respective technologies could be combined for future uses. Cloud computation and generative AI have rapidly developed in their capabilities. By analyzing the ways in which cloud computing and generative AI have been implemented thus far, a better understanding can be established regarding how they may influence current tech solutions within the information technology sector and beyond. The first portion of research consisted of researching the current capabilities of the two technologies respectively. By reviewing relevant publications and …

Deficiency Of Acute-Phase Serum Amyloid A Exacerbates Sepsis-Induced Mortality And Lung Injury In Mice, Ailing Ji, Andrea C. Trumbauer, Victoria P. Noffsinger, Luke W. Meredith, Brittany Dong, Qian Wang, Ling Guo, Xiangan Li, Frederick C. De Beer, Nancy R. Webb, Lisa R. Tannock, Marlene E. Starr, Christopher M. Waters, Preetha Shridas

Saha Cardiovascular Research Center Faculty Publications

Serum amyloid A (SAA) is a family of proteins, the plasma levels of which may increase >1000-fold in acute inflammatory states. We investigated the role of SAA in sepsis using mice deficient in all three acute-phase SAA isoforms (SAA-TKO). SAA deficiency significantly increased mortality rates in the three experimental sepsis mouse models: cecal ligation and puncture (CLP), cecal slurry (CS) injection, and lipopolysaccharide (LPS) treatments. SAA-TKO mice had exacerbated lung pathology compared to wild-type (WT) mice after CLP. A bulk RNA sequencing performed on lung tissues excised 24 h after CLP indicated significant enrichment in the expression of genes associated …

Role Of Authentication Factors In Fin-Tech Mobile Transaction Security, Habib Ullah Khan, Muhammad Sohail, Shah Nazir, Tariq Hussain, Babar Shah, Farman Ali

All Works

Fin-Tech is the merging of finance and technology, to be considered a key term for technology-based financial operations and money transactions as far as Fin-Tech is concerned. In the massive field of business, mobile money transaction security is a great challenge for researchers. The user authentication schemes restrict the ability to enforce the authentication before the account can access and operate. Although authentication factors provide greater security than a simple static password, financial transactions have potential drawbacks because cybercrime expands the opportunities for fraudsters. The most common enterprise challenge is mobile-based user authentication during transactions, which addresses the security issues …

Learning Heterogeneous Subgraph Representations For Team Discovery, Radin Hamidi Rad, Hoang Nguyen, Feras Al-Obeidat, Ebrahim Bagheri, Mehdi Kargar, Divesh Srivastava, Jaroslaw Szlichta, Fattane Zarrinkalam

All Works

The team discovery task is concerned with finding a group of experts from a collaboration network who would collectively cover a desirable set of skills. Most prior work for team discovery either adopt graph-based or neural mapping approaches. Graph-based approaches are computationally intractable often leading to sub-optimal team selection. Neural mapping approaches have better performance, however, are still limited as they learn individual representations for skills and experts and are often prone to overfitting given the sparsity of collaboration networks. Thus, we define the team discovery task as one of learning subgraph representations from a heterogeneous collaboration network where the …

On Hierarchical Clustering-Based Approach For Rddbs Design, Hassan I. Abdalla, Ali A. Amer, Sri Devi Ravana

All Works

Distributed database system (DDBS) design is still an open challenge even after decades of research, especially in a dynamic network setting. Hence, to meet the demands of high-speed data gathering and for the management and preservation of huge systems, it is important to construct a distributed database for real-time data storage. Incidentally, some fragmentation schemes, such as horizontal, vertical, and hybrid, are widely used for DDBS design. At the same time, data allocation could not be done without first physically fragmenting the data because the fragmentation process is the foundation of the DDBS design. Extensive research have been conducted to …

Enhanced Privacy-Enabled Face Recognition Using Κ-Identity Optimization, Ryan Karl

Department of Electrical and Computer Engineering: Dissertations, Theses, and Student Research

Facial recognition is becoming more and more prevalent in the daily lives of the common person. Law enforcement utilizes facial recognition to find and track suspects. The newest smartphones have the ability to unlock using the user's face. Some door locks utilize facial recognition to allow correct users to enter restricted spaces. The list of applications that use facial recognition will only increase as hardware becomes more cost-effective and more computationally powerful. As this technology becomes more prevalent in our lives, it is important to understand and protect the data provided to these companies. Any data transmitted should be encrypted …

Building Squares With Optimal State Complexity In Restricted Active Self-Assembly, Robert M. Alaniz, David Caballero, Sonya C. Cirlos, Timothy Gomez, Elize Grizzell, Andrew Rodriguez, Robert Schweller, Armando Tenorio, Tim Wylie

Computer Science Faculty Publications

Tile Automata is a recently defined model of self-assembly that borrows many concepts from cellular automata to create active self-assembling systems where changes may be occurring within an assembly without requiring attachment. This model has been shown to be powerful even with limited assembly size, but many fundamental questions have yet to be explored. Here, we study the state complexity of assembling n×n squares in seeded Tile Automata systems where growth starts from a seed and tiles attach one at a time, similar to the abstract Tile Assembly Model. We provide optimal bounds for three classes of seeded Tile Automata …

Llm4vis: Explainable Visualization Recommendation Using Chatgpt, Lei Wang, Songheng Zhang, Yun Wang, Ee-Peng Lim, Yong Wang

Research Collection School Of Computing and Information Systems

Data visualization is a powerful tool for exploring and communicating insights in various domains. To automate visualization choice for datasets, a task known as visualization recommendation has been proposed. Various machine-learning-based approaches have been developed for this purpose, but they often require a large corpus of dataset-visualization pairs for training and lack natural explanations for their results. To address this research gap, we propose LLM4Vis, a novel ChatGPT-based prompting approach to perform visualization recommendation and return human-like explanations using very few demonstration examples. Our approach involves feature description, demonstration example selection, explanation generation, demonstration example construction, and inference steps. To …

Refinement-Based Specification And Analysis Of Multi-Core Arinc 653 Using Event-B, Feng Zhang, Leping Zhang, Yongwang Zhao, Yang Liu, Jun Sun

Research Collection School Of Computing and Information Systems

ARINC 653 as the de facto standard of partitioning operating systems has been applied in many safety-critical domains. The multi-core version of ARINC 653, ARINC 653 Part 1-4 (Version 4), provides support for services to be utilized with a module that contains multiple processor cores. Formal specification and analysis of this standard document could provide a rigorous specification and uncover concealed errors in the textual description of service requirements. This article proposes a specification method for concurrency on a multi-core platform using Event-B, and a refinement structure for the complicated ARINC 653 Part 1-4 provides a comprehensive, stepwise refinement-based Event-B …