Other Computer Sciences Commons^™

Scalable, Secure, And Adaptable Perception Systems Through Adversarial Analysis And Federated Fine-Tuning, Arkajyoti Mitra

Computer Science and Engineering Dissertations - Archive

Perception systems are fundamental to intelligent machines, enabling them to sense, understand, and interpret complex environments. However, as perception increasingly underpins critical applications such as autonomous vehicles, IoT healthcare devices, and smart trading platforms, challenges related to security, scalability, and environmental understanding have become more pressing. This work addresses three core research questions: (1) How can we identify, analyze, and mitigate adversarial vulnerabilities in perception systems to ensure reliable operation under adversarial conditions? (2.1) How can AVPS models be efficiently scaled and fine-tuned across decentralized and resource-constrained environments while preserving privacy and performance? (2.2) How can we scale generative models …

Exploiting Artificial Intelligence And Optimization For Smart Agriculture, Jackson K. Butcher

Theses and Dissertations--Computer Science

Dynamic integration of Cyber-Physical Systems (CPS) and Artificial Intelligence (AI) has become a vital component for unlocking the potential of smart agriculture. Currently, limitations such as limited computational resources, poor network connectivity, and rigid treatment strategies stifle optimal agricultural outcomes. This creates a challenge of leveraging the capabilities of modern artificial intelligence to combat the natural and artificial constraints of the smart agriculture environment. The primary contribution of this thesis is the development of frameworks to alleviate the overhead data and computational demand for AI within smart agriculture settings. The first framework, iCrop+, utilizes TinyML and LoRa to guarantee high-precision …

Towards Smart Farming: Image-Based Crop Health Assessment And Disease Diagnosis Using Deep Learning Techniques, Kristina Botova

Master's Theses or Doctor of Nursing Practice

Accurate crop monitoring is essential for optimizing agricultural productivity and ensuring food security. This study presents a comprehensive deep learning framework for image crop type recognition, health status prediction, and disease detection using multiple Convolutional Neural Network (CNN) models. The proposed approach uses open-source datasets consisting of five crop types (apple, corn, grape, potato, tomato), varying health conditions, and common diseases. By deploying specialized CNN architecture focused on each task, the system achieves a high accuracy of 99.25% in classifying crop types, identifying health status, and detecting specific diseases. Compared to a single CNN model, the use of the proposed …

Efficient Task Scheduling In Cloud Infrastructures Using Dynamic Score-Based Allocation And Deep Q-Learning, Shadman Sakib

Graduate Theses/Dissertations

Cloud computing has grown rapidly in recent years, mainly due to the sharp increase in data transferred over the internet. This growth makes task scheduling a key and challenging part of cloud systems, as it helps distribute user requests across servers to minimize response time, prevent overloading, and ensure smooth user experience. This thesis proposes two novel approaches for dynamic task scheduling in cloud environments. First, a novel Score-Based Dynamic Load Balancing (SBDLB) strategy is developed, which leverages system parameters to allocate tasks efficiently across virtual machines (VMs) in data centers. SBDLB ensures balanced workload distribution by continuously evaluating VM …

Personalized Physics Learning Through Ai: Insights From Problem Generation, Chatbot Dialogues, And Intelligent Tutoring Systems, Atharva Dange

Physics Dissertations - Archive

Artificial intelligence (AI) is poised to transform science education, yet questions remain on how best to integrate these technologies into teaching and learning. This dissertation investigates the use of AI-driven tools in university physics courses through three complementary studies. In the first study, a generative language model (ChatGPT) was used to create novel physics homework problems aligned with course objectives. Analysis showed that, after expert vetting, AI-generated questions can foster higher-order problem-solving and reduce student reliance on solution memorization, though careful instructor oversight is required to ensure accuracy. The second study embedded an AI chatbot as a learning aid in …

Large Scale Machine Learning Over Knowledge Graphs, Bedirhan Gergin

Electronic Theses & Dissertations (2024 - present)

Knowledge graphs (KGs) have become popular across various fields, providing convenient access to web-based knowledge while storing and formalizing domain-specific information. By analyzing KGs, patterns, connections, and dependencies can be identified across different data sources, enabling the inference of new knowledge from given facts. As the use of KGs expands, the size of modern KGs has grown significantly, making them impossible to process within the main memory of a single computer. Distributed computing offers a viable solution to this challenge by leveraging the combined capabilities of multiple servers within a cluster. This thesis explores how distributed computing can be effectively …

Real-Time Feedback-Driven Framework For Automated Cybersickness Mitigation, Md Jahirul Islam

Master's Theses

As technologies are becoming more advanced day by day, the embracement of virtual reality (VR) technology among users is also increasing in daily activities for various purposes, and subsequently, the barrier between the real and virtual world is fading. Despite the versatile uses, cybersickness (CS) is a major problem which is induced among users due to the immersive VR experience. There is a plethora of research findings and methods to measure the users’ CS such as virtual reality sickness questionnaire (VRSQ), simulator sickness questionnaire (SSQ), fast motion scale questionnaire (FMS), and others. Recently, machine learning approaches have also been adopted …

How Does Augmentation Affect Feature Space: A Study Using Various Augmentation Methods In Distributed Learning, Nikil Sharan Prabahar Balasubramanian

Computer Science Theses

This thesis examines the impact of data augmentation techniques on model performance within a distributed learning framework, focusing on enhancing feature diversity and improving representation for under-represented classes. Data augmentation, commonly used to address data imbalance, significantly influences the feature space learned by deep learning models, with varied effects in distributed settings where data is split across nodes. Our study reveals that inconsistencies in feature learning across nodes reduce the benefits of local augmentation in capturing complex patterns, leading to suboptimal model performance. To address this, we propose a coherent augmentation approach that embeds consistent transformations in the central server, …

Q-Learning In Starclash, Hanani Pankaj

2024 Fall Honors Capstone Projects - Archive

Developers create video games using Artificial Intelligence (AI) agents to provide a challenging opponent in a single-player game. However, studies show that when Reinforcement Learning (RL) agents are used, they outperform the AI agents. This project sought to test how RL agents would perform in StarClash, a video game without RL agents, using Q-Learning. This was done by creating two Q-Learning agents: a Simple agent and an Advanced (more complex) agent. These two agents were tested against each other and a Random AI agent. As expected, the Advanced agent did better than the Simple agent but only performed slightly better, …

Patterns Of Interactions In Human-Machine Teams, Kazuhiko Momose

Theses and Dissertations

Increasingly capable machines, including Artificial Intelligence (AI) agents are playing a more important role in a wide range of applications, including human daily activities and safety-critical systems. They can benefit even more when humans and such machines agents work together as a team by leveraging each other's strengths and complementing each other to enhance overall performance. To design high-performing teams, it is critical to analyze the team dynamics and understand how humans and machines interact with each other. Collaboration, Coordination, and Cooperation (3Cs) are terms typically used to describe the behavior of teams. However, these terms tend to be used …

Basic Safety Message Generation Through A Video-Based Analytics For Potential Safety Application, Abyad Enan

All Theses

With the advancement of modern artificial intelligence techniques, computer vision can play a vital role in enhancing roadway safety by reducing the risk of imminent collisions. To do so, a vision-based safety application is required, where a roadside camera can monitor the roadway traffic and predict potential risks of crashes in real-time. If any risky situation or behavior is observed that may lead to a crash, then a safety application can send warnings to the vehicles at risk. For vision-based safety applications on a roadway section, it is important to accurately monitor each vehicle’s location, speed, acceleration, heading direction, etc. …

Time Series Decomposition Of Land Surface Temperature For Long-Term Trend Forecasting And Impact On Nesting Sea Turtle Habitats In The Arabian Gulf, Sachi Perera, Rommel H. Maneja, Mohamed Allali, Cyril Rakovski, Erik Linstead, Daniele Struppa, Ali Qasem, Hesham El-Askary

Mathematics, Physics, and Computer Science Faculty Articles and Research

Improving land surface temperature (LST) modeling is vital for mitigating climate change effects on various ecosystems and marine habitats such as important sea turtle habitats. Over the past decade, extreme temperatures have likely significantly affected nesting sea turtle habitats in the Arabian Gulf, with predominantly female hatchlings creating an imbalance in the sex ratio. Such shifts have profound implications for these habitats’ long-term survival and conservation management. This study leverages statistical machine learning models to measure ongoing temporal variations in LST. We break down the LST time series into trend, seasonal, and noise components using classical decomposition methods like X11, …

Enhancing Place-Based Interaction With Emotion Ai And Augmented Reality, Jake Maier, Ivan Martinez

College of Engineering Summer Undergraduate Research Program

This project explores the integration of augmented reality (AR) and Emotion AI technologies to enhance user experiences in physical environments. By seamlessly merging virtual elements with real-world contexts, we aim to deepen individuals’ interactions and perceptions of their surroundings. Leveraging AR technology enables users to access contextual information, engage with interactive content, and navigate spaces with heightened immersion and understanding. Additionally, Emotion AI enhances these experiences by detecting and responding to users’ emotional states, fostering personalized and emotionally resonant interactions. We aim to integrate digital content within physical environments using mixed-reality headsets equipped with eye-tracking capabilities and consumer-grade wireless EEG …

A Guideline For Open-Source Tools To Make Medical Imaging Data Ready For Artificial Intelligence Applications: A Society Of Imaging Informatics In Medicine (Siim) Survey, Sanaz Vahdati, Bardia Khosravi, Elham Mahmoudi, Kuan Zhang, Pouria Rouzrokh, Shahriar Faghani, Mana Moassefi, Aylin Tahmasebi, Katherine Andriole, Peter Chang, Keyvan Farahani, Mona Flores, Les Folio, Sina Houshmand, Maryellen Giger, Judy Gichoya, Bradley Erickson

Department of Radiology Faculty Papers

In recent years, the role of Artificial Intelligence (AI) in medical imaging has become increasingly prominent, with the majority of AI applications approved by the FDA being in imaging and radiology in 2023. The surge in AI model development to tackle clinical challenges underscores the necessity for preparing high-quality medical imaging data. Proper data preparation is crucial as it fosters the creation of standardized and reproducible AI models while minimizing biases. Data curation transforms raw data into a valuable, organized, and dependable resource and is a fundamental process to the success of machine learning and analytical projects. Considering the plethora …

Rethinking Retrieval Augmented Fine-Tuning In An Evolving Llm Landscape, Nicholas Sager, Timothy Cabaza, Matthew Cusack, Ryan Bass, Joaquin Dominguez

SMU Data Science Review

This study explores the utilization of Retrieval Augmented Fine-Tuning (RAFT) to enhance the performance of Large Language Models (LLMs) in domain-specific Retrieval Augmented Generation (RAG) tasks. By integrating domain-specific information during the retrieval process, RAG aims to reduce hallucination and improve the accuracy of LLM outputs. We investigate the use of RAFT, an approach that enhances LLMs by incorporating domain-specific knowledge and effectively handling distractor documents. This paper validates previous work, which found that RAFT can considerably improve the performance of Llama2-7B in specific domains. We also expand upon previous work into new state-of-the-art open-source models and other datasets with …

Advancing Affective Computing: Emotion Recognition And Tracking Across Diverse Contexts (Varied Environments), Shao Liu

Dissertations, Theses, and Capstone Projects

Affective Computing (AC) is an interdisciplinary field that recognizes, interprets, and processes human emotions. Emotions are complex, involving consciousness, physical sensations, and behavioral expressions, and are significant in various domains like mental health, human-computer interaction, and social security. Real-world applications of AC include monitoring drivers’ emotional states to improve road safety and understanding the emotions expressed by artists in visual arts. Traditional methods relying on facial expressions often fall short due to the nuanced nature of emotions, which vary across individuals, cultures, and contexts. Accurate AC systems require sophisticated, multimodal models to handle these variations and external factors like noise …

Offensive Content Detection In Online Social Platforms, Ebuka Okpala

All Dissertations

Online social platforms enable users to connect with large, diverse audiences and the ability for a message or content to flow from one user to another user, user to followers, followers to user, and followers to followers. Of course, the advantages of this are apparent, and the dangers are also clearly obvious. The user-generated content could be abusive, offensive, or hateful to other users, possibly leading to adverse health effects or offline harm. As more of society's public discourse and interaction move online and these platforms grow and increase their reach, it is inherently important to protect the safety of …

Bridging Design And Perception: Novel Tools And Technologies For Creating Effective Human-Robot Interactions, Benjamin Dossett

Electronic Theses and Dissertations

This thesis explores human perception of robots through the use of novel tools and technologies. First, the impact of Augmented Reality (AR) data presentation on human perception of robots is investigated. A study conducted with the AR human-robot teaming system found that robot performance significantly influenced participants’ perceptions, overshadowing the impact of matching or mismatching robot confidence feedback. Second, the DU Want to Build-A-Bot platform is presented, which enables participatory robot design and opens the door for novel research of how robot design affects human perception. The Build-A-Bot platform enables the collection of diverse robot designs, facilitating machine learning analysis …

Machine Learning Multimodal Framework For Fake News Detection And Mitigation, Nada A. Gaballah

Theses and Dissertations

Social media has become our new reality, people wake up every morning and the first thing they do before getting out of bed, is check their social media. Nowadays, people rarely read newspapers, they even rarely watch TV news or listen to radio broadcasts. In recent years, we have witnessed lots of fake news roaming social media every second, with people simply believing it and spreading it even more without checking the credibility of this news. This fake news affected several domains like what happened in the US election in 2016 and again in 2020, the false information about Covid-19 …

Context In Computer Vision: A Taxonomy, Multi-Stage Integration, And A General Framework, Xuan Wang

Dissertations, Theses, and Capstone Projects

Contextual information has been widely used in many computer vision tasks, such as object detection, video action detection, image classification, etc. Recognizing a single object or action out of context could be sometimes very challenging, and context information may help improve the understanding of a scene or an event greatly. However, existing approaches design specific contextual information mechanisms for different detection tasks.

In this research, we first present a comprehensive survey of context understanding in computer vision, with a taxonomy to describe context in different types and levels. Then we proposed MultiCLU, a new multi-stage context learning and utilization framework, …

Combining Cloud Architecting With Education, Sharon P. Pagidipati

Liberal Arts and Engineering Studies

I pursued the AWS Solutions Architect Professional Certification while applying my knowledge to build and revise technical solutions for an educational company known as EDFX.

Toward Intuitive 3d Interactions In Virtual Reality: A Deep Learning- Based Dual-Hand Gesture Recognition Approach, Trudi Di Qi, Franceli L. Cibrian, Meghna Raswan, Tyler Kay, Hector M. Camarillo-Abad, Yuxin Wen

Engineering Faculty Articles and Research

Dual-hand gesture recognition is crucial for intuitive 3D interactions in virtual reality (VR), allowing the user to interact with virtual objects naturally through gestures using both handheld controllers. While deep learning and sensor-based technology have proven effective in recognizing single-hand gestures for 3D interactions, research on dual-hand gesture recognition for VR interactions is still underexplored. In this work, we introduce CWT-CNN-TCN, a novel deep learning model that combines a 2D Convolution Neural Network (CNN) with Continuous Wavelet Transformation (CWT) and a Temporal Convolution Network (TCN). This model can simultaneously extract features from the time-frequency domain and capture long-term dependencies using …

Toward The Integration Of Behavioral Sensing And Artificial Intelligence, Subigya K. Nepal

Dartmouth College Ph.D Dissertations

The integration of behavioral sensing and Artificial Intelligence (AI) has increasingly proven invaluable across various domains, offering profound insights into human behavior, enhancing mental health monitoring, and optimizing workplace productivity. This thesis presents five pivotal studies that employ smartphone, wearable, and laptop-based sensing to explore and push the boundaries of what these technologies can achieve in real-world settings. This body of work explores the innovative and practical applications of AI and behavioral sensing to capture and analyze data for diverse purposes. The first part of the thesis comprises longitudinal studies on behavioral sensing, providing a detailed, long-term view of how …

Automated Cinematographer For Vr Viewing Experiences, Zihan Wu

Dartmouth College Master’s Theses

As the virtual reality (VR) industry continues to evolve, the question of how to effectively capture VR experiences for an audience remains a challenge. The predominant method of showcasing VR applications through first-person recordings lacks cinematic interest, failing to capture other viewpoints and the essence of the moment. Meanwhile, manually setting up cameras and editing videos requires technical expertise on behalf of the user. In this paper, we propose the use of machine learning (ML) to automatically select the most compelling predefined viewpoint in a VR environment, at any given moment. Our models, trained on actor motion and voice volume, …

Comparative Predictive Analysis Of Stock Performance In The Tech Sector, Asaad Sendi

LSU New Orleans Theses and Dissertations

This study compares the performance of deep learning models, including Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU), and Transformer, in predicting stock prices across five companies (AAPL, CSCO, META, MSFT, and TSLA) from July 2019 to July 2023. Key findings reveal that GRU models generally exhibit the lowest Mean Absolute Error (MAE), indicating higher precision, particularly notable for CSCO with a remarkably low MAE. While LSTM models often show slightly higher MAE values, they outperform Transformer models in capturing broader trends and variance in stock prices, as evidenced by higher R-squared (R2) values. Transformer models generally exhibit higher MAE …

Choreographing The Rhythms Of Observation: Dynamics For Ranged Observer Bipartite-Unipartite Spatiotemporal (Robust) Networks, Edward A. Holmberg Iv

LSU New Orleans Theses and Dissertations

Existing network analysis methods struggle to optimize observer placements in dynamic environments with limited visibility. This dissertation introduces the novel ROBUST (Ranged Observer Bipartite-Unipartite SpatioTemporal) framework, offering a significant advancement in modeling, analyzing, and optimizing observer networks within complex spatiotemporal domains. ROBUST leverages a unique bipartite-unipartite approach, distinguishing between observer and observable entities while incorporating spatial constraints and temporal dynamics.

This research extends spatiotemporal network theory by introducing novel graph-based measures, including myopic degree, spatial closeness centrality, and edge length proportion. These measures, coupled with advanced clustering techniques like Proximal Recurrence, provide insights into network structure, resilience, and the effectiveness …

Cardiogpt: An Ecg Interpretation Generation Model, Guohua Fu, Jianwei Zheng, Islam Abudayyeh, Chizobam Ani, Cyril Rakovski, Louis Ehwerhemuepha, Hongxia Lu, Yongjuan Guo, Shenglin Liu, Huimin Chu, Bing Yang

Mathematics, Physics, and Computer Science Faculty Articles and Research

Numerous supervised learning models aimed at classifying 12-lead electrocardiograms into different groups have shown impressive performance by utilizing deep learning algorithms. However, few studies are dedicated to applying the Generative Pre-trained Transformer (GPT) model in interpreting electrocardiogram (ECG) using natural language. Thus, we are pioneering the exploration of this uncharted territory by employing the CardioGPT model to tackle this challenge. We used a dataset of ECGs (standard 10s, 12-channel format) from adult patients, with 60 distinct rhythms or conduction abnormalities annotated by board-certified, actively practicing cardiologists. The ECGs were collected from The First Affiliated Hospital of Ningbo University and Shanghai …

Deep Learning-Based Human Action Understanding In Videos, Elahe Vahdani

Dissertations, Theses, and Capstone Projects

The understanding of human actions in videos holds immense potential for technological advancement and societal betterment. This thesis explores fundamental aspects of this field, including action recognition in trimmed clips and action localization in untrimmed videos. Trimmed videos contain only one action instance, with moments before or after the action excluded from the video. However, the majority of videos captured in unconstrained environments, often referred to as untrimmed videos, are naturally unsegmented. Untrimmed videos are typically lengthy and may encompass multiple action instances, along with the moments preceding or following each action, as well as transitions between actions. In the …

Usage And Knowledge Of Online Tools And Generative Ai: A Survey Of Students, Rahul R. Divekar Phd, Lisette Gonzalez, Sophia Guerra, Natasha Boos

Department of Experience Design (XD) Faculty Publications

Artificial Intelligence (AI) tools like ChatGPT are poised to transform student and educator workflows in higher education. However, there is less documentation on the range of tools students in higher education use, how they use them and in coordination with other online tools for learning, and their expertise using AI tools. We present a mixed-method analysis of a survey conducted at a doctoral-granting university in the United States investigating the adoption of AI tools in the context of other technologies. The findings include how the students used GenAI tools in light of other on-line technologies, their perception of expertise on …

Using Ai For Qualitative Labeling: Consistency And Comparisons, James Mcintyre

Honors Program Theses

This paper details a research study evaluating AI's ability to perform qualitative deductive coding. Multiple AI models were utilized and compared against three human coders and one expert coder. A series of 107 statements were sourced from a group discussion for a qualitative impact assessment of an organization. The AI models were provided these statements and directed to code them using the Community Capitals Framework. Two generations of AI models were evaluated. Overall, the AI achieved a fair level of agreement with the human annotators, but the alignment was far from perfect. Newer AI models did not increase agreement with …