Artificial Intelligence and Robotics Commons^™

Robustness Of Vision Language Models For Pedestrian Detection Tasks, Ostonya K. Thomas

All Theses

Autonomous vehicle (AV) systems typically employ modular systems in which discrete components handle separate tasks such as perception, computation, and path planning. While flexible, this approach allows errors to propagate and compound across the pipeline, and many AI systems offer little transparency into their internal decision-making. Such limitations are particularly concerning in safety-critical domains where failures can carry lethal consequences. Vision Language Models (VLMs) have emerged as a promising alternative because they support end-to-end implementations that bypass compounding error risks and provide natural language explanations of their outputs. Despite these advantages, prior research has demonstrated that both computer vision systems …

Beyond The Interface: Human Perceptions Of Generative-Ai Chatbots As Conversational Partners, Browning W.E. Blair

All Theses

Generative AI (gen-AI) chatbots are becoming embedded in everyday communicative life, yet it remains unclear whether users perceive these systems as socially reciprocative conversational partners. Therefore, this study examines how young adults understand and interact with gen-AI chatbots, focusing on perceptions of conversational partnership, anthropomorphism, politeness, discomfort, and technical understanding. Guided by the CASA framework, Media Equation Theory, and the uncanny valley hypothesis, this study employed four semi-structured, online focus groups with 15 undergraduate students and recent college graduates in the United States. Findings indicate that participants did not broadly perceive gen-AI chatbots as conversational partners in the interpersonal sense. …

Learning Global Context For Sparse Activity Recognition In Lengthy Recordings With Limited Dataset Size, Zeyu Tang

All Dissertations

This dissertation describes methods to analyze lengthy recordings of data in order to detect sparsely occurring activities. The narrative below describes the progression of research that led to the development of these methods and their generalization into a unified framework. My research started with designing models for dietary monitoring, including detecting meals from day-long recordings and detecting intake gestures from meal-length recordings. Both tasks share some common characteristics: (a) the target event takes only a small portion of data recordings, and (b) there is global context within full-length data recordings that can help a model make better decisions. After finishing …

An Analysis Of Face Synthesis Methods And Their Influence On Human Perception, Maha Habib Almaimani

All Dissertations

Synthetic faces (e.g., computer-generated characters) have been increasingly utilized across various fields, including entertainment, healthcare, and education. Perceptual studies are often conducted to understand how synthetic faces are perceived by humans, aiming to enhance both quality and user experience in these domains. Over the years, numerous methods have been developed to create synthetic faces, ranging from traditional techniques such as image composites, Active Appearance Models, and 3D Morphable Models to more recent machine-learning-based frameworks like Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs).

Despite the growing adoption of synthetic face generation and the variety of algorithms available for their creation, …

Cross-Modal Prompting For Multi-Class Visual Anomaly Localization, Duncan F. Mccain

All Theses

Visual anomaly detection is a technology that uses computer vision to automatically identify defects or irregularities in images, such as cracks, scratches, or discolorations on manufactured products. Unsupervised visual anomaly detection does this without needing examples of those defects during the training process. This "unsupervised" approach is crucial in industries like manufacturing, automotive, electronics, and pharmaceuticals, where ensuring product quality is essential for safety, reliability, and cost efficiency. For instance, it helps spot flaws in circuit boards, fabrics, or medical pills during production lines, preventing faulty items from reaching consumers. By reducing manual inspections, it saves time and resources, benefiting …

Adaptive Deep Learning In Physical Layer Applications, Ali Owfi

All Dissertations

Traditionally, signal processing models in communication systems have been designed based on solid foundations in statistics and information theory, often assuming linearity and optimizing for simplified models. However, real-world communication systems exhibit numerous imperfections and non-linearities that traditional linear models struggle to capture accurately. Deep Learning (DL)-based approaches, unconstrained by rigid mathematical models, have shown promise in optimizing system performance by accommodating specific hardware configurations and dynamic channel conditions as an alternative to the traditional methods. Despite all the recent research efforts on DL-based methods for physical layer applications, DL models have still not been widely applied to physical layer …

Examining The Roles Of Embodiment And Theory Of Mind In Shaping User Perceptions Of Llm-Driven Conversational Agents, Elizabeth A. Schlesener

All Dissertations

Large Language Models (LLMs) have advanced conversational agents, enabling natural, human-like interactions in domains such as education, programming, and workplace collaboration. Yet, user distrust persists over privacy, accuracy, and bias. As developers work to mitigate these issues and human-AI collaboration expands, reinforcing trust in LLM-driven systems is essential. To address this problem, this dissertation explores the role of anthropomorphic form in LLM-driven conversational agents and its impact on user perception.

According to the familiarity thesis, humans attribute human-like characteristics to nonhuman entities — a process known as anthropomorphism — to better comprehend unfamiliar phenomena, based on the assumption that they …

Ai In Consideration Of Her: Accounting For Gendered Workplace Dynamics In The Design And Evaluation Of Human-Centered Ai Integration In Everyday Workplaces, Kelsea S. Schulenberg

All Dissertations

Rapid advancements in the technical capabilities and availability of generative Artificial Intelligence (AI) systems, such as OpenAI's ChatGPT, have drawn widespread attention to the opportunities and challenges associated with AI integration into everyday workplaces (i.e., office-type work). Following calls for organizations to consider the ethical and workplace-specific impacts of generative AI's use before integrating it into the workplace, this dissertation addresses three critical gaps in Human-Centered Computing (HCC) and AI workplace integration research. First, this dissertation unpacks the underdeveloped links between women's representation - or lack thereof - in AI-related fields and how their experiences with gendered workplace dynamics in …

Machine Learning Based Medical Ultrasound Image Classification And Grad-Cam Interpretation, Victoria C. Hemphill

All Theses

This work takes a step in creating a diagnostic tool for the classification decision process of Achilles tendinopathy using ultrasound images. An attention-based multiple instance learning model is developed to classify the images. Typically, doctors capture multiple ultrasound images of the Achilles tendon during a study to determine a complete diagnosis. Multiple instance models adopt this behavior by providing a single label for a set of instances (images). The images are grouped into ”bags” at the study level and passed into the model. The MIL model then uses its attention property to assign an importance score to each image to …

Unsupervised Deep Learning For Video Restoration, Mary Damilola Aiyetigbo

All Dissertations

In today's digital era, visual data is vital across several domains such as medical diagnostics, scientific imaging, surveillance, and entertainment. However, video data often suffers from degradations like noise, blur, compression artifacts, and low resolution, which degrade quality and downstream usability. Video restoration aims to recover clean, high-fidelity video from such corrupted inputs. Unlike static images, video restoration must maintain temporal consistency across frames, making it a significantly more complex problem. While supervised deep learning methods have achieved state-of-the-art results, they typically require large datasets of paired noisy-clean video datasets that are scarce or impractical to obtain in real-world settings …

Robustness Investigation, Detection, And Defense Of Deep Learning Models Against False Data Injection, Amirhossein Nazeri

All Dissertations

This dissertation addresses the critical challenge of adversarial robustness in deep learning systems, focusing on two fundamental domains: time-series prediction and object detection. As these AI systems become increasingly deployed in safety-critical applications from power grid management to autonomous vehicles their vulnerability to adversarial attacks poses significant risks to infrastructure and human safety.

The first contribution introduces a novel stealthy black-box False Data Injection (FDI) attack specifically designed for quasi-periodic time-series data. Unlike existing attacks that produce easily detectable anomalies, our method generates adversarial perturbations that preserve the underlying periodicity and statistical properties of the data, effectively bypassing traditional anomaly …

Towards Securing Ai Systems: Investigating Threats In Multimodal Autonomous Driving & Rag Systems, Saket Sanjeev Chaturvedi

All Dissertations

Artificial Intelligence (AI) systems have become central to high-stakes applications such as autonomous driving and language-based decision support. As their deployment accelerates, ensuring the security and trustworthiness of these systems becomes paramount. Among the most stealthy and potent threats are backdoor attacks, where models behave as expected under normal conditions but exhibit malicious behavior when triggered by specific inputs, either digital or physical.

This thesis investigates novel backdoor and adversarial vulnerabilities across two emerging classes of AI architectures: (1) multimodal 3D object detection systems that fuse LiDAR and camera data, and (2) Retrieval-Augmented Generation (RAG) systems that pair large language …

Strengthening The Bonds Between Us: An Empirical Investigation Of Morale In Human-Ai Teams And The Socially Supportive Ai Teammates Who Empower It, Rohit Mallick

All Dissertations

This dissertation investigates how artificial intelligence (AI) can be designed to improve the collective emotion within a team. A team's collective emotion, or morale, describes how motivated, optimistic, and enthusiastic the group is in accomplishing its goals. We conducted four studies that compared different social support strategies that AI teammates can provide to the team. Study 1A found that AI teammates who communicate with emotions can better motivate human team members and promote awareness of team dynamics and environmental changes. Study 1B found that human teammates become more motivated and happier when their AI teammates express joy and are close …

A Systemic Approach To Maximize Heterogeneous System Performance, Thomas L. Randall

All Dissertations

Continuous increases in high performance computing (HPC) throughput have served as catalysts for industry and scientific advancement in countless manners that have fundamentally shaped our modern world. Our demands on compute resources continue to scale, but the limitations of Ahmdal’s law and Dennard scaling have proven increasingly difficult to overcome when approached solely through hardware or software design. Furthermore, many HPC applications fail to utilize the collective system’s performance, even on the most advanced supercomputers.

However, the resurgence of AI in the industry has promoted an explosion of hardware and software codesign that have fueled massive improvements in GPU design …

Learning To Represent Temporal Dynamics And Generative Factors For Intelligent Visual Navigation, Sahand Khoshdel

All Theses

Visual navigation systems are crucial in various applications, including autonomous driving, unmanned aerial systems (UAS), and industrial automation. For these systems to operate efficiently in dynamic environments, they must not only interpret complex surroundings but also anticipate changes over time. Temporal prediction—forecasting environmental changes like moving obstacles or shifting lighting conditions—enables navigation systems to act proactively, enhancing both safety and performance. This dissertation investigates representation learning methods both as a backbone feature extractor for RL agents as well as a proxy for systems oriented for Explainable AI (XAI). Two main projects are presented as case studies to achieve the aforementioned …

Enhancing Low-Resource Language Performance In Multilingual Large Language Models, Mingqi Li

All Dissertations

The large language models play an important role in many natural language tasks. However, training these models requires large amounts of data, which is not available for many languages. A noticeable performance gap exists between English and other languages, with low-resource languages showcasing this gap prominently. Therefore, it becomes imperative to improve large language models for low-resource languages. To address these challenges, we developed knowledge distillation and strategic prompt-learning, and attention alignment methods to improve the representation capabilities of large language models for low-resource language, and then enhanced their performance in downstream tasks.

In our first study, we developed a …

Basic Safety Message Generation Through A Video-Based Analytics For Potential Safety Application, Abyad Enan

All Theses

With the advancement of modern artificial intelligence techniques, computer vision can play a vital role in enhancing roadway safety by reducing the risk of imminent collisions. To do so, a vision-based safety application is required, where a roadside camera can monitor the roadway traffic and predict potential risks of crashes in real-time. If any risky situation or behavior is observed that may lead to a crash, then a safety application can send warnings to the vehicles at risk. For vision-based safety applications on a roadway section, it is important to accurately monitor each vehicle’s location, speed, acceleration, heading direction, etc. …

Unsupervised Moving Object Segmentation With Atmospheric Turbulence, Dehao Qin

All Theses

Moving object segmentation in the presence of atmospheric turbulence is a highly challenging task due to the irregular and time-varying distortions induced by the atmospheric turbulence. This thesis presents an unsupervised approach for segmenting moving objects in videos affected by such atmospheric turbulence. The proposed methodology is grounded in a detect-then-grow scheme: the algorithm begins by identifying a small set of moving object pixels (seed points) with high confidence and progressively expanding a foreground mask from these seed points to segment all moving objects. The proposed approach capitalizes on rigid geometric consistency across video frames to disentangle different types of …

Computational Representation, Analysis And Verification Of Requirements In Engineering Design And Systems Engineering, Chandan Kumar Sahu

All Dissertations

Systems are developed to satisfy a set of requirements derived from stakeholders’ needs, defining the problem space for which the system is created as a feasible solution. The system design process begins with eliciting these requirements and concludes with validating whether the created system meets them. Requirements engineering (RE) encompasses elicitation, representation, analysis, documentation, verification, and validation. However, challenges in RE, such as imprecision in natural language (NL), proprietary restrictions, and a lack of standardized quality metrics, hinder the creation of well-formed and comprehensive requirements. These challenges complicate formalization and analysis of requirements.

This dissertation addresses these challenges by proposing …

Exploring Healthcare Chatbot Information Presentation: Applying Hierarchical Bayesian Regression And Inductive Thematic Analysis In A Mixed Methods Study, Samuel Nelson Koscelny

All Theses

High blood pressure, also known as hypertension, significantly increases the risk of heart disease and stroke, which are leading causes of death in the United States. While contributing to over 691,000 deaths in 2021 alone in the United States (U.S.), it also imposes immense economic burden on the healthcare system, costing approximately $131 billion annually. One way to address this issue is for increased self-care behaviors and medication adherence, both of which require sufficient health literacy. Despite the importance of health literacy, 90% of U.S. adults struggle with health-related subjects. Overcoming the issues associated with health literacy requires addressing the …

Offensive Content Detection In Online Social Platforms, Ebuka Okpala

All Dissertations

Online social platforms enable users to connect with large, diverse audiences and the ability for a message or content to flow from one user to another user, user to followers, followers to user, and followers to followers. Of course, the advantages of this are apparent, and the dangers are also clearly obvious. The user-generated content could be abusive, offensive, or hateful to other users, possibly leading to adverse health effects or offline harm. As more of society's public discourse and interaction move online and these platforms grow and increase their reach, it is inherently important to protect the safety of …

Physics-Informed Machine Learning Methods For Inverse Design Of Multi-Phase Materials With Targeted Mechanical Properties, Yunpeng Wu

All Dissertations

Advances in machine learning algorithms and applications have significantly enhanced engineering inverse design capabilities. This work focuses on the machine learning-based inverse design of material microstructures with targeted linear and nonlinear mechanical properties. It involves developing and applying predictive and generative physics-informed neural networks for both 2D and 3D multiphase materials.

The first investigation aims to develop a machine learning method for the inverse design of 2D multiphase materials, particularly porous materials. We first develop machine learning methods to understand the implicit relationship between a material's microstructure and its mechanical behavior. Specifically, we use ResNet-based models to predict the elastic …

Genomic Data Science Approaches For Understanding Human Diseases, Snehal Shah

All Dissertations

The intricate interplay of genetic predisposition, environmental influences, and lifestyle acts as the multifactorial landscape of diseases. Understanding this complexity presents a significant challenge. Molecular insights into disease mechanisms, particularly the interactions of DNA, RNA, and proteins with environmental and lifestyle factors, have revolutionized disease diagnosis, prognosis, and treatment. High-throughput technologies, such as next-generation sequencing, generate large amounts of molecular data, holding a wealth of knowledge. These datasets unveil the roles of genes and their interactions with various factors through analysis, shedding light on previously unknown molecular mechanisms underlying disease pathogenesis. Furthermore, they facilitate the discovery of biomarkers crucial for …

We Train Ai, Why Not Humans, Too? An Exploration Of Human-Ai Team Training For Future Workplace Viability, Caitlin M. Lancaster

All Dissertations

The integration of Artificial Intelligence (AI) in the workforce is transforming team dynamics, leading to the emergence of Human-AI Teams (HATs). These teams offer opportunities to capitalize on human strengths with AI's prowess, offering significant opportunities for innovation and efficiency. Effective HAT functioning requires aligning human expectations with AI capabilities and bridging knowledge gaps between teammates. Despite this potential, key integration challenges remain, such as developing shared mental models, addressing skill limitations, and overcoming negative AI perceptions. Existing training efforts often apply human-human teaming principles directly to HATs, overlooking AI's role as a teammate and limiting the development of HAT-specific …

Robust And Trustworthy Deep Learning: Attacks, Defenses And Designs, Bingyin Zhao

All Dissertations

Deep neural networks (DNNs) have achieved unprecedented success in many fields. However, robustness and trustworthiness have become emerging concerns since DNNs are vulnerable to various attacks and susceptible to data distributional shifts. Attacks such as data poisoning and out-of-distribution scenarios such as natural corruption significantly undermine the performance and robustness of DNNs in model training and inference and impose uncertainty and insecurity on the deployment in real-world applications. Thus, it is crucial to investigate threats and challenges against deep neural networks, develop corresponding countermeasures, and dig into design tactics to secure their safety and reliability. The works investigated in this …

Identifying Temporomandibular Disorder Morphological Risk Factors Via Explainable Deep Learning And Multiscale Biomechanical Modeling, Shuchun Sun

All Dissertations

Clarifying multifactorial musculoskeletal disorder etiologies supports risk analysis and development of targeted prevention and treatment modalities. Deep learning enables comprehensive risk factor identification through systematic analysis of disease datasets but does not provide sufficient context for mechanistic understanding, limiting clinical applicability for etiological investigations. Conversely, multiscale biomechanical modeling can evaluate mechanistic etiology within the relevant biomechanical and physiological context. We propose a hybrid approach combining 3D explainable deep learning and multiscale biomechanical modeling; we applied this approach to investigate temporomandibular joint (TMJ) disorder etiology by systematically identifying risk factors and elucidating mechanistic relationships between risk factors and TMJ biomechanics and …

Developing Machine Learning Agency Among Youth: Characterizing Youth Critical Use, Examination, And Production Of Machine Learning Applications, Ibrahim Oluwajoba Adisa

All Dissertations

This study explores how middle school-aged youths at an afterschool center utilized, examined, and produced AI applications for social good with the support of adults and peers. The study employs a qualitative single case study design. It uses thematic analysis and quantitative ethnography methods to analyze data from multiple sources, including field notes, interviews, focus groups, story completions, video recordings, and artifacts. Findings indicated that engaging youths in critical exploration of AI tools enhanced their ability to design interest-based AI applications that provide solutions for healthcare problems, security, and accessibility. Moreover, the computational thinking practices that youth engaged in increased …

The Human Side Of Adaptive Autonomy: Design Considerations For Adaptive Autonomous Teammates, Allyson Hauptman

All Dissertations

Ground-breaking advances in artificial intelligence (AI) have led to the possibility of AI agents operating not just as useful tools for teams, but also as full-fledged team members with unique, interdependent roles. This possibility is fueled by the human desire to create more and more autonomous systems that possess computational powers beyond human capability and the promise of increasing the productivity and efficiency of human teams dramatically. Yet, for all the promise and potential of these human-AI teams, the inclusion of AI teammates presents several challenges and concerns for both teaming and human-centered AI.

An important part of teaming is …

Meet Scite, “Chatgpt For Research”, A New Artificial Intelligence (Ai) Tool Available Via Clemson Libraries, Jennifer Groff, Shelby Carroll

Clemson Teaching Excellence Conference 2024: Teaching in the Age of AI

No abstract provided.

Hiccups And Hallucinations: Critically Engaging Ai In The Design Classroom, Drew Sisk

Clemson Teaching Excellence Conference 2024: Teaching in the Age of AI

No abstract provided.