Artificial Intelligence and Robotics Commons^™

Tedvil: Leveraging Transformer-Based Embeddings For Vulnerability Detection In Lifted Code, Gary Mccully, John Hastings, Shengjie Xu

Research & Publications

Ransomware and other malware inflict devastating financial and operational damage on organizations worldwide by exploiting deeply embedded, hard-to-detect vulnerabilities in their systems. Detecting these vulnerabilities in compiled code before malicious actors exploit them remains a critical challenge in cybersecurity. This research introduces TEDVIL (Transformer-based Embeddings for Discovering Vulnerabilities in Lifted Code), a novel framework which uses transformer-based embeddings to train neural networks to detect vulnerabilities in lifted code. The framework was implemented using bidirectional (BERT and RoBERTa) and unidirectional (GPT-1 and GPT-2) transformer-based models to generate embeddings for training Long Short-Term Memory (LSTM) neural networks to detect stack-based buffer overflows …

Optimizing Decision-Making In A Cerebral Palsy Model Using Reinforcement Learning, Richard Ampah

Pitzer Senior Theses

This study presents an original interdisciplinary investigation into how reinforcement learning (RL) can model motor and cognitive defects and potentially improve motor and cognitive functions in individuals with cerebral palsy (CP), a non-progressive neurological disorder that impairs movement and adaptability. Integrating computational neuroscience and machine learning, the research applies policy gradient methods and Markov Decision Processes (MDPs) to simulate adaptive learning in agents with and without CP-related constraints.

The central aim is to compare the cumulative rewards of optimal policies, derived from value iteration, and human-like learning policies using the REINFORCE algorithm, both with and without the Bellman baseline. The …

Mass-Adaptive Admittance Control For Robotic Manipulators, Hossein Gholampour, Jonathon E. Slightam, Logan E. Beaver

Mechanical & Aerospace Engineering Faculty Publications

Handling objects with unknown or changing masses is a common challenge in robotics, often leading to errors or instability if the control system cannot adapt in realtime. In this paper, we present a novel approach that enables a six-degrees-of-freedom robotic manipulator to reliably follow waypoints while automatically estimating and compensating for unknown payload weight. Our method integrates an admittance control framework with a mass estimator, allowing the robot to dynamically update an excitation force to compensate for the payload mass. This strategy mitigates end-effector sagging and preserves stability when handling objects of unknown weights. We experimentally validated our approach in …

Optimal Manipulation Motion Action Planner Enabled By Physics Informed Neural Networks, Jonathon E. Slightam, Logan E. Beaver

Mechanical & Aerospace Engineering Faculty Publications

Autonomous robotic manipulation in unstructured environments faces many challenges and is hindered by capabilities that bridge the gap between perception and acting on the world. Action plans that are centric to object motion rather than end-of-arm tooling behavior may aid this. This paper presents an autonomous action planner for a feedback linearizeable system comprised of three base motions that can be leveraged on their own or in combination to give custom motion plans. The optimization routine for the three different types of motion are presented, which are integrated into physics informed neural networks. A component of this is the autonomy …

Application Of Large Language Model Methods In Scientific And Technical Intelligence Practice, Bolin Hua, Yingze Wang

Journal of Scientific Information Research

[Purpose/significance]With the strong ability to process large-scale datasets and outstanding performance in various natural language processing tasks, large language models (LLMs) have excelled across multiple industries.Since scientific and technical intelligence primarily relies on textual data, LLMs are naturally well-suited for this field, ushering in a new wave of transformative changes. [Method /process]This article discusses the advantages of LLMs from five perspectives: low-dimensional dense vector representations of text, large-scale pre-trained models,fine-tuning and prompt learning, high-quality large-scale training data, and human alignment techniques. [Result/conclusion]LLMs have extensive applications in tasks such as intelligence identification, intelligence tracking, intelligence evaluation, and intelligence prediction, resulting in …

Why Ai Monitoring Faces Resistance And What Healthcare Organizations Can Do About It: An Emotion-Based Perspective, Karl Werder, Lan Cao, Eun Hee Park, Balasubramaniam Ramesh

Information Technology & Decision Sciences Faculty Publications

Continuous monitoring of patients' health facilitated by artificial intelligence (AI) has enhanced the quality of health care, that is, the ability to access effective care. However, AI monitoring often encounters resistance to adoption by decision makers. Healthcare organizations frequently assume that the resistance stems from patients' rational evaluation of the technology's costs and benefits. Recent research challenges this assumption and suggests that the resistance to AI monitoring is influenced by the emotional experiences of patients and their surrogate decision makers. We develop a framework from an emotional perspective, provide important implications for healthcare organizations, and offer recommendations to help reduce …

Enhanced Network Anomaly Detection Using Machine Learning Models, Ousmane Barry

CCAC Theses and Dissertations

This dissertation investigates enhanced network anomaly detection using Machine Learning (ML) models. The study addresses two distinct classification problems: binary classification and multiclass classification. In the binary classification task, network traffic data is categorized as either "normal" or "abnormal," where abnormal includes all non-normal traffic. Leveraging the balanced nature of the dataset, this study develops optimized models that achieve consistently high classification performance. Key metrics, including precision, recall, and F1 scores, are used to ensure robust evaluation and reliable detection across all classes.

For multiclass classification, only classes present in both training and test datasets are included to ensure meaningful …

A Vision Transformer Based Assistive System For Dermatological Diagnosis In Systemic Lupus Erythematosus, Syeda Lamima Farhat

All Graduate Theses, Dissertations, and Other Capstone Projects

Systemic Lupus Erythematosus (SLE) is a complex and often underdiagnosed autoimmune disease that affects multiple organs and presents with a wide range of symptoms-ranging from fatigue and joint pain to life-threatening organ damage. One of its most visible and diagnostically significant indicators is the Butterfly Malar Rash (BMR), a distinctive facial rash that often resembles other common dermatological conditions like rosacea, acne, eczema, and fifth disease. This overlap can lead to misdiagnosis or delayed detection, especially in busy clinical environments. To assist dermatologists in distinguishing BMR from similar facial rashes, this study explores the development of an AI-powered image classification …

Predicting Lung Cancer Severity Using Machine Learning Algorithms: Enhanced By Statistical Analysis, Esin Bilgin

Theses, Dissertations and Culminating Projects

Cancer is a serious and severe cause seen in every region of the world and severely affects the quality of life and life span. Among the various types of cancer, lung cancer is one of the most critical, having a fatal impact on life. While medical imaging techniques, laboratory results, and biomarkers play a significant role in diagnosis and prognosis, clinical studies are also crucial in monitoring the progression of cancer and identifying diagnostic and prognostic factors. The findings demonstrate satisfactory accuracy, and the analysis incorporates statistical data with machine learning techniques. These findings play a pivotal role in supporting …

‘Waves Of Imagination’ Unconditional Spectogram Diffusion Using Diffusion Architecture., Rahul Vanukuri

Computer Science and Engineering Theses - Archive

The swift evolution of wireless communication technologies,particularly in the field of rf signals or in CBRS bands,demands increasingly sophisticated signal processing techniques to ensure efficient transmission, reception, and spectrum management.Traditional approaches to signal generation and reconstruction, although effective in controlled environments, often struggle to cope with the challenges presented by real-world noisy conditions, hardware constraints, and limited access to large-scale datasets. In response to these limitations, this thesis explores the application of diffusion models—a class of generative models known for their ability to produce high-fidelity samples—to the domain of spectrogram generation for communication signals.

Different from conventional strategies to simulate …

A Personal Interview With William Patry: His Thoughts On Music, Ai, And Copyright

IP Theory

No abstract provided.

Csc36000 - Modern Distributed Computing Assignment 2, Saptarashmi Bandyopadhyay

Open Educational Resources

This assignment is designed to help the student identify and mitigate common errors in Distributed Computing such as race conditions and reaching consensus, as well as reflecting on how Distributed Computing concepts apply to their class project.

A Survey Of Multilingual Large Language Models, Libo Qin, Qiguang Chen, Yuhang Zhou, Zhi Chen, Yinghui Li, Lizi Liao, Min Li, Wanxiang Che, Philip S. Yu

Research Collection School Of Computing and Information Systems

Multilingual large language models (MLLMs) leverage advanced large language models to process and respond to queries across multiple languages, achieving significant success in polyglot tasks. Despite these breakthroughs, a comprehensive survey summarizing existing approaches and recent developments remains absent. To this end, this paper presents a unified and thorough review of the field, highlighting recent progress and emerging trends in MLLM research. The contributions of this paper are as follows. (1) Extensive survey: to our knowledge, this is the pioneering thorough review of multilingual alignment in MLLMs. (2) Unified taxonomy: we provide a unified framework to summarize the current progress …

Defending Federated Recommender Systems Against Untargeted Attacks: A Contribution-Aware Robust Aggregation Scheme, Ruicheng Liang, Yuanchun Jiang, Feida Zhu, Ling Cheng, Huiwen Liu

Research Collection School Of Computing and Information Systems

Federated recommender systems (FedRSs) effectively tackle the tradeoff between recommendation accuracy and privacy preservation. However, recent studies have revealed severe vulnerabilities in FedRSs, particularly against untargeted attacks seeking to undermine their overall performance. Defense methods employed in traditional recommender systems are not applicable to FedRSs, and existing robust aggregation schemes for other federated learning-based applications have proven ineffective in FedRSs. Building on the observation that malicious clients contribute negatively to the training process, we design a novel contribution-aware robust aggregation scheme to defend FedRSs against untargeted attacks, named contribution-aware Bayesian knowledge distillation aggregation (ConDA), comprising two key components for the …

Handwritten Digit Recognition Using Machine Learning Classifiers, Md Ahiduzzaman

Data Science and Data Mining

This project explores and compares the performance of various machine learning classifiers for handwritten digit recognition using the MNIST dataset. The classifiers include Logistic Regression, k-Nearest Neighbors, and Convolutional Neural Networks. Each classifier is evaluated based on accuracy, precision, recall, F1-score, and confusion matrix analysis.

Towards Human Explainable Digital Forensics: Generating Human Interpretable Evidence For Semantic Understanding In Manipulated Images And Text, Yuwei Chen

Electronic Theses & Dissertations (2024 - present)

Detecting and characterizing manipulations in digital media continues to pose a significant challenge within the field of digital forensics. Despite notable advancements, the discipline often remains in a reactive stance against emerging threats. Current state-of-the-art methods, typically evaluated within academic settings, fails to mirror the complexities of real-world disinformation scenarios. These methods generally prioritize high performance based on quantitative metrics, yet they demonstrate a considerable dependency on training data and lack adaptability to new novel attack signatures. With the rapid evolution of attack methodologies, the dependency on highly accurate models that do not generalize or adapt well to unseen threats …

Improving Generalizability In Image Manipulation Detection, Zhenfei Zhang

Electronic Theses & Dissertations (2024 - present)

Image manipulation detection (IMD) aims to determine whether an image has been tampered with and to identify the manipulated regions. These capabilities have become increasingly important with the rapid advancement of media editing and generation technologies, such as Photoshop and generative AI methods, which underscore the need for robust tools for media authentication. Although current state-of-the-art (SoTA) methods achieve strong results on common manipulation types, such as splicing, copy-move, and removal, they often struggle to generalize to manipulation types not represented in the training data. Consequently, their real-world applicability remains limited, with performance degrading significantly in practical scenarios.

In this …

Human Perception Of Ai Capabilities At Classifying Perturbed Roadway Signs, Katherine R. Garcia, Jing Chen, Yanru Xiao, Scott Mishler, Cong Wang, Bin Hu

Psychology Faculty Publications

Artificial Intelligence (AI) is crucial to numerous functions required for driving automation systems, including the computer vision techniques used to detect the roadway environment and make real-time decisions. However, the images used as inputs to the AI system may be maliciously perturbed, or manipulated, causing the AI system to make an incorrect classification. In this study, we examined humans’ perception of the AI’s computer vision capability of classifying various road sign images, including the original images, images with two different types of malicious attacks, and images that are scrambled randomly at the pixel level. Our results showed that participants rated …

Trustworthiness And Trust: Identifying Factors That Drive Successful Human-Ai Interaction In Nuclear Power Plant Applications, Yusuke Yamani, Austin Jackson, Casey Kovesdi, Jeffrey Joe, Jeremy Mohon

Psychology Faculty Publications

Emerging technologies such as artificial intelligence (AI) and machine learning are rapidly evolving and promising tools for efficient and continued safe operations of the U.S. nuclear power plants (NPPs). Emerging AI techniques like large language models (LLMs) are one such technology that may help personnel at existing NPPs perform work more efficiently. For example, operators may query the current operational status of a power plant via a chat interface, leveraging LLMs to access plant-related information in an interactive manner rather than manually collecting various sensor data for surveillance or work order tasks. This is a fundamental shift in the way …

High Tech Touts, Sherman J. Clark

Articles

This essay has three interrelated aims. First, it articulates a set of capacities I call virtues of attention—capacities for intuitive discernment, good judgment about what is worth sustained focus, and the ability to engage deeply with worthwhile things. These are eudaimonist virtues in that they help us live well, not merely act rightly. Second, the essay explores what I call poisonous persuasion: the idea that rhetorical appeals, especially those used in marketing, may not only succeed by appealing to certain desires or habits of mind but may also deepen and entrench them. Third, I bring these insights together to examine …