Artificial Intelligence and Robotics Commons^™

Dual Operation Aggregation Graph Neural Networks For Solving Flexible Job-Shop Scheduling Problem With Reinforcement Learning, Peng Zhao, You Zhou, Di Wang, Zhiguang Cao, Yubin Xiao, Xuan Wu, Yuanshu Li, Hongjia Liu, Wei Du, Yuan Jiang, Liupu Wang

Research Collection School Of Computing and Information Systems

With the widespread adoption of Internet Protocol (IP) communication technology and web-based platforms, cloud manufacturing has become a significant hallmark of Industry 4.0. Integrating graph algorithms into these web-enabled environments is crucial as they facilitate the representation and analysis of complex relationships in manufacturing processes, enabling efficient decision-making and adaptability in dynamic environments. As a key scheduling problem in cloud manufacturing, the flexible job-shop scheduling problem (FJSP) finds extensive applications in real-world scenarios. However, traditional FJSP-solving methods struggle to meet the efficiency and adaptability demands of cloud manufacturing due to generalization issues and excessive computational time, while reinforcement learning-based methods …

Neural Multi-Objective Combinatorial Optimization Via Graph-Image Multimodal Fusion, Jinbiao Chen, Jiahai Wang, Zhiguang Cao, Yaoxin Wu

Research Collection School Of Computing and Information Systems

Existing neural multi-objective combinatorial optimization (MOCO) methods still exhibit an optimality gap since they fail to fully exploit the intrinsic features of problem instances. A significant factor contributing to this shortfall is their reliance solely on graph-modal information. To overcome this, we propose a novel graph-image multimodal fusion (GIMF) framework that enhances neural MOCO methods by integrating graph and image information of the problem instances. Our GIMF framework comprises three key components: (1) a constructed coordinate image to better represent the spatial structure of the problem instance, (2) a problem-size adaptive resolution strategy during the image construction process to improve …

Graph-Assisted Offline-Online Deep Reinforcement Learning For Dynamic Workflow Scheduling, Yifan Yang, Gang Chen, Hui Ma, Cong Zhang, Zhiguang Cao, Mengjie Zhang

Research Collection School Of Computing and Information Systems

Dynamic workflow scheduling (DWS) in cloud computing presents substantial challenges due to heterogeneous machine configurations, unpredictable workflow arrivals/patterns, and constantly evolving environments. However, existing research often assumes homogeneous setups and static conditions, limiting flexibility and adaptability in real-world scenarios. In this paper, we propose a novel Graph assisted Offline-Online Deep Reinforcement Learning (GOODRL) approach to building an effective and efficient scheduling agent for DWS. Our approach features three key innovations: (1) a task-specific graph representation and a Graph Attention Actor Network that enable the agent to dynamically assign focused tasks to heterogeneous machines while explicitly considering the future impact of …

Nash Bargaining Strategy In Autonomous Decision Making For Multi-Ship Collision Avoidance Based On Route Exchange, Yang Wang, Qiangsheng Ye, Hoong Chuin Lau, Tengfei Wang, Bing Wu

Research Collection School Of Computing and Information Systems

A novel scheme is proposed for the distributed multi-ship collision avoidance (CA) problem with consideration of the autonomous, dynamic nature of the real circumstance. All the ships in the envisioned scenarios can share their decisions or intentions through route exchange, allowing them to make subsequent decisions based on the route planning in each iteration. By leveraging route exchange, the multi-ship CA problem involves iterations for negotiation, and is regarded as a staged cooperative game under conditions of complete information. The concept of closest spatio-temporal distance (CSTD) is introduced to more accurately assess collision risk between ships. A coordinated CA mechanism …

Samgpt: Text-Free Graph Foundation Model For Multi-Domain Pre-Training And Cross-Domain Adaptation, Xingtong Yu, Zechuan Gong, Chang Zhou, Yuan Fang, Hui Zhang

Research Collection School Of Computing and Information Systems

Graphs are able to model interconnected entities in many online services, supporting a wide range of applications on the Web. This raises an important question: How can we train a graph foundational model on multiple source domains and adapt to an unseen target domain? A major obstacle is that graphs from different domains often exhibit divergent characteristics. Some studies leverage large language models to align multiple domains based on textual descriptions associated with the graphs, limiting their applicability to text-attributed graphs. For text-free graphs, a few recent works attempt to align different feature distributions across domains, while generally neglecting structural …

Agentstudio: A Toolkit For Building General Virtual Agents, Longtao Zheng, Zhiyuan Huang, Zhenghai Xue, Xinrun Wang, Bo An, Shuicheng Yan

Research Collection School Of Computing and Information Systems

General virtual agents need to handle multimodal observations, master complex action spaces, and self-improve in dynamic, open-domain environments. However, existing environments are often domain-specific and require complex setups, which limits agent development and evaluation in real-world settings. As a result, current evaluations lack in-depth analyses that decompose fundamental agent capabilities. We introduce AgentStudio, a trinity of environments, tools, and benchmarks to address these issues. AgentStudio provides a lightweight, interactive environment with highly generic observation and action spaces, e.g., video observations and GUI/API actions. It integrates tools for creating online benchmark tasks, annotating GUI elements, and labeling actions in videos. Based …

On Minimizing Adversarial Counterfactual Error In Adversarial Reinforcement Learning, Roman Belaire, Arunesh Sinha, Pradeep Varakantham

Research Collection School Of Computing and Information Systems

Deep Reinforcement Learning (DRL) policies are highly susceptible to adversarial noise in observations, which poses significant risks in safety-critical scenarios. The challenge inherent to adversarial perturbations is that by altering the information observed by the agent, the state becomes only partially observable. Existing approaches address this by either enforcing consistent actions across nearby states or maximizing the worst-case value within adversarially perturbed observations. However, the former suffers from performance degradation when attacks succeed, while the latter tends to be overly conservative, leading to suboptimal performance in benign settings. We hypothesize that these limitations stem from their failing to account for …

Semantic Loss-Guided Data-Efficient Supervised Fine-Tuning For Safe Responses In Llms, Yuxiao Lu, Pradeep Varakantham, Pradeep Varakantham

Research Collection School Of Computing and Information Systems

Large Language Models (LLMs) generating unsafe responses to toxic prompts is a significant issue in their applications. While various efforts aim to address this safety concern, previous approaches often demand substantial human data collection or rely on the less dependable option of using another LLM to generate corrective data. In this paper, we aim to take this problem and overcome limitations of requiring significant high-quality human data. Our method requires only a small set of unsafe responses to toxic prompts, easily obtained from the unsafe LLM itself. By employing a semantic cost combined with a negative Earth Mover Distance (EMD) …

Bootstrapping Language Models With Dpo Implicit Rewards, Changyu Chen, Zichen Liu, Chao Du, Tianyu Pang, Qian Liu, Arunesh Sinha, Pradeep Varakantham, Min Lin

Research Collection School Of Computing and Information Systems

Human alignment in large language models (LLMs) is an active area of research. A recent groundbreaking work, direct preference optimization (DPO), has greatly simplified the process from past work in reinforcement learning from human feedback (RLHF) by bypassing the reward learning stage in RLHF. DPO, after training, provides an implicit reward model. In this work, we make a novel observation that this implicit reward model can by itself be used in a bootstrapping fashion to further align the LLM. Our approach is to use the rewards from a current LLM model to construct a preference dataset, which is then used …

Predictive Modelling For Vessel Traffic Flow: A Comprehensive Survey From Statistics To Ai, Deshan. Chen, Chen. Huang, Tengze. Fan, Hoong Chuin Lau, Xinping. Yan

Research Collection School Of Computing and Information Systems

Recognizing the specific complexities of vessel traffic flow, this comprehensive survey exclusively addresses the predictive modelling in maritime transportation, tracing the evolution from conventional statistical approaches to modern artificial intelligence (AI) techniques. The survey examines a broad range of predictive targets, including vessel volume, trajectories, velocities, destinations and traffic patterns. Through bibliometric analysis utilizing Citespace, the central research themes and technological trends characterizing the vessel traffic flow prediction domain have been identified and discussed. Our analysis indicates a clear trend towards AI-based models, highlighting their increasing dominance in enhancing predictive accuracy and efficiency. Additionally, we highlight persistent challenges, such as …

Bigcodebench: Benchmarking Code Generation With Diverse Function Calls And Complex Instructions, T.Y. Zhuo, M.C. Vu, J. Chim, ..., David Lo

Research Collection School Of Computing and Information Systems

Task automation has been greatly empowered by the recent advances in Large Language Models (LLMs) via Python code, where the tasks ranging from software engineering development to general-purpose reasoning. While current benchmarks have shown that LLMs can solve tasks using programs like human developers, the majority of their evaluations are limited to short and self-contained algorithmic tasks or standalone function calls. Solving challenging and practical tasks requires the capability of utilizing diverse function calls as tools to efficiently implement functionalities like data analysis and web development. In addition, using multiple tools to solve a task needs compositional reasoning by accurately …

Cutting-Edge Deep Learning Methods For Image-Based Object Detection In Autonomous Driving: In-Depth Survey, Narges Saeedizadeh, Seyed Mohammad Jafar Jalali, Burhan Khan, Shady Mohamed

Research outputs 2022 to 2026

Object detection is a critical aspect of computer vision (CV) applications, especially within autonomous driving systems (AVs), where it is fundamental to ensuring safety and reducing traffic accidents. Recent advancements in computational resources have enabled the widespread adoption of Deep Learning (DL) techniques, significantly enhancing the efficiency and accuracy of object detection tasks. However, the technology for autonomous driving has yet to reach a level of maturity that guarantees consistent performance, reliability, and safety, with several challenges remaining unresolved. This study specifically focuses on 2D image-based object detection methods, which offer several advantages over other modalities, such as cost-effectiveness and …

Experimenting With Machine Learning Using Diabetes Datasets, Wyatt Mcdonnell, Hongbiao Zeng

SACAD: Scholarly Activities

The purpose of this research is to understand how to implement machine learning in a practical scenario. There were two diabetes datasets[5][6] used for testing the machine learning models. These datasets contain information relevant to a person’s health, as well as whether that subject had diabetes. I used a total of four models, and three of those models were manually programmed. The model which was not manually programmed was used for comparison with a similar model. This research directly compares and shows the factors which affect the efficiency of each machine learning model.

Ai Models By Boodlebox: Purpose-Built Intelligence, Kyle Horn

SACAD: Scholarly Activities

Generative AI has transformed the way we interact with technology, enabling dynamic and intelligent conversations through AI-driven bots. This project explores my experience with BoodleBox, a platform that hosts AI chatbots, offering users access to leading AI models such as ChatGPT, Gemini, DALL·E, and DeepSeek. Through the FHSU Generative AI Initiative, I was granted access to experiment with these models and create my own custom AI bot tailored to specific needs. This poster highlights the process of developing a custom bot, including defining instructions, enforcing rules, and sharing the bot for others to use. Additionally, it discusses the background of …

Multimodal Ai-Driven Biomarker For Early Detection Of Cancer Cachexia, Sabeen Ahmed

USF Tampa Graduate Theses and Dissertations

Cancer cachexia is a metabolic syndrome characterized by substantial skeletal muscle loss, impacting cancer patients' survival and quality of life. Despite its clinical significance, early detection remains a challenge due to the lack of standardized diagnostic criteria and the reliance on indirect markers. This work presents an AI-driven approach to enhance cachexia detection and monitoring by integrating multiple deep learning methodologies. We explore transformer architectures for time-series analysis to model sequential medical data, enabling disease prediction and progression modeling. To ensure robust and reliable decision-making in clinical settings, we explore Bayesian deep neural networks for uncertainty estimation. Additionally, we introduce …

Robust Spacecraft Autonomy For Deep Space Exploration In Special Euclidean Group Se(3), Matthew Wittal

Doctoral Dissertations and Master's Theses

Over the past half-century, humanity has gained extensive experience conducting manned spaceflight near Earth. Arguably, "near Earth" could even include the Moon — the most distant destination humans have reached. However, "near" in this work primarily refers low Earth orbit (LEO). One could argue that we have not truly left Earth since the Apollo, as spacecraft in some LEOs remain subject to atmospheric drag thus emphasizing their continued connection to Earth's immediate environment. Reflecting on this, it becomes clear that humanity has largely remained bound to Earth’s immediate vicinity since the Apollo missions reached the Moon. However, that is set …

The Asset Management Optimization Engine: An Ai And Machine Learning Model Approach To Pavement Asset Management, Matt Versdahl

USF Tampa Graduate Theses and Dissertations

While state Departments of Transportation (DOT) face major funding challenges, the need to find optimal ways to preserve and maintain pavement assets remains. Asset management employs a lowest cost lifecycle method to analyze asset costs and determine the best investment strategies to preserve it throughout its lifecycle. As new technology emerges, so do opportunities to leverage it. DOTs collect a significant amount of performance data on pavement and use it to decide how to keep it in a state of good repair. The literature in this area focuses on engineering techniques applied to treatment strategies. This dissertation research focuses on …

Evaluating A Large Language Model’S Accuracy In Chest X-Ray Interpretation For Acute Thoracic Conditions, Adam M. Ostrovsky

SKMC Student Presentations and Publications

BACKGROUND: The rapid advancement of artificial intelligence (AI) has great ability to impact healthcare. Chest X-rays are essential for diagnosing acute thoracic conditions in the emergency department (ED), but interpretation delays due to radiologist availability can impact clinical decision-making. AI models, including deep learning algorithms, have been explored for diagnostic support, but the potential of large language models (LLMs) in emergency radiology remains largely unexamined.

METHODS: This study assessed ChatGPT's feasibility in interpreting chest X-rays for acute thoracic conditions commonly encountered in the ED. A subset of 1400 images from the NIH Chest X-ray dataset was analyzed, representing seven pathology …

The Present And Future Of Ai: Ethical Issues And Research Opportunities, Ankita Srivastava, Marco Marabelli, Danielle Blanch-Hartigan, Jeffrey Moriarty, Evan Carey

Computer Information Systems Faculty Publications

Healthcare is currently a fast-changing industry with AI and generative AI (GenAI) playing a prominent role in the transformation of clinical as well as managerial practices. Clinical practices involve AI to diagnose diseases and develop new drugs and compounds, while managerial practices concern AI-supporting processes such as billing patients and insurance companies, handling electronic medical records, and supporting remote connections with patients, increasingly using virtual and augmented reality. Yet, all these opportunities offered by AI come with challenges involving potential ethical issues, such as discrimination, bias, lack of accessibility, and privacy issues. In March 2024, we organized a panel with …

The Impact Of Artificial Intelligence On Quality Of Higher Education, Pragati K. Rouniyar

Honors Thesis

Artificial Intelligence (AI) is redefining higher education, captivating scholars with its promise to personalize learning and streamline institutions. However, underneath this assurance exists a network of ethical challenges, disparities in equity, and inquiries regarding academic integrity that require our focus. In pursuit of this goal, this research employs a mixed-methods strategy—through the implementation of surveys and semi-structured interviews—to investigate the transformative effects of AI on higher education, concentrating on its repercussions for teaching techniques, learning results, and institutional processes. This study’s findings indicate that AI can personalize educational experiences to meet individual needs, ease course administrative workload, and assist with …