Artificial Intelligence and Robotics Commons^™

Tamos: Task-Aware Multi-Agent Orchestrator System, Joshit Mohanty, Sandeep Kumar Nayak, Sumit Lahiri

Graduate Student Government Association Research Conference

Large language models (LLMs) are increasingly at the core of multi-agent systems (MAS). However, the high resource demand, error propagation, and lack of adaptive evaluation mechanisms pose significant challenges in deploying these agentic solutions at scale. To address these concerns, this research proposes a Task-Aware Multi-Agent Orchestrator System designed to refine the agentic framework, categorizing tasks autonomously, assigning specialized evaluation datasets, and balancing token usage against functional effectiveness. This approach underscores robust data management, including AsyncHow, Mosaic AI, and Synthetic Preference Optimization (PO) corpora. Each dataset targets specific dimensions of agent performance, such as dynamic task decomposition and tool integration …

Survey On Intelligent Planning Methods From Large Language Models Perspective, Yanzhong Zhou, Junren Luo, Xueqiang Gu, Wanpeng Zhang

Journal of System Simulation

Abstract: Starting from the perspective of large language models, this paper gives an overview of the definition and development of intelligent planning, and briefly introduces the traditional methods of intelligent planning; based on the close relationship between large language model intelligent agents and intelligent planning, introduces the architecture of large language models and typical large model intelligent agents; focusing on the intelligent planning for large language models, combs through the learning of planning languages, chain of thought, feedback optimization, and process automation; combining with the current challenges and difficulties, introduces the outlook of cutting-edge research on intelligent planning with large …

Cogprog: Utilizing Large Language Models To Forecast In-The-Moment Health Assessment, Gina Sprint, Maureen Schmitter-Edgecombe, Raven Weaver, Lisa Wiese, Diane Cook

Computer Science Faculty Scholarship

Forecasting future health status is beneficial for understanding health patterns and providing anticipatory support for cognitive and physical health difficulties. In recent years, generative Large Language Models (LLMs) have shown promise as forecasters. Though not traditionally considered strong candidates for numeric tasks, LLMs demonstrate emerging abilities to address various forecasting problems. They also provide the ability to incorporate unstructured information and explain their reasoning process. In this article, we explore whether LLMs can effectively forecast future self-reported health state. To do this, we utilized in-the-moment assessments of mental sharpness, fatigue, and stress from multiple studies, utilizing daily responses (N = …

Framework For Integrating Industry Knowledge Into A Large Language Model To Assist Construction Cost Estimation, Prashnna Ghimire

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

The construction industry generates a large amount of data across projects produced by digital devices, tools, and methods, and this volume is rapidly increasing. However, the industry lags behind in adopting data-driven technologies. On the other hand, the rapid advancement of generative AI (GenAI) in recent years, especially state-of-the-art large language models (LLMs), shows great potential and has been increasingly adopted in many industries; however, the construction industry is behind in adoption. While academic studies have proposed various machine learning applications for construction, industry implementation has lagged due to a disconnect between these proof-of-concept developments and practical industry needs. Also, …

Artificial Intelligence In Surgical Coding: Evaluating Large Language Models For Current Procedural Terminology Accuracy In Hand Surgery, Emily Isch, Jamie Lee, D. Mitchell Self, Abhijeet Sambangi, Theodore E. Habarth-Morales, John R. Vaile, E. J. Caterson

Department of Surgery Faculty Papers

PURPOSE: The advent of large language models (LLMs) like ChatGPT has introduced notable advancements in various surgical disciplines. These developments have led to an increased interest in the use of LLMs for Current Procedural Terminology (CPT) coding in surgery. With CPT coding being a complex and time-consuming process, often exacerbated by the scarcity of professional coders, there is a pressing need for innovative solutions to enhance coding efficiency and accuracy.

METHODS: This observational study evaluated the effectiveness of five publicly available large language models-Perplexity.AI, Bard, BingAI, ChatGPT 3.5, and ChatGPT 4.0-in accurately identifying CPT codes for hand surgery procedures. A …

Making The Most Of Artificial Intelligence And Large Language Models To Support Collection Development In Health Sciences Libraries, Ivan Portillo, David Carson

Library Articles and Research

This project investigated the potential of generative AI models in aiding health sciences librarians with collection development. Researchers at Chapman University’s Harry and Diane Rinker Health Science campus evaluated four generative AI models—ChatGPT 4.0, Google Gemini, Perplexity, and Microsoft Copilot—over six months starting in March 2024. Two prompts were used: one to generate recent eBook titles in specific health sciences fields and another to identify subject gaps in the existing collection. The first prompt revealed inconsistencies across models, with Copilot and Perplexity providing sources but also inaccuracies. The second prompt yielded more useful results, with all models offering helpful analysis …

Successfully Navigating The Disruption Ai Will Bring To Survey Research, David M. Rothschild, Trent D. Buskirk, Stephanie Eckman, D. Sunshine Hillygus, Frauke Kreuter, David Lazer

Information Technology & Decision Sciences Faculty Publications

Surveys are a core methodological tool in government, industry, and academia, providing essential data for theory development and evidence-based decision-making. As artificial intelligence continues its rapid advancement, it stands to fundamentally transform the entire survey lifecycle - from design and administration to analytics and reporting. Previous transitions to new technologies, such as telephone, internet, and non-probability surveys, led to divisions within the survey research community with real consequences for both the trajectory of research and trust in the industry. We believe the survey community should take proactive steps now to avoid similar challenges with AI integration. Specifically, our paper examines …

The Impact Of Llms Usage On Learning Outcomes For Software Development Students: A Focus On Prompt Engineering, Mohammed Owaidh Aljohani

CGU Theses & Dissertations

This study investigates the impact of large language model (LLM) usage, specifically ChatGPT, on student learning outcomes in programming education. The research adopts a mixed-methods approach, combining quantitative survey data from students and qualitative interviews with instructors. The study addresses three research questions: (1) the effect of LLM usage on undergraduate students' learning outcomes, (2) the influence of prompt engineering skills on this relationship, and (3) instructors' perceptions on these relationships. Quantitative data were collected from 159 students across two Saudi universities using a structured online survey with sections covering demographic information, LLM usage, self-reported programming understanding, and prompt engineering …

Fault And Cyberattack Diagnosis And Handling Via Large Language Models And State Prediction For Manufacturing And Quantum Systems, Jihan Abou Halloun

Wayne State University Dissertations

In the digitalization era and Smart Manufacturing, companies are harnessing the power of artificial intelligence (AI) and machine learning (ML) across multiple sectors, including process engineering optimization, process control and fault detection, to enhance efficiency and engineering decision making. Although AI and ML are widely used in anomaly detection and handling, there are still areas where it has been less explored. One of the major areas where AI’s potential in manufacturing needs to be characterized is with respect to the applications of large language models (LLMs) in manufacturing troubleshooting for fault/attack handling. A second major area where the potential of …

Information-Theoretic Methods For Efficient Training And Robust Evaluations In Self-Supervised Learning, Oscar Skean

Theses and Dissertations--Computer Science

Self-supervised learning (SSL) has become a cornerstone of modern machine learning, offering a scalable alternative to costly human annotation by constructing pretext tasks directly from raw data. While SSL has delivered strong results across vision, language, and multimodal domains, two major limitations persist: (1) SSL methods are often significantly slower to train than supervised counterparts, and (2) evaluation protocols remain narrow, with most studies relying on linear probing accuracy on the pretraining dataset. . These challenges are particularly acute for large language models (LLMs), where training costs and interpretability of intermediate representations are critical concerns.

In this work, we propose …

Guiding Evolutionary Algorithms With Large Language Models To Learn Fuzzy Cognitive Maps, Ryan Schuerkamp, Philippe J. Giabbanelli

VMASC Publications

Fuzzy Cognitive Maps (FCMs) are interpretable simulation models that represent causal relationships between concepts as a weighted digraph with labeled nodes. They serve to examine a system’s structure (e.g., what concepts are critical to spreading an intervention’s effects?) and long-term behavior (e.g., if we increase fruit availability, how will its consumption change?). When modelers build FCMs by leveraging participants’ knowledge, the resulting participant-built FCMs can be analyzed and interpreted since participants report perceived causality. However, engaging enough knowledgeable participants to construct an FCM can be challenging. Alternatively, machine learning algorithms derive FCMs from data by selecting relationships to maximize a …

Nexus: Network Exploration For Exploiting Unsafe Sequences In Multi-Turn Llm Jailbreaks, Javad Rafiei Asl, Sidhant Narula, Mohammad Ghasemigol, Eduardo Blanco, Daniel Takabi

School of Cybersecurity Faculty Publications

Large Language Models (LLMs) have revolutionized natural language processing, yet remain vulnerable to jailbreak attacks—particularly multi-turn jailbreaks that distribute malicious intent across benign exchanges, thereby bypassing alignment mechanisms. Existing approaches often suffer from limited exploration of the adversarial space, rely on hand-crafted heuristics, or lack systematic query refinement. We propose NEXUS (Network Exploration for eXploiting Unsafe Sequences), a modular framework for constructing, refining, and executing optimized multi-turn attacks. NEXUS comprises: (1) ThoughtNet, which hierarchically expands a harmful intent into a structured semantic network of topics, entities, and query chains; (2) a feedback-driven Simulator that iteratively refines and prunes these chains …

Is It Getting Better? An Evaluation Of Two Successive Generations Of Chatgpt In Answering Specialized Vascular Surgery Questions, Dongjin Suh, Quang Le, Leana Dogbe, Kedar Lavingia, Michael Amendola

Department Surgery Faculty Publications

Purpose: Large language models (LLMs) can generate clinically relevant text; however, their performance in highly specialized medical domains remains uncertain. This study evaluated ChatGPT-3.5 and ChatGPT-4 (OpenAI) using vascular surgery board–style questions from the Vascular Education and Self-Assessment Program, version 4 (VESAP4) and compared the two public model versions (June and November 2023).

Materials and Methods: All non-image VESAP4 questions (n=384) were presented independently three times to each model version (ChatGPT-3.5 June/November; ChatGPT-4, June/November). Outcomes included accuracy (proportion correct), consistency (same option letter across all three attempts and “consistently correct”), explanation length (word count), and modes of failure classified for …

On The Applicability Of Generating Pathological Speech Data Using Large Language Models, Caroline Hopkins

SURF Posters 2025

Pathological speech data is scarce in Speech-Language Pathology (SLP). Synthetic data, thus, is an appealing alternative. It extends the amount of usable data without the risk for privacy concerns that naturally occurring data may bring. In this work, a collection of Large-Language-Model-based methods for generating synthetic pathological speech data are studied. Human experts in SLP as judges delivered negative opinions on the quality of the synthetic data generated by a variety of prompt engineering methods. From the judgements, the resulting data was found to be weak in reflecting the characteristics of the target disorders. Further research will involve fine-tuning the …

From Philosophy To Nlu: Evolving Definitions With Research Hypotheses, Jian Wu, Sarah Rajtmajer

Computer Science Faculty Publications

Over the past decades, alongside advancements in natural language processing, significant attention has been paid to training models to automatically extract, understand, test, and generate hypotheses in open and scientific domains. However, interpretations of the term hypothesis for various natural language understanding (NLU) tasks have migrated from traditional definitions in the natural, social, and formal sciences. Even within NLU, we observe differences defining hypotheses across literature. In this paper, we overview and delineate various definitions of hypothesis. Especially, we discern the nuances of definitions across recently published NLU tasks. We highlight the importance of well-structured and well-defined hypotheses, particularly as …

From Philosophy To Nlu: Evolving Definitions Of Research Hypotheses, Jian Wu, Sarah Rajtmajer

Computer Science Faculty Publications

Over the past decades, alongside advancements in natural language processing, significant attention has been paid to training models to automatically extract, understand, test, and generate hypotheses in open and scientific domains. However, interpretations of the term hypothesis for various natural language understanding (NLU) tasks have migrated from traditional definitions in the natural, social, and formal sciences. Even within NLU, we observe differences defining hypotheses across literature. In this paper, we overview and delineate various definitions of hypothesis. Especially, we discern the nuances of definitions across recently published NLU tasks. We highlight the importance of well-structured and well-defined hypotheses, particularly as …

Trustworthiness And Trust: Identifying Factors That Drive Successful Human-Ai Interaction In Nuclear Power Plant Applications, Yusuke Yamani, Austin Jackson, Casey Kovesdi, Jeffrey Joe, Jeremy Mohon

Psychology Faculty Publications

Emerging technologies such as artificial intelligence (AI) and machine learning are rapidly evolving and promising tools for efficient and continued safe operations of the U.S. nuclear power plants (NPPs). Emerging AI techniques like large language models (LLMs) are one such technology that may help personnel at existing NPPs perform work more efficiently. For example, operators may query the current operational status of a power plant via a chat interface, leveraging LLMs to access plant-related information in an interactive manner rather than manually collecting various sensor data for surveillance or work order tasks. This is a fundamental shift in the way …

Leveraging Large Language Models To Create Learner Personas For Training Design, N. Lovett, M. Yang, K. Herman, B. Li, M. Sosonkina, W. Purwanto, P. Jiang, M. H. Wu

Electrical & Computer Engineering Faculty Publications

This case examines the innovative use of Large Language Models (LLMs) to generate learner personas for developing learner-centered cybersecurity training materials when direct access to initial learner data is not available. The team developed a nine-stage iterative process for creating and refining AI-generated personas to address this constraint, integrating ethical review, stakeholder feedback, and action research principles. The process expanded upon Kouprie and Visser’s (2009) empathic design framework to ensure cultural responsiveness and mitigate potential biases in LLM outputs. Through multiple refinement cycles, initial generic personas evolved into detailed, context-rich archetypes which informed the development of effective and context-responsive training …

Pushing The Boundaries Of Large Language Models: Innovations And Limitations In Nlp, Finance, And Mathematics, A M Muntasir Rahman

Dissertations

Large Language Models (LLMs) have emerged as transformative tools across a spectrum of domains, yet their practical deployment reveals a blend of remarkable potential and notable limitations. This research explores innovative methodologies to extend the capabilities of LLMs while addressing critical challenges in their evaluation and application. By leveraging rule-based approaches, the in-context learning capabilities of LLMs, and human-in-the-loop validation across three focused studies, this research introduces robust strategies for dataset synthesis, model enhancement, and model assessment in three distinct domains: natural language processing, financial sentiment analysis, and mathematical reasoning

The first study proposes an efficient data augmentation framework, EASE, …

Video Game Development 3.0: Ai-Driven Collaborative Co-Creation, Jay Ratican, James Hutson

Faculty Scholarship

The evolution of game development has transitioned from manual coding (Software 1.0) to data-driven Artificial Intelligence (AI) (Software 2.0), and now to a more advanced stage—video game development 3.0. This phase is characterized by AI-driven processes leveraging large language models (LLMs), neural networks, and other AI techniques that autonomously generate code, content, and narratives. This paper explores the foundational technologies underpinning this paradigm shift, including customizable AI modules, dynamic asset creation, and intelligent non player characters (NPCs) that adapt to player interactions. It also highlights the integration of AI with emerging technologies like Virtual Reality (VR), Augmented Reality (AR), and …

Converting Vocal Performances Into Sheet Music Leveraging Large Language Models, Jinjing Jiang, Nicole Teo, Haibo Pen, Seng-Beng Ho, Zhaoxia Wang

Research Collection School Of Computing and Information Systems

Advanced natural language processing (NLP) models are increasingly applied in music composition and performance, particularly for generating vocal melodies and simulating singing voices. While NLP techniques have been effective in analyzing vocal performance data to assess quality and style, the automatic transcription of vocal performances into sheet music remains a significant challenge. Manual transcription tools often fall short due to the intricate dynamics of vocal expression. This study tackles the automation of vocal performance transcription into sheet music using innovative techniques, including large language models (LLMs). We propose a method to translate vocal audio input into display-ready sheet music effectively. …

Ask-Before-Plan : Proactive Language Agents For Real-World Planning, Xuan Zhang, Yang Deng, Zifeng Ren, See-Kiong Ng, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

The evolution of large language models (LLMs) has enhanced the planning capabilities of language agents in diverse real-world scenarios. Despite these advancements, the potential of LLM-powered agents to comprehend ambiguous user instructions for reasoning and decision-making is still under exploration. In this work, we introduce a new task, Proactive Agent Planning, which requires language agents to predict clarification needs based on user-agent conversation and agent-environment interaction, invoke external tools to collect valid information, and generate a plan to fulfill the user's demands. To study this practical problem, we establish a new benchmark dataset, Ask-before-Plan. To tackle the deficiency of LLMs …

Democratization Of Custom, High Quality Large Language Models, Pablo Lopez

College of Computing and Digital Media Dissertations

Large Language Models (LLMs) have shown exceptional performance in several natural language processing (NLP) tasks. Customizing LLMs boosts their performance in domain specific tasks but typically requires substantial resources and effort for training, such as supervised fine-tuning. This research proposes methods to achieve significant accuracy improvements given minimal resources, particularly focusing on open-ended question answering with a given piece of context. We utilize an LLM’s self-generated training data to fine-tune the LLM and partial fine-tuning with on-demand GPU to reduce practitioner training costs. The research shows that these methods give significant performance gains in a Retrieval Augmented Generation (RAG) based …

In Reply: Can Artificial Intelligence Make The Cut? Dissecting Large Language Model’S Surgical Exam Performance, Adam M. Ostrovsky, Joshua R. Chen, Vishal N. Shah, Babak Abai

Department of Surgery Faculty Papers

No abstract provided.

Sibo : A Simple Booster For Parameter-Efficient Fine-Tuning, Zhihao Wen, Jie Zhang, Yuan Fang

Research Collection School Of Computing and Information Systems

Fine-tuning all parameters of large language models (LLMs) necessitates substantial computational power and extended time. Latest advancements in parameter-efficient fine-tuning (PEFT) techniques, such as Adapter tuning and LoRA, allow for adjustments to only a minor fraction of the parameters of these LLMs. Concurrently, it has been noted that the issue of over-smoothing diminishes the effectiveness of these Transformer-based LLMs, resulting in suboptimal performances in downstream tasks. In this paper, we present SIBO, which is a SImple BOoster to enhance PEFT, by injecting an initial residual. SIBO is straightforward and readily extensible to a range of state-of-the-art PEFT techniques to alleviate …

Analyzing Temporal Complex Events With Large Language Models? A Benchmark Towards Temporal, Long Context Understanding, Zhihan Zhang, Yixin Cao, Chenchen Ye, Ma. Yunshan, Lizi Liao, Tat-Seng Chua

Research Collection School Of Computing and Information Systems

The digital landscape is rapidly evolving with an ever-increasing volume of online news, emphasizing the need for swift and precise analysis of complex events.We refer to the complex events composed of many news articles over an extended period as Temporal Complex Event (TCE). This paper proposes a novel approach using Large Language Models (LLMs) to systematically extract and analyze the event chain within TCE, characterized by their key points and timestamps. We establish a benchmark, named TCELongBench, to evaluate the proficiency of LLMs in handling temporal dynamics and understanding extensive text. This benchmark encompasses three distinct tasks - reading comprehension, …

Speaker Verification In Agent-Generated Conversations, Yizhe Yang, Palakorn Achananuparp, Heyan Huang, Jing Jiang, Ee-Peng Lim

Research Collection School Of Computing and Information Systems

The recent success of large language models (LLMs) has attracted widespread interest to develop role-playing conversational agents personalized to the characteristics and styles of different speakers to enhance their abilities to perform both general and special purpose dialogue tasks. However, the ability to personalize the generated utterances to speakers, whether conducted by human or LLM, has not been well studied. To bridge this gap, our study introduces a novel evaluation challenge: speaker verification in agent-generated conversations, which aimed to verify whether two sets of utterances originate from the same speaker. To this end, we assemble a large dataset collection encompassing …

Harnessing Social Media For Disaster Response: Intelligent Identification Of Reliable Rescue Requests During Hurricanes, Wael Khallouli

Engineering Management & Systems Engineering Theses & Dissertations

Hurricanes pose a significant threat to both human lives and infrastructure. Decision-makers face substantial challenges during such events, as they must act quickly to address victims’ needs. Social media platforms provide a valuable source for quick and real-time information. Recent hurricane events have shown that people turn to social media to call for help when official communication channels, such as 911, are overwhelmed. However, extracting actionable information from the massive number of messages posted on social media is challenging. Furthermore, verifying social media messages posted by the public is a critical concern for disaster response practitioners, making them hesitant to …

Who Wrote The Scientific News? Improving The Discernibility Of Llms To Human-Written Scientific News, Dominik Soós

Computer Science Theses & Dissertations

Large Language Models (LLMs) have rapidly advanced the field of Natural Language Processing and become powerful tools for generating and evaluating scientific text. Although LLMs have demonstrated promising as evaluators for certain text generation tasks, there is still a gap until they are used as reliable text evaluators for general purposes. In this thesis project, I attempted to fill this gap by examining the discernibility of LLMs from human-written and LLM-generated scientific news. This research demonstrated that although it was relatively straightforward for humans to discern scientific news written by humans from scientific news generated by GPT-3.5 using basic prompts, …

Sgsh : Stimulate Large Language Models With Skeleton Heuristics For Knowledge Base Question Generation, Shasha Guo, Lizi Liao, Jing Zhang, Yanling Wang, Cuiping Li, Hong Chen

Research Collection School Of Computing and Information Systems

Knowledge base question generation (KBQG) aims to generate natural language questions from a set of triplet facts extracted from KB. Existing methods have significantly boosted the performance of KBQG via pre-trained language models (PLMs) thanks to the richly endowed semantic knowledge. With the advance of pre-training techniques, large language models (LLMs) (e.g., GPT-3.5) undoubtedly possess much more semantic knowledge. Therefore, how to effectively organize and exploit the abundant knowledge for KBQG becomes the focus of our study. In this work, we propose SGSH — a simple and effective framework to Stimulate GPT-3.5 with Skeleton Heuristics to enhance KBQG. The framework …