Systems Engineering Commons^™

High Tempo Air Operations, Joseph Lipson, Brennan Flanagan, Trevor Sterbens, Brandon Godfrey, Jeremiah Sepich

Discovery Day - Daytona Beach

Aircraft carrier flight decks are one of the most dangerous work environments in the world, where dozens of aircraft must be moved, fueled, and armed within strict time limits. Currently, Flight Deck Handling Officers track aircraft positions using a physical board with wooden pucks that can be knocked out of place or become outdated during fast-moving operations. This study looks at whether using AI tools helps people design a better digital version of this tracking system. Participants with little design experience were randomly selected and then randomly assigned to one of two groups — one that could use AI tools …

Humans Vs. Ai: Comparing Approaches To Disaster Response Interface Design, Kelly Nguyen, Olivia Hartmann, Kailey Hrbek, Madeline Nees, Gabrielle Roth, Emily Silliman

Discovery Day - Daytona Beach

Amphibious emergency support operations involve rapidly changing information, high stress, and significant cognitive demands, which can make decision-making and situation awareness more difficult for operators. When interfaces are poorly designed, they can contribute to issues such as alarm flooding, confusion from incomplete information, and delayed responses, all of which increase operational risk during time-critical disaster situations. This study explores whether using generative AI to assist with interface design will improve performance (output quality and effort) and usability compared to a manual sketch mock-up. Participants were asked to design a dashboard interface to support disaster relief operations following a Category 5 …

A. Vs. I In Ai: Is There A Threshold To "Engineered" Intelligence?, Joshit Mohanty

Engineering Management & Systems Engineering Faculty Publications

Despite artificial intelligence reshaping the world, its development generates uncertainties regarding future capabilities. AI simultaneously exists as an artifact of engineering design and as autonomous intelligence, creating an observer-participant feedback loop. This paper proposes that embodied AI faces a bandwidth-limited intelligence threshold T_h that it arises from B = min(C_sens,C_Act). However, Shannon capacity measures bits while intelligence operates on concepts, necessitating a dual-channel model separating physical bandwidth B_io from representational capacity B_rep. Intelligence emerges as multi-dimensional rather than scalar, with components exhibiting different bandwidth dependencies. Surpassing T_h requires either new sensing methods expanding B, enhanced representational frameworks, or reconceptualization within …

Distilling The Complexity Of Agent-Based Simulations Into Textual Explanations Via Large Language Models, Noé Y. Flandre, Philippe J. Giabbanelli

VMASC Publications

Communicating the design and results of agent-based models (ABMs) to subject matter experts is challenging, which hinders participation and limits trust in simulation-based decision support. Large language models (LLMs) can communicate ABMs as textual summaries, thus complementing traditional disclosure through statistical and visualization techniques. While prior work translated the structure of conceptual models into narratives via LLMs, our extension covers the dynamics of simulation models via an automated simulation-to-text method that extracts contextual information from NetLogo ABMs, performs repeated simulations, and generates narrative descriptions (including the model’s purpose, parameters, and simulation dynamics) using mutimodal LLMs. Furthermore, four summarization algorithms spanning …

Toward Secure And Practical Machine Learning-Based Access Control: A Framework With Real-World Constraints And Adversarial Analysis, Olusesi Balogun, Mohammad Ghasemigol, Zhipeng Cai, Daniel Takabi

School of Cybersecurity Faculty Publications

Attribute-Based Access Control (ABAC) frameworks coordinate access requests based on subject, object, and environment attributes, as well as policy rules, and are widely used in corporate security systems. Recently, machine learning has been applied to ABAC to address policy-generation imbalances, misassigned privileges, and attribute leakages. However, existing MLBAC techniques do not consider the structural constraints and attribute interdependencies present in traditional ABAC systems. Moreover, these frameworks have not been extensively evaluated under black-box attack scenarios. To address these gaps, we propose extensions to MLBAC that integrate structural constraints, attribute dynamism, and attribute weighting into the MLBAC objective function. Additionally, we …

Generative Ai And Llm Applications In Renewable Energy And Smart Grids: A Systematic Review For The Sustainable Energy Transition, Umit Cali, Ugur Halden, Merlinda Andoni, Ferhat Ozgur Catak, Si Chen, Benoit Couraud, Emre Kantar, Samuel Knapper, Ibrahim Kucukdemiral, Huseyin Kusetogullari, Murat Kuzlu, Yashar Mousavi, Sonam Norbu, Taha Selim Ustun, David Flynn

Engineering Technology Faculty Publications

The global energy transition toward decarbonization and digitalization requires advanced methods to manage decentralized, data-intensive cyber-physical energy systems. This systematic review analyzes 106 research studies on Generative Artificial Intelligence (GenAI) and Large Language Models (LLMs) in renewable energy and smart grids, organized into seven application clusters covering forecasting, system design, operation, reliability, data and cybersecurity, and energy markets. The review situates these applications within a Cyber-Physical-Social Systems (CPSS) framework. Results show that GANs dominate current applications (47.2%), followed by LLMs (10.4%) and VAEs (9.4%), with growing adoption of diffusion and score-based models (7.5% each). Selected studies report improved probabilistic forecasting …

Improving Medical Diagnostics With Vision-Language Models: Convex Hull-Based Uncertainty Analysis, Ferhat Ozgur Catak, Murat Kuzlu, Taylor Patrick, Michel Audette

Engineering Technology Faculty Publications

In recent years, vision-language models (VLMs) have been applied to various fields, including healthcare, education, finance, and manufacturing, with remarkable performance. However, concerns remain regarding VLMs’ consistency and uncertainty, particularly in critical applications such as healthcare, which demand a high level of trust and reliability. This paper proposes a novel approach to evaluate uncertainty in VLMs’ responses using a convex hull approach on a healthcare application for visual question answering (VQA). For any VLM, temperature refers to a sampling parameter used in probabilistic generation, which controls the randomness of the model’s output. The LLM-CXR model is selected as the medical …

Generative Ai-Driven Optimization In Flexible And Reconfigurable Manufacturing Systems, Salah Hammedi, Hicham Chaoui, Lotfi Nabli

Electrical & Computer Engineering Faculty Publications

Flexible and Reconfigurable Manufacturing Systems (FRMSs) are essential for coping with variability in modern production environments; however, efficient scheduling and rapid reconfiguration remain challenging. This paper presents a hybrid optimization framework that integrates Colored Petri Net (CPN) modeling with Generative Artificial Intelligence (GenAI) to enhance scheduling performance and system adaptability. The CPN formalism ensures verifiable modeling of system dynamics, while a transformer-based generative model produces candidate scheduling and reconfiguration strategies. Simulation experiments were conducted under static, dynamic, and adaptive scenarios, including machine breakdowns and dynamic job arrivals. Performance was evaluated using makespan, mean flow time, machine utilization, and reconfiguration latency. …

Machine Learning And Optimization For Intelligent Decision-Making, Elson Cibaku

Dissertations

This dissertation presents a series of innovative machine learning and optimization model designs that address complex operational challenges across logistics and power systems. By integrating advanced neural architectures with robust optimization techniques, the work delivers scalable solutions designed to improve efficiency, reliability, and decision-making in dynamic and real-world environments. The first study introduces a two-stage approach to effective vaccine distribution. This framework tackles the capacitated vehicle routing problem by combining adaptive clustering techniques with reinforcement learning and a simulated annealing pickup policy. Through extensive computational experiments, the approach demonstrates substantial improvements in routing efficiency, reducing both computational time and logistical …

Digital Thread: Bridging Macro–Micro Services In System-Of-Systems, Joshit Mohanty

Graduate Student Government Association Research Conference

Organizations and industries increasingly rely on distributed services in decentralized environments—ranging from large-scale, system-of-system architectures to fine-grained, agent-based microservices. While this distributed paradigm offers flexibility and innovation, it presents critical challenges such as interoperability gaps, inconsistent data formats, and a lack of holistic oversight. Traditional integration approaches, including ad-hoc middleware or enterprise service buses, tend to solve these issues reactively. As a result, technical debt accumulates, stakeholder misalignments persist, and scaling to new demands becomes complex.

This research proposes digital thread (DT) as the unifying framework to create an authoritative source of truth: a continuous flow of information across the …

Meta-Clustering For Specialized Language Models: Enhancing Contextual Adaptation And Mitigating Hallucinations In Diverse Healthcare Environments, Joshit Mohanty, Vaishali Vaishali, Sandeep Kumar Nayak, Sumit Lahiri

Graduate Student Government Association Research Conference

Large Language Models (LLMs) have significantly advanced conversational AI by enabling dialogic information-seeking and task execution across diverse domains. However, their extensive parameters and broad domain scope lead to “data hallucinations.” These shortcomings are particularly evident in dynamic and diverse environments like India’s healthcare sector, where myriad languages, regional practices, and cultural nuances demand specialized, localized expertise rather than one-size-fits-all generalist models. This paper introduces a meta-clustering framework that integrates Distilled Language Models (DLMs) and Small/Specialized Language Models (SLMs) with meta-learning principles to address these limitations. By drawing on evidence from works such as MedHalu and Med-HALT, the framework seeks …

Tamos: Task-Aware Multi-Agent Orchestrator System, Joshit Mohanty, Sandeep Kumar Nayak, Sumit Lahiri

Graduate Student Government Association Research Conference

Large language models (LLMs) are increasingly at the core of multi-agent systems (MAS). However, the high resource demand, error propagation, and lack of adaptive evaluation mechanisms pose significant challenges in deploying these agentic solutions at scale. To address these concerns, this research proposes a Task-Aware Multi-Agent Orchestrator System designed to refine the agentic framework, categorizing tasks autonomously, assigning specialized evaluation datasets, and balancing token usage against functional effectiveness. This approach underscores robust data management, including AsyncHow, Mosaic AI, and Synthetic Preference Optimization (PO) corpora. Each dataset targets specific dimensions of agent performance, such as dynamic task decomposition and tool integration …

Graphtreemed: A Hybrid Graph-Tree Rag Architecture For Mission-Critical Medical Applications, Joshit Mohanty, Sandeep Kumar Nayak, Sumit Lahiri

Graduate Student Government Association Research Conference

Studies within engineering management indicate that decision-making is often based on the cognitive processing of grouped and pictographic information clusters entangled with high-level pattern recognition. Similarly, graph-based retrieval-augmented generation (RAG) architectures substantially improve diagnostic accuracy and interpretability, while tree-structured systems reduce critical misses through hierarchical reasoning. However, existing solutions often lack a unified framework that seamlessly integrates these two paradigms to address the multifaceted demands of mission-critical healthcare settings. This proposal introduces GraphTreeMed, a novel hybrid RAG architecture designed to harness the complementary strengths of graph-based and tree-based retrieval mechanisms, thereby advancing the safety and efficacy of clinical decision support …

Performing Requirements Specification And Analysis Through Open Generative Pre-Trained Transformers, Harvey J. Hurst

Theses and Dissertations

Every acquisition program begins with a requirement, and for those programs to succeed, robust requirements engineering (RE) must be implemented. RE encompasses eliciting, analyzing, specifying, and validating requirements—a critical process throughout a program's lifecycle. Despite its importance, RE faces challenges such as scope creep, ambiguity, redundancy, and inadequate automation support, often exacerbated by reliance on historical data. To address these issues, this thesis leverages advancements in Generative Technology, particularly large language models (LLMs) such as Generative Pre-Trained Transformers (GPTs). This research developed two GPT-based tools: the Single Requirement Analysis Tool and the Set of Requirements Analysis Tool. These tools were …

Physics-Informed Deep Learning With Kalman Filter Mixture For Traffic State Prediction, Niharika Deshpande, Hyoshin (John) Park

Engineering Management & Systems Engineering Faculty Publications

Accurate traffic forecasting is crucial for understanding and managing congestion for efficient transportation planning. However, conventional approaches often neglect epistemic uncertainty, which arises from incomplete knowledge across different spatiotemporal scales. This study addresses this challenge by introducing a novel methodology to establish dynamic spatiotemporal correlations that captures the unobserved heterogeneity in travel time through distinct peaks in probability density functions, guided by physics-based principles. We propose an innovative approach to modifying both prediction and correction steps of the Kalman Filter (KF) algorithm by leveraging established spatiotemporal correlations. Central to our approach is the development of a novel deep learning model …

Leveraging Transformer-Based Ocr Model With Generative Data Augmentation For Engineering Document Recognition, Wael Khallouli, Mohammad Shahab Uddin, Andres Sousa-Poza, Jiang Li, Samuel Kovacic

Engineering Management & Systems Engineering Faculty Publications

The long-standing practice of document-based engineering has resulted in the accumulation of a large number of engineering documents across various industries. Engineering documents, such as 2D drawings, continue to play a significant role in exchanging information and sharing knowledge across multiple engineering processes. However, these documents are often stored in non-digitized formats, such as paper and portable document format (PDF) files, making automation difficult. As digital engineering transforms processes in many industries, digitizing engineering documents presents a crucial challenge that requires advanced methods. This research addresses the problem of automatically extracting textual content from non-digitized legacy engineering documents. We introduced …

Computational Representation, Analysis And Verification Of Requirements In Engineering Design And Systems Engineering, Chandan Kumar Sahu

All Dissertations

Systems are developed to satisfy a set of requirements derived from stakeholders’ needs, defining the problem space for which the system is created as a feasible solution. The system design process begins with eliciting these requirements and concludes with validating whether the created system meets them. Requirements engineering (RE) encompasses elicitation, representation, analysis, documentation, verification, and validation. However, challenges in RE, such as imprecision in natural language (NL), proprietary restrictions, and a lack of standardized quality metrics, hinder the creation of well-formed and comprehensive requirements. These challenges complicate formalization and analysis of requirements.

This dissertation addresses these challenges by proposing …

Explainable Artificial Intelligence: Methods And Evaluation, Gayane Grigoryan

Engineering Management & Systems Engineering Theses & Dissertations

A wide array of techniques within explainable artificial intelligence (XAI) have been developed to measure the importance of features in machine learning models. A notable portion of these methods draws upon principles of cooperative game theory (CGT), with the Shapley value emerging as a widely used solution concept. Despite the rising prominence of the Shapley value, other promising solutions from cooperative game theory—such as the Nucleolus, Banzhaf power index, Shapley-Shubik power index, and solutions to conflicting claims problems—have been comparatively overlooked, even though they hold significant potential. In this dissertation, multiple XAI methods based on these other CGT solutions are …

Harnessing Social Media For Disaster Response: Intelligent Identification Of Reliable Rescue Requests During Hurricanes, Wael Khallouli

Engineering Management & Systems Engineering Theses & Dissertations

Hurricanes pose a significant threat to both human lives and infrastructure. Decision-makers face substantial challenges during such events, as they must act quickly to address victims’ needs. Social media platforms provide a valuable source for quick and real-time information. Recent hurricane events have shown that people turn to social media to call for help when official communication channels, such as 911, are overwhelmed. However, extracting actionable information from the massive number of messages posted on social media is challenging. Furthermore, verifying social media messages posted by the public is a critical concern for disaster response practitioners, making them hesitant to …

A Model-Based And System-Theoretic Approach To Design Advanced Autonomy For Air Dominance Missions: A Loyal Wingman Case Study, Elizabeth S. Pennington

Theses and Dissertations

In contested air environments, safe coordination between decision-makers is paramount. Although the Department of Defense (DoD) prioritizes the development of Artificially Intelligent (AI) wingmen for air combat, a lack of methodology exists to design safe, holistic coordination between human and autonomous wingmen in the same environment. This thesis delivers a framework using Systems Theoretic Process Analysis Extended for Coordination (STPA-Coord) to analyze and design holistic coordination for the Loyal Wingman concept in an Air Dominance mission. STPA-Coord is a safety and hazard analysis process that uses Systems Theory to analyze and design coordination between decisionmakers in a system-of-systems architecture. Using …

Artificial Intelligence And Perception: An Empirical Study, Anthony J. Neil

Theses and Dissertations

This thesis investigates the impact of adjusting artificial intelligence explainability levels’ outputs on user perception. The overarching study extends within the Explainable Artificial Intelligence (XAI) domain. It examines a spectrum of variables, including performance, cognizance, familiarity, transparency, system bias, and the overall impact of AI, to understand their collective and individual effects that enable effective professional use in an organization. The study aims to illuminate the relationship between the degree of explainability provided by large language models such as ChatGPT, Bard, and Bing AI and the performance of these models when tasked with XAI adjustments.

The Hazard Prediction Problem, Mary E. Helander, Brendan Smith, Sylvia Charchut, Erika Swiatowy, Calvin Nau, Gregory Cavaretta, Timothy Schuler, Adam Schunk, Héctor Ortiz-Peña

Social Science - All Scholarship

This work formulates the hazard prediction problem while addressing the research question: Can machine learning create a model to automatically recognize patterns that correspond to hazard state conditions during a mission-critical operation? Supervised learning models were trained and tested on data observed from mission simulators, which allowed for safe observation of dynamic system states and undesirable casualty events. The prediction task was formulated as a binary classification problem, producing the probability of being in a hazard state at time t and providing situational awareness of a possible imminent loss. Several modeling architectures were investigated: neural networks, logistic regression, a support …

Investigating Collaborative Explainable Ai (Cxai)/Social Forum As An Explainable Ai (Xai) Method In Autonomous Driving (Ad), Tauseef Ibne Mamun

Dissertations, Master's Theses and Master's Reports

Explainable AI (XAI) systems primarily focus on algorithms, integrating additional information into AI decisions and classifications to enhance user or developer comprehension of the system's behavior. These systems often incorporate untested concepts of explainability, lacking grounding in the cognitive and educational psychology literature (S. T. Mueller et al., 2021). Consequently, their effectiveness may be limited, as they may address problems that real users don't encounter or provide information that users do not seek.

In contrast, an alternative approach called Collaborative XAI (CXAI), as proposed by S. Mueller et al (2021), emphasizes generating explanations without relying solely on algorithms. CXAI centers …

Hard-Real-Time Computing Performance In A Cloud Environment, Alvin Cornelius Murphy

Engineering Management & Systems Engineering Theses & Dissertations

The United States Department of Defense (DoD) is rapidly working with DoD Services to move from multi-year (e.g., 7-10) traditional acquisition programs to a commercial industrybased approach for software development. While commercial technologies and approaches provide an opportunity for rapid fielding of mission capabilities to pace threats, the suitability of commercial technologies to meet hard-real-time requirements within a surface combat system is unclear. This research establishes technical data to validate the effectiveness and suitability of current commercial technologies to meet the hard-real-time demands of a DoD combat management system. (Moreland Jr., 2013) conducted similar research; however, microservices, containers, and container …

Supporting The Discovery, Reuse, And Validation Of Cybersecurity Requirements At The Early Stages Of The Software Development Lifecycle, Jessica Antonia Steinmann

Doctoral Dissertations and Master's Theses

The focus of this research is to develop an approach that enhances the elicitation and specification of reusable cybersecurity requirements. Cybersecurity has become a global concern as cyber-attacks are projected to cost damages totaling more than $10.5 trillion dollars by 2025. Cybersecurity requirements are more challenging to elicit than other requirements because they are nonfunctional requirements that requires cybersecurity expertise and knowledge of the proposed system. The goal of this research is to generate cybersecurity requirements based on knowledge acquired from requirements elicitation and analysis activities, to provide cybersecurity specifications without requiring the specialized knowledge of a cybersecurity expert, and …

Deep Learning Applications In Industrial And Systems Engineering, Winthrop Harvey

Graduate Theses and Dissertations

Deep learning - the use of large neural networks to perform machine learning - has transformed the world. As the capabilities of deep models continue to grow, deep learning is becoming an increasingly valuable and practical tool for industrial engineering. With its wide applicability, deep learning can be turned to many industrial engineering tasks, including optimization, heuristic search, and functional approximation. In this dissertation, the major concepts and paradigms of deep learning are reviewed, and three industrial engineering projects applying these methods are described. The first applies a deep convolutional network to the task of absolute aerial geolocalization - the …

A Unified View Of A Human Digital Twin, Michael Miller, Emily Spatz

Faculty Publications

The term human digital twin has recently been applied in many domains, including medical and manufacturing. This term extends the digital twin concept, which has been illustrated to provide enhanced system performance as it combines system models and analyses with real-time measurements for an individual system to improve system maintenance. Human digital twins have the potential to change the practice of human system integration as these systems employ real-time sensing and feedback to tightly couple measurements of human performance, behavior, and environmental influences throughout a product’s life cycle to human models to improve system design and performance. However, as this …

Supervised Representation Learning For Improving Prediction Performance In Medical Decision Support Applications, Phawis Thammasorn

Graduate Theses and Dissertations

Machine learning approaches for prediction play an integral role in modern-day decision supports system. An integral part of the process is extracting interest variables or features to describe the input data. Then, the variables are utilized for training machine-learning algorithms to map from the variables to the target output. After the training, the model is validated with either validation or testing data before making predictions with a new dataset. Despite the straightforward workflow, the process relies heavily on good feature representation of data. Engineering suitable representation eases the subsequent actions and copes with many practical issues that potentially prevent the …

Cybersecurity Risk Assessment Using Graph Theoretical Anomaly Detection And Machine Learning, Goksel Kucukkaya

Engineering Management & Systems Engineering Theses & Dissertations

The cyber domain is a great business enabler providing many types of enterprises new opportunities such as scaling up services, obtaining customer insights, identifying end-user profiles, sharing data, and expanding to new communities. However, the cyber domain also comes with its own set of risks. Cybersecurity risk assessment helps enterprises explore these new opportunities and, at the same time, proportionately manage the risks by establishing cyber situational awareness and identifying potential consequences. Anomaly detection is a mechanism to enable situational awareness in the cyber domain. However, anomaly detection also requires one of the most extensive sets of data and features …

Human Characteristics Impact On Strategic Decisions In A Human-In-The-Loop Simulation, Andrew J. Collins, Shieda Etemadidavan

Engineering Management & Systems Engineering Faculty Publications

In this paper, a hybrid simulation model of the agent-based model and cooperative game theory is used in a human-in-the-loop experiment to study the effect of human demographic characteristics in situations where they make strategic coalition decisions. Agent-based modeling (ABM) is a computational method that can reveal emergent phenomenon from interactions between agents in an environment. It has been suggested in organizational psychology that ABM could model human behavior more holistically than other modeling methods. Cooperative game theory is a method that models strategic coalitions formation. Three characteristics (age, education, and gender) were considered in the experiment to see if …