Computer Engineering Commons^™

A Hands-On Lab On Agentic Scientific Discovery For Time Series With The Model Context Protocol, Dhaval Patel, Miaomiao Feng, Chathurangi Shyalika, Shuxin Lin, Hasnat Md. Abdullah

Publications

Agentic AI offers new opportunities to accelerate scientific discovery for time series by enabling autonomous systems to inspect data, formulate hypotheses, compose experiments, and refine models based on empirical evidence. However, building agents that make sound modeling decisions requires more than connecting a language model to forecasting tools. Key challenges include exposing large model catalogues without overwhelming the agent, grounding parameter choices in data characteristics, supporting iterative experimentation, and evaluating the quality of the reasoning behind each decision.

This hands-on lab introduces participants to agentic scientific discovery for time series using the Model Context Protocol (MCP). Through five interactive sprints, …

Context Matters: Evaluating Llm-Generated Knowledge Graph Schemas, Ritvik Garimella, Riju Marwah, Atishay Jain, Khusham Bansal, Amit Sheth

Publications

Knowledge graph (KG) schema engineering is labor-intensive and resists automation at scale. We investigate whether LLMs can generate domain-specific KG schemas of sufficient quality for downstream symbolic reasoning. We propose a tiered contextual framework that varies domain context richness across four levels: zero context, domain scope, task requirements, and data distribution. Generated schemas are evaluated intrinsically on BioRED (600 PubMed abstracts, multi-type entities and relations), where automated tiered schemas match an established KG construction baseline at 79.9% EC, with edge conformance rising from 47.5% at L1 to a stable 78–80% from L2 onward. Extrinsic evaluation on a 50-record MedHop controlled …

Doing Less With More: A First-Principles Exploration Of The Suitability Of Agentic Computing Over Alternative Architectural Choices, Ritvik Garimella, Biplav Srivastava, Amit Sheth

Publications

There is growing interest in automating business activities with Agentic Artificial Intelligence (AI) due to latter's seeming ease of use. Never has it been easier, or costlier, to do less with more. However, little is known about when agents are preferable to established alternatives such as local computation, Representational State Transfer (REST), the Simple Object Access Protocol (SOAP), and the Model Context Protocol (MCP), particularly when development speed, performance, and operational cost are considered. We investigate this question using a controlled mathematical task that compares seven methods on a benchmark of 1,000 arithmetic expressions where semantics of operator precedence has …

One Size Does Not Fit All: Revisiting World Models And Neurosymbolic Ai, Amit P. Sheth, Madhur Thareja, Anushka Pawar, Niyati Rawal

Publications

World models are being built twice, from opposite ends, without a shared theory of how the two halves should meet. One lineage grounds the world model in perception: a self-supervised, latent-predictive encoder – exemplified by Joint Embedding Predictive Architectures (JEPA) – that learns the structure of sensory experi-ence. A second, older lineage grounds the world model in cognition: an explicit, inspectable structure of entities, rules, and constraints, ranging from knowledge graphs to formal logic to physical law. Neither lineage alone has produced a world model that is simultane-ously adaptive and auditable. We argue this is not solved by picking a …

Meeting The Moment With Ai-Employer Informed Education, Brent Terwilliger, John Faraca

Publications

As artificial intelligence transforms aviation, aerospace, and autonomy-related sectors, higher education must adapt to meet evolving workforce demands. This session shares emerging findings from a nationwide study led by Embry-Riddle Aeronautical University, focused on employer perceptions of AI adoption, responsible use, and workforce preparedness in domains including uncrewed systems, space systems, robotics, and advanced air mobility. Based on a structured survey and follow-up interviews, the presentation explores how organizations are using AI tools, from generative platforms to enterprise systems, and defining effective and inappropriate use in operational contexts. Participants will gain insight into critical concerns (e.g., data privacy, compliance, security, …

Rgfc: Registry Grounded Function Calling With Stage-Decomposed Evaluation, Ritvik Garimella, Vedant Khandelwal, Anvi Kohli, Amit Sheth

Publications

Tool-calling evaluations often report whether the final call matches a reference answer, but this single outcome merges different failures: choosing a function outside the available registry, violating the selected schema, or filling arguments with values not supported by the user request. These failures matter more when models must choose from larger tool registries. We introduce RFCD, a registry-scaled function-calling benchmark built from BFCL, Glaive Function Calling v2, and Tool-Call-Data, with standardized JSON-schema registries ranging from 5 to 3,000 functions. We also introduce TAAG, a deterministic stage-decomposed evaluator for registry conformance, structural completeness, and argument grounding. Across six locally served sub-4B …

Biologically-Inspired Multiscale Neuromorphic Architecture, Christian O'Reilly, Ramtin Zand

Publications

This white paper proposes a biologically-inspired multiscale neuromorphic architecture that bridges key gaps between artificial neural networks (ANNs), spiking neural networks (SNNs), and biological neural networks (BNNs). While SNNs offer promising energy efficiency, their broader adoption remains limited by suboptimal performance and the need for novel learning paradigms. To address these challenges, the proposed framework integrates structural and functional principles observed in the brain, including hierarchical organization, sparse and modular connectivity, predictive coding, and diverse neuronal dynamics.

The architecture operates across micro-, meso-, and macro-scales, incorporating neuron-level diversity (e.g., excitatory/inhibitory and principal/support cells), canonical microcircuits (CMCs), and large-scale hierarchical organization. …

In-Situ Eval: A Modular Framework For Custom And Real-Time Rag Benchmarking, Ritvik Garimella, Kaushik Roy, Chathurangi Shyalika, Amit Sheth

Publications

Retrieval-Augmented Generation (RAG) has become the standard approach for integrating domain knowledge into Large Language Models (LLMs). However, fair comparison of RAG pipelines remains difficult: data preparation is often ad hoc, subsampling methods are opaque, parameters vary across implementations, and evaluation is fragmented. We present In-Situ Eval, a unified and reproducible framework that operationalizes the full RAG pipeline with configurable subsampling strategies and both RAG-specific and generic evaluation metrics. The platform supports two execution modes: an offline Dataset mode for evaluating precomputed outputs, and a live Retrieval mode for benchmarking RAG variants with state-of-the-art LLMs. Users can flexibly select datasets, …

Toward Neurosymbolic Reinforcement Learning Via Editable Specifications, Vedant Khandelwal, Hong Yung Yip, Amit Sheth

Publications

Reinforcement learning systems are commonly adapted to new settings by retraining or fine-tuning policies. This default is costly, difficult to audit, and poorly aligned with structured requirement changes such as revised safety rules, new operational constraints, or updated user preferences. We argue for an alternative abstraction: adaptation via edits to an external, human-readable specification that the agent consults at execution time. We propose conditioning decision-making on an editable knowledge graph encoding (i) rules capturing action applicability and high-level effects, (ii) hard constraints defining feasibility, and (iii) soft preferences shaping tradeoffs among feasible behaviors. Requirement changes become graph edits, not policy …

Truck Drivers And Autonomous Trucks: A Topic Modeling Analysis Of Truck Driver Posts, Noah Britt, Amy M. Schuster, Shubham Agrawal, Chu-Hsiang Chang, Jenna A. Van Fossen, Elizabeth A. Mack, Sheila R. Cotten

Publications

Social media provides a rich, alternative data source to interviews or survey-based research to study hard-to-reach populations (e.g., truck drivers, because of their transient work structure and unique subculture). This study uses public social media posts from the largest trucking forum in the United States to examine truck drivers’ views on autonomous trucks (ATs), which are poised to transform the trucking industry. We expand on traditional qualitative strategies of analyzing social media data by combining newer methods, including BERT-based topic modeling, sentiment analysis, stance detection, emotion analysis, topic similarity, and location analysis through a social interaction network, to analyze a …

Crisis Observatory: Extracting Credible Signals During A Crisis In The Age Of Llms, Kuan-Chieh Lo, Pranav Maneriker, Sriram Sai Ganesh, Dominik Winecki, Kelly Garrett, Ayaz Hyder, Arnab Nandi, Valerie Shalin, Shannon A. Bowen Ph.D., Amit Sheth, Srinivasan Parthasarathy

Publications

Systems for crisis response have required several different models for the analysis of unstructured text, such as identifying needs, locations, topics, routing, and matching of needs with available responders. Large Language Models (LLMs) have replaced task-specific models across various language processing tasks. However, LLMs are known to be limited by their training data, collected before the crisis. In this demo, we explore the use of LLMs for crisis response scenarios with rapidly evolving information environments. We show how the augmentation of these models with external reliable sources of crisis-specific information can help build adaptive systems for response. The demonstration video …

Building Multimodal Knowledge Graphs: Automation For Enterprise Integration, Ritvik Garimella, Hong Yung Yip, Revathy Venkataramanan, Amit P. Sheth

Publications

As enterprises increasingly aim to incorporate artificial intelligence into their workflows to tackle complex, multimodal tasks, the demand for intelligent, robust, and trustworthy systems is paramount. While multimodal large language models offer initial capabilities for processing diverse data streams, their dependence on embedding-based representations limit their effectiveness in delivering semantically grounded explanations and reasoning, as well as qualities essential for enterprise-grade applications. Neurosymbolic approaches provide a promising alternative by enabling traceable, context-aware decision making. However, constructing enterprise-level multimodal knowledge graphs (MMKGs) that enable neurosymbolic approaches remains largely impractical. Although prior efforts have explored MMKG construction, they fall short in addressing …

From Assembly Lines To The Open Road: Predicting Rare Events In Autonomous Systems, Ruwan Wickramarachchi

Publications

In the age of embodied AI and smart automation, autonomous agents are increasingly deployed in high-stakes, real-world environments. Ensuring the robustness and resilience of these systems in the face of rare but critical failure events is essential for their safe and reliable operation. Accurate forecasting of such rare events is particularly crucial, as a single overlooked anomaly can lead to catastrophic consequences. In manufacturing, for instance, unplanned downtime due to rare failures costs industries over \$50 billion annually, with sectors like automotive losing more than \$2 million per hour—even with preventive maintenance systems in place.

However, the extreme rarity and …

Multiagent Copilot In Industrial Ai Applications, Chathurangi Shyalika, Renjith Prasad, Utkarshani Jaimini, Cory Henson, Fadi El Kalach, Amit Sheth

Publications

In the era of smart automation and digital transformation, achieving efficiency, precision, and adaptability is essential for industries to remain competitive. Sectors, including manufacturing, supply chain and logistics, healthcare, finance, and retail, face significant challenges in deploying Artificial Intelligence (AI) solutions tailored to their unique needs, particularly in critical, resource-constrained applications. According to Gartner’s 2024 Hype Cycle for Artificial Intelligence, composite AI, which integrates techniques like machine learning, knowledge graphs, and rule-based systems, is becoming foundational for industries, enhancing predictions, decisions, and scalability across complex environments.

The complexity of real-world systems requires Industrial AI solutions to be customizable to business …

A Survey On Food Ingredient Substitutions, Hyunwook Kim, Revathy Venkataramanan, Amit P. Sheth

Publications

Diet plays a crucial role in managing chronic conditions and overall well-being. As people become more selective about their food choices, finding recipes that meet dietary needs is important. Ingredient substitution is key to adapting recipes for dietary restrictions, allergies, and availability constraints. However, identifying suitable substitutions is challenging as it requires analyzing the flavor, functionality, and health suitability of ingredients. With the advancement of AI, researchers have explored computational approaches to address ingredient substitution. This survey paper provides a comprehensive overview of the research in this area, focusing on five key aspects: (i) datasets and data sources used to …

Exploring The Potential Of Large Language Models For Assisting With Mental Health Diagnostic Assessments: The Depression And Anxiety Case, Kaushik Roy, Harshul Surana, Darssan Eswaramoorthi, Yuxin Zi, Vedant Palit, Ritvik Garimella, Amit Sheth

Publications

Large language models (LLMs) are increasingly attracting the attention of healthcare professionals for their potential to assist in diagnostic assessments, which could alleviate the strain on the healthcare system caused by a high patient load and a shortage of providers. For LLMs to be effective in supporting diagnostic assessments, it is essential that they closely replicate the standard diagnostic procedures used by clinicians. In this paper, we specifically examine the diagnostic assessment processes described in the Patient Health Questionnaire-9 (PHQ-9) for major depressive disorder (MDD) and the Generalized Anxiety Disorder-7 (GAD-7) questionnaire for generalized anxiety disorder (GAD). We investigate various …

C 3 An: Custom, Compact And Composite Ai Systems - A Neurosymbolic Approach: 4Th-Generation Evolution Of Intelligent Systems, Amit P. Sheth, Kaushik Roy, Revathy Venkataramanan, Venkatesan Nadimuthu

Publications

Artificial Intelligence (AI) systems continue to evolve rapidly. From the architecture perspective, it is evolving from large, monolithic models trained on massive internet data to complex, multi-component “compound” systems and “agentic” frameworks capable of semi-autonomous decision-making. These systems show immense promise yet face numerous challenges in reliability, consistency, transparency, and alignment with user goals. In this article, we propose Custom, Compact and Composite AI with Neurosymbolic (C3AN) approach, a framework that paves way to 4th-generation of AI that integrates data, knowledge, and human expertise to build robust, intelligent and trustworthy AI systems defined by 14 foundation elements.

Custom emphasizes …

Safe Data-Enabled Control Of Human-In-The-Loop Robotic Manipulator Systems, Ritirupa Dey, Avimanyu Sahoo, Vignesh Narayanan

Publications

Safe control of human-in-the-loop (HIL) robotic manipulators is critical for applications such as assistive robotics, teleoperation in hazardous environments, and collaborative manufacturing. However, this remains challenging due to the lack of a unified framework that simultaneously addresses safety constraints, external disturbances, unmodeled dynamics, and dynamic role switching in the HIL setting. In this paper, we propose a novel NN-driven HIL control framework in which human–robot dyadic interaction occurs through the haptic channel. Using Lyapunov stability analysis, we theoretically show that the proposed NN-based controller ensures accurate joint trajectory tracking, compensates for system uncertainties, and adapts to human inputs modeled as …

Investigation Of A Busemann Intake At Negative Angle Of Attack, Mark E. Noftz, Andrew N. Bustard, Nicholas J. Bisek, Thomas J. Juliano, Joseph S. Jewell

Publications

A high-speed, shape-transitioned, inward-turning intake was tested in Purdue’s Boeing/AFOSR Mach 6 Quiet Tunnel. The inlet model, called the Indiana Inlet (INlet), had a total contraction ratio of 4.68:1 and a design point of Mach 6 at 0° angle of attack. The model was outfitted with a suite of high-frequency pressure transducers, and the external flowfield was imaged with high-speed schlieren photography. The INlet was tested under low freestream disturbance levels for a variety of freestream unit Reynolds numbers and at-4° angle of attack. An unsteady shockwave near the leading edge of the inlet forebody, indicative of boundary layer separation, …

Towards Rare Event And Anomaly Prediction In Manufacturing: Bridging Methodological Gaps In Industrial Applications, Chathurangi Shyalika, Renjith Prasad, Ruwan Wickramarachchi, Amit Sheth

Publications

Rare event prediction is critical in industrial applications, including real-world Industry 4.0 applications. These events, defined by their low occurrence frequency, are often difficult to predict due to the skewed data distribution, which complicates modeling and evaluation. In our research, we provide a comprehensive review of current approaches to rare event prediction across four key dimensions: rare event data, data processing techniques, algorithmic approaches, and evaluation methodologies [1]. By analyzing diverse datasets with multiple modalities, including numerical, image, text, and audio, we categorize the primary challenges and present the gaps in current research. Specifically, we present three novel research contributions …

Predicting Chaotic Systems With Quantum Echo-State Networks, Erik Connerty, Ethan N. Evans, Gerasimos Angelatos, Vignesh Narayanan

Publications

Recent advancements in artificial neural networks have enabled impressive tasks on classical computers, but they demand significant computational resources. While quantum computing offers potential beyond classical systems, the advantages of quantum neural networks (QNNs) remain largely unexplored. In this work, we present and examine a quantum circuit (QC) that implements and aims to improve upon the classical echo-state network (ESN), a type of reservoir-based recurrent neural networks (RNNs), using quantum computers. Typically, ESNs consist of an extremely large reservoir that learns high-dimensional embeddings, enabling prediction of complex system trajectories. Quantum echo-state networks (QESNs) aim to reduce this need for prohibitively …

A Benchmark Knowledge Graph Of Driving Scenes For Knowledge Completion Tasks, Ruwan Wickramarachchi, Cory Henson, Amit Sheth

Publications

Knowledge graph completion (KGC) is a problem of significant importance due to the inherent incompleteness in knowledge graphs (KGs). The current approaches for KGC using link prediction (LP) mostly rely on a common set of benchmark datasets that are quite different from real-world industrial KGs. Therefore, the adaptability of current LP methods for real-world KGs and domain-specific ap- plications is questionable. To support the evaluation of current and future LP and KGC methods for industrial KGs, we introduce DSceneKG, a suite of real-world driving scene knowledge graphs that are currently being used across various industrial applications. The DSceneKG is publicly …

Visual Causal Question And Answering With Knowledge Graph Link Prediction, Utkarshani Jaimini, Cory Henson, Amit Sheth

Publications

The ability to answer causal questions is important for any system that requires robust scene under- standing. In this demonstration, we develop a prototype system that leverages our causal link prediction framework, CausalLP. CausalLP framework uses a visual causal knowledge graph and associated knowledge graph embedding for two visual causal question and answering tasks- (i) causal explanation and (ii) causal prediction. In the live demonstration sessions, the participants will be invited to test the efficiency and effectiveness of the system for visual causal question and answering.

Causal Neuro-Symbolic Ai For Root Cause Analysis In Smart Manufacturing, Utkarshani Jaimini, Cory Henson, Amit Sheth

Publications

Root cause analysis is the process of investigating the cause of a failure and providing measures to prevent future failures. It is an active area of research due to the complexities in manufacturing production lines and the vast amount of data that requires manual inspection. We present a combined approach of causal neuro-symbolic AI for root cause analysis to identify failures in smart manufacturing production lines. We have used data from an industry-grade rocket assembly line and a simulation package to demonstrate the effectiveness and relevance of our approach.

Ontology Design Metapattern For Relationtype Role Composition, Utkarshani Jaimini, Ruwan Wickramarachchi, Cory Henson, Amit Sheth

Publications

RelationType is a metapattern that specifies a property in a knowledge graph that directly links the head of a triple with the type of the tail. This metapattern is useful for knowledge graph link prediction tasks, specifically when one wants to predict the type of a linked entity rather than the entity instance itself. The RelationType metapattern serves as a template for future extensions of an ontology with more fine-grained domain information.

Causal Knowledge Graph For Scene Understanding In Autonomous Driving, Utkarshani Jaimini, Cory Henson, Amit Sheth

Publications

The current approaches to autonomous driving focus on learning from observation or simulated data. These approaches are based on correlations rather than causation. For safety-critical applications, like autonomous driving, it’s important to represent causal dependencies among variables in addition to the domain knowledge expressed in a knowledge graph. This will allow for a better understanding of causation during scenarios that have not been observed, such as malfunctions or accidents. The causal knowledge graph, coupled with domain knowledge, demonstrates how autonomous driving scenes can be represented, learned, and explained using counterfactual and intervention reasoning to infer and understand the behavior of …

Pig Butchering In Cybersecurity: A Modern Social Engineering Threat, Sharon L. Burton, Pamela D. Moore

Publications

Pig butchering is an escalating cybersecurity threat that exploits social engineering to build trust and execute financial fraud. The relevance of this research problem lies in the growing incidence and sophistication of these scams, which have severe financial and psychological impacts on victims. The main purpose of this research is to uncover the methods used in pig butchering scams and their impact on individuals and businesses. The research focuses on digital platforms such as social media, dating apps, and professional networking sites, chosen for their wide user bases and the ease of establishing personal connections. The study period encompasses recent …

Healthcare Assistance Challenges-Driven Neurosymbolic Ai, Kaushik Roy

Publications

Although Artificial Intelligence technology has proven effective in providing healthcare assistance by analyzing health data, it still falls short in supporting decision-making. This deficiency largely stems from the predominance of opaque neural networks, particularly in mental health care AI applications, which raise concerns about their unpredictable and unverifiable nature. This skepticism hinders the transition from information support to decision support. This presentation will explore neurosymbolic approaches that combine neural networks with symbolic control and verification mechanisms. These approaches aim to unlock AI’s full potential by enhancing information analysis and decision-making support for healthcare assistance.

Evaluating The Role Of Data Enrichment Approaches Towards Rare Event Analysis In Manufacturing, Chathurangi Shyalika, Ruwan Wickramarachchi, Fadi El Kalach, Ramy Harik, Amit P. Sheth

Publications

Rare events are occurrences that take place with a significantly lower frequency than more common, regular events. These events can be categorized into distinct categories, from frequently rare to extremely rare, based on factors like the distribution of data and significant differences in rarity levels. In manufacturing domains, predicting such events is particularly important, as they lead to unplanned downtime, a shortening of equipment lifespans, and high energy consumption. Usually, the rarity of events is inversely correlated with the maturity of a manufacturing industry. Typically, the rarity of events affects the multivariate data generated within a manufacturing process to be …

Cognitive Manufacturing: Definition And Current Trends, Fadi El Kalach, Ibrahim Yousif, Thorsten Wuest, Amit Sheth, Ramy Harik

Publications

Manufacturing systems have recently witnessed a shift from the widely adopted automated systems seen throughout industry. The evolution of Industry 4.0 or Smart Manufacturing has led to the introduction of more autonomous systems focused on fault tolerant and customized production. These systems are required to utilize multimodal data such as machine status, sensory data, and domain knowledge for complex decision making processes. This level of intelligence can allow manufacturing systems to keep up with the ever-changing markets and intricate supply chain. Current manufacturing lines lack these capabilities and fall short of utilizing all generated data. This paper delves into the …