Computer Engineering Commons^™

Doing Less With More: A First-Principles Exploration Of The Suitability Of Agentic Computing Over Alternative Architectural Choices, Ritvik Garimella, Biplav Srivastava, Amit Sheth

Publications

There is growing interest in automating business activities with Agentic Artificial Intelligence (AI) due to latter's seeming ease of use. However, little is known on when they are suitable for a task over other alternatives developed over the years - local computation, REstful State Transfer (REST), and Simple Object Access Protocol (SOAP) - considering development speed, performance, and operational cost. We explore this with a small mathematical task evaluating five methods for automated mathematical expression evaluation across a benchmark of 1,000 equations where semantics of operator precedence has to be preserved. We ran this setup across a native Function Calling …

One Size Does Not Fit All: Revisitingworld Models And Neurosymbolic Ai, Amit P. Sheth, Madhur Thareja, Anushka Pawar, Niyati Rawal

Publications

World models are being built twice, from opposite ends, without a shared theory of how the two halves should meet. One lineage grounds the world model in perception: a self-supervised, latent-predictive encoder – exemplified by Joint Embedding Predictive Architectures (JEPA) – that learns the structure of sensory experi-ence. A second, older lineage grounds the world model in cognition: an explicit, inspectable structure of entities, rules, and constraints, ranging from knowledge graphs to formal logic to physical law. Neither lineage alone has produced a world model that is simultane-ously adaptive and auditable. We argue this is not solved by picking a …

Meeting The Moment With Ai-Employer Informed Education, Brent Terwilliger, John Faraca

Publications

As artificial intelligence transforms aviation, aerospace, and autonomy-related sectors, higher education must adapt to meet evolving workforce demands. This session shares emerging findings from a nationwide study led by Embry-Riddle Aeronautical University, focused on employer perceptions of AI adoption, responsible use, and workforce preparedness in domains including uncrewed systems, space systems, robotics, and advanced air mobility. Based on a structured survey and follow-up interviews, the presentation explores how organizations are using AI tools, from generative platforms to enterprise systems, and defining effective and inappropriate use in operational contexts. Participants will gain insight into critical concerns (e.g., data privacy, compliance, security, …

Biologically-Inspired Multiscale Neuromorphic Architecture, Christian O'Reilly, Ramtin Zand

Publications

This white paper proposes a biologically-inspired multiscale neuromorphic architecture that bridges key gaps between artificial neural networks (ANNs), spiking neural networks (SNNs), and biological neural networks (BNNs). While SNNs offer promising energy efficiency, their broader adoption remains limited by suboptimal performance and the need for novel learning paradigms. To address these challenges, the proposed framework integrates structural and functional principles observed in the brain, including hierarchical organization, sparse and modular connectivity, predictive coding, and diverse neuronal dynamics.

The architecture operates across micro-, meso-, and macro-scales, incorporating neuron-level diversity (e.g., excitatory/inhibitory and principal/support cells), canonical microcircuits (CMCs), and large-scale hierarchical organization. …

In-Situ Eval: A Modular Framework For Custom And Real-Time Rag Benchmarking, Ritvik Garimella, Kaushik Roy, Chathurangi Shyalika, Amit Sheth

Publications

Retrieval-Augmented Generation (RAG) has become the standard approach for integrating domain knowledge into Large Language Models (LLMs). However, fair comparison of RAG pipelines remains difficult: data preparation is often ad hoc, subsampling methods are opaque, parameters vary across implementations, and evaluation is fragmented. We present In-Situ Eval, a unified and reproducible framework that operationalizes the full RAG pipeline with configurable subsampling strategies and both RAG-specific and generic evaluation metrics. The platform supports two execution modes: an offline Dataset mode for evaluating precomputed outputs, and a live Retrieval mode for benchmarking RAG variants with state-of-the-art LLMs. Users can flexibly select datasets, …

Toward Neurosymbolic Reinforcement Learning Via Editable Specifications, Vedant Khandelwal, Hong Yung Yip, Amit Sheth

Publications

Reinforcement learning systems are commonly adapted to new settings by retraining or fine-tuning policies. This default is costly, difficult to audit, and poorly aligned with structured requirement changes such as revised safety rules, new operational constraints, or updated user preferences. We argue for an alternative abstraction: adaptation via edits to an external, human-readable specification that the agent consults at execution time. We propose conditioning decision-making on an editable knowledge graph encoding (i) rules capturing action applicability and high-level effects, (ii) hard constraints defining feasibility, and (iii) soft preferences shaping tradeoffs among feasible behaviors. Requirement changes become graph edits, not policy …

Truck Drivers And Autonomous Trucks: A Topic Modeling Analysis Of Truck Driver Posts, Noah Britt, Amy M. Schuster, Shubham Agrawal, Chu-Hsiang Chang, Jenna A. Van Fossen, Elizabeth A. Mack, Sheila R. Cotten

Publications

Social media provides a rich, alternative data source to interviews or survey-based research to study hard-to-reach populations (e.g., truck drivers, because of their transient work structure and unique subculture). This study uses public social media posts from the largest trucking forum in the United States to examine truck drivers’ views on autonomous trucks (ATs), which are poised to transform the trucking industry. We expand on traditional qualitative strategies of analyzing social media data by combining newer methods, including BERT-based topic modeling, sentiment analysis, stance detection, emotion analysis, topic similarity, and location analysis through a social interaction network, to analyze a …

Crisis Observatory: Extracting Credible Signals During A Crisis In The Age Of Llms, Kuan-Chieh Lo, Pranav Maneriker, Sriram Sai Ganesh, Dominik Winecki, Kelly Garrett, Ayaz Hyder, Arnab Nandi, Valerie Shalin, Shannon A. Bowen Ph.D., Amit Sheth, Srinivasan Parthasarathy

Publications

Systems for crisis response have required several different models for the analysis of unstructured text, such as identifying needs, locations, topics, routing, and matching of needs with available responders. Large Language Models (LLMs) have replaced task-specific models across various language processing tasks. However, LLMs are known to be limited by their training data, collected before the crisis. In this demo, we explore the use of LLMs for crisis response scenarios with rapidly evolving information environments. We show how the augmentation of these models with external reliable sources of crisis-specific information can help build adaptive systems for response. The demonstration video …

From Assembly Lines To The Open Road: Predicting Rare Events In Autonomous Systems, Ruwan Wickramarachchi

Publications

In the age of embodied AI and smart automation, autonomous agents are increasingly deployed in high-stakes, real-world environments. Ensuring the robustness and resilience of these systems in the face of rare but critical failure events is essential for their safe and reliable operation. Accurate forecasting of such rare events is particularly crucial, as a single overlooked anomaly can lead to catastrophic consequences. In manufacturing, for instance, unplanned downtime due to rare failures costs industries over \$50 billion annually, with sectors like automotive losing more than \$2 million per hour—even with preventive maintenance systems in place.

However, the extreme rarity and …

Multiagent Copilot In Industrial Ai Applications, Chathurangi Shyalika, Renjith Prasad, Utkarshani Jaimini, Cory Henson, Fadi El Kalach, Amit Sheth

Publications

In the era of smart automation and digital transformation, achieving efficiency, precision, and adaptability is essential for industries to remain competitive. Sectors, including manufacturing, supply chain and logistics, healthcare, finance, and retail, face significant challenges in deploying Artificial Intelligence (AI) solutions tailored to their unique needs, particularly in critical, resource-constrained applications. According to Gartner’s 2024 Hype Cycle for Artificial Intelligence, composite AI, which integrates techniques like machine learning, knowledge graphs, and rule-based systems, is becoming foundational for industries, enhancing predictions, decisions, and scalability across complex environments.

The complexity of real-world systems requires Industrial AI solutions to be customizable to business …

A Survey On Food Ingredient Substitutions, Hyunwook Kim, Revathy Venkataramanan, Amit P. Sheth

Publications

Diet plays a crucial role in managing chronic conditions and overall well-being. As people become more selective about their food choices, finding recipes that meet dietary needs is important. Ingredient substitution is key to adapting recipes for dietary restrictions, allergies, and availability constraints. However, identifying suitable substitutions is challenging as it requires analyzing the flavor, functionality, and health suitability of ingredients. With the advancement of AI, researchers have explored computational approaches to address ingredient substitution. This survey paper provides a comprehensive overview of the research in this area, focusing on five key aspects: (i) datasets and data sources used to …

Exploring The Potential Of Large Language Models For Assisting With Mental Health Diagnostic Assessments: The Depression And Anxiety Case, Kaushik Roy, Harshul Surana, Darssan Eswaramoorthi, Yuxin Zi, Vedant Palit, Ritvik Garimella, Amit Sheth

Publications

Large language models (LLMs) are increasingly attracting the attention of healthcare professionals for their potential to assist in diagnostic assessments, which could alleviate the strain on the healthcare system caused by a high patient load and a shortage of providers. For LLMs to be effective in supporting diagnostic assessments, it is essential that they closely replicate the standard diagnostic procedures used by clinicians. In this paper, we specifically examine the diagnostic assessment processes described in the Patient Health Questionnaire-9 (PHQ-9) for major depressive disorder (MDD) and the Generalized Anxiety Disorder-7 (GAD-7) questionnaire for generalized anxiety disorder (GAD). We investigate various …

C 3 An: Custom, Compact And Composite Ai Systems - A Neurosymbolic Approach: 4Th-Generation Evolution Of Intelligent Systems, Amit P. Sheth, Kaushik Roy, Revathy Venkataramanan, Venkatesan Nadimuthu

Publications

Artificial Intelligence (AI) systems continue to evolve rapidly. From the architecture perspective, it is evolving from large, monolithic models trained on massive internet data to complex, multi-component “compound” systems and “agentic” frameworks capable of semi-autonomous decision-making. These systems show immense promise yet face numerous challenges in reliability, consistency, transparency, and alignment with user goals. In this article, we propose Custom, Compact and Composite AI with Neurosymbolic (C3AN) approach, a framework that paves way to 4th-generation of AI that integrates data, knowledge, and human expertise to build robust, intelligent and trustworthy AI systems defined by 14 foundation elements.

Custom emphasizes …

Safe Data-Enabled Control Of Human-In-The-Loop Robotic Manipulator Systems, Ritirupa Dey, Avimanyu Sahoo, Vignesh Narayanan

Publications

Safe control of human-in-the-loop (HIL) robotic manipulators is critical for applications such as assistive robotics, teleoperation in hazardous environments, and collaborative manufacturing. However, this remains challenging due to the lack of a unified framework that simultaneously addresses safety constraints, external disturbances, unmodeled dynamics, and dynamic role switching in the HIL setting. In this paper, we propose a novel NN-driven HIL control framework in which human–robot dyadic interaction occurs through the haptic channel. Using Lyapunov stability analysis, we theoretically show that the proposed NN-based controller ensures accurate joint trajectory tracking, compensates for system uncertainties, and adapts to human inputs modeled as …

Investigation Of A Busemann Intake At Negative Angle Of Attack, Mark E. Noftz, Andrew N. Bustard, Nicholas J. Bisek, Thomas J. Juliano, Joseph S. Jewell

Publications

A high-speed, shape-transitioned, inward-turning intake was tested in Purdue’s Boeing/AFOSR Mach 6 Quiet Tunnel. The inlet model, called the Indiana Inlet (INlet), had a total contraction ratio of 4.68:1 and a design point of Mach 6 at 0° angle of attack. The model was outfitted with a suite of high-frequency pressure transducers, and the external flowfield was imaged with high-speed schlieren photography. The INlet was tested under low freestream disturbance levels for a variety of freestream unit Reynolds numbers and at-4° angle of attack. An unsteady shockwave near the leading edge of the inlet forebody, indicative of boundary layer separation, …

Towards Rare Event And Anomaly Prediction In Manufacturing: Bridging Methodological Gaps In Industrial Applications, Chathurangi Shyalika, Renjith Prasad, Ruwan Wickramarachchi, Amit Sheth

Publications

Rare event prediction is critical in industrial applications, including real-world Industry 4.0 applications. These events, defined by their low occurrence frequency, are often difficult to predict due to the skewed data distribution, which complicates modeling and evaluation. In our research, we provide a comprehensive review of current approaches to rare event prediction across four key dimensions: rare event data, data processing techniques, algorithmic approaches, and evaluation methodologies [1]. By analyzing diverse datasets with multiple modalities, including numerical, image, text, and audio, we categorize the primary challenges and present the gaps in current research. Specifically, we present three novel research contributions …

Predicting Chaotic Systems With Quantum Echo-State Networks, Erik Connerty, Ethan N. Evans, Gerasimos Angelatos, Vignesh Narayanan

Publications

Recent advancements in artificial neural networks have enabled impressive tasks on classical computers, but they demand significant computational resources. While quantum computing offers potential beyond classical systems, the advantages of quantum neural networks (QNNs) remain largely unexplored. In this work, we present and examine a quantum circuit (QC) that implements and aims to improve upon the classical echo-state network (ESN), a type of reservoir-based recurrent neural networks (RNNs), using quantum computers. Typically, ESNs consist of an extremely large reservoir that learns high-dimensional embeddings, enabling prediction of complex system trajectories. Quantum echo-state networks (QESNs) aim to reduce this need for prohibitively …

A Benchmark Knowledge Graph Of Driving Scenes For Knowledge Completion Tasks, Ruwan Wickramarachchi, Cory Henson, Amit Sheth

Publications

Knowledge graph completion (KGC) is a problem of significant importance due to the inherent incompleteness in knowledge graphs (KGs). The current approaches for KGC using link prediction (LP) mostly rely on a common set of benchmark datasets that are quite different from real-world industrial KGs. Therefore, the adaptability of current LP methods for real-world KGs and domain-specific ap- plications is questionable. To support the evaluation of current and future LP and KGC methods for industrial KGs, we introduce DSceneKG, a suite of real-world driving scene knowledge graphs that are currently being used across various industrial applications. The DSceneKG is publicly …

Ontology Design Metapattern For Relationtype Role Composition, Utkarshani Jaimini, Ruwan Wickramarachchi, Cory Henson, Amit Sheth

Publications

RelationType is a metapattern that specifies a property in a knowledge graph that directly links the head of a triple with the type of the tail. This metapattern is useful for knowledge graph link prediction tasks, specifically when one wants to predict the type of a linked entity rather than the entity instance itself. The RelationType metapattern serves as a template for future extensions of an ontology with more fine-grained domain information.

Visual Causal Question And Answering With Knowledge Graph Link Prediction, Utkarshani Jaimini, Cory Henson, Amit Sheth

Publications

The ability to answer causal questions is important for any system that requires robust scene under- standing. In this demonstration, we develop a prototype system that leverages our causal link prediction framework, CausalLP. CausalLP framework uses a visual causal knowledge graph and associated knowledge graph embedding for two visual causal question and answering tasks- (i) causal explanation and (ii) causal prediction. In the live demonstration sessions, the participants will be invited to test the efficiency and effectiveness of the system for visual causal question and answering.

Causal Neuro-Symbolic Ai For Root Cause Analysis In Smart Manufacturing, Utkarshani Jaimini, Cory Henson, Amit Sheth

Publications

Root cause analysis is the process of investigating the cause of a failure and providing measures to prevent future failures. It is an active area of research due to the complexities in manufacturing production lines and the vast amount of data that requires manual inspection. We present a combined approach of causal neuro-symbolic AI for root cause analysis to identify failures in smart manufacturing production lines. We have used data from an industry-grade rocket assembly line and a simulation package to demonstrate the effectiveness and relevance of our approach.

Causal Knowledge Graph For Scene Understanding In Autonomous Driving, Utkarshani Jaimini, Cory Henson, Amit Sheth

Publications

The current approaches to autonomous driving focus on learning from observation or simulated data. These approaches are based on correlations rather than causation. For safety-critical applications, like autonomous driving, it’s important to represent causal dependencies among variables in addition to the domain knowledge expressed in a knowledge graph. This will allow for a better understanding of causation during scenarios that have not been observed, such as malfunctions or accidents. The causal knowledge graph, coupled with domain knowledge, demonstrates how autonomous driving scenes can be represented, learned, and explained using counterfactual and intervention reasoning to infer and understand the behavior of …

Pig Butchering In Cybersecurity: A Modern Social Engineering Threat, Sharon L. Burton, Pamela D. Moore

Publications

Pig butchering is an escalating cybersecurity threat that exploits social engineering to build trust and execute financial fraud. The relevance of this research problem lies in the growing incidence and sophistication of these scams, which have severe financial and psychological impacts on victims. The main purpose of this research is to uncover the methods used in pig butchering scams and their impact on individuals and businesses. The research focuses on digital platforms such as social media, dating apps, and professional networking sites, chosen for their wide user bases and the ease of establishing personal connections. The study period encompasses recent …

Healthcare Assistance Challenges-Driven Neurosymbolic Ai, Kaushik Roy

Publications

Although Artificial Intelligence technology has proven effective in providing healthcare assistance by analyzing health data, it still falls short in supporting decision-making. This deficiency largely stems from the predominance of opaque neural networks, particularly in mental health care AI applications, which raise concerns about their unpredictable and unverifiable nature. This skepticism hinders the transition from information support to decision support. This presentation will explore neurosymbolic approaches that combine neural networks with symbolic control and verification mechanisms. These approaches aim to unlock AI’s full potential by enhancing information analysis and decision-making support for healthcare assistance.

Evaluating The Role Of Data Enrichment Approaches Towards Rare Event Analysis In Manufacturing, Chathurangi Shyalika, Ruwan Wickramarachchi, Fadi El Kalach, Ramy Harik, Amit P. Sheth

Publications

Rare events are occurrences that take place with a significantly lower frequency than more common, regular events. These events can be categorized into distinct categories, from frequently rare to extremely rare, based on factors like the distribution of data and significant differences in rarity levels. In manufacturing domains, predicting such events is particularly important, as they lead to unplanned downtime, a shortening of equipment lifespans, and high energy consumption. Usually, the rarity of events is inversely correlated with the maturity of a manufacturing industry. Typically, the rarity of events affects the multivariate data generated within a manufacturing process to be …

Cognitive Manufacturing: Definition And Current Trends, Fadi El Kalach, Ibrahim Yousif, Thorsten Wuest, Amit Sheth, Ramy Harik

Publications

Manufacturing systems have recently witnessed a shift from the widely adopted automated systems seen throughout industry. The evolution of Industry 4.0 or Smart Manufacturing has led to the introduction of more autonomous systems focused on fault tolerant and customized production. These systems are required to utilize multimodal data such as machine status, sensory data, and domain knowledge for complex decision making processes. This level of intelligence can allow manufacturing systems to keep up with the ever-changing markets and intricate supply chain. Current manufacturing lines lack these capabilities and fall short of utilizing all generated data. This paper delves into the …

Ri2ap: Robust And Interpretable 2d Anomaly Prediction In Assembly Pipelines, Chathurangi Shyalika, Kaushik Roy, Renjith Prasad, Fadi El Kalach, Yuxin Zi, Priya Mittal, Vignesh Narayanan, Ramy Harik, Amit Sheth

Publications

Predicting anomalies in manufacturing assembly lines is crucial for reducing time and labor costs and improving processes. For instance, in rocket assembly, premature part failures can lead to significant financial losses and labor inefficiencies. With the abundance of sensor data in the Industry 4.0 era, machine learning (ML) offers potential for early anomaly detection. However, current ML methods for anomaly prediction have limitations, with F1 measure scores of only 50% and 66% for prediction and detection, respectively. This is due to challenges like the rarity of anomalous events, scarcity of high-fidelity simulation data (actual data are expensive), and the complex …

Immersive Framework For Designing Trajectories Using Augmented Reality, Joseph Anderson, Leo Materne, Karis Cooks, Michelle Aros, Jaia Huggins, Jesika Geliga-Torres, Kamden Kuykendall, David Canales, Barbara Chaparro

Publications

The intuitive interaction capabilities of augmented reality make it ideal for solving complex 3D problems that require complex spatial representations, which is key for astrodynamics and space mission planning. By implementing common and complex orbital mechanics algorithms in augmented reality, a hands-on method for designing orbit solutions and spacecraft missions is created. This effort explores the aforementioned implementation with the Microsoft Hololens 2 as well as its applications in industry and academia. Furthermore, a human-centered design process and study are utilized to ensure the tool is user-friendly while maintaining accuracy and applicability to higher-fidelity problems.

Neurosymbolic Customized And Compact Copilots, Kaushik Roy, Megha Chakraborty, Yuxin Zi, Manas Gaur, Amit Sheth

Publications

Large Language Models (LLMs) are credible with open-domain interactions such as question answering, summarization, and explanation generation [1]. LLM reasoning is based on parametrized knowledge, and as a consequence, the models often produce absurdities and inconsistencies in outputs (e.g., hallucinations and confirmation biases) [2]. In essence, they are fundamentally hard to control to prevent off-the-rails behaviors, are hard to fine-tune, customize for tailored needs, prompt effectively (due to the “tug-of-war” between external and parametric memory), and extremely resource-hungry due to the enormous size of their extensive parametric configurations [3,4]. Thus, significant challenges arise when these models are required to perform …

K-Perm: Personalized Response Generation Using Dynamic Knowledge Retrieval And Persona-Adaptive Queries, Kanak Raj, Kaushik Roy, Vamshi Bonagiri, Priyanshul Govil, Krishnaprasad Thirunarayan, Raxit Goswami, Manas Gaur

Publications

Personalizing conversational agents can enhance the quality of conversations and increase user engagement. However, they often lack external knowledge to tend to a user’s persona appropriately. This is particularly crucial for practical applications like mental health support, nutrition planning, culturally sensitive conversations, or reducing toxic behavior in conversational agents. To enhance the relevance and comprehensiveness of personalized responses, we propose using a two-step approach that involves (1) selectively integrating user personas and (2) contextualizing the response with supplementing information from a background knowledge source. We develop K-PERM (Knowledge-guided PErsonalization with Reward Modulation), a dynamic conversational agent that combines these elements. …