Engineering Commons^™

An Ontology Design Pattern For Representing Causality, Utkarshani Jaimini, Cory Henson, Amit Sheth

Publications

The causal pattern is a proposed ontology design pattern for representing the structure of causal relations in a knowledge graph. This pattern is grounded in the concepts defined and used by the CausalAI community i.e., Causal Bayesian Networks and do-calculus. Specifically, the pattern models three primary concepts: (1) causal relations, (2) causal event roles, and (3) causal effect weights. Two use cases involving a sprinkler system and asthma patients are provided along with their relevant competency questions.

Eeg Functional Connectivity In Infants At Elevated Familial Likelihood For Autism Spectrum Disorder, Christian O'Reilly, Scott Huberty, Stefon Van Noordt, James Desjardins, Nicky Wright, Julie Scorah, Sara Jane Webb, Mayada Elsabbagh, Basis Team

Publications

Background

Many studies have reported that autism spectrum disorder (ASD) is associated with atypical structural and functional connectivity. However, we know relatively little about the development of these differences in infancy.

Methods

We used a high-density electroencephalogram (EEG) dataset pooled from two independent infant sibling cohorts, to characterize such neurodevelopmental deviations during the first years of life. EEG was recorded at 6 and 12 months of age in infants at typical (N = 92) or elevated likelihood for ASD (N = 90), determined by the presence of an older sibling with ASD. We computed the functional connectivity between …

Reducing Brain Kynurenic Acid Synthesis Precludes Kynurenine-Induced Sleep Disturbances, Katherine M. Rentschler, Snezana Milosavljevic, Annalisa M. Baratta, Courtney J. Wright, Maria V. Piroli, Zachary Tentor, Homayoun Valafar, Christian O'Reilly, Ana Pocivavsek

Publications

Patients with neurocognitive disorders often battle sleep disturbances. Kynurenic acid is a tryptophan metabolite of the kynurenine pathway implicated in the pathology of these illnesses. Modest increases in kynurenic acid, an antagonist at glutamatergic and cholinergic receptors, result in cognitive impairments and sleep dysfunction. We explored the hypothesis that inhibition of the kynurenic acid synthesising enzyme, kynurenine aminotransferase II, may alleviate sleep disturbances. At the start of the light phase, adult male and female Wistar rats received systemic injections of either: (i) vehicle; (ii) kynurenine (100 mg kg−1; i.p.); (iii) the kynurenine aminotransferase II inhibitor, PF-04859989 (30 mg kg−1; s.c.); …

Ki-Cook: Clustering Multimodal Cooking Representations Through Knowledge-Infused Learning, Revathy Venkataramanan, Swati Padhee, Saini Rohan Rao, Ronak Kaoshik, Anirudh Sundara Rajan, Amit Sheth

Publications

Cross-modal recipe retrieval has gained prominence due to its ability to retrieve a text representation given an image representation and vice versa. Clustering these recipe representations based on similarity is essential to retrieve relevant information about unknown food images. Existing studies cluster similar recipe representations in the latent space based on class names. Due to inter-class similarity and intraclass variation, associating a recipe with a class name does not provide sufficient knowledge about recipes to determine similarity. However, recipe title, ingredients, and cooking actions provide detailed knowledge about recipes and are a better determinant of similar recipes. In this study, …

Ecg Recordings As Predictors Of Very Early Autism Likelihood: A Machine Learning Approach, Deepa Tilwani, Jessica Bradshaw, Amit Sheth, Christian O'Reilly

Publications

In recent years, there has been a rise in the prevalence of autism spectrum disorder (ASD). The diagnosis of ASD requires behavioral observation and standardized testing completed by highly trained experts. Early intervention for ASD can begin as early as 1–2 years of age, but ASD diagnoses are not typically made until ages 2–5 years, thus delaying the start of intervention. There is an urgent need for non-invasive biomarkers to detect ASD in infancy. While previous research using physiological recordings has focused on brain-based biomarkers of ASD, this study investigated the potential of electrocardiogram (ECG) recordings as an ASD biomarker …

Model-Driven Analysis Of Ecg Using Reinforcement Learning, Christian O'Reilly, Sai Durga Rithvik Oruganti, Deepa Tilwani, Jessica Bradshaw

Publications

Modeling is essential to better understand the generative mechanisms responsible for experimental observations gathered from complex systems. In this work, we are using such an approach to analyze the electrocardiogram (ECG). We present a systematic framework to decompose ECG signals into sums of overlapping lognormal components. We use reinforcement learning to train a deep neural network to estimate the modeling parameters from an ECG recorded in babies from 1 to 24 months of age. We demonstrate this model-driven approach by showing how the extracted parameters vary with age. From the 751,510 PQRST complexes modeled, 82.7% provided a signal-to-noise ratio that …

Dynamic Multi-Dimensional Numerical Transport Study Of Lithium-Ion Battery Active Material Microstructures For Automotive Applications, Joseph S. Lopata, Taylor R. Garrick, Fengkun Wang, Han Zhang, Yangbing Zeng, Sirivatch Shimpalee

Faculty Publications

In support of GM’s traction battery efforts, we derived and implemented a method to describe the electrochemical performance of a battery cell considering the nuances of the electrode microstructure at the anode and the cathode and the corresponding impact on the electrochemical transport in the solid and liquid phases. To assess the capability of the method, we compared model results from the microstructure framework with the commonly used continuum-level porous electrode model, commonly referred to as the pseudo-2-dimensional model, or the Newman Model. The microstructure modeling framework was applied to simulate the electrochemical and transport processes within the battery cell …

Investigation Of Electrically Isolated Capacitive Sensing Skins On Concrete To Reduce Structure/Sensor Capacitive Coupling, Emmanuel Ogunniyi, Alexander Vareen, Austin Downey, Simon Laflamme, Jian Li, Caroline Bennett, William Collins, Hongki Jo, Alexander Henderson, Paul Ziehl

Faculty Publications

Damage to bridges can result in partial or complete structural failures, with fatal consequences. Cracks develop in concrete infrastructure from fatigue loading, vibrations, corrosion, or unforeseen structural displacement. Effective long-term monitoring of civil infrastructure can reduce the risk of structural failures and potentially reduce the cost and frequency of inspections. However, deploying structural health monitoring technologies for crack detection on bridges is expensive, especially long-term, due to the density of sensors required to detect, localize, and quantify cracks. Previous research on soft elastomeric capacitors (SECs) has shown their viability for low-cost monitoring of cracks in transportation infrastructure. However, when deployed …

The Troubling Emergence Of Hallucination In Large Language Models--An Extensive Definition, Quantification, And Prescriptive Remediations, Vipula Rawte, Swagata Chakraborty, Agnibh Pathak, Anubhav Sarkar, S.M Towhidul Islam Tonmoy, Aman Chadha, Amit Sheth, Amitava Das

Publications

The recent advancements in Large Language Models (LLMs) have garnered widespread acclaim for their remarkable emerging capabilities. However, the issue of hallucination has parallelly emerged as a by-product, posing significant concerns. While some recent endeavors have been made to identify and mitigate different types of hallucination, there has been a limited emphasis on the nuanced categorization of hallucination and associated mitigation methods. To address this gap, we offer a finegrained discourse on profiling hallucination based on its degree, orientation, and category, along with offering strategies for alleviation. As such, we define two overarching orientations of hallucination: (i) factual mirage (FM) …

Proknow: Process Knowledge For Safety Constrained And Explainable Question Generation For Mental Health Diagnostic Assistance, Kaushik Roy, Manas Gaur, Misagh Soltani, Vipula Rawte, Ashwin Kalyan, Amit Sheth

Publications

Current Virtual Mental Health Assistants (VMHAs) provide counseling and suggestive care. They refrain from patient diagnostic assistance because of a lack of training on safety-constrained and specialized clinical process knowledge (Pro-Know). In this work, we define ProKnow as an ordered set of information that maps to evidence-based guidelines or categories of conceptual understanding to experts in a domain. We also introduce a new dataset of diagnostic conversations guided by safety constraints and ProKnow that healthcare professionals use (ProKnow-data). We develop a method for natural language question generation (NLG) that collects diagnostic information from the patient interactively (ProKnow-algo). We demonstrate the …

Demo Alleviate: Demonstrating Artificial Intelligence Enabled Virtual Assistance For Telehealth: The Mental Health Case, Kaushik Roy, Vedant Khandelwal, Raxit Goswami, Nathan Dolbir, Jinendra Malekar, Amit Sheth

Publications

After the pandemic, artificial intelligence (AI) powered support for mental health care has become increasingly important. The breadth and complexity of significant challenges required to provide adequate care involve: (a) Personalized patient understanding, (b) Safety-constrained and medically validated chatbot patient interactions, and (c) Support for continued feedback-based refinements in design using chatbot-patient interactions. We propose Alleviate, a chatbot designed to assist patients suffering from mental health challenges with personalized care and assist clinicians with understanding their patients better. Alleviate draws from an array of publicly available clinically valid mental-health texts and databases, allowing Alleviate to make medically sound and informed …

Cook-Gen: Robust Generative Modeling Of Cooking Actions From Recipes, Revathy Venkataramanan, Kaushik Roy, Kanak Ray, Renjith Prasad, Yuxin Zi, Vignesh Narayanan, Amit Sheth

Publications

As people become more aware of their food choices, food computation models have become increasingly popular in assisting people in maintaining healthy eating habits. For example, food recommendation systems analyze recipe instructions to assess nutritional contents and provide recipe recommendations. The recent and remarkable successes of generative AI methods, such as auto-regressive large language models, can lead to robust methods for a more comprehensive understanding of recipes for healthy food recommendations beyond surface-level nutrition content assessments. In this study, we explore the use of generative AI methods to extend current food computation models, primarily involving the analysis of nutrition and …

Tutorial - Shodhguru Labs: Knowledge-Infused Artificial Intelligence For Mental Healthcare, Kaushik Roy

Publications

Artificial Intelligence (AI) systems for mental healthcare (MHCare) have been ever-growing after realizing the importance of early interventions for patients with chronic mental health (MH) conditions. Social media (SocMedia) emerged as the go-to platform for supporting patients seeking MHCare. The creation of peer-support groups without social stigma has resulted in patients transitioning from clinical settings to SocMedia supported interactions for quick help. Researchers started exploring SocMedia content in search of cues that showcase correlation or causation between different MH conditions to design better interventional strategies. User-level Classification-based AI systems were designed to leverage diverse SocMedia data from various MH conditions, …

Ierl: Interpretable Ensemble Representation Learning - Combining Crowdsourced Knowledge And Distributed Semantic Representations, Yuxin Zi, Kaushik Roy, Vignesh Narayanan, Manas Gaur, Amit Sheth

Publications

Large Language Models (LLMs) encode meanings of words in the form of distributed semantics. Distributed semantics capture common statistical patterns among language tokens (words, phrases, and sentences) from large amounts of data. LLMs perform exceedingly well across General Language Understanding Evaluation (GLUE) tasks designed to test a model’s understanding of the meanings of the input tokens. However, recent studies have shown that LLMs tend to generate unintended, inconsistent, or wrong texts as outputs when processing inputs that were seen rarely during training, or inputs that are associated with diverse contexts (e.g., well-known hallucination phenomenon in language generation tasks). Crowdsourced and …

Cooperative Deep Q -Learning Framework For Environments Providing Image Feedback, Krishnan Raghavan, Vignesh Narayanan, Sarangapani Jagannathan

Publications

In this article, we address two key challenges in deep reinforcement learning (DRL) setting, sample inefficiency, and slow learning, with a dual-neural network (NN)-driven learning approach. In the proposed approach, we use two deep NNs with independent initialization to robustly approximate the action-value function in the presence of image inputs. In particular, we develop a temporal difference (TD) error-driven learning (EDL) approach, where we introduce a set of linear transformations of the TD error to directly update the parameters of each layer in the deep NN. We demonstrate theoretically that the cost minimized by the EDL regime is an approximation …

Acm Web Conference 2023, Usha Lokala, Kaushik Roy, Utkarshani Jaimini, Amit Sheth

Publications

Improving the performance and explanations of ML algorithms is a priority for adoption by humans in the real world. In critical domains such as healthcare, such technology has significant potential to reduce the burden on humans and considerably reduce manual assessments by providing quality assistance at scale. In today’s data-driven world, artificial intelligence (AI) systems are still experiencing issues with bias, explainability, and human-like reasoning and interpretability. Causal AI is the technique that can reason and make human-like choices making it possible to go beyond narrow Machine learning-based techniques and can be integrated into human decision-making. It also offers intrinsic …

Tutorial - Shodhguru Labs: Optimization And Hyperparameter Tuning For Neural Networks, Kaushik Roy

Publications

Neural networks have emerged as a powerful and versatile class of machine learning models, revolutionizing various fields with their ability to learn complex patterns and make accurate predictions. The performance of neural networks depends significantly on the appropriate choice of hyperparameters, which are critical factors governing their architecture, regularization, and optimization techniques. As the demand for high-performance neural networks grows across diverse applications, the need for efficient optimization and hyperparameter tuning methods becomes paramount. This paper presents a comprehensive exploration of optimization strategies and hyperparameter tuning techniques for neural networks. Neural networks have emerged as a powerful and versatile class …

L3 Ensembles: Lifelong Learning Approach For Ensemble Of Foundational Language Models*, Aidin Shiri, Kaushik Roy, Amit Sheth, Manas Gaur

Publications

Fine-tuning pre-trained foundational language models (FLM) for specific tasks is often impractical, especially for resource-constrained devices. This necessitates the development of a Lifelong Learning (L3) framework that continuously adapts to a stream of Natural Language Processing (NLP) tasks efficiently. We propose an approach that focuses on extracting meaningful representations from unseen data, constructing a structured knowledge base, and improving task performance incrementally. We conducted experiments on various NLP tasks to validate its effectiveness, including benchmarks like GLUE and SuperGLUE. We measured good performance across the accuracy, training efficiency, and knowledge transfer metrics. Initial experimental results show that the proposed L3 …