Open Access. Powered by Scholars. Published by Universities.®

Computer Engineering Commons™

Open Access. Powered by Scholars. Published by Universities.®

University of South Carolina

Discipline
Keyword
Publication Year
Publication
Publication Type
File Type

Articles 31 - 60 of 328

Full-Text Articles in Computer Engineering

Visual Causal Question And Answering With Knowledge Graph Link Prediction, Utkarshani Jaimini, Cory Henson, Amit Sheth Nov 2024

Visual Causal Question And Answering With Knowledge Graph Link Prediction, Utkarshani Jaimini, Cory Henson, Amit Sheth

Publications

The ability to answer causal questions is important for any system that requires robust scene under- standing. In this demonstration, we develop a prototype system that leverages our causal link prediction framework, CausalLP. CausalLP framework uses a visual causal knowledge graph and associated knowledge graph embedding for two visual causal question and answering tasks- (i) causal explanation and (ii) causal prediction. In the live demonstration sessions, the participants will be invited to test the efficiency and effectiveness of the system for visual causal question and answering.


Causal Neuro-Symbolic Ai For Root Cause Analysis In Smart Manufacturing, Utkarshani Jaimini, Cory Henson, Amit Sheth Nov 2024

Causal Neuro-Symbolic Ai For Root Cause Analysis In Smart Manufacturing, Utkarshani Jaimini, Cory Henson, Amit Sheth

Publications

Root cause analysis is the process of investigating the cause of a failure and providing measures to prevent future failures. It is an active area of research due to the complexities in manufacturing production lines and the vast amount of data that requires manual inspection. We present a combined approach of causal neuro-symbolic AI for root cause analysis to identify failures in smart manufacturing production lines. We have used data from an industry-grade rocket assembly line and a simulation package to demonstrate the effectiveness and relevance of our approach.


Ontology Design Metapattern For Relationtype Role Composition, Utkarshani Jaimini, Ruwan Wickramarachchi, Cory Henson, Amit Sheth Nov 2024

Ontology Design Metapattern For Relationtype Role Composition, Utkarshani Jaimini, Ruwan Wickramarachchi, Cory Henson, Amit Sheth

Publications

RelationType is a metapattern that specifies a property in a knowledge graph that directly links the head of a triple with the type of the tail. This metapattern is useful for knowledge graph link prediction tasks, specifically when one wants to predict the type of a linked entity rather than the entity instance itself. The RelationType metapattern serves as a template for future extensions of an ontology with more fine-grained domain information.


Causal Knowledge Graph For Scene Understanding In Autonomous Driving, Utkarshani Jaimini, Cory Henson, Amit Sheth Nov 2024

Causal Knowledge Graph For Scene Understanding In Autonomous Driving, Utkarshani Jaimini, Cory Henson, Amit Sheth

Publications

The current approaches to autonomous driving focus on learning from observation or simulated data. These approaches are based on correlations rather than causation. For safety-critical applications, like autonomous driving, it’s important to represent causal dependencies among variables in addition to the domain knowledge expressed in a knowledge graph. This will allow for a better understanding of causation during scenarios that have not been observed, such as malfunctions or accidents. The causal knowledge graph, coupled with domain knowledge, demonstrates how autonomous driving scenes can be represented, learned, and explained using counterfactual and intervention reasoning to infer and understand the behavior of …


Devices And Dining: A Cross-Cultural Analysis Of Mobile Device Use In Italian And American Restaurants, O'Malley Jenkins Oct 2024

Devices And Dining: A Cross-Cultural Analysis Of Mobile Device Use In Italian And American Restaurants, O'Malley Jenkins

Senior Theses

The field of technology ethics has seen increasing growth and interest over the years. Many have begun to consider the impacts of technology’s use and whether it is being employed in a healthy manner by users. However, there has been limited investigation into whether the ways in which technology use varies across cultures. This study begins to address this gap by researching Italian and American device usage in fast food settings. Non-participant naturalistic observations were used to record data for 89 Italian and 88 American customers of fast food restaurants. Analysis of the collected data indicates that Americans use their …


Real-Time Robot Pose Estimation For Industry 4.0: Enhancing Motion Validation And Monitoring With A Vision-Based Framework, Jad Samaha Oct 2024

Real-Time Robot Pose Estimation For Industry 4.0: Enhancing Motion Validation And Monitoring With A Vision-Based Framework, Jad Samaha

Theses and Dissertations

Amidst the era of Industry 4.0, robots became integral to automated production lines by performing complex tasks with high precision and adapting to changing production needs in real-time. Therefore, ensuring their precise and reliable operation is paramount for maintaining high-quality standards and operational efficiency. This invoked the need for an automated motion validation tool that guarantees accurate program task execution, by detecting deviations or anomalies that may indicate mechanical faults or software errors. Given the exponential advancements in AI, particularly in Computer Vision, a vision-based solution is ideal for ensuring the correct positioning of a robot in real-time. Operating independently …


Neuro-Symbolic Ai For Deep Analysis Of Social Media Big Data, Vedant Khandelwal, Manas Gaur, Ugur Kursuncu, Valerie Shalin, Amit P. Sheth Sep 2024

Neuro-Symbolic Ai For Deep Analysis Of Social Media Big Data, Vedant Khandelwal, Manas Gaur, Ugur Kursuncu, Valerie Shalin, Amit P. Sheth

Faculty Publications

This tutorial introduces a neuro-symbolic AI framework to analyze big data from social media platforms. Integrating human-curated knowledge through symbolic AI with the pattern recognition capabilities of neural networks enhances the adaptability and efficiency of traditional neural network approaches. Knowledge-guided zero-shot learning techniques enable swift adaption to new linguistic contexts and emerging events [6]. Participants will explore how to design, develop, and utilize these models in specific domains, such as public health surveillance, that require dynamic adaptation to new terminologies. This session The tutorial aims to equip attendees with practical skills and a deep understanding of how to apply neuro-symbolic …


Approximate Computing And In-Memory Computing: The Best Of The Two Worlds!, Mohammed Essa Fawzy Essa Aug 2024

Approximate Computing And In-Memory Computing: The Best Of The Two Worlds!, Mohammed Essa Fawzy Essa

Theses and Dissertations

Machine learning (ML) has become ubiquitous, integrating into numerous real-life applications. However, meeting the computational demands of ML systems is challenging, as existing computing platforms are constrained by memory bandwidth, and technology scaling no longer yields substantial improvements in system performance. This work introduces novel hardware architectures to accelerate ML workloads, addressing both compute and memory challenges. In the compute domain, we explore various approximate computing techniques to assess their efficacy in accelerating ML computations. Subsequently, we propose the Approximate Tensor Processing Unit (APTPU), a hardware accelerator that utilizes approximate processing elements to replace direct quantization of inputs and weights …


Uav-Based Tracking And Following Of Railroad Lines, Keith Michael Lewandowski Aug 2024

Uav-Based Tracking And Following Of Railroad Lines, Keith Michael Lewandowski

Theses and Dissertations

Given the pivotal role of the railroad industry in modern transportation and the potential risks associated with track malfunctions, the inspection and maintenance of railroad tracks emerges as a critical concern. While existing solutions excel in performing accurate measurements and detection, they often rely on large, expensive, and time-consuming platforms for inspections. This project, however, seeks to solve the same problem with the use of an unmanned aerial vehicle (UAV), significantly reducing time and cost while maintaining detection capabilities. In particular, this solution is ideal for large-scale, high-level inspections following major events such as floods [6], hurricanes [7] or earthquakes …


Healthcare Assistance Challenges-Driven Neurosymbolic Ai, Kaushik Roy Aug 2024

Healthcare Assistance Challenges-Driven Neurosymbolic Ai, Kaushik Roy

Publications

Although Artificial Intelligence technology has proven effective in providing healthcare assistance by analyzing health data, it still falls short in supporting decision-making. This deficiency largely stems from the predominance of opaque neural networks, particularly in mental health care AI applications, which raise concerns about their unpredictable and unverifiable nature. This skepticism hinders the transition from information support to decision support. This presentation will explore neurosymbolic approaches that combine neural networks with symbolic control and verification mechanisms. These approaches aim to unlock AI’s full potential by enhancing information analysis and decision-making support for healthcare assistance.


Evaluating The Role Of Data Enrichment Approaches Towards Rare Event Analysis In Manufacturing, Chathurangi Shyalika, Ruwan Wickramarachchi, Fadi El Kalach, Ramy Harik, Amit P. Sheth Aug 2024

Evaluating The Role Of Data Enrichment Approaches Towards Rare Event Analysis In Manufacturing, Chathurangi Shyalika, Ruwan Wickramarachchi, Fadi El Kalach, Ramy Harik, Amit P. Sheth

Publications

Rare events are occurrences that take place with a significantly lower frequency than more common, regular events. These events can be categorized into distinct categories, from frequently rare to extremely rare, based on factors like the distribution of data and significant differences in rarity levels. In manufacturing domains, predicting such events is particularly important, as they lead to unplanned downtime, a shortening of equipment lifespans, and high energy consumption. Usually, the rarity of events is inversely correlated with the maturity of a manufacturing industry. Typically, the rarity of events affects the multivariate data generated within a manufacturing process to be …


Improving Tcp Performance Using P4-Programmable Data Planes, Jose Antonio Gomez Gaona Jul 2024

Improving Tcp Performance Using P4-Programmable Data Planes, Jose Antonio Gomez Gaona

Theses and Dissertations

The Transmission Control Protocol (TCP) forms the foundation of reliable end-to-end communication and is widely used by many applications for efficient data transfers across the Internet. TCP relies on various congestion control algorithms (CCAs) to manage its response to network congestion. These algorithms ensure fairness among competing flows and optimize the use of available bandwidth. However, since TCP is deployed within end hosts, its capacity to attain visibility of network events is constrained. This limitation arises from the closed nature of non-programmable network devices, which prevents researchers from exploring customized actions in response to network events. Recently, the emergence of …


Cognitive Manufacturing: Definition And Current Trends, Fadi El Kalach, Ibrahim Yousif, Thorsten Wuest, Amit Sheth, Ramy Harik Jun 2024

Cognitive Manufacturing: Definition And Current Trends, Fadi El Kalach, Ibrahim Yousif, Thorsten Wuest, Amit Sheth, Ramy Harik

Publications

Manufacturing systems have recently witnessed a shift from the widely adopted automated systems seen throughout industry. The evolution of Industry 4.0 or Smart Manufacturing has led to the introduction of more autonomous systems focused on fault tolerant and customized production. These systems are required to utilize multimodal data such as machine status, sensory data, and domain knowledge for complex decision making processes. This level of intelligence can allow manufacturing systems to keep up with the ever-changing markets and intricate supply chain. Current manufacturing lines lack these capabilities and fall short of utilizing all generated data. This paper delves into the …


Ri2ap: Robust And Interpretable 2d Anomaly Prediction In Assembly Pipelines, Chathurangi Shyalika, Kaushik Roy, Renjith Prasad, Fadi El Kalach, Yuxin Zi, Priya Mittal, Vignesh Narayanan, Ramy Harik, Amit Sheth May 2024

Ri2ap: Robust And Interpretable 2d Anomaly Prediction In Assembly Pipelines, Chathurangi Shyalika, Kaushik Roy, Renjith Prasad, Fadi El Kalach, Yuxin Zi, Priya Mittal, Vignesh Narayanan, Ramy Harik, Amit Sheth

Publications

Predicting anomalies in manufacturing assembly lines is crucial for reducing time and labor costs and improving processes. For instance, in rocket assembly, premature part failures can lead to significant financial losses and labor inefficiencies. With the abundance of sensor data in the Industry 4.0 era, machine learning (ML) offers potential for early anomaly detection. However, current ML methods for anomaly prediction have limitations, with F1 measure scores of only 50% and 66% for prediction and detection, respectively. This is due to challenges like the rarity of anomalous events, scarcity of high-fidelity simulation data (actual data are expensive), and the complex …


Detecting Substance Use Disorder Using Social Media Data And Dark Web: Time And Knowledge Aware Study, Usha Lokala, Orchid Chetia Phukan, Triyasha Ghosh Dastidar, Francois Lamy, Raminta Daniulaityte, Amit Sheth Feb 2024

Detecting Substance Use Disorder Using Social Media Data And Dark Web: Time And Knowledge Aware Study, Usha Lokala, Orchid Chetia Phukan, Triyasha Ghosh Dastidar, Francois Lamy, Raminta Daniulaityte, Amit Sheth

Faculty Publications

Opioid and substance misuse is rampant in the United States today, with the phenomenon known as the "opioid crisis". The relationship between substance use and mental health has been extensively studied, with one possible relationship being: substance misuse causes poor mental health. However, the lack of evidence on the relationship has resulted in opioids being largely inaccessible through legal means. This study analyzes the substance use posts on social media with opioids being sold through crypto market listings. We use the Drug Abuse Ontology, state-of-the-art deep learning, and knowledge-aware BERT-based models to generate sentiment and emotion for the social media …


Towards Pragmatic Temporal Alignment In Stateful Generative Ai Systems: A Configurable Approach, Kaushik Roy, Yuxn Zi, Amit Sheth Jan 2024

Towards Pragmatic Temporal Alignment In Stateful Generative Ai Systems: A Configurable Approach, Kaushik Roy, Yuxn Zi, Amit Sheth

Publications

Temporal alignment in stateful generative artificial intelligence (AI) systems remains an underexplored area, particularly beyond goal-driven approaches in planning. Stateful refers to maintaining a persistent memory or “state” across runs or sessions. This helps with referencing past information to make system outputs more contextual and relevant. This position paper proposes a framework for temporal alignment with several configurable toggles. We present four alignment mechanisms: knowledge graph path-based, neural score-based, vector similarity-based, and sequential process-guided alignment. By offering these interchangeable approaches, we aim to provide a flexible solution adaptable to complex and real-world applications. This paper discusses the potential benefits and …


Causal Neuro-Symbolic Ai: A Synergy Between Causality And Neuro-Symbolic Methods, Utkarshani Jaimini, Cory Henson, Amit Sheth Jan 2024

Causal Neuro-Symbolic Ai: A Synergy Between Causality And Neuro-Symbolic Methods, Utkarshani Jaimini, Cory Henson, Amit Sheth

Publications

Causal Neuro-Symbolic AI combines the benefits of causality with Neuro-Symbolic Artificial Intelligence (NeSyAI). More specifically, it (1) enriches NeSyAI systems with explicit representations of causality, (2) integrates causal knowledge with domain knowledge, and (3) enables the use of NeSyAI techniques for causal AI tasks. The explicit causal representation yields insights that predictive models may fail to analyze from observational data. It can also assist people in decision-making scenarios where discerning the cause of an outcome is necessary to choose among various interventions.


Ontolog Summit 2024 Talk Report: Healthcare Assistance Challenges-Driven Neurosymbolic Ai, Kaushik Roy Jan 2024

Ontolog Summit 2024 Talk Report: Healthcare Assistance Challenges-Driven Neurosymbolic Ai, Kaushik Roy

Publications

Although Artificial Intelligence technology has proven effective in providing healthcare assistance by analyzing health data, it still falls short in supporting decision-making. This deficiency largely stems from the predominance of opaque neural networks, particularly in mental health care AI applications, which raise concerns about their unpredictable and unverifiable nature. This skepticism hinders the transition from information support to decision support. This presentation will explore neurosymbolic approaches that combine neural networks with symbolic control and verification mechanisms. These approaches aim to unlock AI’s full potential by enhancing information analysis and decision-making support for healthcare assistance1.


Neurosymbolic Customized And Compact Copilots, Kaushik Roy, Megha Chakraborty, Yuxin Zi, Manas Gaur, Amit Sheth Jan 2024

Neurosymbolic Customized And Compact Copilots, Kaushik Roy, Megha Chakraborty, Yuxin Zi, Manas Gaur, Amit Sheth

Publications

Large Language Models (LLMs) are credible with open-domain interactions such as question answering, summarization, and explanation generation [1]. LLM reasoning is based on parametrized knowledge, and as a consequence, the models often produce absurdities and inconsistencies in outputs (e.g., hallucinations and confirmation biases) [2]. In essence, they are fundamentally hard to control to prevent off-the-rails behaviors, are hard to fine-tune, customize for tailored needs, prompt effectively (due to the “tug-of-war” between external and parametric memory), and extremely resource-hungry due to the enormous size of their extensive parametric configurations [3,4]. Thus, significant challenges arise when these models are required to perform …


A Comprehensive Survey On Rare Event Prediction, Chathurangi Shyalika Jayakody Kankanamalage, Ruwan Wickramarachchi, Amit Sheth Jan 2024

A Comprehensive Survey On Rare Event Prediction, Chathurangi Shyalika Jayakody Kankanamalage, Ruwan Wickramarachchi, Amit Sheth

Publications

Rare event prediction involves identifying and forecasting events with a low probability using machine learning (ML) and data analysis. Due to the imbalanced data distributions, where the frequency of common events vastly outweighs that of rare events, it requires using specialized methods within each step of the ML pipeline, i.e., from data processing to algorithms to evaluation protocols. Predicting the occurrences of rare events is important for real-world applications, such as Industry 4.0, and is an active research area in statistics and ML. This paper comprehensively reviews the current approaches for rare event prediction along four dimensions: rare event data, …


Personalized Bayesian Inference For Explainable Healthcare Management And Intervention, Utkarshani Jaimini, Krishnaprasad Thirunaravan, Maninder Kalra, Robin Dawson, Amit Sheth Jan 2024

Personalized Bayesian Inference For Explainable Healthcare Management And Intervention, Utkarshani Jaimini, Krishnaprasad Thirunaravan, Maninder Kalra, Robin Dawson, Amit Sheth

Publications

Chronic healthcare conditions such as Asthma re- quires constant monitoring and managing of symptoms and their triggers for better quality of life. Each asthma patient reacts very differently to potential triggers. Hence, there is a need to develop a explainable personalized framework for each patient to capture susceptibility to asthma triggers. We developed a personalized knowledge-based probabilistic model to predict asthma exacerbation for different environmental factors utilizing patient generated health data from pediatric asthma patients. Further, the personalized model provides a metric, called Health Coefficient, to quantify the health of a patient for varying environmental factors. We demonstrate the predictive …


Neurosymbolic Value-Inspired Ai (Why, What, And How), Amit Sheth, Kaushik Roy Jan 2024

Neurosymbolic Value-Inspired Ai (Why, What, And How), Amit Sheth, Kaushik Roy

Publications

The rapid progression of Artificial Intelligence (AI) systems, facilitated by the advent of Large Language Models (LLMs), has resulted in their widespread application to provide human assistance across diverse industries. This trend has sparked significant discourse centered around the ever-increasing need for LLM-based AI systems to function among humans as part of human society, sharing human values, especially as these systems are deployed in high-stakes settings (e.g., healthcare, autonomous driving, etc.). Towards this end, neurosymbolic AI systems are attractive due to their potential to enable easy-tounderstand and interpretable interfaces for facilitating valuebased decision-making, by leveraging explicit representations of shared values. …


K-Perm: Personalized Response Generation Using Dynamic Knowledge Retrieval And Persona-Adaptive Queries, Kanak Raj, Kaushik Roy, Vamshi Bonagiri, Priyanshul Govil, Krishnaprasad Thirunarayan, Raxit Goswami, Manas Gaur Jan 2024

K-Perm: Personalized Response Generation Using Dynamic Knowledge Retrieval And Persona-Adaptive Queries, Kanak Raj, Kaushik Roy, Vamshi Bonagiri, Priyanshul Govil, Krishnaprasad Thirunarayan, Raxit Goswami, Manas Gaur

Publications

Personalizing conversational agents can enhance the quality of conversations and increase user engagement. However, they often lack external knowledge to tend to a user’s persona appropriately. This is particularly crucial for practical applications like mental health support, nutrition planning, culturally sensitive conversations, or reducing toxic behavior in conversational agents. To enhance the relevance and comprehensiveness of personalized responses, we propose using a two-step approach that involves (1) selectively integrating user personas and (2) contextualizing the response with supplementing information from a background knowledge source. We develop K-PERM (Knowledge-guided PErsonalization with Reward Modulation), a dynamic conversational agent that combines these elements. …


Causal Event Graph-Guided Language-Based Spatiotemporal Question Answering, Kaushik Roy, Alessandro Oltramari, Yuxin Zi, Chathurangi Shyalika, Vignesh Narayanan, Amit Sheth Jan 2024

Causal Event Graph-Guided Language-Based Spatiotemporal Question Answering, Kaushik Roy, Alessandro Oltramari, Yuxin Zi, Chathurangi Shyalika, Vignesh Narayanan, Amit Sheth

Publications

Large Language Models have excelled at encoding and leveraging language patterns in large text-based corpora for various tasks, including spatiotemporal event-based question answering (QA). However, due to encoding a text-based projection of the world, they have also been shown to lack a fullbodied understanding of such events, e.g., a sense of intuitive physics, and cause-and-effect relationships among events. In this work, we propose using causal event graphs (CEGs) to enhance language understanding of spatiotemporal events in language models, using a novel approach that also provides proofs for the model’s capture of the CEGs. A CEG consists of events denoted by …


Exploring Alternative Approaches To Language Modeling For Learning From Data And Knowledge, Yuxin Zi, Kaushik Roy, Vignesh Narayanan, Amit Sheth Jan 2024

Exploring Alternative Approaches To Language Modeling For Learning From Data And Knowledge, Yuxin Zi, Kaushik Roy, Vignesh Narayanan, Amit Sheth

Publications

Despite their wide applications to language understanding tasks, large language models (LLMs) still face challenges such as hallucinations - the occasional fabrication of information, and alignment issues - the lack of associations with human-curated world models (e.g., intuitive physics or common-sense knowledge). Additionally, the black-box nature of LLMs makes it highly challenging to train them meaningfully in order to achieve a desired behavior. Specifically, the attempt to adjust LLMs’ concept embedding spaces can be highly intractable, which involves analyzing the implicit impact on LLMs’ numerous parameters and the resulting inductive biases. This paper proposes a novel architecture that wraps powerful …


Tutorial: Knowledge-Infused Artificial Intelligence For Mental Healthcare, Kaushik Roy Jan 2024

Tutorial: Knowledge-Infused Artificial Intelligence For Mental Healthcare, Kaushik Roy

Publications

Artificial Intelligence (AI) systems for mental healthcare (MHCare) have been ever-growing after realizing the importance of early interventions for patients with chronic mental health (MH) conditions. Social media (SocMedia) emerged as the go-to platform for supporting patients seeking MHCare. The creation of peer-support groups without social stigma has resulted in patients transitioning from clinical settings to SocMedia supported interactions for quick help. Researchers started exploring SocMedia content in search of cues that showcase correlation or causation between different MH conditions to design better interventional strategies. User-level Classification-based AI systems were designed to leverage diverse SocMedia data from various MH conditions, …


Proknow: Process Knowledge For Safety Constrained And Explainable Question Generation For Mental Health Diagnostic Assistance In The Age Of Large Language Models, Kaushik Roy, Manas Gaur, Misagh Soltani, Vipula Rawte, Ashwin Allen, Amit P. Sheth Jan 2024

Proknow: Process Knowledge For Safety Constrained And Explainable Question Generation For Mental Health Diagnostic Assistance In The Age Of Large Language Models, Kaushik Roy, Manas Gaur, Misagh Soltani, Vipula Rawte, Ashwin Allen, Amit P. Sheth

Publications

Current Virtual Mental Health Assistants (VMHAs) primarily offer counseling and suggestive care but do not assist with patient diagnosis due to their lack of training in safety-constrained and specialized clinical process knowledge, referred to as ProKnow. In this work, we define ProKnow as an ordered set of information aligned with evidence-based guidelines or categories of conceptual understanding used by domain experts. We also introduce a new dataset of diagnostic conversations guided by safety constraints and Pro- Know, known as ProKnow-data. We develop a method for natural language question generation (NLG) designed to interactively gather diagnostic information from patients, termed ProKnow-algo. …


An Ontology Design Pattern For Representing Causality, Utkarshani Jaimini, Cory Henson, Amit Sheth Nov 2023

An Ontology Design Pattern For Representing Causality, Utkarshani Jaimini, Cory Henson, Amit Sheth

Publications

The causal pattern is a proposed ontology design pattern for representing the structure of causal relations in a knowledge graph. This pattern is grounded in the concepts defined and used by the CausalAI community i.e., Causal Bayesian Networks and do-calculus. Specifically, the pattern models three primary concepts: (1) causal relations, (2) causal event roles, and (3) causal effect weights. Two use cases involving a sprinkler system and asthma patients are provided along with their relevant competency questions.


Ki-Cook: Clustering Multimodal Cooking Representations Through Knowledge-Infused Learning, Revathy Venkataramanan, Swati Padhee, Saini Rohan Rao, Ronak Kaoshik, Anirudh Sundara Rajan, Amit Sheth Jul 2023

Ki-Cook: Clustering Multimodal Cooking Representations Through Knowledge-Infused Learning, Revathy Venkataramanan, Swati Padhee, Saini Rohan Rao, Ronak Kaoshik, Anirudh Sundara Rajan, Amit Sheth

Publications

Cross-modal recipe retrieval has gained prominence due to its ability to retrieve a text representation given an image representation and vice versa. Clustering these recipe representations based on similarity is essential to retrieve relevant information about unknown food images. Existing studies cluster similar recipe representations in the latent space based on class names. Due to inter-class similarity and intraclass variation, associating a recipe with a class name does not provide sufficient knowledge about recipes to determine similarity. However, recipe title, ingredients, and cooking actions provide detailed knowledge about recipes and are a better determinant of similar recipes. In this study, …


Ecg Recordings As Predictors Of Very Early Autism Likelihood: A Machine Learning Approach, Deepa Tilwani, Jessica Bradshaw, Amit Sheth, Christian O'Reilly Jul 2023

Ecg Recordings As Predictors Of Very Early Autism Likelihood: A Machine Learning Approach, Deepa Tilwani, Jessica Bradshaw, Amit Sheth, Christian O'Reilly

Publications

In recent years, there has been a rise in the prevalence of autism spectrum disorder (ASD). The diagnosis of ASD requires behavioral observation and standardized testing completed by highly trained experts. Early intervention for ASD can begin as early as 1–2 years of age, but ASD diagnoses are not typically made until ages 2–5 years, thus delaying the start of intervention. There is an urgent need for non-invasive biomarkers to detect ASD in infancy. While previous research using physiological recordings has focused on brain-based biomarkers of ASD, this study investigated the potential of electrocardiogram (ECG) recordings as an ASD biomarker …