Open Access. Powered by Scholars. Published by Universities.®

Computer Engineering Commons

Open Access. Powered by Scholars. Published by Universities.®

University of South Carolina

Discipline
Keyword
Publication Year
Publication
Publication Type
File Type

Articles 31 - 60 of 320

Full-Text Articles in Computer Engineering

Uav-Based Tracking And Following Of Railroad Lines, Keith Michael Lewandowski Aug 2024

Uav-Based Tracking And Following Of Railroad Lines, Keith Michael Lewandowski

Theses and Dissertations

Given the pivotal role of the railroad industry in modern transportation and the potential risks associated with track malfunctions, the inspection and maintenance of railroad tracks emerges as a critical concern. While existing solutions excel in performing accurate measurements and detection, they often rely on large, expensive, and time-consuming platforms for inspections. This project, however, seeks to solve the same problem with the use of an unmanned aerial vehicle (UAV), significantly reducing time and cost while maintaining detection capabilities. In particular, this solution is ideal for large-scale, high-level inspections following major events such as floods [6], hurricanes [7] or earthquakes …


Healthcare Assistance Challenges-Driven Neurosymbolic Ai, Kaushik Roy Aug 2024

Healthcare Assistance Challenges-Driven Neurosymbolic Ai, Kaushik Roy

Publications

Although Artificial Intelligence technology has proven effective in providing healthcare assistance by analyzing health data, it still falls short in supporting decision-making. This deficiency largely stems from the predominance of opaque neural networks, particularly in mental health care AI applications, which raise concerns about their unpredictable and unverifiable nature. This skepticism hinders the transition from information support to decision support. This presentation will explore neurosymbolic approaches that combine neural networks with symbolic control and verification mechanisms. These approaches aim to unlock AI’s full potential by enhancing information analysis and decision-making support for healthcare assistance.


Evaluating The Role Of Data Enrichment Approaches Towards Rare Event Analysis In Manufacturing, Chathurangi Shyalika, Ruwan Wickramarachchi, Fadi El Kalach, Ramy Harik, Amit P. Sheth Aug 2024

Evaluating The Role Of Data Enrichment Approaches Towards Rare Event Analysis In Manufacturing, Chathurangi Shyalika, Ruwan Wickramarachchi, Fadi El Kalach, Ramy Harik, Amit P. Sheth

Publications

Rare events are occurrences that take place with a significantly lower frequency than more common, regular events. These events can be categorized into distinct categories, from frequently rare to extremely rare, based on factors like the distribution of data and significant differences in rarity levels. In manufacturing domains, predicting such events is particularly important, as they lead to unplanned downtime, a shortening of equipment lifespans, and high energy consumption. Usually, the rarity of events is inversely correlated with the maturity of a manufacturing industry. Typically, the rarity of events affects the multivariate data generated within a manufacturing process to be …


Improving Tcp Performance Using P4-Programmable Data Planes, Jose Antonio Gomez Gaona Jul 2024

Improving Tcp Performance Using P4-Programmable Data Planes, Jose Antonio Gomez Gaona

Theses and Dissertations

The Transmission Control Protocol (TCP) forms the foundation of reliable end-to-end communication and is widely used by many applications for efficient data transfers across the Internet. TCP relies on various congestion control algorithms (CCAs) to manage its response to network congestion. These algorithms ensure fairness among competing flows and optimize the use of available bandwidth. However, since TCP is deployed within end hosts, its capacity to attain visibility of network events is constrained. This limitation arises from the closed nature of non-programmable network devices, which prevents researchers from exploring customized actions in response to network events. Recently, the emergence of …


Cognitive Manufacturing: Definition And Current Trends, Fadi El Kalach, Ibrahim Yousif, Thorsten Wuest, Amit Sheth, Ramy Harik Jun 2024

Cognitive Manufacturing: Definition And Current Trends, Fadi El Kalach, Ibrahim Yousif, Thorsten Wuest, Amit Sheth, Ramy Harik

Publications

Manufacturing systems have recently witnessed a shift from the widely adopted automated systems seen throughout industry. The evolution of Industry 4.0 or Smart Manufacturing has led to the introduction of more autonomous systems focused on fault tolerant and customized production. These systems are required to utilize multimodal data such as machine status, sensory data, and domain knowledge for complex decision making processes. This level of intelligence can allow manufacturing systems to keep up with the ever-changing markets and intricate supply chain. Current manufacturing lines lack these capabilities and fall short of utilizing all generated data. This paper delves into the …


Ri2ap: Robust And Interpretable 2d Anomaly Prediction In Assembly Pipelines, Chathurangi Shyalika, Kaushik Roy, Renjith Prasad, Fadi El Kalach, Yuxin Zi, Priya Mittal, Vignesh Narayanan, Ramy Harik, Amit Sheth May 2024

Ri2ap: Robust And Interpretable 2d Anomaly Prediction In Assembly Pipelines, Chathurangi Shyalika, Kaushik Roy, Renjith Prasad, Fadi El Kalach, Yuxin Zi, Priya Mittal, Vignesh Narayanan, Ramy Harik, Amit Sheth

Publications

Predicting anomalies in manufacturing assembly lines is crucial for reducing time and labor costs and improving processes. For instance, in rocket assembly, premature part failures can lead to significant financial losses and labor inefficiencies. With the abundance of sensor data in the Industry 4.0 era, machine learning (ML) offers potential for early anomaly detection. However, current ML methods for anomaly prediction have limitations, with F1 measure scores of only 50% and 66% for prediction and detection, respectively. This is due to challenges like the rarity of anomalous events, scarcity of high-fidelity simulation data (actual data are expensive), and the complex …


Detecting Substance Use Disorder Using Social Media Data And Dark Web: Time And Knowledge Aware Study, Usha Lokala, Orchid Chetia Phukan, Triyasha Ghosh Dastidar, Francois Lamy, Raminta Daniulaityte, Amit Sheth Feb 2024

Detecting Substance Use Disorder Using Social Media Data And Dark Web: Time And Knowledge Aware Study, Usha Lokala, Orchid Chetia Phukan, Triyasha Ghosh Dastidar, Francois Lamy, Raminta Daniulaityte, Amit Sheth

Faculty Publications

Opioid and substance misuse is rampant in the United States today, with the phenomenon known as the "opioid crisis". The relationship between substance use and mental health has been extensively studied, with one possible relationship being: substance misuse causes poor mental health. However, the lack of evidence on the relationship has resulted in opioids being largely inaccessible through legal means. This study analyzes the substance use posts on social media with opioids being sold through crypto market listings. We use the Drug Abuse Ontology, state-of-the-art deep learning, and knowledge-aware BERT-based models to generate sentiment and emotion for the social media …


Neurosymbolic Customized And Compact Copilots, Kaushik Roy, Megha Chakraborty, Yuxin Zi, Manas Gaur, Amit Sheth Jan 2024

Neurosymbolic Customized And Compact Copilots, Kaushik Roy, Megha Chakraborty, Yuxin Zi, Manas Gaur, Amit Sheth

Publications

Large Language Models (LLMs) are credible with open-domain interactions such as question answering, summarization, and explanation generation [1]. LLM reasoning is based on parametrized knowledge, and as a consequence, the models often produce absurdities and inconsistencies in outputs (e.g., hallucinations and confirmation biases) [2]. In essence, they are fundamentally hard to control to prevent off-the-rails behaviors, are hard to fine-tune, customize for tailored needs, prompt effectively (due to the “tug-of-war” between external and parametric memory), and extremely resource-hungry due to the enormous size of their extensive parametric configurations [3,4]. Thus, significant challenges arise when these models are required to perform …


K-Perm: Personalized Response Generation Using Dynamic Knowledge Retrieval And Persona-Adaptive Queries, Kanak Raj, Kaushik Roy, Vamshi Bonagiri, Priyanshul Govil, Krishnaprasad Thirunarayan, Raxit Goswami, Manas Gaur Jan 2024

K-Perm: Personalized Response Generation Using Dynamic Knowledge Retrieval And Persona-Adaptive Queries, Kanak Raj, Kaushik Roy, Vamshi Bonagiri, Priyanshul Govil, Krishnaprasad Thirunarayan, Raxit Goswami, Manas Gaur

Publications

Personalizing conversational agents can enhance the quality of conversations and increase user engagement. However, they often lack external knowledge to tend to a user’s persona appropriately. This is particularly crucial for practical applications like mental health support, nutrition planning, culturally sensitive conversations, or reducing toxic behavior in conversational agents. To enhance the relevance and comprehensiveness of personalized responses, we propose using a two-step approach that involves (1) selectively integrating user personas and (2) contextualizing the response with supplementing information from a background knowledge source. We develop K-PERM (Knowledge-guided PErsonalization with Reward Modulation), a dynamic conversational agent that combines these elements. …


Tutorial: Knowledge-Infused Artificial Intelligence For Mental Healthcare, Kaushik Roy Jan 2024

Tutorial: Knowledge-Infused Artificial Intelligence For Mental Healthcare, Kaushik Roy

Publications

Artificial Intelligence (AI) systems for mental healthcare (MHCare) have been ever-growing after realizing the importance of early interventions for patients with chronic mental health (MH) conditions. Social media (SocMedia) emerged as the go-to platform for supporting patients seeking MHCare. The creation of peer-support groups without social stigma has resulted in patients transitioning from clinical settings to SocMedia supported interactions for quick help. Researchers started exploring SocMedia content in search of cues that showcase correlation or causation between different MH conditions to design better interventional strategies. User-level Classification-based AI systems were designed to leverage diverse SocMedia data from various MH conditions, …


Personalized Bayesian Inference For Explainable Healthcare Management And Intervention, Utkarshani Jaimini, Krishnaprasad Thirunaravan, Maninder Kalra, Robin Dawson, Amit Sheth Jan 2024

Personalized Bayesian Inference For Explainable Healthcare Management And Intervention, Utkarshani Jaimini, Krishnaprasad Thirunaravan, Maninder Kalra, Robin Dawson, Amit Sheth

Publications

Chronic healthcare conditions such as Asthma re- quires constant monitoring and managing of symptoms and their triggers for better quality of life. Each asthma patient reacts very differently to potential triggers. Hence, there is a need to develop a explainable personalized framework for each patient to capture susceptibility to asthma triggers. We developed a personalized knowledge-based probabilistic model to predict asthma exacerbation for different environmental factors utilizing patient generated health data from pediatric asthma patients. Further, the personalized model provides a metric, called Health Coefficient, to quantify the health of a patient for varying environmental factors. We demonstrate the predictive …


Causal Neuro-Symbolic Ai: A Synergy Between Causality And Neuro-Symbolic Methods, Utkarshani Jaimini, Cory Henson, Amit Sheth Jan 2024

Causal Neuro-Symbolic Ai: A Synergy Between Causality And Neuro-Symbolic Methods, Utkarshani Jaimini, Cory Henson, Amit Sheth

Publications

Causal Neuro-Symbolic AI combines the benefits of causality with Neuro-Symbolic Artificial Intelligence (NeSyAI). More specifically, it (1) enriches NeSyAI systems with explicit representations of causality, (2) integrates causal knowledge with domain knowledge, and (3) enables the use of NeSyAI techniques for causal AI tasks. The explicit causal representation yields insights that predictive models may fail to analyze from observational data. It can also assist people in decision-making scenarios where discerning the cause of an outcome is necessary to choose among various interventions.


Ontolog Summit 2024 Talk Report: Healthcare Assistance Challenges-Driven Neurosymbolic Ai, Kaushik Roy Jan 2024

Ontolog Summit 2024 Talk Report: Healthcare Assistance Challenges-Driven Neurosymbolic Ai, Kaushik Roy

Publications

Although Artificial Intelligence technology has proven effective in providing healthcare assistance by analyzing health data, it still falls short in supporting decision-making. This deficiency largely stems from the predominance of opaque neural networks, particularly in mental health care AI applications, which raise concerns about their unpredictable and unverifiable nature. This skepticism hinders the transition from information support to decision support. This presentation will explore neurosymbolic approaches that combine neural networks with symbolic control and verification mechanisms. These approaches aim to unlock AI’s full potential by enhancing information analysis and decision-making support for healthcare assistance1.


A Comprehensive Survey On Rare Event Prediction, Chathurangi Shyalika Jayakody Kankanamalage, Ruwan Wickramarachchi, Amit Sheth Jan 2024

A Comprehensive Survey On Rare Event Prediction, Chathurangi Shyalika Jayakody Kankanamalage, Ruwan Wickramarachchi, Amit Sheth

Publications

Rare event prediction involves identifying and forecasting events with a low probability using machine learning (ML) and data analysis. Due to the imbalanced data distributions, where the frequency of common events vastly outweighs that of rare events, it requires using specialized methods within each step of the ML pipeline, i.e., from data processing to algorithms to evaluation protocols. Predicting the occurrences of rare events is important for real-world applications, such as Industry 4.0, and is an active research area in statistics and ML. This paper comprehensively reviews the current approaches for rare event prediction along four dimensions: rare event data, …


Neurosymbolic Value-Inspired Ai (Why, What, And How), Amit Sheth, Kaushik Roy Jan 2024

Neurosymbolic Value-Inspired Ai (Why, What, And How), Amit Sheth, Kaushik Roy

Publications

The rapid progression of Artificial Intelligence (AI) systems, facilitated by the advent of Large Language Models (LLMs), has resulted in their widespread application to provide human assistance across diverse industries. This trend has sparked significant discourse centered around the ever-increasing need for LLM-based AI systems to function among humans as part of human society, sharing human values, especially as these systems are deployed in high-stakes settings (e.g., healthcare, autonomous driving, etc.). Towards this end, neurosymbolic AI systems are attractive due to their potential to enable easy-tounderstand and interpretable interfaces for facilitating valuebased decision-making, by leveraging explicit representations of shared values. …


Exploring Alternative Approaches To Language Modeling For Learning From Data And Knowledge, Yuxin Zi, Kaushik Roy, Vignesh Narayanan, Amit Sheth Jan 2024

Exploring Alternative Approaches To Language Modeling For Learning From Data And Knowledge, Yuxin Zi, Kaushik Roy, Vignesh Narayanan, Amit Sheth

Publications

Despite their wide applications to language understanding tasks, large language models (LLMs) still face challenges such as hallucinations - the occasional fabrication of information, and alignment issues - the lack of associations with human-curated world models (e.g., intuitive physics or common-sense knowledge). Additionally, the black-box nature of LLMs makes it highly challenging to train them meaningfully in order to achieve a desired behavior. Specifically, the attempt to adjust LLMs’ concept embedding spaces can be highly intractable, which involves analyzing the implicit impact on LLMs’ numerous parameters and the resulting inductive biases. This paper proposes a novel architecture that wraps powerful …


Towards Pragmatic Temporal Alignment In Stateful Generative Ai Systems: A Configurable Approach, Kaushik Roy, Yuxn Zi, Amit Sheth Jan 2024

Towards Pragmatic Temporal Alignment In Stateful Generative Ai Systems: A Configurable Approach, Kaushik Roy, Yuxn Zi, Amit Sheth

Publications

Temporal alignment in stateful generative artificial intelligence (AI) systems remains an underexplored area, particularly beyond goal-driven approaches in planning. Stateful refers to maintaining a persistent memory or “state” across runs or sessions. This helps with referencing past information to make system outputs more contextual and relevant. This position paper proposes a framework for temporal alignment with several configurable toggles. We present four alignment mechanisms: knowledge graph path-based, neural score-based, vector similarity-based, and sequential process-guided alignment. By offering these interchangeable approaches, we aim to provide a flexible solution adaptable to complex and real-world applications. This paper discusses the potential benefits and …


Proknow: Process Knowledge For Safety Constrained And Explainable Question Generation For Mental Health Diagnostic Assistance In The Age Of Large Language Models, Kaushik Roy, Manas Gaur, Misagh Soltani, Vipula Rawte, Ashwin Allen, Amit P. Sheth Jan 2024

Proknow: Process Knowledge For Safety Constrained And Explainable Question Generation For Mental Health Diagnostic Assistance In The Age Of Large Language Models, Kaushik Roy, Manas Gaur, Misagh Soltani, Vipula Rawte, Ashwin Allen, Amit P. Sheth

Publications

Current Virtual Mental Health Assistants (VMHAs) primarily offer counseling and suggestive care but do not assist with patient diagnosis due to their lack of training in safety-constrained and specialized clinical process knowledge, referred to as ProKnow. In this work, we define ProKnow as an ordered set of information aligned with evidence-based guidelines or categories of conceptual understanding used by domain experts. We also introduce a new dataset of diagnostic conversations guided by safety constraints and Pro- Know, known as ProKnow-data. We develop a method for natural language question generation (NLG) designed to interactively gather diagnostic information from patients, termed ProKnow-algo. …


Causal Event Graph-Guided Language-Based Spatiotemporal Question Answering, Kaushik Roy, Alessandro Oltramari, Yuxin Zi, Chathurangi Shyalika, Vignesh Narayanan, Amit Sheth Jan 2024

Causal Event Graph-Guided Language-Based Spatiotemporal Question Answering, Kaushik Roy, Alessandro Oltramari, Yuxin Zi, Chathurangi Shyalika, Vignesh Narayanan, Amit Sheth

Publications

Large Language Models have excelled at encoding and leveraging language patterns in large text-based corpora for various tasks, including spatiotemporal event-based question answering (QA). However, due to encoding a text-based projection of the world, they have also been shown to lack a fullbodied understanding of such events, e.g., a sense of intuitive physics, and cause-and-effect relationships among events. In this work, we propose using causal event graphs (CEGs) to enhance language understanding of spatiotemporal events in language models, using a novel approach that also provides proofs for the model’s capture of the CEGs. A CEG consists of events denoted by …


An Ontology Design Pattern For Representing Causality, Utkarshani Jaimini, Cory Henson, Amit Sheth Nov 2023

An Ontology Design Pattern For Representing Causality, Utkarshani Jaimini, Cory Henson, Amit Sheth

Publications

The causal pattern is a proposed ontology design pattern for representing the structure of causal relations in a knowledge graph. This pattern is grounded in the concepts defined and used by the CausalAI community i.e., Causal Bayesian Networks and do-calculus. Specifically, the pattern models three primary concepts: (1) causal relations, (2) causal event roles, and (3) causal effect weights. Two use cases involving a sprinkler system and asthma patients are provided along with their relevant competency questions.


Ki-Cook: Clustering Multimodal Cooking Representations Through Knowledge-Infused Learning, Revathy Venkataramanan, Swati Padhee, Saini Rohan Rao, Ronak Kaoshik, Anirudh Sundara Rajan, Amit Sheth Jul 2023

Ki-Cook: Clustering Multimodal Cooking Representations Through Knowledge-Infused Learning, Revathy Venkataramanan, Swati Padhee, Saini Rohan Rao, Ronak Kaoshik, Anirudh Sundara Rajan, Amit Sheth

Publications

Cross-modal recipe retrieval has gained prominence due to its ability to retrieve a text representation given an image representation and vice versa. Clustering these recipe representations based on similarity is essential to retrieve relevant information about unknown food images. Existing studies cluster similar recipe representations in the latent space based on class names. Due to inter-class similarity and intraclass variation, associating a recipe with a class name does not provide sufficient knowledge about recipes to determine similarity. However, recipe title, ingredients, and cooking actions provide detailed knowledge about recipes and are a better determinant of similar recipes. In this study, …


Ecg Recordings As Predictors Of Very Early Autism Likelihood: A Machine Learning Approach, Deepa Tilwani, Jessica Bradshaw, Amit Sheth, Christian O'Reilly Jul 2023

Ecg Recordings As Predictors Of Very Early Autism Likelihood: A Machine Learning Approach, Deepa Tilwani, Jessica Bradshaw, Amit Sheth, Christian O'Reilly

Publications

In recent years, there has been a rise in the prevalence of autism spectrum disorder (ASD). The diagnosis of ASD requires behavioral observation and standardized testing completed by highly trained experts. Early intervention for ASD can begin as early as 1–2 years of age, but ASD diagnoses are not typically made until ages 2–5 years, thus delaying the start of intervention. There is an urgent need for non-invasive biomarkers to detect ASD in infancy. While previous research using physiological recordings has focused on brain-based biomarkers of ASD, this study investigated the potential of electrocardiogram (ECG) recordings as an ASD biomarker …


Leveraging Programmable Switches To Enhance The Performance Of Networks: Active And Passive Deployments, Elie Kfoury Jul 2023

Leveraging Programmable Switches To Enhance The Performance Of Networks: Active And Passive Deployments, Elie Kfoury

Theses and Dissertations

The performance of networks today is drastically affected by: 1) switches equipped with large buffers, referred to as “bloated buffers”: due to the lack of programmability and traffic visibility in legacy switches, operators nowadays configure large buffers statically without considering the characteristics or dynamics of flows. Such buffers increase the delays on packets, causing the Quality of Service (QoS) of networked applications (e.g., voice over IP, web browsing) to degrade; 2) switches forwarding packets on a best-effort basis: traffic crossing a switch is heterogeneous in many ways. Mixing such traffic in a single queue without any QoS measures can drastically …


Digital Health Design For Improving Treatment Decisions, Akanksha Singh Jul 2023

Digital Health Design For Improving Treatment Decisions, Akanksha Singh

Theses and Dissertations

In the age of artificial intelligence and large datasets, information retrieval by querying large databases is an impossible task for the common user due to the information overload. Recommender Systems (RS) for commercial applications like YouTube, Amazon and Netflix were designed to support users by finding items of interest based on their user profiles and various filtering techniques. Health Recommender Systems (HRS) is a category of RSs that provides immense opportunities for application across several healthcare domains and contexts including treatment decision support. Unlike RS applications that focus on analyzing consumer choices, a key differentiator for HRS applications is the …


Model-Driven Analysis Of Ecg Using Reinforcement Learning, Christian O'Reilly, Sai Durga Rithvik Oruganti, Deepa Tilwani, Jessica Bradshaw Jun 2023

Model-Driven Analysis Of Ecg Using Reinforcement Learning, Christian O'Reilly, Sai Durga Rithvik Oruganti, Deepa Tilwani, Jessica Bradshaw

Publications

Modeling is essential to better understand the generative mechanisms responsible for experimental observations gathered from complex systems. In this work, we are using such an approach to analyze the electrocardiogram (ECG). We present a systematic framework to decompose ECG signals into sums of overlapping lognormal components. We use reinforcement learning to train a deep neural network to estimate the modeling parameters from an ECG recorded in babies from 1 to 24 months of age. We demonstrate this model-driven approach by showing how the extracted parameters vary with age. From the 751,510 PQRST complexes modeled, 82.7% provided a signal-to-noise ratio that …


Real-Time Facial Expression Recognition Using Edge Ai Accelerators, Mark Heath Smith Apr 2023

Real-Time Facial Expression Recognition Using Edge Ai Accelerators, Mark Heath Smith

Theses and Dissertations

Facial expression recognition is a popular and challenging area of research in machine learning applications. Facial expressions are critical to human communication and allow us to convey complex thoughts and emotions beyond spoken language. The complexity of facial expressions creates a difficult problem for computer vision systems, especially edge computing systems. Current Deep Learning (DL) methods rely on large-scale Convolutional Neural Networks (CNN) which require millions of floating point operations (FLOPS) to accomplish similar image classification tasks. However, on edge and IoT devices, large-scale convolutional models can cause problems due to memory and power limitations. The intent of this work …


A Semantic Web Approach To Fault Tolerant Autonomous Manufacturing, Fadi El Kalach Apr 2023

A Semantic Web Approach To Fault Tolerant Autonomous Manufacturing, Fadi El Kalach

Theses and Dissertations

The next phase of manufacturing is centered on making the switch from traditional automated to autonomous systems. Future Factories are required to be agile, allowing for more customized production, and resistant to disturbances. Such production lines would have the capability to reallocate resources as needed and eliminate downtime while keeping up with market demands. These systems must be capable of complex decision making based on different parameters such as machine status, sensory data, and inspection results. Current manufacturing lines lack this complex capability and instead focus on low level decision making on the machine level without utilizing the generated data …


Knowledge Graph Empowered Machine Learning Pipelines For Improved Efficiency, Reusability, And Explainability, Revathy Venkataramanan, Aalap Tripathy, Martin Foltin, Hong Yung Yip, Annmary Justine, Amit Sheth Feb 2023

Knowledge Graph Empowered Machine Learning Pipelines For Improved Efficiency, Reusability, And Explainability, Revathy Venkataramanan, Aalap Tripathy, Martin Foltin, Hong Yung Yip, Annmary Justine, Amit Sheth

Publications

Artificial intelligence (AI) pipelines are complex, heavily parameterized, and expensive to execute in terms of time and computational resources. Consequently, it is onerous to run experiments with all possible parameter combinations to achieve an optimal solution. However, these AI experiments can be optimized by recommending relevant parameters to commence the experiments, reducing search space significantly, which can be fine tuned further. The relevant parameters can be identified by observing the metadata of pipelines executed in the past, and the relevant pipeline with relevant parameters can be recommended to the user. Currently, there are various metadata frameworks that automatically record the …


Demo Alleviate: Demonstrating Artificial Intelligence Enabled Virtual Assistance For Telehealth: The Mental Health Case, Kaushik Roy, Vedant Khandelwal, Raxit Goswami, Nathan Dolbir, Jinendra Malekar, Amit Sheth Jan 2023

Demo Alleviate: Demonstrating Artificial Intelligence Enabled Virtual Assistance For Telehealth: The Mental Health Case, Kaushik Roy, Vedant Khandelwal, Raxit Goswami, Nathan Dolbir, Jinendra Malekar, Amit Sheth

Publications

After the pandemic, artificial intelligence (AI) powered support for mental health care has become increasingly important. The breadth and complexity of significant challenges required to provide adequate care involve: (a) Personalized patient understanding, (b) Safety-constrained and medically validated chatbot patient interactions, and (c) Support for continued feedback-based refinements in design using chatbot-patient interactions. We propose Alleviate, a chatbot designed to assist patients suffering from mental health challenges with personalized care and assist clinicians with understanding their patients better. Alleviate draws from an array of publicly available clinically valid mental-health texts and databases, allowing Alleviate to make medically sound and informed …


Cook-Gen: Robust Generative Modeling Of Cooking Actions From Recipes, Revathy Venkataramanan, Kaushik Roy, Kanak Ray, Renjith Prasad, Yuxin Zi, Vignesh Narayanan, Amit Sheth Jan 2023

Cook-Gen: Robust Generative Modeling Of Cooking Actions From Recipes, Revathy Venkataramanan, Kaushik Roy, Kanak Ray, Renjith Prasad, Yuxin Zi, Vignesh Narayanan, Amit Sheth

Publications

As people become more aware of their food choices, food computation models have become increasingly popular in assisting people in maintaining healthy eating habits. For example, food recommendation systems analyze recipe instructions to assess nutritional contents and provide recipe recommendations. The recent and remarkable successes of generative AI methods, such as auto-regressive large language models, can lead to robust methods for a more comprehensive understanding of recipes for healthy food recommendations beyond surface-level nutrition content assessments. In this study, we explore the use of generative AI methods to extend current food computation models, primarily involving the analysis of nutrition and …