Artificial Intelligence and Robotics Commons^™

Hack24f: Ai Conversations In Healthcare, Patrick Finger, Hannah Neale, Anthony Ferreira, Ayaz Mohammed

Paul English Applied Artificial Intelligence (AI) Institute Publications

Nursing students often complete clinical hours under the supervision of instructors in traditional hospital settings. However, obtaining individualized, consistent feedback from patients about their interactions with nursing students is often not feasible. This limits students' ability to fully understand how their communication skills are perceived and how they can improve. Currently, there are no models that represent realistic real life conversations with patients. Most virtual simulation models used for nursing students provide scripted responses that do not feel genuine.

Hack24f: The Empathy Architects, Michael Rejtig, Ajanee Igharo, Emma Kelminson, Jackson Comeau

Paul English Applied Artificial Intelligence (AI) Institute Publications

Problem Statement: We want to help patients from underserved communities feel more safe, respected and comfortable in interacting with healthcare providers during the initial in-person encounters while also helping providers build empathy and implement socio-emotionally competent communication behaviors. Solution: Empathy Evolution is an AI-powered role-playing game that helps patients simulate their ideal communication with healthcare providers.

Sub-Band Backdoor Attack In Remote Sensing Imagery, Kazi Aminul Islam, Hongyi Wu, Chunsheng Xin, Rui Ning, Liuwan Zhu, Jiang Li

Electrical & Computer Engineering Faculty Publications

Remote sensing datasets usually have a wide range of spatial and spectral resolutions. They provide unique advantages in surveillance systems, and many government organizations use remote sensing multispectral imagery to monitor security-critical infrastructures or targets. Artificial Intelligence (AI) has advanced rapidly in recent years and has been widely applied to remote image analysis, achieving state-of-the-art (SOTA) performance. However, AI models are vulnerable and can be easily deceived or poisoned. A malicious user may poison an AI model by creating a stealthy backdoor. A backdoored AI model performs well on clean data but behaves abnormally when a planted trigger appears in …

Domain Adaptive Federated Learning For Multi-Institution Molecular Mutation Prediction And Bias Identification, W. Farzana, M. A. Witherow, I. Longoria, M. S. Sadique, A. Temtam, K. M. Iftekharuddin

Electrical & Computer Engineering Faculty Publications

Deep learning models have shown potential in medical image analysis tasks. However, training a generalized deep learning model requires huge amounts of patient data that is usually gathered from multiple institutions which may raise privacy concerns. Federated learning (FL) provides an alternative to sharing data across institutions. Nonetheless, FL is susceptible to a few challenges including inversion attacks on model weights, heterogenous data distributions, and bias. This study addresses heterogeneity and bias issues for multi-institution patient data by proposing domain adaptive FL modeling using several radiomics (volume, fractal, texture) features for O6-methylguanine-DNA methyltransferase (MGMT) classification across multiple institutions. The proposed …

Computer-Aided Craniofacial Superimposition Validation Study: The Identification Of The Leaders And Participants Of The Polish-Lithuanian January Uprising (1863–1864), Rubén Martos, Rosario Guerra, Fernando Navarro, Michela Peruch, Kevin Neuwirth, Andrea Valsecchi, Rimantas Jankauskas, Oscar Ibáñez

Faculty, Staff and Student Publications

In 2017, a series of human remains corresponding to the executed leaders of the "January Uprising" of 1863-1864 were uncovered at the Upper Castle of Vilnius (Lithuania). During the archeological excavations, 14 inhumation pits with the human remains of 21 individuals were found at the site. The subsequent identification process was carried out, including the analysis and cross-comparison of post-mortem data obtained in situ and in the lab with ante-mortem data obtained from historical archives. In parallel, three anthropologists with diverse backgrounds in craniofacial identification and two students without previous experience attempted to identify 11 of these 21 individuals using …

Ai And Ml-Based Risk Assessment Of Chemicals: Predicting Carcinogenic Risk From Chemical-Induced Genomic Instability, Ajay Vikram Singh, Preeti Bhardwaj, Peter Laux, Prachi Pradeep, Madleen Busse, Andreas Luch, Akihiko Hirose, Christopher J. Osgood, Michael W. Stacey

Biological Sciences Faculty Publications

Chemical risk assessment plays a pivotal role in safeguarding public health and environmental safety by evaluating the potential hazards and risks associated with chemical exposures. In recent years, the convergence of artificial intelligence (AI), machine learning (ML), and omics technologies has revolutionized the field of chemical risk assessment, offering new insights into toxicity mechanisms, predictive modeling, and risk management strategies. This perspective review explores the synergistic potential of AI/ML and omics in deciphering clastogen-induced genomic instability for carcinogenic risk prediction. We provide an overview of key findings, challenges, and opportunities in integrating AI/ML and omics technologies for chemical risk assessment, …

Spatially-Aware Speaker For Vision-And-Language Navigation Instruction Generation, Muraleekrishna Gopinathan, Martin Masek, Jumana Abu-Khalaf, David Suter

Research outputs 2022 to 2026

Embodied AI aims to develop robots that can understand and execute human language instructions, as well as communicate in natural languages. On this front, we study the task of generating highly detailed navigational instructions for the embodied robots to follow. Although recent studies have demonstrated significant leaps in the generation of step-by-step instructions from sequences of images, the generated instructions lack variety in terms of their referral to objects and landmarks. Existing speaker models learn strategies to evade the evaluation metrics and obtain higher scores even for low-quality sentences. In this work, we propose SAS (Spatially-Aware Speaker), an instruction generator …

Triphlapan: Predicting Hla Molecules Binding Peptides Based On Triple Coding Matrix And Transfer Learning, Meng Wang, Chuqi Lei, Jianxin Wang, Yaohang Li, Min Li

Computer Science Faculty Publications

Human leukocyte antigen (HLA) recognizes foreign threats and triggers immune responses by presenting peptides to T cells. Computationally modeling the binding patterns between peptide and HLA is very important for the development of tumor vaccines. However, it is still a big challenge to accurately predict HLA molecules binding peptides. In this paper, we develop a new model TripHLApan for predicting HLA molecules binding peptides by integrating triple coding matrix, BiGRU + Attention models, and transfer learning strategy. We have found the main interaction site regions between HLA molecules and peptides, as well as the correlation between HLA encoding and binding …

Artificial Intelligence For The Electron Ion Collider (Ai4eic), C. Allaire, R. Ammendola, E.-C. Aschenauer, M. Balandat, M. Battaglieri, J. Bernauer, M. Bondì, N. Branson, T. Britton, A. Butter, I. Chahrour, P. Chatagnon, E. Cisbani, E. W. Cline, S. Dash, C. Dean, W. Deconinck, A. Deshpande, M. Diefenthaler, R. Ent, C. Fanelli, M. Finger, M. Finger Jr., E. Fol, S. Furletov, Y. Gao, J. Giroux, N. C. Gunawardhana Waduge, O. Hassan, P. L. Hegde, R. J. Hernandez-Pinto, A. Hiller Blin, T. Horn, J. Huang, A. Jalotra, D. Jayakodige, B. Joo, M. Junaid, N. Kalantarians, P. Karande, B. Kriesten, R. Kunnawalkam Elayavalli, Y. Li, M. Lin, F. Liu, S. Liuti, G. Matousek, M. Mceneaney, D. Mcspadden, T. Menzo, T. Miceli, V. Mikuni, R. Montgomery, B. Nachman, R. R. Nair, J. Niestroy, S. A. Ochoa Oregon, J. Oleniacz, J. D. Osborn, C. Paudel, C. Pecar, C. Peng, G. N. Perdue, W. Phelps, M. L. Purschke, H. Rajendran, K. Rajput, Y. Ren, D. F. Renteria-Estrada, D. Richford, B. J. Roy, D. Roy, A. Saini, N. Sato, T. Satogata, G. Sborlini, M. Schram, D. Shih, J. Singh, R. Singh, A. Siodmok, J. Stevens, P. Stone, L. Suarez, K. Suresh, A. -N. Tawfik, F. Torales Acosta, N. Tran, R. Trotta, F. J. Twagirayezu, R. Tyson, S. Volkova, A. Vossen, E. Walter, D. Whiteson, M. Williams, S. Wu, N. Zachariou, P. Zurita

Computer Science Faculty Publications

The Electron-Ion Collider (EIC), a state-of-the-art facility for studying the strong force, is expected to begin commissioning its first experiments in 2028. This is an opportune time for artificial intelligence (AI) to be included from the start at this facility and in all phases that lead up to the experiments. The second annual workshop organized by the AI4EIC working group, which recently took place, centered on exploring all current and prospective application areas of AI for the EIC. This workshop is not only beneficial for the EIC, but also provides valuable insights for the newly established ePIC collaboration at EIC. …

Evaluating Pre-Trial Programs Using Interpretable Machine Learning Matching Algorithms For Causal Inference, Travis Seale-Carlisle, Saksham Jain, Courtney Lee, Caroline Levenson, Swathi Ramprasad, Brandon Garrett, Sudeepa Roy, Cynthia Rudin, Alexander Volfovsky

Faculty Scholarship

After a person is arrested and charged with a crime, they may be released on bail and required to participate in a community supervision program while awaiting trial. These ‘pretrial programs’ are common throughout the United States, but very little research has demonstrated their effectiveness. Researchers have emphasized the need for more rigorous program evaluation methods, which we introduce in this article. We describe a program evaluation pipeline that uses recent interpretable machine learning techniques for observational causal inference, and demonstrate these techniques in a study of a pre-trial program in Durham, North Carolina. Our findings show no evidence that …

Deepfakes In Court: How Judges Can Proactively Manage Alleged Ai-Generated Material In National Security Cases, Abhishek Dalal, Chongyang Gao, Paul W. Grimm, Maura R. Grossman, Daniel W. Linna Jr., Chiara Pulice, V. S. Subrahmanian, John Tunheim

Faculty Scholarship

Dall-E. ChatGPT GPT-4. Words that did not exist in the English lexicon just a few years ago are now commonplace. With the widespread availability of Artificial Intelligence (AI) tools, specifically Generative AI, whether in the context of text, audio, video, imagery, or even combinations of these, it is inevitable that trials related to national security will involve evidentiary issues raised by Generative AI. We must confront two possibilities: first, that evidence presented is AI-generated and not real and, second, that other evidence is genuine but alleged to be fabricated. Technologies designed to detect AI-generated content have proven to be unreliable, …

Human Psychology And Robot Evidence In The Courtroom, Alternative Dispute Resolution, And Agency Proceedings, Sara Sun Beale, Hayley Lawrence

Faculty Scholarship

In human–robot interactions in legal proceedings, human responses to robot-generated evidence will present unique challenges to the accuracy of litigation as well as ancillary goals such as fairness and transparency, though it may also enhance accuracy in other respects. The most important feature of human–robot interactions is the human tendency to anthropomorphize robots, which can generate misleading impressions and be manipulated by designing robots to make them appear more trustworthy and believable. Although robot-generated evidence may also offer unique advantages, there are concerns about the degree to which the traditional methods of testing the accuracy of evidence, particularly cross-examination, will …

Diffusion Model Approach To Simulating Electron-Proton Scattering Events, Peter Devlin, Jian-Wei Qiu, Felix Ringer, Nobuo Sato

Physics Faculty Publications

Generative artificial intelligence is a fast-growing area of research offering various avenues for exploration in high-energy nuclear physics. In this work, we explore the use of generative models for simulating electron-proton collisions relevant to experiments like the Continuous Electron Beam Accelerator Facility and the future Electron-Ion Collider (EIC). These experiments play a critical role in advancing our understanding of nucleons and nuclei in terms of quark and gluon degrees of freedom. The use of generative models for simulating collider events faces several challenges such as the sparsity of the data, the presence of global or eventwide constraints, and steeply falling …

Advancing Machine Learning Interpretability: Lime Applications To Temporal Data And A Novel Method Of Counterfactual Generation, Shou Nakano, Yang Liu

Theses and Dissertations (Comprehensive)

As machine learning has advanced significantly over the past decade, predictive models have achieved substantial success across various domains. However, they often lack transparency in their decision-making processes. This opacity presents risks, particularly in sectors like healthcare and finance, where transparency is crucial. To address these challenges, explainable artificial intelligence (XAI) has risen in importance. Techniques such as LIME (Local Interpretable Model-agnostic Explanations) have been developed, utilizing simpler alternative models like linear regression or tree-based models to explain decisions for specific instances.

This thesis initially concentrates on the application of LIME to three global annual datasets, specifically within the relatively …

Different Visions From Biosview: A Brief Report, Lucas N. Potter, Xavier-Lewis Palmer

Electrical & Computer Engineering Faculty Publications

In this collaborative research endeavor at the intersection of biological safety and cybersecurity for BiosView labs, the authors highlight their engagement with a diverse student cohort. The chapter delves into the motivation behind collaborations extending beyond traditional academic research environments, emphasizing inclusivity. The meticulous examination of student demographics, including gender, self-reported ethnicity, and national origin, is detailed in the methodology. A student-centric approach is central to the exploration, focusing on aligning teaching and management styles with unique student needs. The chapter elaborates on effective teaching methodologies and management practices tailored for BiosView labs. A dedicated section emphasizes the purpose of …

Beyond Binary: Revealing Variations In Islamophobic Content With Hierarchical Multi-Class Classification, Esraa Aldreabi, Khawlah M. Harahsheh, Mukul Dev Chhangani, Chung-Hao Chen, Jeremy Blackburn

Electrical & Computer Engineering Faculty Publications

In the digital age, the rise of Islamophobia-marked by an irrational fear or discrimination against Islam and Muslims-has emerged as a pressing issue, especially on social media platforms. In this paper we employs a multi-class classification system, moving beyond traditional binary models. We categorize Islamophobic content into three main classes and various subclasses, covering a range from subtle biases to explicit incitement. Comparative analysis of data from Reddit and Twitter illuminates the distinct prevalence and types of Islamophobic content specific to each platform. This paper deepens our understanding of digital Islamophobia and provides insights for crafting targeted online counter strategies. …

Toward Inclusivity: Rethinking Islamophobic Content Classification In The Digital Age, Esraa Aldreabi, Mukul Dev Chhangani, Khawlah M. Harahsheh, Justin M. Lee, Chung-Hao Chen

Electrical & Computer Engineering Faculty Publications

In this paper, we implement a comprehensive three-class system to categorize social media discussions about Islam and Muslims, enhancing the typical binary approach. These classes are: I) General Discourse About Islam and Muslims, II) Criticism of Islamic Teachings and Figures, and III) Comments Against Muslims. These categories are designed to balance the nuances of free speech while protecting diverse groups like Muslims, ex-Muslims, LGBTQ+ communities, and atheists. By utilizing machine learning and employing transformer-based models, we analyze the distribution and characteristics of these classes in social media content. Our findings reveal distinct patterns of user engagement with topics related to …

Ensemble Learning With Sleep Mode Management To Enhance Anomaly Detection In Iot Environment, Khawlah Harahsheh, Rami Al-Naimat, Malek Alzaqebah, Salam Shreem, Esraa Aldreabi, Chung-Hao Chen

Electrical & Computer Engineering Faculty Publications

The rapid proliferation of Internet of Things (IoT) devices has underscored the critical need for energy-efficient cybersecurity measures. This presents the dual challenge of maintaining robust security while minimizing power consumption. Thus, this paper proposes enhancing the machine learning performance through Ensemble Techniques with Sleep Mode Management (ELSM) approach for IoT Intrusion Detection Systems (IDS). The main challenge lies in the high-power consumption attributed to continuous monitoring in traditional IDS setups. ELSM addresses this challenge by introducing a sophisticated sleep-awake mechanism, activating the IDS system only during anomaly detection events, effectively minimizing energy expenditure during periods of normal network operation. …

Accelerating Cavity Fault Prediction Using Deep Learning At Jefferson Laboratory, Md M. Rahman, A. Carpenter, K. Iftekharuddin, C. Tennant

Electrical & Computer Engineering Faculty Publications

Accelerating cavities are an integral part of the continuous electron beam accelerator facility (CEBAF) at Jefferson Laboratory. When any of the over 400 cavities in CEBAF experiences a fault, it disrupts beam delivery to experimental user halls. In this study, we propose the use of a deep learning model to predict slowly developing cavity faults. By utilizing pre-fault signals, we train a long short-term memory-convolutional neural network binary classifier to distinguish between radio-frequency (RF) signals during normal operation and RF signals indicative of impending faults. We optimize the model by adjusting the fault confidence threshold and implementing a multiple consecutive …

Skipresnet: Crop And Weed Recognition Based On The Improved Resnet, Wenyi Hu, Tian Chen, Chunjie Lan, Shan Liu, Lirong Yin

Electrical & Computer Engineering Faculty Publications

Weeds have a detrimental effect on crop yield. However, the prevailing chemical weed control methods cause pollution of the ecosystem and land. Therefore, it has become a trend to reduce dependence on herbicides; realize a sustainable, intelligent weed control method; and protect the land. In order to realize intelligent weeding, efficient and accurate crop and weed recognition is necessary. Convolutional neural networks (CNNs) are widely applied for weed and crop recognition due to their high speed and efficiency. In this paper, a multi-path input skip-residual network (SkipResNet) was put forward to upgrade the classification function of weeds and crops. It …