Artificial Intelligence and Robotics Commons^™

Artificial Intelligence In Orthopaedic Education: A Comparative Analysis Of Chatgpt And Bing Ai’S Orthopaedic In-Training Examination Performance, Clark Chen, Vivek Biololikar, Duncan Vannest, James Raphael, Gene Shaffer

Einstein Health Papers

Background: This study evaluated the performance of generative artificial intelligence (AI) models on the Orthopaedic In-Training Examination (OITE), an annual exam administered to U.S. orthopaedic residency programs. Methods: ChatGPT 3.5 and Bing AI GPT 4.0 were evaluated on standardised sets of multiple-choice questions drawn from the American Academy of Orthopaedic Surgeons OITE online question bank spanning 5 years (2018–2022). A total of 1165 questions were posed to each AI system. The performance of both systems was standardised using the latest versions of ChatGPT 3.5 and Bing AI GPT 4.0. Historical data of resident scores taken from the annual OITE technical …

Performance Of 5 Prominent Large Language Models In Surgical Knowledge Evaluation: A Comparative Analysis, Adam M. Ostrovsky, Joshua R. Chen, Vishal N. Shah, Babak Abai

Department of Surgery Faculty Papers

No abstract provided.

Diabetes Technology Meeting 2023, Tiffany Tian, Rachel E Aaron, Ashley Y Dunova, Johan H Jendle, David Kerr, Eda Cengiz, Andjela Drincic, John C Pickup, Kong Y Chen, Naomi Schwartz, Douglas B Muchmore, Halis K Akturk, Carol J Levy, Signe Schmidt, Riccardo Bellazzi, Alan H B Wu, Elias K Spanakis, Bijan Najafi, James Geoffrey Chase, Jane Jeffrie Seley, David C Klonoff

Center on Aging Staff Publications

Diabetes Technology Society hosted its annual Diabetes Technology Meeting from November 1 to November 4, 2023. Meeting topics included digital health; metrics of glycemia; the integration of glucose and insulin data into the electronic health record; technologies for insulin pumps, blood glucose monitors, and continuous glucose monitors; diabetes drugs and analytes; skin physiology; regulation of diabetes devices and drugs; and data science, artificial intelligence, and machine learning. A live demonstration of a personalized carbohydrate dispenser for people with diabetes was presented.

Supervised Classification Modeling On Louisiana Medicaid Data: A Comparative Study, Yead Rahman

Master's Theses

This thesis systematically optimizes and compares state-of-the-art supervised classification models for Louisiana Medicaid data targeting clinical services, COVID-19 infection, and tobacco use. These target variables are critically important as they represent key health outcomes and behaviors among Medicaid enrollees in Louisiana, a population often characterized by poverty and limited access to education. This study applies advanced machine learning techniques to identify the best model for multinomial and binary classification tasks. These include models such as Logistic Regression, XGBoost, AdaBoost, Random Forest, Decision Tree, Artificial Neural Networks, and Naïve Bayes. Extensive tuning of the hyperparameters and optimization of each classifier were …

Interventional Radiology's Exploration Into Artificial Intelligence, Raymond Nguyen

Master's Projects and Capstones

Background: Artificial intelligence (AI) has become more prominent in our daily lives in recent years. This includes various aspects of healthcare. Interventional radiology (IR) is one of these specialties that has taken strides in understanding how AI can be leveraged for patient care. This literature review aims to understand what areas will be most impacted by AI in IR and how it will influence both the patient and interventional radiologist.

Methods: Twenty-six publications from 2019-2024 were selected from PubMed and Scopus. Publications were sourced through a combination of keywords, subject headings (MeSH terms), and citation searching.

Results: This literature review …

Hyperpolarized Magnetic Resonance Imaging, Nuclear Magnetic Resonance Metabolomics, And Artificial Intelligence To Interrogate The Metabolic Evolution Of Glioblastoma, Kang Lin Hsieh, Qing Chen, Travis C Salzillo, Jian Zhang, Xiaoqian Jiang, Pratip K Bhattacharya, Shyan Shams

Faculty, Staff and Student Publications

Glioblastoma (GBM) is a malignant Grade VI cancer type with a median survival duration of only 8-16 months. Earlier detection of GBM could enable more effective treatment. Hyperpolarized magnetic resonance spectroscopy (HPMRS) could detect GBM earlier than conventional anatomical MRI in glioblastoma murine models. We further investigated whether artificial intelligence (A.I.) could detect GBM earlier than HPMRS. We developed a deep learning model that combines multiple modalities of cancer data to predict tumor progression, assess treatment effects, and to reconstruct in vivo metabolomic information from ex vivo data. Our model can detect GBM progression two weeks earlier than conventional MRIs …

In Reply: Can Artificial Intelligence Make The Cut? Dissecting Large Language Model’S Surgical Exam Performance, Adam M. Ostrovsky, Joshua R. Chen, Vishal N. Shah, Babak Abai

Department of Surgery Faculty Papers

No abstract provided.

Digital Scribes: A Possible Solution For Provider Burnout By Reducing Provider Workload, Shannon Storley

Theses and Graduate Projects

Background: Provider burnout is continuing to be a massive problem for our healthcare industry. One major contributor to provider burnout is burdensome administrative tasks associated with documentation of electronic medical records (EMR). This review aims to uncover the applications for artificially intelligent digital scribes as a solution to reduce EMR documentation burden. Purpose: Provider burnout has shown to increase the incidence of major mistakes and decreased patient safety grades. Digital scribes could be a solution in reducing provider burnout by reducing the administrative burden of EMR documentation. Methods: A comprehensive literature review was conducted using articles from PubMed using search …

Enhancing Clinical Relevance Of Pretrained Language Models Through Integration Of External Knowledge: Case Study On Cardiovascular Diagnosis From Electronic Health Records, Qiuhao Lu, Andrew Wen, Thien Nguyen, Hongfang Liu

Faculty, Staff and Student Publications

Background: Despite their growing use in health care, pretrained language models (PLMs) often lack clinical relevance due to insufficient domain expertise and poor interpretability. A key strategy to overcome these challenges is integrating external knowledge into PLMs, enhancing their adaptability and clinical usefulness. Current biomedical knowledge graphs like UMLS (Unified Medical Language System), SNOMED CT (Systematized Medical Nomenclature for Medicine-Clinical Terminology), and HPO (Human Phenotype Ontology), while comprehensive, fail to effectively connect general biomedical knowledge with physician insights. There is an equally important need for a model that integrates diverse knowledge in a way that is both unified and compartmentalized. …

Exploring Healthcare Chatbot Information Presentation: Applying Hierarchical Bayesian Regression And Inductive Thematic Analysis In A Mixed Methods Study, Samuel Nelson Koscelny

All Theses

High blood pressure, also known as hypertension, significantly increases the risk of heart disease and stroke, which are leading causes of death in the United States. While contributing to over 691,000 deaths in 2021 alone in the United States (U.S.), it also imposes immense economic burden on the healthcare system, costing approximately $131 billion annually. One way to address this issue is for increased self-care behaviors and medication adherence, both of which require sufficient health literacy. Despite the importance of health literacy, 90% of U.S. adults struggle with health-related subjects. Overcoming the issues associated with health literacy requires addressing the …

Development Of Feature Extraction Models To Improve Image Analysis Applications In Cancer, Yu Shi

Dissertations and Doctoral Documents, University of Nebraska-Lincoln, 2023–

Cancer poses a significant global health challenge. With an estimated 20 million new cases diagnosed worldwide in 2022 and 9.7 million fatalities attributable to the disease, the economic burden of cancer is immense. It impacts healthcare systems and imposes substantial costs for its care on patients and their families. Despite advancements in early detection, prevention, and treatment that have reduced overall cancer mortality rates, the growing prevalence of cancer, particularly among younger individuals, remains a pressing issue.

Recent advancements in medical imaging technology have progressed significantly with the help of emerging computer vision and artificial intelligence (AI) technology. Despite these …

Transformer-Based Deep Learning Prediction Of 10-Degree Humphrey Visual Field Tests From 24-Degree Data, Min Shi, Anagha Lokhande, Yu Tian, Yan Luo, Mohammad Eslami, Saber Kazeminasab, Tobias Elze, Lucy Shen, Louis Pasquale, Sarah Wellik, Carlos Gustavo De Moraes, Jonathan Myers, Nazlee Zebardast, David Friedman, Michael Boland, Mengyu Wang

Wills Eye Hospital Papers

PURPOSE: To predict 10-2 Humphrey visual fields (VFs) from 24-2 VFs and associated non-total deviation features using deep learning.

METHODS: We included 5189 reliable 24-2 and 10-2 VF pairs from 2236 patients, and 28,409 reliable pairs of macular OCT scans and 24-2 VF from 19,527 eyes of 11,560 patients. We developed a transformer-based deep learning model using 52 total deviation values and nine VF test features to predict 68 10-2 total deviation values. The mean absolute error, root mean square error, and the R2 were evaluation metrics. We further evaluated whether the predicted 10-2 VFs can improve the structure-function relationship …

High Prevalence Of Artifacts In Optical Coherence Tomography With Adequate Signal Strength, Wei-Chun Lin, Aaron Coyner, Charles Amankwa, Abigail Lucero, Gadi Wollstein, Joel Schuman, Hiroshi Ishikawa

Wills Eye Hospital Papers

PURPOSE: This study aims to investigate the prevalence of artifacts in optical coherence tomography (OCT) images with acceptable signal strength and evaluate the performance of supervised deep learning models in improving OCT image quality assessment.

METHODS: We conducted a retrospective study on 4555 OCT images from 546 patients, with each image having an acceptable signal strength (≥6). A comprehensive analysis of prevalent OCT artifacts was performed, and five pretrained convolutional neural network models were trained and tested to infer images based on quality.

RESULTS: Our results showed a high prevalence of artifacts in OCT images with acceptable signal strength. Approximately …

Genomic Data Science Approaches For Understanding Human Diseases, Snehal Shah

All Dissertations

The intricate interplay of genetic predisposition, environmental influences, and lifestyle acts as the multifactorial landscape of diseases. Understanding this complexity presents a significant challenge. Molecular insights into disease mechanisms, particularly the interactions of DNA, RNA, and proteins with environmental and lifestyle factors, have revolutionized disease diagnosis, prognosis, and treatment. High-throughput technologies, such as next-generation sequencing, generate large amounts of molecular data, holding a wealth of knowledge. These datasets unveil the roles of genes and their interactions with various factors through analysis, shedding light on previously unknown molecular mechanisms underlying disease pathogenesis. Furthermore, they facilitate the discovery of biomarkers crucial for …

Checklist For Reproducibility Of Deep Learning In Medical Imaging, Mana Moassefi, Yashbir Singh, Gian Marco Conte, Bardia Khosravi, Pouria Rouzrokh, Sanaz Vahdati, Nabile Safdar, Linda Moy, Felipe Kitamura, Amilcare Gentili, Paras Lakhani, Nina Kottler, Safwan Halabi, Joseph Yacoub, Yuankai Hou, Khaled Younis, Bradley Erickson, Elizabeth Krupinski, Shahriar Faghani

Department of Radiology Faculty Papers

The application of deep learning (DL) in medicine introduces transformative tools with the potential to enhance prognosis, diagnosis, and treatment planning. However, ensuring transparent documentation is essential for researchers to enhance reproducibility and refine techniques. Our study addresses the unique challenges presented by DL in medical imaging by developing a comprehensive checklist using the Delphi method to enhance reproducibility and reliability in this dynamic field. We compiled a preliminary checklist based on a comprehensive review of existing checklists and relevant literature. A panel of 11 experts in medical imaging and DL assessed these items using Likert scales, with two survey …

Advancing Telehealth Through Artificial Intelligence: Incorporating Emotional Intelligence And Addressing Cybersecurity Challenges, Mahima Rajendra Pulgaonkar

Electronic Theses, Projects, and Dissertations

This culminating experience project explores the integration of Emotional Artificial Intelligence (Emotional AI) into telehealth systems, addressing the dual challenges of enhancing patient care and mitigating cybersecurity risks. The research questions are: (Q1) How can Emotionally Intelligent AI improve telehealth systems' ability to recognize and respond to mental health symptoms? and (Q2) What are the specific cybersecurity challenges associated with AI in telehealth and how can they be mitigated? The findings for each question are: Q1: Emotionally Intelligent AI can significantly enhance telehealth by providing personalized, empathetic interactions that improve patient engagement, adherence to treatment plans, and early detection of …

Querymate: A Custom Llm Powered By Llamacpp, Pegah Khosravi

Open Educational Resources

No abstract provided.

Leveraging Generative Artificial Intelligence Models In Patient Education On Inferior Vena Cava Filters, Som Singh, Aleena Jamal, Farah Qureshi, Rohma Zaidi, Fawad Qureshi

SKMC Student Presentations and Publications

Background: Inferior Vena Cava (IVC) filters have become an advantageous treatment modality for patients with venous thromboembolism. As the use of these filters continues to grow, it is imperative for providers to appropriately educate patients in a comprehensive yet understandable manner. Likewise, generative artificial intelligence models are a growing tool in patient education, but there is little understanding of the readability of these tools on IVC filters. Methods: This study aimed to determine the Flesch Reading Ease (FRE), Flesch–Kincaid, and Gunning Fog readability of IVC Filter patient educational materials generated by these artificial intelligence models. Results: The ChatGPT cohort had …

Predicting Choroidal Nevus Transformation To Melanoma Using Machine Learning, Prashant D. Tailor, Piotr K. Kopinski, Haley S. D'Souza, David A. Leske, Timothy W. Olsen, Carol L. Shields, Jerry A. Shields, Lauren A. Dalvin

Wills Eye Hospital Papers

PURPOSE: To develop and validate machine learning (ML) models to predict choroidal nevus transformation to melanoma based on multimodal imaging at initial presentation.

DESIGN: Retrospective multicenter study.

PARTICIPANTS: Patients diagnosed with choroidal nevus on the Ocular Oncology Service at Wills Eye Hospital (2007-2017) or Mayo Clinic Rochester (2015-2023).

METHODS: Multimodal imaging was obtained, including fundus photography, fundus autofluorescence, spectral domain OCT, and B-scan ultrasonography. Machine learning models were created (XGBoost, LGBM, Random Forest, Extra Tree) and optimized for area under receiver operating characteristic curve (AUROC). The Wills Eye Hospital cohort was used for training and testing (80% training-20% testing) with …

Vysion Software, Isaias Hernandez-Dominguez Jr, Chander Luderman Miller

2024 Symposium

Vision loss presents significant challenges in daily life. Existing solutions for blind and visually impaired individuals are often limited in functionality, expensive, or complex to use. Vysion Software addresses this gap by developing a user-friendly, all-in-one AI companion app that provides features including text summarization, real-time audio descriptions, and AI-enhanced navigation. This project details the development plan, initial functionalities, and future vision for Vysion Software.

Enhancing Tumor Classification Through Machine Learning Algorithms For Breast Cancer Diagnosis, Lawrence Agbota, Edmund F. Agyemang, Priscilla Kissi-Appiah, Lateef Moshood, Akua Osei- Nkwantabisa, Vincent Agbenyeavu, Abraham Nsiah, Augustina Adjei

School of Mathematical & Statistical Sciences Faculty Publications

In cancer diagnosis, machine learning helps improve cancer detection by providing doctors with a second perspective and allowing for faster and more accurate determination and decisions. Numerous studies have used both classic machine learning approaches and deep learning to address cancer classification. In this study, we examine the efficacy of five commonly used machine learning algorithms; both traditional and deep learning models namely, Logistic Regression, Support Vector Machines (SVM), Random Forest (RF), Decision Tree and Deep Neural Networks (DNN). We analyze their ability to properly classify tumors as Benign or Malignant using the Wisconsin breast cancer dataset (WBCD). Random Forest …

From Graph Theory For Robust Deep Networks To Graph Learning For Multimodal Cancer Analysis, Asim Waqas

USF Tampa Graduate Theses and Dissertations

This dissertation explores the intersection of graph theory and deep learning, focusing on enhancing the robustness of deep neural networks (DNNs) and applying these advancements to complex problems like cancer diagnosis and treatment. We investigate the structural properties of graphs and their influence on neural network performance, particularly in multimodal learning. The work delves into the design space of DNN architectures using graph-theoretic measures, transforming graphs into DNN architectures for various tasks, and examining their robustness against noise and adversarial attacks. The study extends to medical imaging, highlighting advanced DNN architectures like U-Net for brain tumor segmentation. It addresses the …

Design And Implementation Of A Vision-Based Deep-Learning Protocol For Kinematic Feature Extraction With Application To Stroke Rehabilitation, Juan Diego Luna Inga

Master's Theses

Stroke is a leading cause of long-term disability, affecting thousands of individuals annually and significantly impairing their mobility, independence, and quality of life. Traditional methods for assessing motor impairments are often costly and invasive, creating substantial barriers to effective rehabilitation. This thesis explores the use of DeepLabCut (DLC), a deep-learning-based pose estimation tool, to extract clinically meaningful kinematic features from video data of stroke survivors with upper-extremity (UE) impairments.

To conduct this investigation, a specialized protocol was developed to tailor DLC for analyzing movements characteristic of UE impairments in stroke survivors. This protocol was validated through comparative analysis using peak …

Accessible Real-Time Eye-Gaze Tracking For Neurocognitive Health Assessments, A Multimodal Web-Based Approach, Daniel C. Tisdale

Master's Theses

We introduce a novel integration of real-time, predictive eye-gaze tracking models into a multimodal dialogue system tailored for remote health assessments. This system is designed to be highly accessible requiring only a conventional webcam for video input along with minimal cursor interaction and utilizes engaging gaze-based tasks that can be performed directly in a web browser. We have crafted dynamic subsystems that capture high-quality data efficiently and maintain quality through instances of user attrition and incomplete calls. Additionally, these subsystems are designed with the foresight to allow for future re-analysis using improved predictive models, as well as enable the creation …

Predicting Mild Cognitive Impairment Through Ambient Sensing And Artificial Intelligence, Ah-Hwee Tan, Weng Yan Ying, Budhitama Subagdja, Anni Huang, Shanthoshigaa D, Tony Chin-Ian Tay, Iris Rawtaer

Research Collection School Of Computing and Information Systems

This paper reports an emerging application leveraging ambient and artificial intelligence techniques for in-home sensing and cognitive health assessment. The application involves a prospective longitudinal study, wherein non-pervasive sensing devices are installed in homes of over 63 real users undergoing clinical cognitive assessment, and digital signals of the users’ activities and behaviour are transmitted to a central cloud-based data server for further processing and analysis. Based on the sensor readings, we identify a set of digital biomarkers covering four key aspects of daily living, namely physical, activity, cognitive, and sleep, and develop a suite of customized feature extraction methods for …

Charting A Path To The Quintuple Aim: Harnessing Ai To Address Social Determinants Of Health, Yash Shah, Zachary Goldberg, Erika Harness, David Nash

College of Population Health Faculty Papers

The Quintuple Aim seeks to improve healthcare by addressing social determinants of health (SDOHs), which are responsible for 70-80% of medical outcomes. SDOH-related concerns have traditionally been addressed through referrals to social workers and community-based organizations (CBOs), but these pathways have had limited success in connecting patients with resources. Given that health inequity is expected to cost the United States nearly USD 300 billion by 2050, new artificial intelligence (AI) technology may aid providers in addressing SDOH. In this commentary, we present our experience with using ChatGPT to obtain SDOH management recommendations for archetypal patients in Philadelphia, PA. ChatGPT identified …

Making The Most Of Artificial Intelligence And Large Language Models: A Novel Approach For Book Recommendation And Discovery In Medical Libraries, Ivan Portillo, David Carson

Library Presentations, Posters, and Audiovisual Materials

This poster presentation evaluates the use of Artificial Intelligence and large language models (LLMs) to assist health science libraries in recommending and discovering book titles as part of their collection development. Using pre-determined prompts, the researchers evaluated ChatGPT 4.0, Bing Chat, and Google Bard as recommender systems for book discovery and ranking existing titles.

Supporting South Korea’S Aging Population: How Ai And Iot Acceptance Connects The Young And Old, Bobby Im

Master's Projects and Capstones

In 2024, South Korea surpassed every other nation by becoming the country with the lowest fertility rate (below 0.7%). Population decline will hinder future ability to care for their aging population and although the government and private corporations are investing millions of dollars on developing Artificial Intelligence-Internet of Things (AI-IoT) devices to support the aging, the acceptance levels and the amount of family support required is undervalued. By examining AI-IoT’s current use and role in South Korea’s public health system this paper shows how intergenerational support helps optimize existing procedures and equipment, increases the level of acceptance and use, and …

Missing Wedge Completion Via Unsupervised Learning With Coordinate Networks, Dave Van Veen, Jesús G Galaz-Montoya, Liyue Shen, Philip Baldwin, Akshay S Chaudhari, Dmitry Lyumkis, Michael F Schmid, Wah Chiu, John Pauly

Faculty, Staff and Students Publications

Cryogenic electron tomography (cryoET) is a powerful tool in structural biology, enabling detailed 3D imaging of biological specimens at a resolution of nanometers. Despite its potential, cryoET faces challenges such as the missing wedge problem, which limits reconstruction quality due to incomplete data collection angles. Recently, supervised deep learning methods leveraging convolutional neural networks (CNNs) have considerably addressed this issue; however, their pretraining requirements render them susceptible to inaccuracies and artifacts, particularly when representative training data is scarce. To overcome these limitations, we introduce a proof-of-concept unsupervised learning approach using coordinate networks (CNs) that optimizes network weights directly against input …

Accuracy Of Machine Learning To Predict The Outcomes Of Shoulder Arthroplasty: A Systematic Review, Amir H. Karimi, Joshua Langberg, Ajith Malige, Omar Rahman, Joseph A. Abboud, Michael A. Stone

Department of Orthopaedic Surgery Faculty Papers

BACKGROUND: Artificial intelligence (AI) uses computer systems to simulate cognitive capacities to accomplish goals like problem-solving and decision-making. Machine learning (ML), a branch of AI, makes algorithms find connections between preset variables, thereby producing prediction models. ML can aid shoulder surgeons in determining which patients may be susceptible to worse outcomes and complications following shoulder arthroplasty (SA) and align patient expectations following SA. However, limited literature is available on ML utilization in total shoulder arthroplasty (TSA) and reverse TSA.

METHODS: A systematic literature review in accordance with PRISMA guidelines was performed to identify primary research articles evaluating ML's ability to …