Artificial Intelligence and Robotics Commons^™

Use Of Ai To Recreate And Repatriate Lost, Destroyed Or Stolen Paintings: The 1785 Parisian Salon Case Study, Charles E. O'Brien, James Hutson, Trent Olsen, Jay Ratican

Faculty Scholarship

This study investigates the efficacy of artificial intelligence (AI) in the field of artwork restoration, focusing on lost, stolen, or destroyed artworks. Employing a dual approach that combines traditional manual restoration techniques with advanced generative AI tools, the research centers on a case study of the 1785 Parisian Salon. It specifically examines the reconstitution of Antoine François Callet's painting, Achilles Dragging the Body of Hector, unveiled alongside Jacques-Louis David's Oath of the Horatii. The study utilizes Easy Diffusion and Stable Diffusion 2.1 technologies for inpainting and colorization processes. These AI tools are employed in concert with manual restoration practices to …

Leveraging Artificial Intelligence For Team Cognition In Human-Ai Teams, Beau Schelble

All Dissertations

Advances in artificial intelligence (AI) technologies have enabled AI to be applied across a wide variety of new fields like cryptography, art, and data analysis. Several of these fields are social in nature, including decision-making and teaming, which introduces a new set of challenges for AI research. While each of these fields has its unique challenges, the area of human-AI teaming is beset with many that center around the expectations and abilities of AI teammates. One such challenge is understanding team cognition in these human-AI teams and AI teammates' ability to contribute towards, support, and encourage it. Team cognition is …

Essence As Algorithm: Public Perceptions Of Ai-Powered Avatars Of Real People, James Hutson, Jay Ratican, Colleen Biri

Faculty Scholarship

This paper investigates the intersection of generative AI, Large Language Models (LLM), and robotics. Exemplified by systems like ChatGPT and technological marvels such as Ameca the Robot, the combination of technologies will allow humans to transcend the limitations of death. Through digital necromancy, a practice encompassing the technological resurrection of deceased individuals, the ability to not only passively see recordings of loved ones but to interact with them is made possible, leading to ethical and psychological considerations. Therefore, examining these trends extends into the motives underlying engagement with both incorporeal and corporeal reproductions of individuals, with reasons ranging from memory …

Forecasting Traffic Speed During Daytime From Google Street View Images Using Deep Learning, Junfeng Jiao, Huihai Wang

Research Collection College of Integrative Studies

Traffic forecasting plays an important role in urban planning. Deep learning methods outperform traditional traffic flow forecasting models because of their ability to capture spatiotemporal characteristics of traffic conditions. However, these methods require high-quality historical traffic data, which can be both difficult to acquire and non-comprehensive, making it hard to predict traffic flows at the city scale. To resolve this problem, we implemented a deep learning method, SceneGCN, to forecast traffic speed at the city scale. The model involves two steps: firstly, scene features are extracted from Google Street View (GSV) images for each road segment using pretrained Resnet18 models. …

Marss: Multi-Agent Reinforcement Learning For Satellite Swarms, Nicholas J. Yielding

Theses and Dissertations

Multi-agent systems and swarms in spacecraft formation flying are of ever-increasing importance in a contested space environment—use of multiple spacecraft to contribute to a cooperative mission potentially increases positive outcomes on orbit, while autonomy becomes an ever more important requirement to reduce reaction time in dynamic situations and lower the burden on space operators. This research explores difficult swarm Guidance Navigation and Control (GNC) scenarios using Deep Reinforcement Learning (DRL). DRL polices are trained to provide guidance inputs to agents in multi-agent swarm environments for completing complex, teamwork focused objectives in geosynchronous orbit. An example scenario is explored for a …

Evaluating The Efficacy Of Chatgpt In Navigating The Spanish Medical Residency Entrance Examination (Mir): Promising Horizons For Ai In Clinical Medicine., Francisco Guillen-Grima, Sara Guillen-Aguinaga, Laura Guillen-Aguinaga, Rosa Alas-Brun, Luc Onambele, Wilfrido Ortega, Rocio Montejo, Enrique Aguinaga-Ontoso, Paul Barach, Ines Aguinaga-Ontoso

Department of Medicine Faculty Papers

UNLABELLED: The rapid progress in artificial intelligence, machine learning, and natural language processing has led to increasingly sophisticated large language models (LLMs) for use in healthcare. This study assesses the performance of two LLMs, the GPT-3.5 and GPT-4 models, in passing the MIR medical examination for access to medical specialist training in Spain. Our objectives included gauging the model's overall performance, analyzing discrepancies across different medical specialties, discerning between theoretical and practical questions, estimating error proportions, and assessing the hypothetical severity of errors committed by a physician.

MATERIAL AND METHODS: We studied the 2022 Spanish MIR examination results after excluding …

The Fast And The Curious: Accelerating Literature Reviews With Ai, Jennifer Freer, Natalia Tingle Dolan, Gabrielle Wiersma

Presentations and other scholarship

As the world of academic research shifts gears into the digital age, AI-powered tools are beginning to shape the scholarly landscape. Just as high-performance vehicles transformed the world of car racing, AI-powered tools like scite, Elicit, and Research Rabbit have the potential to revolutionize the traditional literature review process. This presentation will accelerate your understanding of AI literature review tools and how these technologies can turbocharge the research process. Navigating between traditional library tools and AI-powered systems can be like choosing the right vehicle for the race. AI tools can enhance the speed, depth, and breadth of literature reviews, allowing …

Human Vs Machine: Hyper-Realistic Avatars And Their Efficacy As A Communication Channel, Jill S. Schiefelbein

USF Tampa Graduate Theses and Dissertations

Hyper-realistic avatars (HRAs), a form of synthetic media, are custom-created digital embodiments of a human, created by capturing and combining that person’s video and vocal likeness. This is the first known study of the efficacy of videos delivered by hyper-realistic avatars as a communication channel in comparison to videos delivered by their human counterparts. An experiment testing how information retention, engagement, and trust vary between viewers of videos delivered by a real human, videos delivered by the HRA representing that same human, and videos delivered by the HRA that discloses to viewers that it is a hyper-realistic avatar is presented. …

Smart Street Light Control: A Review On Methods, Innovations, And Extended Applications, Fouad Agramelal, Mohamed Sadik, Youssef Moubarak, Saad Abouzahir

Computer Vision Faculty Publications

As urbanization increases, streetlights have become significant consumers of electrical power, making it imperative to develop effective control methods for sustainability. This paper offers a comprehensive review on control methods of smart streetlight systems, setting itself apart by introducing a novel light scheme framework that provides a structured classification of various light control patterns, thus filling an existing gap in the literature. Unlike previous studies, this work dives into the technical specifics of individual research papers and methodologies, ranging from basic to advanced control methods like computer vision and deep learning, while also assessing the energy consumption associated with each …

Limitations And Possibilities Of Digital Restoration Techniques Using Generative Ai Tools: Reconstituting Antoine François Callet’S Achilles Dragging Hector’S Body Past The Walls Of Troy, Charles O'Brien, James Hutson, Trent Olsen, Jay Ratican

Faculty Scholarship

Digital restoration offers new avenues for conserving historical artworks, yet presents unique challenges. This research delves into the balance between traditional restoration methods and the use of generative artificial intelligence (AI) tools, using Antoine François Callet’s portrayal of Achilles Dragging Hector’s Body Past the Walls of Troy as a case study. The application of Easy Diffusion and Stable Diffusion 2.1 technologies provides insights into AI-driven restoration methods such as inpainting and colorization. Results indicate that while AI can streamline the restoration process, repeated inpainting can compromise the painting’s color quality and detailed features. Furthermore, the AI approach occasionally introduces unintended …

Healthaichain: Improving Security And Safety Using Blockchain Technology Applications In Ai-Based Healthcare Systems, Naresh Kshetri, James Hutson, Revathy G

Faculty Scholarship

Blockchain as a digital ledger for keeping records of digital transactions and other information, it is secure and decentralized technology. The globally growing number of digital population every day possesses a significant threat to online data including the medical and patients’ data. After bitcoin, blockchain technology has emerged into a general-purpose technology with applications in medical industries and healthcare. Blockchain can promote highly configurable openness while retaining the highest security standards for critical data of medical patients. Referred to as distributed record keeping for healthcare systems which makes digital assets unalterable and transparent via a cryptographic hash and decentralized network. …

Digitizing The Cultural Capital: Harnessing Digital Humanities For Heritage Preservation In Bujumbura, Burundi, James Hutson, Pace Ellsworth, Matt Ellsworth, Jean Bosco Ntungirimana

Faculty Scholarship

In an era where the erosion of cultural heritage is increasingly prevalent, there exists a critical imperative to explore and implement innovative methods for the preservation and revitalization of cultural identities, as exemplified by the urgent situation in Bujumbura, Burundi. Central to this study is the exploration of innovative digital methodologies for archiving a wide spectrum of cultural artifacts, including both notable and everyday heritage elements, in Bujumbura. Traditional approaches to biographical and historical profiling have predominantly focused on official records and significant events, often neglecting the richness of personal experiences and everyday interactions that substantially shape cultural identities. To …

Individuality And The Collective In Ai Agents: Explorations Of Shared Consciousness And Digital Homunculi In The Metaverse For Cultural Heritage, James Hutson, Jay Ratican

Faculty Scholarship

The confluence of extended reality (XR) technologies, including augmented and virtual reality, with large language models (LLM) marks a significant advancement in the field of digital humanities, opening uncharted avenues for the representation of cultural heritage within the burgeoning metaverse. This paper undertakes an examination of the potentialities and intricacies of such a convergence, focusing particularly on the creation of digital homunculi or changelings. These virtual beings, remarkable for their sentience and individuality, are also part of a collective consciousness, a notion explored through a thematic comparison in science fiction with the Borg and the Changelings in the Star Trek …

Examining The Externalities Of Highway Capacity Expansions In California: An Analysis Of Land Use And Land Cover (Lulc) Using Remote Sensing Technology, Serena E. Alexander, Bo Yang, Owen Hussey, Derek Hicks

Mineta Transportation Institute

There are over 590,000 bridges dispersed across the roadway network that stretches across the United States alone. Each bridge with a length of 20 feet or greater must be inspected at least once every 24 months, according to the Federal Highway Act (FHWA) of 1968. This research developed an artificial intelligence (AI)-based framework for bridge and road inspection using drones with multiple sensors collecting capabilities. It is not sufficient to conduct inspections of bridges and roads using cameras alone, so the research team utilized an infrared (IR) camera along with a high-resolution optical camera. In many instances, the IR camera …

A Review Of Cyber Attacks On Sensors And Perception Systems In Autonomous Vehicle, Taminul Islam, Md. Alif Sheakh, Anjuman Naher Jui, Omar Sharif, Md Zobaer Hasan

School of Mathematical & Statistical Sciences Faculty Publications

Vehicle automation has been in the works for a long time now. Automatic brakes, cruise control, GPS satellite navigation, etc. are all common features seen in today's automobiles. Automation and artificial intelligence breakthroughs are likely to lead to an increase in the usage of automation technologies in cars. Because of this, mankind will be more reliant on computer-controlled equipment and car systems in our daily lives. All major corporations have begun investing in the development of self-driving cars because of the rapid advancement of advanced driver support technologies. However, the level of safety and trustworthiness is still questionable. Imagine what …

Designing Depaul

DePaul Magazine

DePaul’s comprehensive, collaborative plan creates a road map that positions the university for monumental impact.

Ai And The Creative Process: Part Three, James Hutson

Faculty Scholarship

Article discussing the effects of artificial intelligence on the creative process in the art world.

A Psychometric Analysis Of Natural Language Inference Using Transformer Language Models, Antonio Laverghetta Jr.

USF Tampa Graduate Theses and Dissertations

Large language models (LLMs) are poised to transform both academia and industry. But the excitement around these generative AIs has also been met with concern for the true extent of their capabilities. This dissertation helps to address these questions by examining the capabilities of LLMs using the tools of psychometrics. We focus on analyzing the capabilities of LLMs on the task of natural language inference (NLI), a foundational benchmark often used to evaluate new models. We demonstrate that LLMs can reliably predict the psychometric properties of NLI items were those items administered to humans. Through a series of experiments, we …

Metaverse Key Requirements And Platforms Survey, Akbobek Abilkaiyrkyzy, Ahmed Elhagry, Fedwa Laamarti, Abdulmotaleb El Saddik

Computer Vision Faculty Publications

The growing interest in the metaverse has led to an abundance of platforms, each with its own unique features and limitations. This paper's objective is two-fold. First, we aim at providing an objective analysis of requirements that need to be fulfilled by metaverse platforms. We survey a broad set of criteria including interoperability, immersiveness, persistence, multimodal and social interaction, scalability, level of openness, configurability, market access, security, and blockchain integration, among others. Second, we review a wide range of existing metaverse platforms, and we critically evaluate their ability to meet the requirements listed. We identify their limitations, which must be …

Ai As A License Review Assistant, Nat Gustafson-Sundell

Library Services Publications

I will present the steps we have taken to develop a prototype AI assistant for license review. I’ll explain our criteria for the selection of an AI tool for this project. We reviewed ChatGPT, Claude 2, Bard, and PDF readers. My goal was to develop an initial prototype in a Jupyter Notebook environment so I could easily re-load context information, including a license checklist, but I’ll explain why I revised this goal, instead to linger over license review interactions with ChatBots. I’ll discuss early results, demonstrate example license review interactions, and outline my next steps.

Dtitd: An Intelligent Insider Threat Detection Framework Based On Digital Twin And Self-Attention Based Deep Learning Models, Zhi Qiang Wang, Abdulmotaleb El Saddik

Computer Vision Faculty Publications

Recent statistics and studies show that the loss generated by insider threats is much higher than that generated by external attacks. More and more organizations are investing in or purchasing insider threat detection systems to prevent insider risks. However, the accurate and timely detection of insider threats faces significant challenges. In this study, we proposed an intelligent insider threat detection framework based on Digital Twins and self-attentions based deep learning models. First, this paper introduces insider threats and the challenges in detecting them. Then this paper presents recent related works on solving insider threat detection problems and their limitations. Next, …

Synthesizing Sentience: Integrating Large Language Models And Autonomous Agents For Emulating Human Cognitive Complexity, Jay Ratican, James Hutson, Daniel Plate

Faculty Scholarship

The paper aims to present a novel methodology for emulating the intricacies of human cognitive complexity by ingeniously integrating large language models with autonomous agents. Grounded in the theoretical framework of the modular mind theory-originally espoused by Fodor and later refined by scholars such as Joanna Bryson—the study seeks to venture into the untapped potential of large language models and autonomous agents in mirroring human cognition. Recent advancements in artificial intelligence, exemplified by the inception of autonomous agents like Age in GPT, auto GPT, and baby AGI, underscore the transformative capacities of these technologies in diverse applications. Moreover, empirical studies …

Object Recognition With Deep Neural Networks In Low-End Systems, Lillian Davis

Mahurin Honors College Capstone Experience/Thesis Projects

Object recognition is an important area in computer vision. Object recognition has been advanced significantly by deep learning that unifies feature extraction and classification. In general, deep neural networks, such as Convolution Neural Networks (CNNs), are trained in high-performance systems. Aiming to extend the reach of deep learning to personal computing, I propose a study of deep learning-based object recognition in low-end systems, such as laptops. This research includes how differing layer configurations and hyperparameter values used in CNNs can either create or resolve the issue of overfitting and affect final accuracy levels of object recognition systems. The main contribution …

A Gentle Introduction To Chatgpt, Steven W. Holloway

Libraries

A guest lecture on the state of commercial generative transformer technology, mid-2023, to a general audience at Staunton Public Library.

Perceptions And Barriers To Adopting Artificial Intelligence In K-12 Education: A Survey Of Educators In Fifty States, Karen Woodruff, James Hutson, Kathryn Arnone

Faculty Scholarship

Artificial Intelligence (AI) is making significant strides in the field of education, offering new opportunities for personalized learning and access to education for a more diverse population. Despite this potential, the adoption of AI in K-12 education is limited, and educators’ express hesitancy towards its integration due to perceived technological barriers and misconceptions. The purpose of this study is to examine the perceptions of K-12 educators in all 50 states of the USA towards AI, policies, training, and resources related to technology and AI, their comfort with technology, willingness to adopt new technologies for classroom instruction, and needs assessment for …

Ai-Supported Academic Advising: Exploring Chatgpt’S Current State And Future Potential Toward Student Empowerment, Daisuke Akiba, Michelle C. Fraboni

Publications and Research

Artificial intelligence (AI), once a phenomenon primarily in the world of science fiction, has evolved rapidly in recent years, steadily infiltrating into our daily lives. ChatGPT, a freely accessible AI-powered large language model designed to generate human-like text responses to users, has been utilized in several areas, such as the healthcare industry, to facilitate interactive dissemination of information and decision-making. Academic advising has been essential in promoting success among university students, particularly those from disadvantaged backgrounds. Unfortunately, however, student advising has been marred with problems, with the availability and accessibility of adequate advising being among the hurdles. The current study …

Artificial Intelligence In Cardiology: An Australian Perspective, Biyanka Jaltotage, Abdul R. Ihdayhid, Nick S. R. Lan, Faraz Pathan, Sanjay Patel, Clare Arnott, Gemma Figtree, Leonard Kritharides, Syed M. S. Islam, Clara K. Chow, James M. Rankin, Stephen J. Nicholls, Girish Dwivedi

Research outputs 2022 to 2026

Significant advances have been made in artificial intelligence technology in recent years. Many health care applications have been investigated to assist clinicians and the technology is close to being integrated into routine clinical practice. The high prevalence of cardiac disease in Australia places overwhelming demands on the existing health care system, challenging its capacity to provide quality patient care. Artificial intelligence has emerged as a promising solution. This discussion paper provides an Australian perspective on the current state of artificial intelligence in cardiology, including the benefits and challenges of implementation. This paper highlights some current artificial intelligence applications in cardiology, …

Framing And Intentionality In Artificial Intelligence Poetry, Alyson Elaine Marie Nichols

Student Theses and Dissertations

As natural language generation expands, increasing attention has been paid to neural networks and other machine learning techniques. This study offers a cheaper, simpler approach in the field of poetry generation. The Empath system uses a random-grammar model to constrain creativity with syntactical rules in order to produce novel and valuable poetry after the style of Emily Dickinson. It pays specific attention to using related words to create a sense of coherence and implements a framing system to prove that its creative choices are intentional. A survey of 118 students and teachers at Arkansas State University shows that Empath’s products …

Vision Language Navigation With Knowledge-Driven Environmental Dreamer, Fengda Zhu, Vincent C.S. Lee, Xiaojun Chang, Xiaodan Liang

Computer Vision Faculty Publications

Vision-language navigation (VLN) requires an agent to perceive visual observation in a house scene and navigate step-by-step following natural language instruction. Due to the high cost of data annotation and data collection, current VLN datasets provide limited instruction-trajectory data samples. Learning vision-language alignment for VLN from limited data is challenging since visual observation and language instruction are both complex and diverse. Previous works only generate augmented data based on original scenes while failing to generate data samples from unseen scenes, which limits the generalization ability of the navigation agent. In this paper, we introduce the Knowledge-driven Environmental Dreamer (KED), a …

Controllable Language Generation Using Deep Learning, Rohola Zandie

Electronic Theses and Dissertations

The advent of deep neural networks has sparked a revolution in Artificial Intelligence (AI), notably with the creation of Transformer models like GPT-X and ChatGPT. These models have surpassed previous methods in various Natural Language Processing (NLP) tasks. As the NLP field evolves, there is a need to further understand and question the capabilities of these models. Text generation, a crucial part of NLP, remains an area where our comprehension is limited while being critical in research.

This dissertation focuses on the challenging problem of controlling the general behaviors of language models such as sentiment, topical focus, and logical reasoning. …