Physical Sciences and Mathematics Commons^™

Role Of Authentication Factors In Fin-Tech Mobile Transaction Security, Habib Ullah Khan, Muhammad Sohail, Shah Nazir, Tariq Hussain, Babar Shah, Farman Ali

All Works

Fin-Tech is the merging of finance and technology, to be considered a key term for technology-based financial operations and money transactions as far as Fin-Tech is concerned. In the massive field of business, mobile money transaction security is a great challenge for researchers. The user authentication schemes restrict the ability to enforce the authentication before the account can access and operate. Although authentication factors provide greater security than a simple static password, financial transactions have potential drawbacks because cybercrime expands the opportunities for fraudsters. The most common enterprise challenge is mobile-based user authentication during transactions, which addresses the security issues …

Development Of An Explainable Artificial Intelligence Model For Asian Vascular Wound Images, Zhiwen Joseph Lo, Malcolm Han Wen Mak, Shanying Liang, Yam Meng Chan, Cheng Cheng Goh, Tina Peiting Lai, Audrey Hui Min Tan, Patrick Thng, Patrick Thng, Tillman Weyde, Sylvia Smit

Research Collection School Of Computing and Information Systems

Chronic wounds contribute to significant healthcare and economic burden worldwide. Wound assessment remains challenging given its complex and dynamic nature. The use of artificial intelligence (AI) and machine learning methods in wound analysis is promising. Explainable modelling can help its integration and acceptance in healthcare systems. We aim to develop an explainable AI model for analysing vascular wound images among an Asian population. Two thousand nine hundred and fifty-seven wound images from a vascular wound image registry from a tertiary institution in Singapore were utilized. The dataset was split into training, validation and test sets. Wound images were classified into …

Use Of Ai To Recreate And Repatriate Lost, Destroyed Or Stolen Paintings: The 1785 Parisian Salon Case Study, Charles E. O'Brien, James Hutson, Trent Olsen, Jay Ratican

Faculty Scholarship

This study investigates the efficacy of artificial intelligence (AI) in the field of artwork restoration, focusing on lost, stolen, or destroyed artworks. Employing a dual approach that combines traditional manual restoration techniques with advanced generative AI tools, the research centers on a case study of the 1785 Parisian Salon. It specifically examines the reconstitution of Antoine François Callet's painting, Achilles Dragging the Body of Hector, unveiled alongside Jacques-Louis David's Oath of the Horatii. The study utilizes Easy Diffusion and Stable Diffusion 2.1 technologies for inpainting and colorization processes. These AI tools are employed in concert with manual restoration practices to …

Leveraging Generative Agents: Autonomous Ai With Simulated Personas For Interactive Simulacra And Collaborative Research, James Hutson, Jay Ratican

Faculty Scholarship

The advent of large language models (LLMs) and AI learning have fundamentally reshaped the research landscape, paving the way for novel problem-solving approaches. This paper introduces a unique framework that leverages the capabilities of autonomous AI agents with simulated personas to drive collaborative research in groundbreaking ways. Inspired by a recent study of autonomous agents mirroring human behavior, this concept encourages the use of a cadre of AI agents, each possessing specialized expertise for collective endeavors. By replicating human diversity in teamwork, this approach targets complex and hitherto unsolvable issues. The key to this strategy is persona and emotional simulation, …

Essence As Algorithm: Public Perceptions Of Ai-Powered Avatars Of Real People, James Hutson, Jay Ratican, Colleen Biri

Faculty Scholarship

This paper investigates the intersection of generative AI, Large Language Models (LLM), and robotics. Exemplified by systems like ChatGPT and technological marvels such as Ameca the Robot, the combination of technologies will allow humans to transcend the limitations of death. Through digital necromancy, a practice encompassing the technological resurrection of deceased individuals, the ability to not only passively see recordings of loved ones but to interact with them is made possible, leading to ethical and psychological considerations. Therefore, examining these trends extends into the motives underlying engagement with both incorporeal and corporeal reproductions of individuals, with reasons ranging from memory …

Evaluating The Efficacy Of Chatgpt In Navigating The Spanish Medical Residency Entrance Examination (Mir): Promising Horizons For Ai In Clinical Medicine., Francisco Guillen-Grima, Sara Guillen-Aguinaga, Laura Guillen-Aguinaga, Rosa Alas-Brun, Luc Onambele, Wilfrido Ortega, Rocio Montejo, Enrique Aguinaga-Ontoso, Paul Barach, Ines Aguinaga-Ontoso

Department of Medicine Faculty Papers

UNLABELLED: The rapid progress in artificial intelligence, machine learning, and natural language processing has led to increasingly sophisticated large language models (LLMs) for use in healthcare. This study assesses the performance of two LLMs, the GPT-3.5 and GPT-4 models, in passing the MIR medical examination for access to medical specialist training in Spain. Our objectives included gauging the model's overall performance, analyzing discrepancies across different medical specialties, discerning between theoretical and practical questions, estimating error proportions, and assessing the hypothetical severity of errors committed by a physician.

MATERIAL AND METHODS: We studied the 2022 Spanish MIR examination results after excluding …

The Fast And The Curious: Accelerating Literature Reviews With Ai, Jennifer Freer, Natalia Tingle Dolan, Gabrielle Wiersma

Presentations and other scholarship

As the world of academic research shifts gears into the digital age, AI-powered tools are beginning to shape the scholarly landscape. Just as high-performance vehicles transformed the world of car racing, AI-powered tools like scite, Elicit, and Research Rabbit have the potential to revolutionize the traditional literature review process. This presentation will accelerate your understanding of AI literature review tools and how these technologies can turbocharge the research process. Navigating between traditional library tools and AI-powered systems can be like choosing the right vehicle for the race. AI tools can enhance the speed, depth, and breadth of literature reviews, allowing …

The Age Of Synthetic Realities: Challenges And Opportunities, João Phillipe Cardenuto, Jing Yang, Rafael Padilha, Renjie Wan, Daniel Moreira, Haoliang Li, Shiqi Wang, Fernanda Andaló, Sébastien Marcel, Anderson Rocha

Computer Science: Faculty Publications and Other Works

Synthetic realities are digital creations or augmentations that are contextually generated through the use of Artificial Intelligence (AI) methods, leveraging extensive amounts of data to construct new narratives or realities, regardless of the intent to deceive. In this paper, we delve into the concept of synthetic realities and their implications for Digital Forensics and society at large within the rapidly advancing field of AI. We highlight the crucial need for the development of forensic techniques capable of identifying harmful synthetic creations and distinguishing them from reality. This is especially important in scenarios involving the creation and dissemination of fake news, …

Smart Street Light Control: A Review On Methods, Innovations, And Extended Applications, Fouad Agramelal, Mohamed Sadik, Youssef Moubarak, Saad Abouzahir

Computer Vision Faculty Publications

As urbanization increases, streetlights have become significant consumers of electrical power, making it imperative to develop effective control methods for sustainability. This paper offers a comprehensive review on control methods of smart streetlight systems, setting itself apart by introducing a novel light scheme framework that provides a structured classification of various light control patterns, thus filling an existing gap in the literature. Unlike previous studies, this work dives into the technical specifics of individual research papers and methodologies, ranging from basic to advanced control methods like computer vision and deep learning, while also assessing the energy consumption associated with each …

A Review Of Cyber Attacks On Sensors And Perception Systems In Autonomous Vehicle, Taminul Islam, Md. Alif Sheakh, Anjuman Naher Jui, Omar Sharif, Md Zobaer Hasan

School of Mathematical and Statistical Sciences Faculty Publications and Presentations

Vehicle automation has been in the works for a long time now. Automatic brakes, cruise control, GPS satellite navigation, etc. are all common features seen in today's automobiles. Automation and artificial intelligence breakthroughs are likely to lead to an increase in the usage of automation technologies in cars. Because of this, mankind will be more reliant on computer-controlled equipment and car systems in our daily lives. All major corporations have begun investing in the development of self-driving cars because of the rapid advancement of advanced driver support technologies. However, the level of safety and trustworthiness is still questionable. Imagine what …

Examining The Externalities Of Highway Capacity Expansions In California: An Analysis Of Land Use And Land Cover (Lulc) Using Remote Sensing Technology, Serena E. Alexander, Bo Yang, Owen Hussey, Derek Hicks

Mineta Transportation Institute

There are over 590,000 bridges dispersed across the roadway network that stretches across the United States alone. Each bridge with a length of 20 feet or greater must be inspected at least once every 24 months, according to the Federal Highway Act (FHWA) of 1968. This research developed an artificial intelligence (AI)-based framework for bridge and road inspection using drones with multiple sensors collecting capabilities. It is not sufficient to conduct inspections of bridges and roads using cameras alone, so the research team utilized an infrared (IR) camera along with a high-resolution optical camera. In many instances, the IR camera …

Individuality And The Collective In Ai Agents: Explorations Of Shared Consciousness And Digital Homunculi In The Metaverse For Cultural Heritage, James Hutson, Jay Ratican

Faculty Scholarship

The confluence of extended reality (XR) technologies, including augmented and virtual reality, with large language models (LLM) marks a significant advancement in the field of digital humanities, opening uncharted avenues for the representation of cultural heritage within the burgeoning metaverse. This paper undertakes an examination of the potentialities and intricacies of such a convergence, focusing particularly on the creation of digital homunculi or changelings. These virtual beings, remarkable for their sentience and individuality, are also part of a collective consciousness, a notion explored through a thematic comparison in science fiction with the Borg and the Changelings in the Star Trek …

Healthaichain: Improving Security And Safety Using Blockchain Technology Applications In Ai-Based Healthcare Systems, Naresh Kshetri, James Hutson, Revathy G

Faculty Scholarship

Blockchain as a digital ledger for keeping records of digital transactions and other information, it is secure and decentralized technology. The globally growing number of digital population every day possesses a significant threat to online data including the medical and patients’ data. After bitcoin, blockchain technology has emerged into a general-purpose technology with applications in medical industries and healthcare. Blockchain can promote highly configurable openness while retaining the highest security standards for critical data of medical patients. Referred to as distributed record keeping for healthcare systems which makes digital assets unalterable and transparent via a cryptographic hash and decentralized network. …

Limitations And Possibilities Of Digital Restoration Techniques Using Generative Ai Tools: Reconstituting Antoine François Callet’S Achilles Dragging Hector’S Body Past The Walls Of Troy, Charles O'Brien, James Hutson, Trent Olsen, Jay Ratican

Faculty Scholarship

Digital restoration offers new avenues for conserving historical artworks, yet presents unique challenges. This research delves into the balance between traditional restoration methods and the use of generative artificial intelligence (AI) tools, using Antoine François Callet’s portrayal of Achilles Dragging Hector’s Body Past the Walls of Troy as a case study. The application of Easy Diffusion and Stable Diffusion 2.1 technologies provides insights into AI-driven restoration methods such as inpainting and colorization. Results indicate that while AI can streamline the restoration process, repeated inpainting can compromise the painting’s color quality and detailed features. Furthermore, the AI approach occasionally introduces unintended …

Digitizing The Cultural Capital: Harnessing Digital Humanities For Heritage Preservation In Bujumbura, Burundi, James Hutson, Pace Ellsworth, Matt Ellsworth, Jean Bosco Ntungirimana

Faculty Scholarship

In an era where the erosion of cultural heritage is increasingly prevalent, there exists a critical imperative to explore and implement innovative methods for the preservation and revitalization of cultural identities, as exemplified by the urgent situation in Bujumbura, Burundi. Central to this study is the exploration of innovative digital methodologies for archiving a wide spectrum of cultural artifacts, including both notable and everyday heritage elements, in Bujumbura. Traditional approaches to biographical and historical profiling have predominantly focused on official records and significant events, often neglecting the richness of personal experiences and everyday interactions that substantially shape cultural identities. To …

Laf: Labeling-Free Model Selection For Automated Deep Neural Network Reusing, Qiang Hu, Yuejun Guo, Xiaofei Xie, Maxime Cordy, Mike Papadakis, Yves Le Traon

Research Collection School Of Computing and Information Systems

pplying deep learning (DL) to science is a new trend in recent years, which leads DL engineering to become an important problem. Although training data preparation, model architecture design, and model training are the normal processes to build DL models, all of them are complex and costly. Therefore, reusing the open-sourced pre-trained model is a practical way to bypass this hurdle for developers. Given a specific task, developers can collect massive pre-trained deep neural networks from public sources for reusing. However, testing the performance (e.g., accuracy and robustness) of multiple deep neural networks (DNNs) and recommending which model should be …

Ai And The Creative Process: Part Three, James Hutson

Faculty Scholarship

Article discussing the effects of artificial intelligence on the creative process in the art world.

Metaverse Key Requirements And Platforms Survey, Akbobek Abilkaiyrkyzy, Ahmed Elhagry, Fedwa Laamarti, Abdulmotaleb El Saddik

Computer Vision Faculty Publications

The growing interest in the metaverse has led to an abundance of platforms, each with its own unique features and limitations. This paper's objective is two-fold. First, we aim at providing an objective analysis of requirements that need to be fulfilled by metaverse platforms. We survey a broad set of criteria including interoperability, immersiveness, persistence, multimodal and social interaction, scalability, level of openness, configurability, market access, security, and blockchain integration, among others. Second, we review a wide range of existing metaverse platforms, and we critically evaluate their ability to meet the requirements listed. We identify their limitations, which must be …

Ai As A License Review Assistant, Nat Gustafson-Sundell

Library Services Publications

I will present the steps we have taken to develop a prototype AI assistant for license review. I’ll explain our criteria for the selection of an AI tool for this project. We reviewed ChatGPT, Claude 2, Bard, and PDF readers. My goal was to develop an initial prototype in a Jupyter Notebook environment so I could easily re-load context information, including a license checklist, but I’ll explain why I revised this goal, instead to linger over license review interactions with ChatBots. I’ll discuss early results, demonstrate example license review interactions, and outline my next steps.

Dtitd: An Intelligent Insider Threat Detection Framework Based On Digital Twin And Self-Attention Based Deep Learning Models, Zhi Qiang Wang, Abdulmotaleb El Saddik

Computer Vision Faculty Publications

Recent statistics and studies show that the loss generated by insider threats is much higher than that generated by external attacks. More and more organizations are investing in or purchasing insider threat detection systems to prevent insider risks. However, the accurate and timely detection of insider threats faces significant challenges. In this study, we proposed an intelligent insider threat detection framework based on Digital Twins and self-attentions based deep learning models. First, this paper introduces insider threats and the challenges in detecting them. Then this paper presents recent related works on solving insider threat detection problems and their limitations. Next, …

Malfe—Malware Feature Engineering Generation Platform, Avinash Singh, Richard Adeyemi Ikuesan, Hein Venter

All Works

The growing sophistication of malware has resulted in diverse challenges, especially among security researchers who are expected to develop mechanisms to thwart these malicious attacks. While security researchers have turned to machine learning to combat this surge in malware attacks and enhance detection and prevention methods, they often encounter limitations when it comes to sourcing malware binaries. This limitation places the burden on malware researchers to create context-specific datasets and detection mechanisms, a time-consuming and intricate process that involves a series of experiments. The lack of accessible analysis reports and a centralized platform for sharing and verifying findings has resulted …

Synthesizing Sentience: Integrating Large Language Models And Autonomous Agents For Emulating Human Cognitive Complexity, Jay Ratican, James Hutson, Daniel Plate

Faculty Scholarship

The paper aims to present a novel methodology for emulating the intricacies of human cognitive complexity by ingeniously integrating large language models with autonomous agents. Grounded in the theoretical framework of the modular mind theory-originally espoused by Fodor and later refined by scholars such as Joanna Bryson—the study seeks to venture into the untapped potential of large language models and autonomous agents in mirroring human cognition. Recent advancements in artificial intelligence, exemplified by the inception of autonomous agents like Age in GPT, auto GPT, and baby AGI, underscore the transformative capacities of these technologies in diverse applications. Moreover, empirical studies …

Object Recognition With Deep Neural Networks In Low-End Systems, Lillian Davis

Mahurin Honors College Capstone Experience/Thesis Projects

Object recognition is an important area in computer vision. Object recognition has been advanced significantly by deep learning that unifies feature extraction and classification. In general, deep neural networks, such as Convolution Neural Networks (CNNs), are trained in high-performance systems. Aiming to extend the reach of deep learning to personal computing, I propose a study of deep learning-based object recognition in low-end systems, such as laptops. This research includes how differing layer configurations and hyperparameter values used in CNNs can either create or resolve the issue of overfitting and affect final accuracy levels of object recognition systems. The main contribution …

Deep Reinforcement Learning With Explicit Context Representation, Francisco Munguia-Galeano, Ah-Hwee Tan, Ze Ji

Research Collection School Of Computing and Information Systems

Though reinforcement learning (RL) has shown an outstanding capability for solving complex computational problems, most RL algorithms lack an explicit method that would allow learning from contextual information. On the other hand, humans often use context to identify patterns and relations among elements in the environment, along with how to avoid making wrong actions. However, what may seem like an obviously wrong decision from a human perspective could take hundreds of steps for an RL agent to learn to avoid. This article proposes a framework for discrete environments called Iota explicit context representation (IECR). The framework involves representing each state …

Perceptions And Barriers To Adopting Artificial Intelligence In K-12 Education: A Survey Of Educators In Fifty States, Karen Woodruff, James Hutson, Kathryn Arnone

Faculty Scholarship

Artificial Intelligence (AI) is making significant strides in the field of education, offering new opportunities for personalized learning and access to education for a more diverse population. Despite this potential, the adoption of AI in K-12 education is limited, and educators’ express hesitancy towards its integration due to perceived technological barriers and misconceptions. The purpose of this study is to examine the perceptions of K-12 educators in all 50 states of the USA towards AI, policies, training, and resources related to technology and AI, their comfort with technology, willingness to adopt new technologies for classroom instruction, and needs assessment for …

Ai-Supported Academic Advising: Exploring Chatgpt’S Current State And Future Potential Toward Student Empowerment, Daisuke Akiba, Michelle C. Fraboni

Publications and Research

Artificial intelligence (AI), once a phenomenon primarily in the world of science fiction, has evolved rapidly in recent years, steadily infiltrating into our daily lives. ChatGPT, a freely accessible AI-powered large language model designed to generate human-like text responses to users, has been utilized in several areas, such as the healthcare industry, to facilitate interactive dissemination of information and decision-making. Academic advising has been essential in promoting success among university students, particularly those from disadvantaged backgrounds. Unfortunately, however, student advising has been marred with problems, with the availability and accessibility of adequate advising being among the hurdles. The current study …

Vision Language Navigation With Knowledge-Driven Environmental Dreamer, Fengda Zhu, Vincent C.S. Lee, Xiaojun Chang, Xiaodan Liang

Computer Vision Faculty Publications

Vision-language navigation (VLN) requires an agent to perceive visual observation in a house scene and navigate step-by-step following natural language instruction. Due to the high cost of data annotation and data collection, current VLN datasets provide limited instruction-trajectory data samples. Learning vision-language alignment for VLN from limited data is challenging since visual observation and language instruction are both complex and diverse. Previous works only generate augmented data based on original scenes while failing to generate data samples from unseen scenes, which limits the generalization ability of the navigation agent. In this paper, we introduce the Knowledge-driven Environmental Dreamer (KED), a …

Artificial Intelligence Frameworks To Detect And Investigate The Pathophysiology Of Spaceflight Associated Neuro-Ocular Syndrome (Sans), Joshua Ong, Ethan Waisberg, Mouayad Masalkhi, Sharif Amit Kamran, Kemper Lowry, Prithul Sarker, Nasif Zaman, Phani Paladugu, Alireza Tavakkoli, Andrew G Lee

Student Papers, Posters & Projects

Spaceflight associated neuro-ocular syndrome (SANS) is a unique phenomenon that has been observed in astronauts who have undergone long-duration spaceflight (LDSF). The syndrome is characterized by distinct imaging and clinical findings including optic disc edema, hyperopic refractive shift, posterior globe flattening, and choroidal folds. SANS serves a large barrier to planetary spaceflight such as a mission to Mars and has been noted by the National Aeronautics and Space Administration (NASA) as a high risk based on its likelihood to occur and its severity to human health and mission performance. While it is a large barrier to future spaceflight, the underlying …

Accuracy Vs. Energy: An Assessment Of Bee Object Inference In Videos From On-Hive Video Loggers With Yolov3, Yolov4-Tiny, And Yolov7-Tiny, Vladimir A. Kulyukin, Aleksey V. Kulyukin

Computer Science Faculty and Staff Publications

A continuing trend in precision apiculture is to use computer vision methods to quantify characteristics of bee traffic in managed colonies at the hive's entrance. Since traffic at the hive's entrance is a contributing factor to the hive's productivity and health, we assessed the potential of three open-source convolutional network models, YOLOv3, YOLOv4-tiny, and YOLOv7-tiny, to quantify omnidirectional traffic in videos from on-hive video loggers on regular, unmodified one- and two-super Langstroth hives and compared their accuracies, energy efficacies, and operational energy footprints. We trained and tested the models with a 70/30 split on a dataset of 23,173 flying bees …

Enhancing Video-Based Learning Using Knowledge Tracing: Personalizing Students’ Learning Experience With Orbits, Shady Shehata, David Santandreu, Philip Purnell, Mark Thompson

Natural Language Processing Faculty Publications

As the world regains its footing following the COVID-19 pandemic, academia is striving to consolidate the gains made in students’ education experience. New technologies such as video-based learning have shown some early improvement in student learning and engagement. In this paper, we present ORBITS predictive engine at YOURIKA company, a video-based student support platform powered by knowledge tracing. In an exploratory case study of one master’s level Speech Processing course at the Mohamed Bin Zayed University of Artificial Intelligence (MBZUAI) in Abu Dhabi, half the students used the system while the other half did not. Student qualitative feedback was universally …