Artificial Intelligence and Robotics Commons^™

Humans Vs. Llms On Open Domain Scientific Claim Verification: A Baseline Study, Benjamin Curtis, Stefania Dzhaman, Matthew Maisonave, Jian Wu

Computer Science Faculty Publications

Verifying scientific claims is challenging for the general public because most people lack domain knowledge. Manual verification by subject domain experts is accurate, but it is obviously not scalable to meet the rising number of scientific claims on the Web. Whether the emerging large language models and large reasoning models can be used for scientific claim verification, and how their performances compare to humans, are still research questions. To this end, we developed a new benchmark MSVEC2 that consists of 138 claims from credible fact verification websites and science news outlets. Two tasks were given to both human and LLM …

Position: Benchmarking Is Broken - Don't Let Ai Be Its Own Judge, Zerui Cheng, Stella Wohnig, Ruchika Gupta, Samiul Alam, Tassallah Abdullahi, João Alves Ribeiro, Christian Nielsen-Garcia, Saif Mir, Siran Li, Jason Orender, Seyed Ali Bahrainian, Daniel Kirste, Aaron Gokaslan, Carsten Eickhoff, Pramod Viswanath, Ruben Wolff

Computer Science Faculty Publications

The meteoric rise of Artificial Intelligence (AI), with its rapidly expanding market capitalization, presents both transformative opportunities and critical challenges. Chief among these is the urgent need for a new, unified paradigm for trustworthy evaluation, as current benchmarks increasingly reveal critical vulnerabilities. Issues like data contamination and selective reporting by model developers fuel hype, while inadequate data quality control can lead to biased evaluations that, even if unintentionally, may favor specific approaches. As a flood of participants enters the AI space, this "Wild West" of assessment makes distinguishing genuine progress from exaggerated claims exceptionally difficult. Such ambiguity blurs scientific signals …

Human Perception Of Ai Capabilities At Classifying Perturbed Roadway Signs, Katherine R. Garcia, Jing Chen, Yanru Xiao, Scott Mishler, Cong Wang, Bin Hu

Computer Science Faculty Publications

Artificial Intelligence (AI) is crucial to numerous functions required for driving automation systems, including the computer vision techniques used to detect the roadway environment and make real-time decisions. However, the images used as inputs to the AI system may be maliciously perturbed, or manipulated, causing the AI system to make an incorrect classification. In this study, we examined humans’ perception of the AI’s computer vision capability of classifying various road sign images, including the original images, images with two different types of malicious attacks, and images that are scrambled randomly at the pixel level. Our results showed that participants rated …

How Do Selected Biomedical And Health Sciences Journals React To Submissions Of Artificial Intelligence (Ai) Assisted Manuscripts?, Misa Mi, Lin Wu, Yingting Zhang, Wendy Wu

Library Scholarly Publications

Background and Objectives: Generative artificial intelligence (GenAI) increasingly impacts research and scholarly communication. Given the evolving application of ChatGPT and other AI tools in scholarly communications, health sciences librarians must become cognizant of any existing journal publishing guidelines for AI-created or assisted manuscripts. The study aims to examine how scholarly biomedical and health sciences journals and publishers respond to submissions of these manuscripts and what requirements or policies have been put in place to guide and instruct authors on AI use.

Methods: We first retrieved and consolidated a list of journals representing disciplines in biomedical and health sciences from four …

Applying Transfer Learning For Street-Scale Nuisance Flood Forecasting In Coastal-Urban Cities, Binata Roy, Jonathan L. Goodall, Diana Mcspadden, Chetan Kumar, Steven Goldenberg, Yidi Wang, Malachi Schram

VMASC Publications

An important challenge with Machine Learning (ML) is its transferability; i.e., whether a ML model trained on one set of data can be applied to a second set of data without requiring full re-training of the model. Transfer Learning (TL) addresses this challenge by transferring knowledge learned in the source domain (the data it was trained on) to the target domain (a second set of data that is statistically different but related, which the model was not trained on). This study investigates the use of TL for street-scale nuisance flood forecasting by exploring whether a ML model trained for one …

A Bibliometric Analysis Of Ai-Driven Healthcare Literature Containing Kos Keywords: Trends, Themes, And Gaps, Julaine Clunis, Eric Asare

STEMPS Faculty Publications

As artificial intelligence (AI) becomes increasingly embedded in healthcare applications, concerns have emerged around the trustworthiness, interpretability, and context-awareness of these systems. Knowledge Organization Systems (KOS) hold considerable potential to address these challenges by supporting semantic standardization, explainability, and domain alignment. This study presents a bibliometric analysis of scholarly publications referencing both AI and healthcare concepts to examine how KOS are positioned within this evolving discourse. The findings indicate that while early literature frequently and explicitly referenced KOS—such as ontologies, controlled vocabularies, and classification systems—their visibility has declined relative to newer paradigms such as machine learning and large language models. …

Comprehensive Benchmarking Of Several Machine Learning And Bayesian Models For Early-Stage Diabetes Risk Prediction: A Large-Scale Comparative Study, Md. Iqbal Hossain, Najila Alam Porno

Mathematics & Statistics Faculty Publications

Diabetes remains a critical global health challenge, with early detection is crucial for effective management. This study presents a comprehensive benchmarking analysis of 14 diverse machine learning and Bayesian models for early-stage diabetes risk prediction using clinical data [2] from Sylhet, Bangladesh. This research evaluated traditional methods (Logistic Regression, Decision Trees), ensemble techniques (Random Forest, XGBoost, LightGBM), Bayesian approaches (BART, Bayesian Logistic Regression), and advanced neural architectures (Deep Belief Networks) using both 70-30 train-test splits and 10-fold cross-validation. The results demonstrate that ensemble methods consistently outperformed other approaches, with Random Forest(RF) achieving the highest cross-validated AUC (0.9951) and accuracy (0.9699). …

Digital Platform Transitions In The Finance Industry: Three Essays, Cheryll-Ann Wilson

2025

This three-paper dissertation is motivated by an emerging dichotomy in the financial sector: an increasing use of an open-source digital platform—the Python platform—in an industry that historically has been wedded to proprietary systems.

Chapter 1 is a qualitative pilot study to ascertain which factors are likely to motivate investment professionals to select Python versus other tools and/or technologies. I find that efficiency and access to industry-specific libraries—notably Pandas and NumPy—are significant motivators in their selection of Python over Excel. Chapters 2 and 3 examine the issues through a sequential, exploratory mixed methods approach.

Chapter 2—the qualitative field study—investigates how and …

Method Entity And Relation Extraction Based On Automatically Generated Syntactic Templates: A Case Study Of Csdn Artificial Intelligence Blog, Kuiliang Li, Bolin Huang

Journal of Scientific Information Research

[Purpose/significance]There are many relationships between method entities and application scenarios, problems,organizations and other entities. Extracting these entity relationships helps to capture the development trend of technology and promote the improvement of innovation ability.[Method/process]This paper discusses a method for extracting method entities and relations based on automatically generated syntactic templates. By designing a new adaptive template, the method improves flexibility and adaptability, reducing dependence on large-scale labeled data. Using a small number of seed triples, the method iteratively generates syntactic templates and extracts method entities and relations for the CSDN artificial intelligence topic blog. It also improves the extraction quality using …

A Proposed Ehrenfeucht-Fraïssé Game Model For Natural Language Processing Generative Adversarial Networks, Don Li

Anthós

Large Language Models (LLM’s) (e.g., ChatGPT) constitute both a significant research area and commercial application of AI. Current major LLM’s are built on Generative Pre-Trained Transformer (GPT) neural network architecture to perform natural language processing (NLP) tasks. Generative Adversarial Network (GAN) is another popular neural network architecture, which leverages a zero-sum game between constituent neural networks within the architecture to train the GAN, and is widely used for visual data applications. This article proposes a new GAN architecture for NLP: an EF-GAN whose underlying algorithm uses Ehrenfeucht–Fraïssé (EF) games, a game-theoretic approach from model theory to determine elementary equivalence of …

A Happy Medium?: Using Image Generators To Explore Solution-Focused Art Therapy’S Miracle Question, Daniel A. Hernried

Art Therapy | Master's Theses

This mixed methods, randomized, single-session study tested whether integrating text-to-image generations into Solution-Focused Brief Art Therapy alters therapeutic rapport and short-term outcomes relative to traditional artmaking materials. Participants were assigned by coin flip to create using either a text-to-image generator or convention media (23 per group), completing immediate and three-day follow-ups. Alliance was measured using DREAM (Dimensions of Regard, Empathy, and Authenticity Metric), and problems were rated pre/post; groups did not differ significantly on DREAM total or facets, and both modalities produced reliable pre-to-post reductions in problem severity. At the same time, process differences were pronounced: the AI condition showed …

Enhancing Adhd Diagnosis In College Students Using Multimodal Integration Of Nicats And Iva-2 Tools, Rushmila Shabneen

College of Graduate Studies: Theses & Dissertations

This study explores enhanced methods for accurately identifying Attention Deficit Hyperactivity Disorder (ADHD) indicators in college students. ADHD, a neurodevelopmental disorder, impacts attention, impulse control, and emotional regulation, often leading to academic and social difficulties. Many students remain undiagnosed due to symptom overlap with stress and other factors. Traditional tools like the IVA-2 assess behavioral responses but may not fully capture ADHD complexity. This research integrates IVA-2 data with multimodal metrics from the Non-Intrusive Classroom Attention Tracking System (NiCATS), which monitors facial expressions, eye movements, and computer interactions. Preliminary results show that combining these tools improves ADHD detection, reduces false …

Generative Ai And Finding The Law, Paul D. Callister

Faculty Works

Legal information science requires, among other things, principles and theories. The article states six principles or considerations that any discussion of generative AI large language models and their role in finding the law must include. The article concludes that law librarianship will increasingly become legal information science and require new paradigms. In addition to the six principles, the article applies ecological holistic media theory to understand the relationship of the legal community’s cognitive authority, institutions, techné (technology, medium and method), geopolitical factors, and the past and future to understand the changes in this information milieu. The article also explains generative …

Evaluating The Evaluators: The Role Of Benchmarks In Legal Ai, Jonathan A. Franklin, Sean Harrington, Christine Hye Won Park

Other Faculty Publications

No abstract provided.

Security Enhancement In Uav Swarms: A Case Study Using Federated Learning And Shap Analysis, Sushmitha Halli Sudhakara, Lida Haghnegahdar

School of Cybersecurity Faculty Publications

As cyber-physical systems (CPSs) increasingly integrate physical and digital realms, securing critical infrastructure, such as the Port of Virginia, becomes paramount. Among CPSs, Unmanned Aerial Vehicles (UAVs) are vital for monitoring, communication, and supporting the command and control through remote reconnaissance and surveillance missions. These UAV applications often require coordination, planning, and runtime reconfiguration, traditionally managed by human decision-makers. However, this approach has limitations, as extensively documented in the literature. Artificial Intelligence (AI) has emerged as a pivotal tool to address these limitations, enhancing risk mitigation and informed decision-making. This research proposes a machine learning (ML) based security mechanism, leveraging …

An Integrated Machine Learning Approach For Identifying Emergency Rescue Messages On Social Media During Natural Disasters, Wael Khallouli, Jiang Li, Jingwei Huang, Ghaith Rabadi, Samuel Kovacic

School of Cybersecurity Faculty Publications

During large-scale disasters, emergency call centers are often overwhelmed by the large volume of rescue requests and calls for help. Consequently, people are turning to social media platforms to seek assistance. Rescue information posted on these platforms is extremely valuable for first responders to make informed rescue decisions. Therefore, the automatic identification of these requests from the vast amount of data posted on social media during crises is critical yet challenging. This work presents our ongoing research on applying deep learning techniques to extract actionable rescue information from social media during crises. We proposed a novel deep learning model that …

Leveraging Transformer-Based Ocr Model With Generative Data Augmentation For Engineering Document Recognition, Wael Khallouli, Mohammad Shahab Uddin, Andres Sousa-Poza, Jiang Li, Samuel Kovacic

Engineering Management & Systems Engineering Faculty Publications

The long-standing practice of document-based engineering has resulted in the accumulation of a large number of engineering documents across various industries. Engineering documents, such as 2D drawings, continue to play a significant role in exchanging information and sharing knowledge across multiple engineering processes. However, these documents are often stored in non-digitized formats, such as paper and portable document format (PDF) files, making automation difficult. As digital engineering transforms processes in many industries, digitizing engineering documents presents a crucial challenge that requires advanced methods. This research addresses the problem of automatically extracting textual content from non-digitized legacy engineering documents. We introduced …

Governing Intelligence: Singapore’S Evolving Ai Governance Framework, Jason G. Allen, Jane Loo, Jose Luna

Research Collection Yong Pung How School Of Law

This paper provides an outline analysis of the evolving governance framework for Artificial Intelligence (AI) in Singapore. Across the Singapore government, AI solutions are being adopted in line with Singapore’s “Smart Nation Initiative” to leverage technology to make impactful changes to the nation and the economy. In tandem, Singaporean authorities have been assiduous to release a growing number of governance documents, which we analyse together to chart the city-state’s approach to AI governance in international comparison. Characteristics of Singapore’s AI governance approach include an emphasis on consensusbuilding between stakeholders (particularly government and industry but also citizens) andvoluntary or “quasi” regulation, …

Transforming Urban Dynamics: Harnessing Large Language Models For Smarter Mobility, Hao Xue, Ming Jin, Shirui Pan, Flora Salim, Guansong Pang

Research Collection School Of Computing and Information Systems

Artificial intelligence (AI) has the potential to analyze mobility data and make mobility systems smarter by leveraging diverse data sources such as geospatial data, transportation logs, and real-time sensor data to optimize traffic flow, enhance public transportation systems, and support the development of autonomous vehicles. With the newly emerged generative AI paradigm, exemplified by large language models (LLMs), there is great potential to transform the current AI applications in mobility, transportation, and urban domains. This article provides an overview of recent efforts and aims to shed light on the challenges and future opportunities to facilitate the adaptation of LLMs for …

Fostering Critically Conscious Lesson Planning In A Generative Artificial Intelligence Era, Derek Riddle, Paula Cristina Azevedo, Catharyn Shelton, Jaime Colwell, Jori Beck

Teaching & Learning Faculty Publications

Teacher candidates (TCs) use digital resources and social media to plan and develop learning material, and with publically accessible generative artificial intelligence (GAI), TCs are able to generate lesson plans within seconds rather than hours or days. While there is research on how to support TCs' evaluation of reliable digital media, there is little known on how to prepare TCs for GAI content. Using the complementary frameworks of Freire’s (1970) critical consciousness and Jonnasen’s (1991) theory of constructivism, this in-progress design based research seeks to develop an adaptable framework that addresses the evolving nature of technology, specifically GAI, and the …

Analyzing Visual Attention In Virtual Crime Scene Investigations Using Eye-Tracking And Vr: Insights For Cognitive Modeling, Wen-Chao Yang, Chih-Hung Shih, Jiajun Jiang, Sergio Pallas Enguita, Chung-Hao Chen

Electrical & Computer Engineering Faculty Publications

Understanding human perceptual strategies in high-stakes environments, such as crime scene investigations, is essential for developing cognitive models that reflect expert decision-making. This study presents an immersive experimental framework that utilizes virtual reality (VR) and eye-tracking technologies to capture and analyze visual attention during simulated forensic tasks. A 360° panoramic crime scene, constructed using the Nikon KeyMission 360 camera, was integrated into a VR system with HTC Vive and Tobii Pro eye-tracking components. A total of 46 undergraduate students aged 19 to 24–23, from the National University of Singapore in Singapore and 23 from the Central Police University in Taiwan—participated …

Copyright And Artificial Intelligence, Part 2: Copyrightability

Copyright, Fair Use, Scholarly Communication, etc.

This report by the United States Copyright Office addresses the legal and policy issues related to artificial intelligence (AI) and copyright as outlined in the Office’s August 2023 Notice of Inquiry (NOI).

The report will be published in several parts each one addressing a different topic. This part addresses the copyrightability of works created using generative AI. The first part, published in 2024, addresses the topic of digital replicas—the use of digital technology to realistically replicate an individual’s voice or appearance. A subsequent part will turn to the training of AI models on copyrighted works, licensing considerations, and allocation of …

From Philosophy To Nlu: Evolving Definitions With Research Hypotheses, Jian Wu, Sarah Rajtmajer

Computer Science Faculty Publications

Over the past decades, alongside advancements in natural language processing, significant attention has been paid to training models to automatically extract, understand, test, and generate hypotheses in open and scientific domains. However, interpretations of the term hypothesis for various natural language understanding (NLU) tasks have migrated from traditional definitions in the natural, social, and formal sciences. Even within NLU, we observe differences defining hypotheses across literature. In this paper, we overview and delineate various definitions of hypothesis. Especially, we discern the nuances of definitions across recently published NLU tasks. We highlight the importance of well-structured and well-defined hypotheses, particularly as …

A Qualitative Analysis Of College Students' Interest In Mhealth Solutions, Leslie Hoglund, Craig M. Becker, Cara Tonn

Health Behavior, Policy & Management Faculty Publications

This study explores college students' perceptions of an AI-driven mHealth application designed to promote well-being. With rising mental health challenges in academic settings, students increasingly seek digital tools that provide holistic support for physical, mental, and financial health. Through focus groups, this qualitative study examines students' preferences for personalized health tracking, educational content, and flexible reminders within a private, supportive community. Key findings emphasize students' desire for a balanced, all-in-one app that integrates health and wellness tools without overwhelming them with notifications. Students also highlighted the importance of social media integration for outreach, though concerns were raised about potential stress …

Am I As Effective At Identifying Emotions As Artificial Intelligence? A Comparative Study Of Emotional Recognition, Traci R. Grove, Alexandra T. Lucas, Maryann Martin, Cathleen M. Deckers, Lulu Sherif Mahmood, Nicole Danaher-Garcia, Mark W. Scerbo, Suzan Kardong-Edgren, Janice C. Palaganas

Psychology Faculty Publications

Background

Learning conversations, or dialogues aimed at deepening understanding and reflection, are deeply influenced by emotions. Effective communication is influenced by emotional intelligence - the ability to recognize, understand, and manage both one’s own and others’ emotions. While advances in artificial intelligence (AI) offer new tools for emotion recognition, these technologies still struggle with accurately interpreting subtle and culturally diverse emotional expressions, sparking debate about their reliability and effectiveness. This article provides a comparative analysis of human versus AI recognition of emotions during an end-of-course reflective learning conversation.

Methods

Emotions during a structured post-conference debriefing were analyzed and coded by …

Trustworthiness And Trust: Identifying Factors That Drive Successful Human-Ai Interaction In Nuclear Power Plant Applications, Yusuke Yamani, Austin Jackson, Casey Kovesdi, Jeffrey Joe, Jeremy Mohon

Psychology Faculty Publications

Emerging technologies such as artificial intelligence (AI) and machine learning are rapidly evolving and promising tools for efficient and continued safe operations of the U.S. nuclear power plants (NPPs). Emerging AI techniques like large language models (LLMs) are one such technology that may help personnel at existing NPPs perform work more efficiently. For example, operators may query the current operational status of a power plant via a chat interface, leveraging LLMs to access plant-related information in an interactive manner rather than manually collecting various sensor data for surveillance or work order tasks. This is a fundamental shift in the way …

Transformative Impact Of Ai And Digital Technologies On The Fintech Industry: A Comprehensive Review, Soudeh Pazouki, Behdad Jamshidi, Armia Jalali, Arya Tafreshi

Finance Faculty Publications

This paper examines the impact of artificial intelligence (AI) and digital technologies on the financial technology (FinTech) industry and demonstrates how AI- enabled strategies are increasing the ability of businesses not only to grow, but also to better serve their customers through operational efficiencies. But as immersive as the technological advancements may be, they present challenges in connection with increasingly complicated licensing regulations and a constantly evolving technological landscape. We examine the way AI and algorithms are streamlining workflows, enhancing productivity and expanding access to financial resources for traditionally under – served populations. The paper also discusses the macroeconomic implications …

Uso De Herramientas De Inteligencia Artificial Generativa Por Parte De Docentes En Una Escuela Del Suroeste De Puerto Rico, Glorimar N. Rodríguez Guiliani

Theses and Dissertations

Esta disertación aplicada fue diseñada para investigar el nivel de conocimiento, uso y dificultades que enfrentan los docentes de quinto a duodécimo grado en una escuela privada del suroeste de Puerto Rico respecto a tecnologías emergentes las cuales presentan desafíos significativos para los docentes y los estudiantes. Se exploró la utilización de herramientas de inteligencia artificial generativa (GenAI) como ChatGPT dentro y fuera del aula para actividades pedagógicas y administrativas.

Los hallazgos revelaron una notable carencia en el conocimiento docente sobre el uso y habilidades de la inteligencia artificial. Se identificó, también, una deficiencia en la capacidad de los docentes …

An Analytical Review Of Preprocessing Techniques In Bengali Natural Language Processing, Sovon Chakraborty, Protiva Das, Shakib Mahmud Dipto, Md Aktaruzzaman Pramanik, Jannatun Noor

Computer Science Faculty Publications

Research in Bengali Natural Language Processing (BNLP) is rapidly expanding. Despite being one of the most widely spoken languages in the world, BNLP research remains insufficient, particularly in Bengali speech recognition. The languages rich morphology, agglutinative structure, and diverse dialects make text and speech processing especially challenging. However, these challenges can be addressed with effective preprocessing techniques. Various organizations in Bangladesh and West Bengal are integrating Natural Language Processing (NLP) into their services, but without a thorough understanding of preprocessing, these implementations remain incomplete. Applying proper preprocessing techniques to the Bengali language will serve as a foundation for developing robust …

Can Llms Beat Humans On Discerning Human-Written And Llm-Generated Science News, Dominik Soós, Meng Jiang, Jian Wu

Computer Science Faculty Publications

Science news is increasingly important in connecting scientists and the public by sharing discoveries and innovations. With the rise of large language models (LLMs), there is potential to automate science news creation, but concerns exist about the quality of LLM-generated news versus human-written news. This paper explores whether LLMs can outperform humans in distinguishing between human-written and LLM-generated news. Inspired by the Chain-of-Thought prompting method, we designed a simple yet effective variant called Guided Few-shot (GFS), which encodes the characteristics of news of two types with examples. Our experiments indicated that GFS with just a single example effectively boosted the …