Artificial Intelligence and Robotics Commons^™

Satirical Deepfakes, Surreal Dreamscapes & Nostalgic Pixels: The Rapid Evolution And Cultural Commentary Of Ai-Aesthetics, Andrew Smith, James Hutson

Faculty Scholarship

The rapid evolution of visual aesthetics driven by AI, shared globally through the internet and social media, has dramatically accelerated what once took centuries to develop. This article explores the unique visual tropes emerging from AI-generated content, characterized by surreal, uncanny, and often unsettling imagery. Examples range from the Dor Brothers' stylized narrative videos to horrifying depictions of transformations, such as people morphing into motorcycles. The article contextualizes this aesthetic within historical developments in creative experimentation, drawing parallels with David Bowie's unconventional approach to sound creation in the 1970s. It also considers how AI-driven art, free from copyright constraints in …

Ai Satire And Digital Dystopia: The Dor Brothers Crafting Imperfection And Political Commentary In Contemporary Video Art, James Hutson, Andrew Smith

Faculty Scholarship

The Dor Brothers' AI-generated video content exemplifies an inflection point in digital creativity, where technological limitations are repurposed as aesthetic tools. Drawing on recent interviews with Yonatan Dor, this article explores the innovative techniques of the brothers, such as masking visual imperfections with retro filters and embracing the unpredictability of AI outputs. Through generating numerous clips and meticulously editing selections, they create a unique aesthetic that juxtaposes surrealism with a gritty realism, often reminiscent of early CCTV or VHS footage. Their work not only transcends the typical "morphing face" trope of AI videos but also engages in satire, using deepfake-like …

Contemplating Existence: Ai And The Meaning Of Life, Emily Barnes, James Hutson

Faculty Scholarship

This article explores the intersection of artificial intelligence (AI) with existential philosophy, examining how AI technologies influence human conceptualizations of purpose and meaning. Despite rapid advancements in AI, the domain's implications for existential thought remain underexplored. By integrating interdisciplinary perspectives from psychology, philosophy, and AI ethics, this study elucidates how AI can shape, challenge, or enhance our understanding of life's purpose. It investigates theoretical frameworks and practical implementations of AI engaging in existential questions, analyzing both the capabilities and limitations of AI systems such as ChatGPT in simulating human existential thought. The ethical implications of AI's role in existential inquiries …

An Artificial Intelligence Report Card For Judicial Review, Zoe E. Niesel

Michigan Journal of Environmental & Administrative Law

The rapid advancement of technology, including artificial intelligence (AI), is creating new challenges for judicial review under the Administrative Procedure Act (APA). In late 2023, federal administrative agencies publicly disclosed over 700 use cases of AI that employ sophisticated techniques like machine learning and natural language processing. While the APA's flexible judicial review framework certainly allows agencies to utilize new technologies, the APA also requires explainability of agency decisions; thus, agencies must be able to articulate the reasoning and methodology behind AI-enabled decisions for the purpose of judicial review. This Article examines APA judicial review as it applies to agency …

Enhancing History Education With Google Notebooklm: Case Study Of Mary Easton Sibley’S Diary For Multimedia Content And Podcast Creation, Paul Huffman, James Hutson

Faculty Scholarship

This article explores new features of Google’s NotebookLM, an AI-powered tool designed for advanced document analysis and educational content generation. Tested on the 92-page transcribed diary of Mary Easton Sibley, the founder of Lindenwood University, NotebookLM effectively generated FAQs, a study guide, a table of contents, a briefing document, and an audio overview in podcast format. By transforming static historical documents into dynamic learning materials, the document-based AI model provides a user-friendly interface for educators and students, especially those without experience in audio editing or podcasting. While successful in creating study guides and audio formats, the tool faced challenges in …

A Machine Learning Approach To Discovering Physical Models Of Galaxy Formation, Festa Bucinca

Dissertations, Theses, and Capstone Projects

Galaxies are the breathtakingly beautiful starry islands of the Universe. The process of galaxy formation involves the transformation from simple initial conditions in the early Universe to the complex galaxy structures we observe today. Spanning an immense spatial range and tremendous time scales - from the vastness of the Universe to the scale of individual stars - the physics of galaxy formation is both complex and crucial for understanding the Universe we live in. However, despite significant advancements, our theoretical understanding of galaxy formation remains incomplete.

In the era of big data available from hydrodynamical simulations and observations, Machine Learning …

Advancing Affective Computing: Emotion Recognition And Tracking Across Diverse Contexts (Varied Environments), Shao Liu

Dissertations, Theses, and Capstone Projects

Affective Computing (AC) is an interdisciplinary field that recognizes, interprets, and processes human emotions. Emotions are complex, involving consciousness, physical sensations, and behavioral expressions, and are significant in various domains like mental health, human-computer interaction, and social security. Real-world applications of AC include monitoring drivers’ emotional states to improve road safety and understanding the emotions expressed by artists in visual arts. Traditional methods relying on facial expressions often fall short due to the nuanced nature of emotions, which vary across individuals, cultures, and contexts. Accurate AC systems require sophisticated, multimodal models to handle these variations and external factors like noise …

La Vida: Towards A Motivated Goal Reasoning Agent, Ursula Addison

Dissertations, Theses, and Capstone Projects

An autonomous agent deployed to operate over extended horizons in uncertain environments will encounter situations for which it was not designed. A class of these situations involves an invalidation of agent goals and limited guidance in establishing a new set of goals to pursue. An agent will benefit from some mechanism that will allow it to pursue new goals under these circumstances such that the goals are broadly useful in its environment and take advantage of its existing skills while aligning with societal norms. We propose augmenting a goal reasoning agent, i.e., an agent that can deliberate on and self-select …

Developing Empathetic Ai: Exploring The Potential Of Artificial Intelligence To Understand And Simulate Family Dynamics And Cultural Identity, Emily Barnes, James Hutson

Faculty Scholarship

The rapid advancement of Artificial Intelligence (AI) has significantly impacted various domains. Yet, the exploration of AI's potential to develop a deep understanding of family culture and identity remains underexplored. This study introduces the concept of "a love of grandma and apple pie" to symbolize the potential of various AI to internalize and appreciate familial relationships, cultural traditions, and personal identity. The proposed study would investigate how an advanced deep learning model, trained on diverse unstructured datasets—including multimedia data from 100 families-could learn and reflect human-like emotions, values, and cultural understanding. Utilizing Convolutional Neural Networks (CNNs) for visual data processing …

Technoculture And Language Models In Archaeology: Reconstructing And Preserving Cultural Narratives Through Digital Humanities, James Hutson

Faculty Scholarship

Technoculture, which examines the intersection of culture and technology, has increasingly permeated archaeological practice, transforming both scholarly research and public engagement [1-3]. The introduction of digital tools such as virtual reality (VR), geographic information systems (GIS), and large language models (LLMs) has democratized access to archaeological knowledge, enabling communities to engage more actively with their cultural heritage [4-6]. This short article explores the mutual influence of technocultural studies and AI technologies on archaeology, with a focus on the preservation and reconstruction of cultural narratives through digital means.

The first aspect of this intersection lies in how technocultural tools are creating …

Artificial Intelligence In Orthopaedic Education: A Comparative Analysis Of Chatgpt And Bing Ai’S Orthopaedic In-Training Examination Performance, Clark Chen, Vivek Biololikar, Duncan Vannest, James Raphael, Gene Shaffer

Einstein Health Papers

Background: This study evaluated the performance of generative artificial intelligence (AI) models on the Orthopaedic In-Training Examination (OITE), an annual exam administered to U.S. orthopaedic residency programs. Methods: ChatGPT 3.5 and Bing AI GPT 4.0 were evaluated on standardised sets of multiple-choice questions drawn from the American Academy of Orthopaedic Surgeons OITE online question bank spanning 5 years (2018–2022). A total of 1165 questions were posed to each AI system. The performance of both systems was standardised using the latest versions of ChatGPT 3.5 and Bing AI GPT 4.0. Historical data of resident scores taken from the annual OITE technical …

Multi-Modal Alignment Via Hyperbolic Geometry, Suyu Liu

Dissertations and Theses Collection (Open Access)

Strong capabilities of generalization to unseen domains are vital for deep neural networks. While existing methods have shown promising results without source domain access, they mostly rely on models that are extensively pre-trained on source domains or overlook the intricate hierarchical structures inherent in visual and textual features. These limitations may have bad impacts on performances, especially on datasets with many classes. To overcome this, in this paper we propose a novel approach that projects the model onto hyperbolic geometry and employs geometric optimal transport to align cross-modal features in an unsupervised manner. Unlike Euclidean geometry, hyperbolic geometry is characterized …

Quality Assurance In Software Engineering: A Journey Towards Explainable Automated Solutions, Ratnadira Widyasari

Dissertations and Theses Collection (Open Access)

In today's digital era, the pervasive influence of software on daily life underscores the necessity for high-quality and reliable systems. Software failures can result in substantial harm and financial losses, highlighting the pivotal role of Software Quality Assurance (SQA). While automated SQA techniques have evolved to aid developers in ensuring software quality, the necessity for explainability in these automated solutions has become equally important. For example, in automated fault localization, only identifying suspicious locations is insufficient; it is essential to provide reasoning on why these locations are suspicious. This dissertation presents a series of interconnected studies aimed at developing explainable …

Fdi : Attack Neural Code Generation Systems Through User Feedback Channel, Zhensu Sun, Xiaoning Du, Xiapu Luo, Fu Song, David Lo, Li Li

Research Collection School Of Computing and Information Systems

Neural code generation systems have recently attracted increasing attention to improve developer productivity and speed up software development. Typically, these systems maintain a pre-trained neural model and make it available to general users as a service (e.g., through remote APIs) and incorporate a feedback mechanism to extensively collect and utilize the users' reaction to the generated code, i.e., user feedback. However, the security implications of such feedback have not yet been explored. With a systematic study of current feedback mechanisms, we find that feedback makes these systems vulnerable to feedback data injection (FDI) attacks. We discuss the methodology of FDI …

Quantum-Enhanced Simulation-Based Optimization For Newsvendor Problems, Monit Sharma, Hoong Chuin Lau, Rudy Raymond

Research Collection School Of Computing and Information Systems

Simulation-based optimization is a widely used method to solve stochastic optimization problems. This method aims to identify an optimal solution by maximizing the expected value of the objective function. However, due to its computational complexity, the function cannot be accurately evaluated directly, hence it is estimated through simulation. Exploiting the enhanced efficiency of Quantum Amplitude Estimation (QAE) compared to classical Monte Carlo simulation, it frequently outpaces classical simulation-based optimization, resulting in notable performance enhancements in various scenarios. In this work, we make use of a quantum-enhanced algorithm for simulation-based optimization and apply it to solve a variant of the classical …

Fintech Digital Transformation: Generative Ai, Humanoid Robots, Metaverse, Human-Ai Collaboration, And Industry 5.0, Yuxin Liu, Runyu Wang, Keng Siau

Research Collection School Of Computing and Information Systems

This paper discusses the transformative impact of emerging digital technologies on the digital transformation of the financial industry, focusing on integrating Generative AI (GenAI), humanoid robots, and the Metaverse within the framework of Industry 5.0. Industry 5.0 emphasizes a human-centric approach to technology, where human-AI collaboration plays a central role in reshaping financial services. By reviewing both academic research and practical applications, the paper highlights the current advancements in FinTech, particularly in AI technologies and the Metaverse, and their future potential, demonstrating how these innovations are driving growth, efficiency, and resilience in the financial sector. Further, the paper proposes a …

Sound And Complete Witnesses For Template-Based Verification Of Ltl Properties On Polynomial Programs, Krishnendu Chatterjee, Amir Goharshady, Ehsan Goharshady, Mehrdad Karrabi, Dorde Zikelic

Research Collection School Of Computing and Information Systems

We study the classical problem of verifying programs with respect to formal specifications given in the linear temporal logic (LTL). We first present novel sound and complete witnesses for LTL verification over imperative programs. Our witnesses are applicable to both verification (proving) and refutation (finding bugs) settings. We then consider LTL formulas in which atomic propositions can be polynomial constraints and turn our focus to polynomial arithmetic programs, i.e. programs in which every assignment and guard consists only of polynomial expressions. For this setting, we provide an efficient algorithm to automatically synthesize such LTL witnesses. Our synthesis procedure is both …

Text-Driven Video Prediction, Xue Song, Jingjing Chen, Bin Zhu, Yu-Gang Jiang

Research Collection School Of Computing and Information Systems

Current video generation models usually convert signals indicating appearance and motion received from inputs (e.g., image and text) or latent spaces (e.g., noise vectors) into consecutive frames, fulfilling a stochastic generation process for the uncertainty introduced by latent code sampling. However, this generation pattern lacks deterministic constraints for both appearance and motion, leading to uncontrollable and undesirable outcomes. To this end, we propose a new task called Text-driven Video Prediction (TVP). Taking the first frame and text caption as inputs, this task aims to synthesize the following frames. Specifically, appearance and motion components are provided by the image and caption …

How Effective Are They? Exploring Large Language Model Based Fuzz Driver Generation, Cen Zhang, Yaowen Zheng, Mingqiang Bai, Yeting Li, Wei Ma, Xiaofei Xie

Research Collection School Of Computing and Information Systems

Fuzz drivers are essential for library API fuzzing. However, automatically generating fuzz drivers is a complex task, as it demands the creation of high-quality, correct, and robust API usage code. An LLM-based (Large Language Model) approach for generating fuzz drivers is a promising area of research. Unlike traditional program analysis-based generators, this text-based approach is more generalized and capable of harnessing a variety of API usage information, resulting in code that is friendly for human readers. However, there is still a lack of understanding regarding the fundamental issues on this direction, such as its e ectiveness and potential challenges. To …

Genixer : Empowering Multimodal Large Language Models As A Powerful Data Generator, Henry Hengyuan Zhao, Pan Zhou, Mike Zheng Shou

Research Collection School Of Computing and Information Systems

Multimodal Large Language Models (MLLMs) demonstrate exceptional problem-solving capabilities, but few research studies aim to gauge the ability to generate visual instruction tuning data. This paper proposes to explore the potential of empowering MLLMs to generate data independently without relying on GPT-4. We introduce Genixer, a comprehensive data generation pipeline consisting of four key steps: (i) instruction data collection, (ii) instruction template design, (iii) empowering MLLMs, and (iv) data generation and filtering. Additionally, we outline two modes of data generation: task-agnostic and task-specific, enabling controllable output. We demonstrate that a synthetic VQA-like dataset trained with LLaVA1.5 enhances performance on 10 …

A Two-Stage Matheuristic For The Home Healthcare Routing And Scheduling Problem With Perishable Products, Aldy Gunawan, Nabila Yuraisyah Salsabila, Vincent F. Yu, Pham Kien Minh Nguyen

Research Collection School Of Computing and Information Systems

This study proposes a home healthcare routing and scheduling problem, where perishable products such as medicines, vaccines, or meals must be provided for some patients’ treatments. This problem is formulated as a mixed integer linear programming (MILP). A two-stage matheuristic is then developed as the solution approach. The first stage is a local search to solve the nurse routing problem, and the second stage is run as the relaxed MILP to solve the scheduling problem. The matheuristic is tested on newly generated instances and compared with the results of CPLEX. The proposed matheuristic is able to obtain CPLEX solutions within …

Machine Visual Perception For Autonomous Docking Maneuvers, Derek B. Worth

Theses and Dissertations

This dissertation presents a novel approach to autonomous docking using machine learning for visual perception, particularly during probe and drogue aerial refueling. Autonomous vehicles have become pervasive in both civilian and defense sectors, and their ability to interact with their surroundings and each other autonomously is critical for future operations. Traditional methods relying on signals or inertial sensors face significant limitations such as interference, jamming, and drift. This research focuses on developing a computer vision-based solution to overcome these limitations. A novel pipeline, termed relative vectoring, is introduced, which utilizes dual object detection and machine learning to estimate relative positions …

Enabling Emg-Based Silent Speech Transcription Through Speech-To-Text Transfer Learning, Alexander T. Garcia

Master's Theses

In recent years, advances in deep learning have allowed various forms of electrographic signals, such as electroencephalography (EEG) and electromyography (EMG), to be used as a viable form of input in artificial intelligence applications, particularly for applications in the medical field. One such topic that EMG inputs have been used is in silent speech interfaces, or devices capable of processing speech without an audio-based input. The goal of this thesis is to explore a novel method of training a machine learning model to be used for silent speech interface development: using transfer learning to leverage a pre-trained speech recognition model …

Performance Of 5 Prominent Large Language Models In Surgical Knowledge Evaluation: A Comparative Analysis, Adam M. Ostrovsky, Joshua R. Chen, Vishal N. Shah, Babak Abai

Department of Surgery Faculty Papers

No abstract provided.

Getting To The Point: Contrasting Directness And Warmth In Motivational Embodied Conversational Agents, Michael O'Mahony, Cathy Ennis, Robert Ross

Conference papers

Enhancing long-term engagement with conversational agents remains a significant challenge. Controlling the perceived warmth or directness of an agent’s personality through the style of its generated text could be used to increase user likeability. This paper reports an investigation of a Wizard-of-Oz (WoZ) mediated study of two variants of a motivational embodied conversational agent to measure user perception of and attitudes towards warmth in interaction style. Results show a significant effect of users preferring an agent with a "more direct" personality for this scenario, though this effect is in many ways nuanced.

Diabetes Technology Meeting 2023, Tiffany Tian, Rachel E Aaron, Ashley Y Dunova, Johan H Jendle, David Kerr, Eda Cengiz, Andjela Drincic, John C Pickup, Kong Y Chen, Naomi Schwartz, Douglas B Muchmore, Halis K Akturk, Carol J Levy, Signe Schmidt, Riccardo Bellazzi, Alan H B Wu, Elias K Spanakis, Bijan Najafi, James Geoffrey Chase, Jane Jeffrie Seley, David C Klonoff

Center on Aging Staff Publications

Diabetes Technology Society hosted its annual Diabetes Technology Meeting from November 1 to November 4, 2023. Meeting topics included digital health; metrics of glycemia; the integration of glucose and insulin data into the electronic health record; technologies for insulin pumps, blood glucose monitors, and continuous glucose monitors; diabetes drugs and analytes; skin physiology; regulation of diabetes devices and drugs; and data science, artificial intelligence, and machine learning. A live demonstration of a personalized carbohydrate dispenser for people with diabetes was presented.

Monocular Bev Perception Of Road Scenes Via Front-To-Top View Projection, Wenxi Liu, Qi Li, Weixiang Yang, Jiaxin Cai, Yuanhong Yu, Yuexin Ma, Shengfeng He, Jia Pan

Research Collection School Of Computing and Information Systems

HD map reconstruction is crucial for autonomous driving. LiDAR-based methods are limited due to expensive sensors and time-consuming computation. Camera-based methods usually need to perform road segmentation and view transformation separately, which often causes distortion and missing content. To push the limits of the technology, we present a novel framework that reconstructs a local map formed by road layout and vehicle occupancy in the bird's-eye view given a front-view monocular image only. We propose a front-to-top view projection (FTVP) module, which takes the constraint of cycle consistency between views into account and makes full use of their correlation to strengthen …

An Empirical Study Of Static Analysis Tools For Secure Code Review, Wachiraphan Charoenwet, Patanamon Thongtanunam, Van-Thuan Pham, Christoph Treude

Research Collection School Of Computing and Information Systems

Early identification of security issues in software development is vital to minimize their unanticipated impacts. Code review is a widely used manual analysis method that aims to uncover security issues along with other coding issues in software projects. While some studies suggest that automated static application security testing tools (SASTs) could enhance security issue identification, there is limited understanding of SAST’s practical effectiveness in supporting secure code review. Moreover, most SAST studies rely on synthetic or fully vulnerable versions of the subject program, which may not accurately represent real-world code changes in the code review process. To address this gap, …

Federated Learning Systems For Mobile Sensing Data, Xiaopeng Jiang

Dissertations

Federated Learning (FL) has emerged as a new distributed Deep Learning (DL) paradigm that enables privacy-aware training and inference on mobile devices with help from the cloud. This dissertation presents a comprehensive exploration of FL with mobile sensing data, covering systems, applications, and optimizations.

First, a mobile-cloud FL system, FLSys, is designed to balance model performance with resource consumption, tolerate communication failures, and achieve scalability. In FLSys, different DL models with different FL aggregation methods can be trained and accessed concurrently by different apps. In addition, FLSys provides advanced privacy-preserving mechanisms and a common API for third-party app developers to …

Ai And Academic Integrity, Max Sparkman Research Instruction Librarian, Milne Library, Brandon West Head Of Research & Instruction, Milne Library

Artificial Intelligence, 2024-25

This short module introduces students to important concepts regarding the use of AI and academic integrity. Concepts covered include a brief overview of generative AI, whether or not their use is considered plagiarism, how to use generative AI tools responsibly, and potential use cases. The module ends with a quiz where students can apply concepts from the module to three scenarios.