Digital Commons Network^™

Adaptive Worlds: Generative Ai In Game Design And Future Of Gaming, And Interactive Media, Jay Ratican, James Hutson

Faculty Scholarship

Generative AI is revolutionizing the field of game design, introducing unprecedented adaptability and personalization in gameplay. The latest advancements in AI-driven engines enable real-time content creation, offering dynamic, player-driven experiences that diverge from traditional pre-programmed narratives. This shift marks a transition toward "choose your own adventure" formats, with an unlimited number of variations in levels, enemies, collectibles, and weaponry, tailored to each player's decisions. Google's GameNGen, for example, showcases AI's capacity to recreate classic games like DOOM, learning and generating gameplay in real time. These innovations are not restricted to gaming alone; they extend to edutainment, television, and film, where …

Multimodal Mixing Convolutional Neural Network And Transformer For Alzheimer’S Disease Recognition, Junde Chen, Yun Wang, Adnan Zeb, M. D. Suzauddola, Yuxin Wen

Engineering Faculty Articles and Research

Early recognition of Alzheimer’s disease (AD) and its precursor state, mild cognitive impairment (MCI), is pivotal in interrupting the progression of the disease and providing suitable treatment. Recent development in deep learning techniques has drawn great research attention for improving the efficacy of AD recognition. However, numerous current methods solely utilize data from a single auxiliary domain, limiting their ability to harness valuable intrinsic insights from multiple domains. To cope with the challenge, this paper is devoted to establishing an innovative multimodal medical data fusion model, termed as MMDF, to perform Alzheimer’s disease recognition. Multimodal data including clinical records and …

Regulating Algorithmic Harms, Sylvia Lu

Law & Economics Working Papers

In recent years, the rapid expansion of artificial intelligence (AI) innovations has led to a rise in algorithmic harms—harms emerging from AI operations that pose significant threats to civil rights and democratic values in today’s technological landscape. A facial recognition system for improving criminal detection wrongly collected sensitive personal data and flagged racial minorities as shoplifters. A risk-prediction algorithm adopted to identify patients denied medical treatment to Black individuals with poor health conditions. A social media algorithm intended to boost social engagement exacerbated addictive behavior and mental illness in teenagers. These harms are becoming increasingly ubiquitous yet often manifest in …

Rethinking Retrieval Augmented Fine-Tuning In An Evolving Llm Landscape, Nicholas Sager, Timothy Cabaza, Matthew Cusack, Ryan Bass, Joaquin Dominguez

SMU Data Science Review

This study explores the utilization of Retrieval Augmented Fine-Tuning (RAFT) to enhance the performance of Large Language Models (LLMs) in domain-specific Retrieval Augmented Generation (RAG) tasks. By integrating domain-specific information during the retrieval process, RAG aims to reduce hallucination and improve the accuracy of LLM outputs. We investigate the use of RAFT, an approach that enhances LLMs by incorporating domain-specific knowledge and effectively handling distractor documents. This paper validates previous work, which found that RAFT can considerably improve the performance of Llama2-7B in specific domains. We also expand upon previous work into new state-of-the-art open-source models and other datasets with …

Assessing The Accuracy And Utility Of Chatgpt Responses To Patient Questions Regarding Posterior Lumbar Decompression, Alec Giakas, Rajkishen Narayanan, Teeto Ezeonu, Jonathan Dalton, Yunsoo Lee, Tyler Henry, John Mangan, Gregory Schroeder, Alex Vaccaro, Christopher Kepler

Department of Orthopaedic Surgery Faculty Papers

Aim: To examine the clinical accuracy and applicability of ChatGPT answers to commonly asked questions from patients considering posterior lumbar decompression (PLD). Methods: A literature review was conducted to identify 10 questions that encompass some of the most common questions and concerns patients may have regarding lumbar decompression surgery. The selected questions were then posed to ChatGPT. Initial responses were then recorded, and no follow-up or clarifying questions were permitted. Two attending fellowship-trained spine surgeons then graded each response from the chatbot using a modified Global Quality Scale to evaluate ChatGPT’s accuracy and utility. The surgeons then analyzed each question, …

Pooling And Winsorizing Machine Learning Forecasts To Predict Stock Returns With High-Dimensional Data, Erik Mekelburg, Jack Strauss

Finance: Faculty Scholarship

We evaluate US market return predictability using a novel data set of several hundred ag- gregated firm-level characteristics. We apply LASSO, Elastic Net, Random Forest, Neural Net, Extreme Gradient Boosting, and Light Gradient Boosting Machine methods and find these models experience large prediction errors that lead to forecast failures. However, winsorizing and pooling machine learning model forecasts provides consistent out-of-sample predictability. To assess robustness, we apply machine learning methods to high-dimensional data for Canada, China, Germany and the UK as well as the Goyal-Welch data. All machine learning models we consider, except for the ensemble pooled methods, fail to significantly …

Recasting The Mould – Librarianship Of The Future: Leveraging Automation, Apis, And Ai, Samantha Seah

Research Collection Library

With leaps in artificial intelligence made in recent years redefining the information landscape and introducing new means of information production, librarianship also must evolve to include new literacies. One way librarians can equip and empower ourselves is by understanding the building blocks of how machines and automation work. Perhaps more important than learning specific programming languages, learning computational thinking provides us with more ways to spot and evaluate problems and devise solutions without extensive coding knowledge. My presentation will take the improvement of membership processing as an example using Power Automate, a low-code Microsoft tool mimicking block programming. The tool …

Self-Replication Via Tile Self-Assembly, Andrew Alseth, Daniel Hader, Matthew J. Patitz

Computer Science and Computer Engineering Faculty Publications and Presentations

In this paper we present a model containing modifications to the Signal-passing Tile Assembly Model (STAM), a tile-based self-assembly model whose tiles are capable of activating and deactivating glues based on the binding of other glues. These modifications consist of an extension to 3D, the ability of tiles to form “flexible” bonds that allow bound tiles to rotate relative to each other, and allowing tiles of multiple shapes within the same system. We call this new model the STAM*, and we present a series of constructions within it that are capable of self-replicating behavior. Namely, the input seed assemblies to …

Satirical Deepfakes, Surreal Dreamscapes & Nostalgic Pixels: The Rapid Evolution And Cultural Commentary Of Ai-Aesthetics, Andrew Smith, James Hutson

Faculty Scholarship

The rapid evolution of visual aesthetics driven by AI, shared globally through the internet and social media, has dramatically accelerated what once took centuries to develop. This article explores the unique visual tropes emerging from AI-generated content, characterized by surreal, uncanny, and often unsettling imagery. Examples range from the Dor Brothers' stylized narrative videos to horrifying depictions of transformations, such as people morphing into motorcycles. The article contextualizes this aesthetic within historical developments in creative experimentation, drawing parallels with David Bowie's unconventional approach to sound creation in the 1970s. It also considers how AI-driven art, free from copyright constraints in …

Ai Satire And Digital Dystopia: The Dor Brothers Crafting Imperfection And Political Commentary In Contemporary Video Art, James Hutson, Andrew Smith

Faculty Scholarship

The Dor Brothers' AI-generated video content exemplifies an inflection point in digital creativity, where technological limitations are repurposed as aesthetic tools. Drawing on recent interviews with Yonatan Dor, this article explores the innovative techniques of the brothers, such as masking visual imperfections with retro filters and embracing the unpredictability of AI outputs. Through generating numerous clips and meticulously editing selections, they create a unique aesthetic that juxtaposes surrealism with a gritty realism, often reminiscent of early CCTV or VHS footage. Their work not only transcends the typical "morphing face" trope of AI videos but also engages in satire, using deepfake-like …

Contemplating Existence: Ai And The Meaning Of Life, Emily Barnes, James Hutson

Faculty Scholarship

This article explores the intersection of artificial intelligence (AI) with existential philosophy, examining how AI technologies influence human conceptualizations of purpose and meaning. Despite rapid advancements in AI, the domain's implications for existential thought remain underexplored. By integrating interdisciplinary perspectives from psychology, philosophy, and AI ethics, this study elucidates how AI can shape, challenge, or enhance our understanding of life's purpose. It investigates theoretical frameworks and practical implementations of AI engaging in existential questions, analyzing both the capabilities and limitations of AI systems such as ChatGPT in simulating human existential thought. The ethical implications of AI's role in existential inquiries …

Enabling Emg-Based Silent Speech Transcription Through Speech-To-Text Transfer Learning, Alexander T. Garcia

Master's Theses

In recent years, advances in deep learning have allowed various forms of electrographic signals, such as electroencephalography (EEG) and electromyography (EMG), to be used as a viable form of input in artificial intelligence applications, particularly for applications in the medical field. One such topic that EMG inputs have been used is in silent speech interfaces, or devices capable of processing speech without an audio-based input. The goal of this thesis is to explore a novel method of training a machine learning model to be used for silent speech interface development: using transfer learning to leverage a pre-trained speech recognition model …

An Artificial Intelligence Report Card For Judicial Review, Zoe E. Niesel

Michigan Journal of Environmental & Administrative Law

The rapid advancement of technology, including artificial intelligence (AI), is creating new challenges for judicial review under the Administrative Procedure Act (APA). In late 2023, federal administrative agencies publicly disclosed over 700 use cases of AI that employ sophisticated techniques like machine learning and natural language processing. While the APA's flexible judicial review framework certainly allows agencies to utilize new technologies, the APA also requires explainability of agency decisions; thus, agencies must be able to articulate the reasoning and methodology behind AI-enabled decisions for the purpose of judicial review. This Article examines APA judicial review as it applies to agency …

Enhancing History Education With Google Notebooklm: Case Study Of Mary Easton Sibley’S Diary For Multimedia Content And Podcast Creation, Paul Huffman, James Hutson

Faculty Scholarship

This article explores new features of Google’s NotebookLM, an AI-powered tool designed for advanced document analysis and educational content generation. Tested on the 92-page transcribed diary of Mary Easton Sibley, the founder of Lindenwood University, NotebookLM effectively generated FAQs, a study guide, a table of contents, a briefing document, and an audio overview in podcast format. By transforming static historical documents into dynamic learning materials, the document-based AI model provides a user-friendly interface for educators and students, especially those without experience in audio editing or podcasting. While successful in creating study guides and audio formats, the tool faced challenges in …

Fdi : Attack Neural Code Generation Systems Through User Feedback Channel, Zhensu Sun, Xiaoning Du, Xiapu Luo, Fu Song, David Lo, Li Li

Research Collection School Of Computing and Information Systems

Neural code generation systems have recently attracted increasing attention to improve developer productivity and speed up software development. Typically, these systems maintain a pre-trained neural model and make it available to general users as a service (e.g., through remote APIs) and incorporate a feedback mechanism to extensively collect and utilize the users' reaction to the generated code, i.e., user feedback. However, the security implications of such feedback have not yet been explored. With a systematic study of current feedback mechanisms, we find that feedback makes these systems vulnerable to feedback data injection (FDI) attacks. We discuss the methodology of FDI …

Monocular Bev Perception Of Road Scenes Via Front-To-Top View Projection, Wenxi Liu, Qi Li, Weixiang Yang, Jiaxin Cai, Yuanhong Yu, Yuexin Ma, Shengfeng He, Jia Pan

Research Collection School Of Computing and Information Systems

HD map reconstruction is crucial for autonomous driving. LiDAR-based methods are limited due to expensive sensors and time-consuming computation. Camera-based methods usually need to perform road segmentation and view transformation separately, which often causes distortion and missing content. To push the limits of the technology, we present a novel framework that reconstructs a local map formed by road layout and vehicle occupancy in the bird's-eye view given a front-view monocular image only. We propose a front-to-top view projection (FTVP) module, which takes the constraint of cycle consistency between views into account and makes full use of their correlation to strengthen …

Technoculture And Language Models In Archaeology: Reconstructing And Preserving Cultural Narratives Through Digital Humanities, James Hutson

Faculty Scholarship

Technoculture, which examines the intersection of culture and technology, has increasingly permeated archaeological practice, transforming both scholarly research and public engagement [1-3]. The introduction of digital tools such as virtual reality (VR), geographic information systems (GIS), and large language models (LLMs) has democratized access to archaeological knowledge, enabling communities to engage more actively with their cultural heritage [4-6]. This short article explores the mutual influence of technocultural studies and AI technologies on archaeology, with a focus on the preservation and reconstruction of cultural narratives through digital means.

The first aspect of this intersection lies in how technocultural tools are creating …

Developing Empathetic Ai: Exploring The Potential Of Artificial Intelligence To Understand And Simulate Family Dynamics And Cultural Identity, Emily Barnes, James Hutson

Faculty Scholarship

The rapid advancement of Artificial Intelligence (AI) has significantly impacted various domains. Yet, the exploration of AI's potential to develop a deep understanding of family culture and identity remains underexplored. This study introduces the concept of "a love of grandma and apple pie" to symbolize the potential of various AI to internalize and appreciate familial relationships, cultural traditions, and personal identity. The proposed study would investigate how an advanced deep learning model, trained on diverse unstructured datasets—including multimedia data from 100 families-could learn and reflect human-like emotions, values, and cultural understanding. Utilizing Convolutional Neural Networks (CNNs) for visual data processing …

Artificial Intelligence In Orthopaedic Education: A Comparative Analysis Of Chatgpt And Bing Ai’S Orthopaedic In-Training Examination Performance, Clark Chen, Vivek Biololikar, Duncan Vannest, James Raphael, Gene Shaffer

Einstein Health Papers

Background: This study evaluated the performance of generative artificial intelligence (AI) models on the Orthopaedic In-Training Examination (OITE), an annual exam administered to U.S. orthopaedic residency programs. Methods: ChatGPT 3.5 and Bing AI GPT 4.0 were evaluated on standardised sets of multiple-choice questions drawn from the American Academy of Orthopaedic Surgeons OITE online question bank spanning 5 years (2018–2022). A total of 1165 questions were posed to each AI system. The performance of both systems was standardised using the latest versions of ChatGPT 3.5 and Bing AI GPT 4.0. Historical data of resident scores taken from the annual OITE technical …

Multi-Modal Alignment Via Hyperbolic Geometry, Suyu Liu

Dissertations and Theses Collection (Open Access)

Strong capabilities of generalization to unseen domains are vital for deep neural networks. While existing methods have shown promising results without source domain access, they mostly rely on models that are extensively pre-trained on source domains or overlook the intricate hierarchical structures inherent in visual and textual features. These limitations may have bad impacts on performances, especially on datasets with many classes. To overcome this, in this paper we propose a novel approach that projects the model onto hyperbolic geometry and employs geometric optimal transport to align cross-modal features in an unsupervised manner. Unlike Euclidean geometry, hyperbolic geometry is characterized …

Quality Assurance In Software Engineering: A Journey Towards Explainable Automated Solutions, Ratnadira Widyasari

Dissertations and Theses Collection (Open Access)

In today's digital era, the pervasive influence of software on daily life underscores the necessity for high-quality and reliable systems. Software failures can result in substantial harm and financial losses, highlighting the pivotal role of Software Quality Assurance (SQA). While automated SQA techniques have evolved to aid developers in ensuring software quality, the necessity for explainability in these automated solutions has become equally important. For example, in automated fault localization, only identifying suspicious locations is insufficient; it is essential to provide reasoning on why these locations are suspicious. This dissertation presents a series of interconnected studies aimed at developing explainable …

Machine Visual Perception For Autonomous Docking Maneuvers, Derek B. Worth

Theses and Dissertations

This dissertation presents a novel approach to autonomous docking using machine learning for visual perception, particularly during probe and drogue aerial refueling. Autonomous vehicles have become pervasive in both civilian and defense sectors, and their ability to interact with their surroundings and each other autonomously is critical for future operations. Traditional methods relying on signals or inertial sensors face significant limitations such as interference, jamming, and drift. This research focuses on developing a computer vision-based solution to overcome these limitations. A novel pipeline, termed relative vectoring, is introduced, which utilizes dual object detection and machine learning to estimate relative positions …

La Vida: Towards A Motivated Goal Reasoning Agent, Ursula Addison

Dissertations, Theses, and Capstone Projects

An autonomous agent deployed to operate over extended horizons in uncertain environments will encounter situations for which it was not designed. A class of these situations involves an invalidation of agent goals and limited guidance in establishing a new set of goals to pursue. An agent will benefit from some mechanism that will allow it to pursue new goals under these circumstances such that the goals are broadly useful in its environment and take advantage of its existing skills while aligning with societal norms. We propose augmenting a goal reasoning agent, i.e., an agent that can deliberate on and self-select …

Getting To The Point: Contrasting Directness And Warmth In Motivational Embodied Conversational Agents, Michael O'Mahony, Cathy Ennis, Robert Ross

Conference papers

Enhancing long-term engagement with conversational agents remains a significant challenge. Controlling the perceived warmth or directness of an agent’s personality through the style of its generated text could be used to increase user likeability. This paper reports an investigation of a Wizard-of-Oz (WoZ) mediated study of two variants of a motivational embodied conversational agent to measure user perception of and attitudes towards warmth in interaction style. Results show a significant effect of users preferring an agent with a "more direct" personality for this scenario, though this effect is in many ways nuanced.

The Impact Of Instrumental Attribution In Ai-Enabled Monitoring On Counterproductive Work Behavior, Qiang Zhang

Dissertations and Theses Collection (Open Access)

AI-enabled monitoring tools are theoretically expected to suppress unethical employee behavior. However, in practice, employees may perceive such monitoring as being driven by leaders' instrumental motives, primarily focused on personal performance evaluation and self-interest. This perception can foster feelings of job insecurity and moral disengagement, ultimately leading to counterproductive work behavior (CWB), which includes unethical employee behavior and turnover. These outcomes may undermine the intended effectiveness of AI-enabled monitoring tools. This study aims to explore the impact of Instrumental Attribution in AIenabled Monitoring (IAAIM) on CWB, specifically focusing on unethical employee behavior and turnover, through both theoretical and empirical lenses. …

Performance Of 5 Prominent Large Language Models In Surgical Knowledge Evaluation: A Comparative Analysis, Adam M. Ostrovsky, Joshua R. Chen, Vishal N. Shah, Babak Abai

Department of Surgery Faculty Papers

No abstract provided.

A Machine Learning Approach To Discovering Physical Models Of Galaxy Formation, Festa Bucinca

Dissertations, Theses, and Capstone Projects

Galaxies are the breathtakingly beautiful starry islands of the Universe. The process of galaxy formation involves the transformation from simple initial conditions in the early Universe to the complex galaxy structures we observe today. Spanning an immense spatial range and tremendous time scales - from the vastness of the Universe to the scale of individual stars - the physics of galaxy formation is both complex and crucial for understanding the Universe we live in. However, despite significant advancements, our theoretical understanding of galaxy formation remains incomplete.

In the era of big data available from hydrodynamical simulations and observations, Machine Learning …

Advancing Affective Computing: Emotion Recognition And Tracking Across Diverse Contexts (Varied Environments), Shao Liu

Dissertations, Theses, and Capstone Projects

Affective Computing (AC) is an interdisciplinary field that recognizes, interprets, and processes human emotions. Emotions are complex, involving consciousness, physical sensations, and behavioral expressions, and are significant in various domains like mental health, human-computer interaction, and social security. Real-world applications of AC include monitoring drivers’ emotional states to improve road safety and understanding the emotions expressed by artists in visual arts. Traditional methods relying on facial expressions often fall short due to the nuanced nature of emotions, which vary across individuals, cultures, and contexts. Accurate AC systems require sophisticated, multimodal models to handle these variations and external factors like noise …

Diabetes Technology Meeting 2023, Tiffany Tian, Rachel E Aaron, Ashley Y Dunova, Johan H Jendle, David Kerr, Eda Cengiz, Andjela Drincic, John C Pickup, Kong Y Chen, Naomi Schwartz, Douglas B Muchmore, Halis K Akturk, Carol J Levy, Signe Schmidt, Riccardo Bellazzi, Alan H B Wu, Elias K Spanakis, Bijan Najafi, James Geoffrey Chase, Jane Jeffrie Seley, David C Klonoff

Center on Aging Staff Publications

Diabetes Technology Society hosted its annual Diabetes Technology Meeting from November 1 to November 4, 2023. Meeting topics included digital health; metrics of glycemia; the integration of glucose and insulin data into the electronic health record; technologies for insulin pumps, blood glucose monitors, and continuous glucose monitors; diabetes drugs and analytes; skin physiology; regulation of diabetes devices and drugs; and data science, artificial intelligence, and machine learning. A live demonstration of a personalized carbohydrate dispenser for people with diabetes was presented.

Sound And Complete Witnesses For Template-Based Verification Of Ltl Properties On Polynomial Programs, Krishnendu Chatterjee, Amir Goharshady, Ehsan Goharshady, Mehrdad Karrabi, Dorde Zikelic

Research Collection School Of Computing and Information Systems

We study the classical problem of verifying programs with respect to formal specifications given in the linear temporal logic (LTL). We first present novel sound and complete witnesses for LTL verification over imperative programs. Our witnesses are applicable to both verification (proving) and refutation (finding bugs) settings. We then consider LTL formulas in which atomic propositions can be polynomial constraints and turn our focus to polynomial arithmetic programs, i.e. programs in which every assignment and guard consists only of polynomial expressions. For this setting, we provide an efficient algorithm to automatically synthesize such LTL witnesses. Our synthesis procedure is both …