Computer Sciences Commons^™

Enhancing History Education With Google Notebooklm: Case Study Of Mary Easton Sibley’S Diary For Multimedia Content And Podcast Creation, Paul Huffman, James Hutson

Faculty Scholarship

This article explores new features of Google’s NotebookLM, an AI-powered tool designed for advanced document analysis and educational content generation. Tested on the 92-page transcribed diary of Mary Easton Sibley, the founder of Lindenwood University, NotebookLM effectively generated FAQs, a study guide, a table of contents, a briefing document, and an audio overview in podcast format. By transforming static historical documents into dynamic learning materials, the document-based AI model provides a user-friendly interface for educators and students, especially those without experience in audio editing or podcasting. While successful in creating study guides and audio formats, the tool faced challenges in …

A Machine Learning Approach To Discovering Physical Models Of Galaxy Formation, Festa Bucinca

Dissertations, Theses, and Capstone Projects

Galaxies are the breathtakingly beautiful starry islands of the Universe. The process of galaxy formation involves the transformation from simple initial conditions in the early Universe to the complex galaxy structures we observe today. Spanning an immense spatial range and tremendous time scales - from the vastness of the Universe to the scale of individual stars - the physics of galaxy formation is both complex and crucial for understanding the Universe we live in. However, despite significant advancements, our theoretical understanding of galaxy formation remains incomplete.

In the era of big data available from hydrodynamical simulations and observations, Machine Learning …

Advancing Affective Computing: Emotion Recognition And Tracking Across Diverse Contexts (Varied Environments), Shao Liu

Dissertations, Theses, and Capstone Projects

Affective Computing (AC) is an interdisciplinary field that recognizes, interprets, and processes human emotions. Emotions are complex, involving consciousness, physical sensations, and behavioral expressions, and are significant in various domains like mental health, human-computer interaction, and social security. Real-world applications of AC include monitoring drivers’ emotional states to improve road safety and understanding the emotions expressed by artists in visual arts. Traditional methods relying on facial expressions often fall short due to the nuanced nature of emotions, which vary across individuals, cultures, and contexts. Accurate AC systems require sophisticated, multimodal models to handle these variations and external factors like noise …

La Vida: Towards A Motivated Goal Reasoning Agent, Ursula Addison

Dissertations, Theses, and Capstone Projects

An autonomous agent deployed to operate over extended horizons in uncertain environments will encounter situations for which it was not designed. A class of these situations involves an invalidation of agent goals and limited guidance in establishing a new set of goals to pursue. An agent will benefit from some mechanism that will allow it to pursue new goals under these circumstances such that the goals are broadly useful in its environment and take advantage of its existing skills while aligning with societal norms. We propose augmenting a goal reasoning agent, i.e., an agent that can deliberate on and self-select …

Monocular Bev Perception Of Road Scenes Via Front-To-Top View Projection, Wenxi Liu, Qi Li, Weixiang Yang, Jiaxin Cai, Yuanhong Yu, Yuexin Ma, Shengfeng He, Jia Pan

Research Collection School Of Computing and Information Systems

HD map reconstruction is crucial for autonomous driving. LiDAR-based methods are limited due to expensive sensors and time-consuming computation. Camera-based methods usually need to perform road segmentation and view transformation separately, which often causes distortion and missing content. To push the limits of the technology, we present a novel framework that reconstructs a local map formed by road layout and vehicle occupancy in the bird's-eye view given a front-view monocular image only. We propose a front-to-top view projection (FTVP) module, which takes the constraint of cycle consistency between views into account and makes full use of their correlation to strengthen …

Developing Empathetic Ai: Exploring The Potential Of Artificial Intelligence To Understand And Simulate Family Dynamics And Cultural Identity, Emily Barnes, James Hutson

Faculty Scholarship

The rapid advancement of Artificial Intelligence (AI) has significantly impacted various domains. Yet, the exploration of AI's potential to develop a deep understanding of family culture and identity remains underexplored. This study introduces the concept of "a love of grandma and apple pie" to symbolize the potential of various AI to internalize and appreciate familial relationships, cultural traditions, and personal identity. The proposed study would investigate how an advanced deep learning model, trained on diverse unstructured datasets—including multimedia data from 100 families-could learn and reflect human-like emotions, values, and cultural understanding. Utilizing Convolutional Neural Networks (CNNs) for visual data processing …

Technoculture And Language Models In Archaeology: Reconstructing And Preserving Cultural Narratives Through Digital Humanities, James Hutson

Faculty Scholarship

Technoculture, which examines the intersection of culture and technology, has increasingly permeated archaeological practice, transforming both scholarly research and public engagement [1-3]. The introduction of digital tools such as virtual reality (VR), geographic information systems (GIS), and large language models (LLMs) has democratized access to archaeological knowledge, enabling communities to engage more actively with their cultural heritage [4-6]. This short article explores the mutual influence of technocultural studies and AI technologies on archaeology, with a focus on the preservation and reconstruction of cultural narratives through digital means.

The first aspect of this intersection lies in how technocultural tools are creating …

Artificial Intelligence In Orthopaedic Education: A Comparative Analysis Of Chatgpt And Bing Ai’S Orthopaedic In-Training Examination Performance, Clark Chen, Vivek Biololikar, Duncan Vannest, James Raphael, Gene Shaffer

Einstein Health Papers

Background: This study evaluated the performance of generative artificial intelligence (AI) models on the Orthopaedic In-Training Examination (OITE), an annual exam administered to U.S. orthopaedic residency programs. Methods: ChatGPT 3.5 and Bing AI GPT 4.0 were evaluated on standardised sets of multiple-choice questions drawn from the American Academy of Orthopaedic Surgeons OITE online question bank spanning 5 years (2018–2022). A total of 1165 questions were posed to each AI system. The performance of both systems was standardised using the latest versions of ChatGPT 3.5 and Bing AI GPT 4.0. Historical data of resident scores taken from the annual OITE technical …

Multi-Modal Alignment Via Hyperbolic Geometry, Suyu Liu

Dissertations and Theses Collection (Open Access)

Strong capabilities of generalization to unseen domains are vital for deep neural networks. While existing methods have shown promising results without source domain access, they mostly rely on models that are extensively pre-trained on source domains or overlook the intricate hierarchical structures inherent in visual and textual features. These limitations may have bad impacts on performances, especially on datasets with many classes. To overcome this, in this paper we propose a novel approach that projects the model onto hyperbolic geometry and employs geometric optimal transport to align cross-modal features in an unsupervised manner. Unlike Euclidean geometry, hyperbolic geometry is characterized …

Quality Assurance In Software Engineering: A Journey Towards Explainable Automated Solutions, Ratnadira Widyasari

Dissertations and Theses Collection (Open Access)

In today's digital era, the pervasive influence of software on daily life underscores the necessity for high-quality and reliable systems. Software failures can result in substantial harm and financial losses, highlighting the pivotal role of Software Quality Assurance (SQA). While automated SQA techniques have evolved to aid developers in ensuring software quality, the necessity for explainability in these automated solutions has become equally important. For example, in automated fault localization, only identifying suspicious locations is insufficient; it is essential to provide reasoning on why these locations are suspicious. This dissertation presents a series of interconnected studies aimed at developing explainable …

Machine Visual Perception For Autonomous Docking Maneuvers, Derek B. Worth

Theses and Dissertations

This dissertation presents a novel approach to autonomous docking using machine learning for visual perception, particularly during probe and drogue aerial refueling. Autonomous vehicles have become pervasive in both civilian and defense sectors, and their ability to interact with their surroundings and each other autonomously is critical for future operations. Traditional methods relying on signals or inertial sensors face significant limitations such as interference, jamming, and drift. This research focuses on developing a computer vision-based solution to overcome these limitations. A novel pipeline, termed relative vectoring, is introduced, which utilizes dual object detection and machine learning to estimate relative positions …

Enabling Emg-Based Silent Speech Transcription Through Speech-To-Text Transfer Learning, Alexander T. Garcia

Master's Theses

In recent years, advances in deep learning have allowed various forms of electrographic signals, such as electroencephalography (EEG) and electromyography (EMG), to be used as a viable form of input in artificial intelligence applications, particularly for applications in the medical field. One such topic that EMG inputs have been used is in silent speech interfaces, or devices capable of processing speech without an audio-based input. The goal of this thesis is to explore a novel method of training a machine learning model to be used for silent speech interface development: using transfer learning to leverage a pre-trained speech recognition model …

Performance Of 5 Prominent Large Language Models In Surgical Knowledge Evaluation: A Comparative Analysis, Adam M. Ostrovsky, Joshua R. Chen, Vishal N. Shah, Babak Abai

Department of Surgery Faculty Papers

No abstract provided.

Fdi : Attack Neural Code Generation Systems Through User Feedback Channel, Zhensu Sun, Xiaoning Du, Xiapu Luo, Fu Song, David Lo, Li Li

Research Collection School Of Computing and Information Systems

Neural code generation systems have recently attracted increasing attention to improve developer productivity and speed up software development. Typically, these systems maintain a pre-trained neural model and make it available to general users as a service (e.g., through remote APIs) and incorporate a feedback mechanism to extensively collect and utilize the users' reaction to the generated code, i.e., user feedback. However, the security implications of such feedback have not yet been explored. With a systematic study of current feedback mechanisms, we find that feedback makes these systems vulnerable to feedback data injection (FDI) attacks. We discuss the methodology of FDI …

Quantum-Enhanced Simulation-Based Optimization For Newsvendor Problems, Monit Sharma, Hoong Chuin Lau, Rudy Raymond

Research Collection School Of Computing and Information Systems

Simulation-based optimization is a widely used method to solve stochastic optimization problems. This method aims to identify an optimal solution by maximizing the expected value of the objective function. However, due to its computational complexity, the function cannot be accurately evaluated directly, hence it is estimated through simulation. Exploiting the enhanced efficiency of Quantum Amplitude Estimation (QAE) compared to classical Monte Carlo simulation, it frequently outpaces classical simulation-based optimization, resulting in notable performance enhancements in various scenarios. In this work, we make use of a quantum-enhanced algorithm for simulation-based optimization and apply it to solve a variant of the classical …

How Effective Are They? Exploring Large Language Model Based Fuzz Driver Generation, Cen Zhang, Yaowen Zheng, Mingqiang Bai, Yeting Li, Wei Ma, Xiaofei Xie

Research Collection School Of Computing and Information Systems

Fuzz drivers are essential for library API fuzzing. However, automatically generating fuzz drivers is a complex task, as it demands the creation of high-quality, correct, and robust API usage code. An LLM-based (Large Language Model) approach for generating fuzz drivers is a promising area of research. Unlike traditional program analysis-based generators, this text-based approach is more generalized and capable of harnessing a variety of API usage information, resulting in code that is friendly for human readers. However, there is still a lack of understanding regarding the fundamental issues on this direction, such as its e ectiveness and potential challenges. To …

Genixer : Empowering Multimodal Large Language Models As A Powerful Data Generator, Henry Hengyuan Zhao, Pan Zhou, Mike Zheng Shou

Research Collection School Of Computing and Information Systems

Multimodal Large Language Models (MLLMs) demonstrate exceptional problem-solving capabilities, but few research studies aim to gauge the ability to generate visual instruction tuning data. This paper proposes to explore the potential of empowering MLLMs to generate data independently without relying on GPT-4. We introduce Genixer, a comprehensive data generation pipeline consisting of four key steps: (i) instruction data collection, (ii) instruction template design, (iii) empowering MLLMs, and (iv) data generation and filtering. Additionally, we outline two modes of data generation: task-agnostic and task-specific, enabling controllable output. We demonstrate that a synthetic VQA-like dataset trained with LLaVA1.5 enhances performance on 10 …

A Two-Stage Matheuristic For The Home Healthcare Routing And Scheduling Problem With Perishable Products, Aldy Gunawan, Nabila Yuraisyah Salsabila, Vincent F. Yu, Pham Kien Minh Nguyen

Research Collection School Of Computing and Information Systems

This study proposes a home healthcare routing and scheduling problem, where perishable products such as medicines, vaccines, or meals must be provided for some patients’ treatments. This problem is formulated as a mixed integer linear programming (MILP). A two-stage matheuristic is then developed as the solution approach. The first stage is a local search to solve the nurse routing problem, and the second stage is run as the relaxed MILP to solve the scheduling problem. The matheuristic is tested on newly generated instances and compared with the results of CPLEX. The proposed matheuristic is able to obtain CPLEX solutions within …

Fintech Digital Transformation: Generative Ai, Humanoid Robots, Metaverse, Human-Ai Collaboration, And Industry 5.0, Yuxin Liu, Runyu Wang, Keng Siau

Research Collection School Of Computing and Information Systems

This paper discusses the transformative impact of emerging digital technologies on the digital transformation of the financial industry, focusing on integrating Generative AI (GenAI), humanoid robots, and the Metaverse within the framework of Industry 5.0. Industry 5.0 emphasizes a human-centric approach to technology, where human-AI collaboration plays a central role in reshaping financial services. By reviewing both academic research and practical applications, the paper highlights the current advancements in FinTech, particularly in AI technologies and the Metaverse, and their future potential, demonstrating how these innovations are driving growth, efficiency, and resilience in the financial sector. Further, the paper proposes a …

Sound And Complete Witnesses For Template-Based Verification Of Ltl Properties On Polynomial Programs, Krishnendu Chatterjee, Amir Goharshady, Ehsan Goharshady, Mehrdad Karrabi, Dorde Zikelic

Research Collection School Of Computing and Information Systems

We study the classical problem of verifying programs with respect to formal specifications given in the linear temporal logic (LTL). We first present novel sound and complete witnesses for LTL verification over imperative programs. Our witnesses are applicable to both verification (proving) and refutation (finding bugs) settings. We then consider LTL formulas in which atomic propositions can be polynomial constraints and turn our focus to polynomial arithmetic programs, i.e. programs in which every assignment and guard consists only of polynomial expressions. For this setting, we provide an efficient algorithm to automatically synthesize such LTL witnesses. Our synthesis procedure is both …

Text-Driven Video Prediction, Xue Song, Jingjing Chen, Bin Zhu, Yu-Gang Jiang

Research Collection School Of Computing and Information Systems

Current video generation models usually convert signals indicating appearance and motion received from inputs (e.g., image and text) or latent spaces (e.g., noise vectors) into consecutive frames, fulfilling a stochastic generation process for the uncertainty introduced by latent code sampling. However, this generation pattern lacks deterministic constraints for both appearance and motion, leading to uncontrollable and undesirable outcomes. To this end, we propose a new task called Text-driven Video Prediction (TVP). Taking the first frame and text caption as inputs, this task aims to synthesize the following frames. Specifically, appearance and motion components are provided by the image and caption …

An Empirical Study Of Static Analysis Tools For Secure Code Review, Wachiraphan Charoenwet, Patanamon Thongtanunam, Van-Thuan Pham, Christoph Treude

Research Collection School Of Computing and Information Systems

Early identification of security issues in software development is vital to minimize their unanticipated impacts. Code review is a widely used manual analysis method that aims to uncover security issues along with other coding issues in software projects. While some studies suggest that automated static application security testing tools (SASTs) could enhance security issue identification, there is limited understanding of SAST’s practical effectiveness in supporting secure code review. Moreover, most SAST studies rely on synthetic or fully vulnerable versions of the subject program, which may not accurately represent real-world code changes in the code review process. To address this gap, …

Getting To The Point: Contrasting Directness And Warmth In Motivational Embodied Conversational Agents, Michael O'Mahony, Cathy Ennis, Robert Ross

Conference papers

Enhancing long-term engagement with conversational agents remains a significant challenge. Controlling the perceived warmth or directness of an agent’s personality through the style of its generated text could be used to increase user likeability. This paper reports an investigation of a Wizard-of-Oz (WoZ) mediated study of two variants of a motivational embodied conversational agent to measure user perception of and attitudes towards warmth in interaction style. Results show a significant effect of users preferring an agent with a "more direct" personality for this scenario, though this effect is in many ways nuanced.

Diabetes Technology Meeting 2023, Tiffany Tian, Rachel E Aaron, Ashley Y Dunova, Johan H Jendle, David Kerr, Eda Cengiz, Andjela Drincic, John C Pickup, Kong Y Chen, Naomi Schwartz, Douglas B Muchmore, Halis K Akturk, Carol J Levy, Signe Schmidt, Riccardo Bellazzi, Alan H B Wu, Elias K Spanakis, Bijan Najafi, James Geoffrey Chase, Jane Jeffrie Seley, David C Klonoff

Center on Aging Staff Publications

Diabetes Technology Society hosted its annual Diabetes Technology Meeting from November 1 to November 4, 2023. Meeting topics included digital health; metrics of glycemia; the integration of glucose and insulin data into the electronic health record; technologies for insulin pumps, blood glucose monitors, and continuous glucose monitors; diabetes drugs and analytes; skin physiology; regulation of diabetes devices and drugs; and data science, artificial intelligence, and machine learning. A live demonstration of a personalized carbohydrate dispenser for people with diabetes was presented.

Federated Learning Systems For Mobile Sensing Data, Xiaopeng Jiang

Dissertations

Federated Learning (FL) has emerged as a new distributed Deep Learning (DL) paradigm that enables privacy-aware training and inference on mobile devices with help from the cloud. This dissertation presents a comprehensive exploration of FL with mobile sensing data, covering systems, applications, and optimizations.

First, a mobile-cloud FL system, FLSys, is designed to balance model performance with resource consumption, tolerate communication failures, and achieve scalability. In FLSys, different DL models with different FL aggregation methods can be trained and accessed concurrently by different apps. In addition, FLSys provides advanced privacy-preserving mechanisms and a common API for third-party app developers to …

Ai And Academic Integrity, Max Sparkman Research Instruction Librarian, Milne Library, Brandon West Head Of Research & Instruction, Milne Library

Artificial Intelligence, 2024-25

This short module introduces students to important concepts regarding the use of AI and academic integrity. Concepts covered include a brief overview of generative AI, whether or not their use is considered plagiarism, how to use generative AI tools responsibly, and potential use cases. The module ends with a quiz where students can apply concepts from the module to three scenarios.

Module: Ai And Value-Neutrality, Jonathan Auyer Ph.D., Department Of Philosophy

Artificial Intelligence, 2024-25

Artificial Intelligence is on the tips of everyone’s tongues these days – What exactly is it? What will can it be used for? What will it be used for in the future? What problems will it create or solve or exacerbate? This learning module aims to look at a specific facet of AI — the issue of value-neutrality — by having students look inward at capabilities necessary for human flourishing and then ask whether AI can cultivate (or inhibit) those capabilities. This will lead to a discussion of what values underlie AI and what this says about whether or not …

Chatgpt Can Write My Class Assignments, Right?: A Guided Classroom Activity For Teaching The Strengths And Weaknesses Of Generative-Ai Tools, Dr. Peter J. Kalenda Assistant Professor, Elementary Science & Math, School Of Education

Artificial Intelligence, 2024-25

This module is designed to support your undergraduate or graduate students with developing an understanding of:

• How to use generative-AI tools, like ChatGPT,
• The strengths and weaknesses of generative-AI tools for completing different tasks,
• How to design and revise a classroom presentation that is aligned with course topics and objectives by using generative-AI tools as a resource, and
• How to engage in prompt engineering and prompt revision for generative-AI tools.

Your students are being tasked with creating an engaging presentation they will deliver to their peers that aligns with the topics and learning objectives of your course. However, they will …

As Soon As [A]I Speak[S], Lytton Smith Professor Of Poetry, Department Of English

Artificial Intelligence, 2024-25

This guide facilitates the delivery of a two-workshop sequence allowing students to understand how an Artificial Intelligence (AI) Large Language Model (LLM) composes poetry, and to use that knowledge to compose their own poem for optional display in both electronic and physical form. Students may participate in either/both workshops, and in each will engage in reflective work to understand how AI impacts them and vice versa. This guide and curriculum aligns with the "Contemporary Global Challenges, Creativity and Innovation" Participation in a Global Society outcome within the Geneseo GLOBE Curriculum.

Creating A Business In 50 Minutes With Ai, Mark A. Rider Vanarsdale Chair In Entrepreneurship, School Of Business

Artificial Intelligence, 2024-25

This lesson plan explores using artificial intelligence (AI) to enhance the process of business idea generation and validation. Over a dynamic 50-minute workshop, students will engage with AI tools, particularly Microsoft's Copilot, to develop viable business concepts aligned with their personal interests and market needs.

The session begins with the Ikigai exercise, guiding students to identify their passions, strengths, and potential economic opportunities. Following this, students will use AI to engage in divergent thinking, generating a wide range of business ideas and refining them through iterative prompts until they find promising concepts.

In the validation phase, students will employ AI …