Artificial Intelligence and Robotics Commons^™

Evaluation And Distillation Of Source Code Generation Tasks By Large Language Models, Danny Brahman

Electronic Theses and Dissertations

Large Language Models (LLMs) are predominantly assessed based on their common sense reasoning, language comprehension, and logical reasoning abilities. While models trained in specialized domains like mathematics or coding have demonstrated remarkable advancements in logical reasoning, there remains a significant gap in evaluating their code generation capabilities. Existing benchmark datasets fall short in pinpointing specific strengths and weaknesses, impeding targeted enhancements in models’ reasoning abilities to synthesize code.

To bridge this gap, this thesis introduces two novel contributions: CodeEval and CodeQual. CodeEval is an innovative, pedagogical benchmarking method that mirrors the evaluation processes encountered in academic programming courses. It comprises …

Ms110 Syllabus: Introduction To Computers, Information Systems, And Artificial Intelligence, Wei Zhang

Management Science and Information Systems Faculty Publication Series

This is a syllabus for Professor Wei Zhang's MS110: Introduction to Computers, Information Systems and Artificial Intelligence Course within UMass Boston's College of Management. This is an Open Educational Resource and can be remixed, copied, redistributed, altered and reused as long as permission is given to the original creator.

A View Under The Hood: Duquesne Kline's Law And Computing Program, Wesley M. Oliver, Katherine L.W. Norton, Martin Mckown, David Horrigan

West Virginia Law Review

No abstract provided.

Addressing The Problems Of Data Variations, Quality, And Scarcity In Training Deep Neural Networks, Jian Sun

Electronic Theses and Dissertations

The performance of deep neural networks (DNNs) is strongly influenced by the characteristics and quality of the underlying datasets. This Ph.D. dissertation addresses three pervasive data challenges-imbalance, quality degradation, and scarcity-that commonly hinder the effectiveness of DNNs in computer vision (CV) and natural language processing (NLP) applications.

Class imbalance remains one of the most frequent causes of degraded model generalization. While Focal Loss effectively mitigates inter-class imbalance by assigning higher weights to minority classes, it struggles with intra-class imbalance, particularly in video datasets where longer clips dominate feature representation. To address this, I implement and utilize …

Llm-Driven Weekly Newsletter To Assess Open Source Software Project Github Health, Christian Novalski, Christopher Chavez, Ghalian Fayyadh, Kostadin Damevski

Undergraduate Research Posters

Open Source Software (OSS) projects increasingly depend on a diverse set of contributors, including episodic participants who contribute intermittently. Episodic contributors represent a large portion of OSS communities, yet projects often struggle to retain them, leading to decreased project health and continuity. While dashboards and real-time communication tools support continuously active contributors, they often fail to serve the unique needs of episodic participants, who may struggle to remain informed and re-engage with project activity after periods of absence. In this study, we examine the effect of a weekly, email-based newsletter intervention designed to improve awareness and engagement among episodic OSS …

Visualizing And Evaluating Binary Classifier Performance With Contingency Space, Colin D. Kehoe, Azim Ahmadzadeh

Undergraduate Research Symposium

Traditional metrics for evaluating binary classifiers, such as Accuracy, F1 Score, and True Skill Statistic (TSS), often obscure the underlying tradeoffs between true positive and true negative performance—particularly in imbalanced or high-stakes domains. This poster introduces the Contingency Space, a two-dimensional representation of classifier behavior defined by true positive rate (TPR) and true negative rate (TNR). Within this space, scalar performance metrics become geometric surfaces, revealing how scores vary across the entire landscape of possible classifier outputs.

We present a Python package that implements this framework, enabling users to map model predictions into the Contingency Space, visualize metric surfaces …

Archaeological Predictive Meta-Modeling In Pre-Columbian Mexico, Peter Stamm

Electronic Theses and Dissertations

Archaeological Predictive Modeling stands firmly as an important tool for Archaeologists to predict undiscovered sites from civilizations all across the globe. While powerful, this methodology is not without its own set of qualms. Striking a balance between pure a data-driven approach while also observing leading expert theories can be a complicated task. Going further, deciding on the specific domain of features to emphasize or overlook can be a challenge within itself, as one misstep can drastically change the output of model, sometimes for the worst. In addition, creating models that can expose their reasoning process can be rather difficult to …

Csc36000 - Modern Distributed Computing Assignment, Saptarashmi Bandyopadhyay

Open Educational Resources

This assignment covers standard performance metrics for Distributed Systems and the basics of Multiprocessing for CSC36000 - Modern Distributed Computing at the City College of New York CUNY. It is an interactive coding assignment intended to be executed in a Python notebook.

Multi-Label Classification Of Acoustic And Electronic Drum Sounds Using Machine Learning, Sean Perman

Electronic Theses and Dissertations

This paper presents a system for multi-class classification of drum sounds using audio signal processing and machine learning techniques. The project utilizes a diverse dataset of both acoustic and electronic drum samples and extracts ten distinct audio features to capture the timbral and temporal characteristics of each sound. The methodology includes signal preprocessing, feature extraction, and the application of supervised classification algorithms to distinguish between multiple drum classes. Experimental evaluations demonstrate that the selected features significantly enhance classification accuracy across a varied dataset. These findings underscore the effectiveness of combining traditional audio processing with modern machine learning, offering promising applications …

Collaborative Federated Learning For Robots In Heterogeneous Environments, Karlan Schneider

Electronic Theses and Dissertations

This research investigates the performance of Federated Averaging (FedAvg) in simulated Federated Learning (FL) scenarios with varying degrees of environmental heterogeneity among robotic agents. The study explores the impact of data heterogeneity on both the convergence of FedAvg and the fairness of learning, with regard to consistency of performance across agents. Experiments were conducted with simulated robots trained to perform a target collection task, where a subset of agents encountered an unfamiliar environment. The results demonstrate that while FedAvg exhibits resilience to the introduction of new environmental data, it struggles to ensure both convergence and fairness in heterogeneous settings. Specifically, …

Extending Feature-Based Detection For Artificial Intelligence, Kayla Ahrndt

SPARK Symposium Presentations

AI text generation is rapidly developing, and, as a result, it is becoming increasingly difficult to differentiate it from human written text. Our base study by Leon Fröhling et al. proposed a feature-based detection model trained on GPT2, GPT3, and Grover data, as well as human-generated text. Our work extends their research by training a modified model with four neural networks on word embeddings, select features from the original study, as well as updated data (GPT3, GPT4, and Grover).

Investigating Key Structures In Protective Scenes For Llms, Eben M. Weisman

University Honors Theses

This research delves into the realm of "protective scenes" within Large Language Models (LLMs), exploring their impact on bias mitigation, deception, and context preservation. The study investigates the use of roleplay prompting human-like behavior and reasoning in LLMs, focusing on the Character-LLM framework's concept of protective scenes with graduated levels of protection. By combining insights from psychology, cognitive science, and computational analysis, this research aims to develop a framework for understanding how protective scenes influence roleplay performance in LLMs, ultimately contributing to the development of more reliable and ethical AI systems.

Csc36000 - Modern Distributed Computing Assignment 2, Saptarashmi Bandyopadhyay

Open Educational Resources

This assignment is designed to help the student identify and mitigate common errors in Distributed Computing such as race conditions and reaching consensus, as well as reflecting on how Distributed Computing concepts apply to their class project.

Graph Neural Networks Powered Scientific Paper Recommendation, Junhao Shen

Computer Science and Engineering Theses and Dissertations

Scientific paper recommendation systems aim to help researchers discover relevant papers amidst the vast and ever-growing body of literature. With the exponential yearly increase in scientific publications, the demand for effective paper recommendation solutions has become both critical and increasingly challenging. In recent years, deep learning techniques have revolutionized recommender systems, and scientific paper recommendations have naturally integrated these advancements. In this dissertation, we address these challenges through three progressive contributions.

First, we enhance traditional content-based methods using Graph Neural Networks (GNNs) by introducing a Graph Convolutional Network-strengthened Topic Modeling (GCN-TM) approach. This method improves upon conventional topic modeling techniques …

Between Copyright And Computer Science: The Law And Ethics Of Generative Ai, Devin R. Desai, Mark Riedl

Northwestern Journal of Technology and Intellectual Property

Copyright and computer science continue to intersect and clash, but they can coexist. The advent of new technologies such as digitization of visual and aural creations, sharing technologies, search engines, social media offerings, and more, challenge copyright-based industries and reopen questions about the reach of copyright law. Breakthroughs in artificial intelligence research, especially Large Language Models that leverage copyrighted material as part of training, are the latest examples of the ongoing tension between copyright and computer science. The exuberance, rush-to-market, and edge problem cases created by a few misguided companies now raises challenges to core legal doctrines and may shift …

Heterogeneous Multi-Robot Person-Following In Constrained Environments, Ori A. Miller

Electronic Theses and Dissertations

Maintaining visibility of a person requires effective systems. Security cameras or ground robots might be ideal, but they often fail in uncontrolled or unknown environments. A single ground robot struggles to navigate and track an agent at the same time. This work addresses the challenge by developing a multi-robot system with a slow ground robot and an agile aerial robot. Three methods are evaluated: FORWARD-PF, RL-Person Following (RL), and a baseline closed-loop method. FORWARD-PF proved the most reliable, completing all nine paths and reaching targets nearly twice as fast as RL. Despite completing seven paths, RL faltered on complex tasks. …

Bridging Design And Perception: Novel Tools And Technologies For Creating Effective Human-Robot Interactions, Benjamin Dossett

Electronic Theses and Dissertations

This thesis explores human perception of robots through the use of novel tools and technologies. First, the impact of Augmented Reality (AR) data presentation on human perception of robots is investigated. A study conducted with the AR human-robot teaming system found that robot performance significantly influenced participants’ perceptions, overshadowing the impact of matching or mismatching robot confidence feedback. Second, the DU Want to Build-A-Bot platform is presented, which enables participatory robot design and opens the door for novel research of how robot design affects human perception. The Build-A-Bot platform enables the collection of diverse robot designs, facilitating machine learning analysis …

An Empirical Study Of Machine Learning Techniques For Accurate Stock Price Forecasting, Daniel Paliulis, Hari Patchigolla

Honors Scholar Theses

This paper presents a comprehensive approach to predicting future stock prices of companies using machine learning and time series analysis. The research problem is centered around addressing the complexity and emotion-driven nature of stock investment decisions. To create an objective determinant in stock decisions, we propose a machine learning model utilizing time series data from major companies, including Amazon, Apple, Google, Nvidia, Meta, Tesla, Salesforce, Intel, and Microsoft. We explore the use of Long Short-Term Memory (LSTM) neural networks, to capture the temporal dynamics of stock prices. These models are designed to process sequential data, maintaining short term and long …

Terrain And Adversary-Aware Autonomous Robot Navigation, Aniekan Ufot Inyang

Electronic Theses and Dissertations

In autonomous robot navigation, the robot is able to understand the environment around it for intelligent navigation. From its world model of this environment, it generates a global plan for navigation from a position to a goal based on different factors. This research aims to implement autonomous robot navigation by learning terrain affordances: traversability (moving quickly) and concealment (staying hidden from an adversary) using the Preference-based Inverse Reward Learning (PbIRL) methodology. The PbIRL methodology reduces the barrier of generating initial demonstration data to learn the terrain affordances by using a human expert’s preferences to learn individual weights over the terrain …

An Investigation Into Machine Learning Techniques For Designing Dynamic Difficulty Agents In Real-Time Games, Ryan Adare Dunagan

Electronic Theses and Dissertations

Video games are an incredibly popular pastime enjoyed by people of all ages world wide. Many different kinds of games exist, but most games feature some elements of the player overcoming some challenge, usually through gameplay. These challenges are insurmountable for some people and may turn them off to video games as a pastime. Games can be made more accessible to players of little skill and/or experience through the use of Dynamic Difficulty Adjustment (DDA) systems that adjust the difficulty of the game in response to the player’s performance. This research seeks to establish the effectiveness of machine learning techniques …

Automated Classification Of Pectinodon Bakkeri Teeth Images Using Machine Learning, Jacob A. Bahn

MS in Computer Science Project Reports

Microfossil dinosaur teeth are studied by paleontologists in order to better under- stand dinosaurs. Currently, tooth classification is a long, manual, error-ridden process. Deep learning offers a solution that allows for an automated way of classifying images of these microfossil teeth. In this thesis, we aimed to use deep learning in order to develop an automated approach for classifying images of Pectinodon bakkeri teeth. The proposed model was trained using a custom topology and it classified the images based on clusters created via K-Means. The model had an accuracy of 71%, a precision of 71%, a recall of 70.5%, and …

Design, Determination, And Evaluation Of Gender-Based Bias Mitigation Techniques For Music Recommender Systems, Sunny Shrestha

Electronic Theses and Dissertations

The majority of smartphone users engage with a recommender system on a daily basis. Many rely on these recommendations to make their next purchase, download the next game, listen to the new music or find the next healthcare provider. Although there are plenty of evidence backed research that demonstrates presence of gender bias in Machine Learning (ML) models like recommender systems, the issue is viewed as a frivolous cause that doesn’t merit much action. However, gender bias poses to effect more than half of the population as by default ML systems are designed to cater to a cisgender man. This …

Terrain Cost Learning From Human Preferences For Robot Path Planning Using A Visual User Interface, Kaivalya Velagapudi

Electronic Theses and Dissertations

Robot navigation in terrains with limited exploration and limited knowledge has been a problem of interest in robotics due to the potential dangers that may arise during traversal. Due to the large number of path permutations within a complex and feature-rich real-world environment, and in the interest of saving time and ensuring safety, the robot should learn the optimal path without repeated exploration of the terrain. This can be accomplished by leveraging the path preferences of a human operator so that, with selective inputs, the agent can effectively learn a terrain-cost mapping in order to determine the optimal route, thereby …

Wordmuse, John M. Nelson

Computer Science and Software Engineering

Wordmuse is an application that allows users to enter a song and a list of keywords to create a new song. Built on Spotify's API, this project showcases the fusion of music composition and artificial intelligence. This paper also discusses the motivation, design, and creation of Wordmuse.

Predicting Startup Success Using Publicly Available Data, Emily Gavrilenko

Master's Theses

Predicting the success of an early-stage startup has always been a major effort for investors and venture funds. Statistically, there are about 305 million total startups created in a year, but less than 10% of them succeed to become profitable businesses. Accurately identifying the signs of startup growth is the work of countless investors, and in recent years, research has turned to machine learning in hopes of improving the accuracy and speed of startup success prediction.

To learn about a startup, investors have to navigate many different internet sources and often rely on personal intuition to determine the startup’s potential …

Human Trafficking And Machine Learning: A Data Pipeline From Law Agencies To Research Groups, Nathaniel Hites

Computer Science and Engineering Theses and Dissertations

Human trafficking is a form of modern-day slavery that, while highly illegal, is more dangerous with the advancements of modern technology (such as the Internet), which allows such a practice to spread more easily and quickly all over the world. While the number of victims of human trafficking is large (according to non-profit organization Safe House, there are estimated to be about 20.5 million human trafficking victims, worldwide (“Human Trafficking Statistics & Facts.” Safe Horizon)- co-erced or manipulated by traffickers into either forced labor, or sexual exploitation and encounters), the number of heard cases is proportionally low- several thousand successful …

Improved Sensor-Based Human Activity Recognition Via Hybrid Convolutional And Recurrent Neural Networks, Sonia Perez-Gamboa

Electronic Theses, Projects, and Dissertations

Non-intrusive sensor-based human activity recognition is utilized in a spectrum of applications including fitness tracking devices, gaming, health care monitoring, and smartphone applications. Deep learning models such as convolutional neural networks (CNNs) and long short-term memory (LSTMs) recurrent neural networks provide a way to achieve human activity recognition accurately and effectively. This project designed and explored a variety of multi-layer hybrid deep learning architectures which aimed to improve human activity recognition performance by integrating local features and was scale invariant with dependencies of activities. We achieved a 94.7% activity recognition rate on the University of California, Irvine public domain dataset …

Multi-Agent Pathfinding In Mixed Discrete-Continuous Time And Space, Thayne T. Walker

Electronic Theses and Dissertations

In the multi-agent pathfinding (MAPF) problem, agents must move from their current locations to their individual destinations while avoiding collisions. Ideally, agents move to their destinations as quickly and efficiently as possible. MAPF has many real-world applications such as navigation, warehouse automation, package delivery and games. Coordination of agents is necessary in order to avoid conflicts, however, it can be very computationally expensive to find mutually conflict-free paths for multiple agents – especially as the number of agents is increased. Existing state-ofthe- art algorithms have been focused on simplified problems on grids where agents have no shape or volume, and …

Highlights Generation For Tennis Matches Using Computer Vision, Natural Language Processing And Audio Analysis, Alon Liberman

Senior Independent Study Theses

This project uses computer vision, natural language processing and audio analysis to automatize the highlights generation task for tennis matches. Computer vision techniques such as camera shot detection, hough transform and neural networks are used to extract the time intervals of the points. To detect the best points, three approaches are used. Point length suggests which points correspond to rallies and aces. The audio waves are analyzed to search for the highest audio peaks, which indicate the moments where the crowd cheers the most. Sentiment analysis, a natural language processing technique, is used to look for points where the commentators …

Plant Disease Detection Through Convolutional Neural Networks: A Survey Of Existing Literature, Best Practices, And Implementation, Kevin Label

Master's Theses

In the United States alone, common diseases spread among plants account for billions of dollars lost in crop yield each year. This issue is exacerbated in countries with less infrastructure to defend against crop epidemics, and can lead to famine and forced migration. Farmers can seek the help of plant pathology experts to defend against diseases and detect crop irregularities early on. However, access to experts can be difficult, and even those trained in the field may miss symptoms before it is too late. To assist in early disease detection, a number of papers have been released on the potential …