Computer Sciences Commons^™

Math, Chatgpt, And You: The Problem With Mathematical Accuracy In Large Language Models, Alexandre M. Hamel

Computer Science Senior Theses

ChatGPT and other Large Language Models (LLMs) currently do a good job at generating novel text across many domains, but math remains a consistent issue when it comes to the accuracy of answers generated by these models. My research into various ways to manipulate the model have led me to the conclusion that a general closed form solution to help LLMs with math is both unrealistic and likely impossible. LLMs can be trained more successfully as you narrow the problem space, but consideration must be taken on the part of human user to recognize when an LLM is detrimental to …

Space Bounds For Estimating Minimum Norm Of Solutions In Underconstrained Systems, Jeffrey Jiang

Computer Science Senior Theses

In this work, we wish to investigate the following situation: suppose we are in an underconstrained linear system where observations are constant but predictors are streaming in. That is, the number of predictors—and therefore the dimensionality of our solution—is changing. How hard is it for a streaming algorithm to maintain the ”size” or norm of the solution if we are constrained in space? More informally, can we keep track of the norm of the solution as new data is streaming in without naively memorizing all data and computing the solution directly? We first show a lower bound that any streaming …

Open Source Supply Chain Security: A Cost-Benefit Analysis Of Achieving Various Security Thresholds In Build Environments, Carly Retterer

Computer Science Senior Theses

Open source software has become a cornerstone of modern software development, offering unparalleled opportunities for innovation and collaboration. However, its widespread adoption has also introduced a host of security vulnerabilities, particularly in the software supply chain. This paper provides a comprehensive cost-benefit analysis of achieving various security thresholds to harden the build environment, focusing on isolated, hermetic, reproducible, and bootstrappable builds. For each build type, we provide a clear definition and outline the steps required for implementation. We then evaluate the associated costs and benefits of each build, emphasizing their roles in strengthening the build environment and enhancing supply chain …

Whisper: Proximity-Based Authentication For Securely Sharing Secrets, Charles A. Vogel

Computer Science Senior Theses

Cryptography offers a wide arsenal of encryption methods to enable secure communication between two
devices that have already exchanged a shared secret. Existing techniques for exchanging a shared secret,
however, are often vulnerable to man-in-the-middle attacks, require special hardware for out-of-band com-
munications, or require a pre-existing Internet connection. With the constantly increasing prevalence of
Internet of Things (IoT) devices sharing sensitive information via wireless networks, the need for a method
to establish secure communication is more pressing than ever.
With this context, we present Whisper, a novel technique that combines elements of digital commu-
nication theory, cryptography, and probability …

Examining Differences In Concept Representation Across Similarity Spaces Between Humans And Large Language Models, Krishnachandra Nair

Computer Science Senior Theses

The replication of human concept representation is a critical task for the pursuit of artificial general intelligence. With the recent influx of large language models that demonstrate text-generation capabilities nearly on par with humans, the question stands on whether these large language models can capture concepts within language. We examine this question by exploring differences in concept representation across similarity spaces between humans and LLMs. We find that, while concept representation within LLMs does partially mimic human concept representation, LLMs are greatly limited by their dependence on semantic information and cannot therefore develop an understanding of human social code or …

Ripl: Recursive Inference For Policy Learning, Kunal Jha, Jeremy R. Manning, Alberto Quattrini Li

Computer Science Senior Theses

Humans excel at understanding the thoughts and intentions of others (theory of mind) and leverage this ability to learn and adapt in social environments. However, replicating this capability in artificial agents remains a challenge. This paper explores the gap between fast, efficient learning often achieved by Reinforcement Learning (RL) algorithms and the interpretability and adaptability desired in agents interacting with humans. We propose a novel approach that integrates an inference network within existing RL frameworks. This allows agents to reason about the beliefs of others (nested reasoning) while learning optimal actions. Our method leverages approximate solutions to the I-POMDP framework, …

Embodied Visions: Interactive Installations That Reimagine Bodily Presence In Digital Imaging Apparatuses As Shadows, Yunzi Shi

Dartmouth College Master’s Theses

Contextualized within a history of technological development, the evolution of imaging devices and technologies is accompanied by the abstraction of spatial relationships between the body of the observer, the apparatus, and physical reality, which leads to disembodying experiences for the observing subject. Compared with devices and interactive experiences, critical reflection on the epistemological impact of digital imaging devices has less priority in computational imaging and human-computer interaction research. Taking an artistic approach, this thesis describes Embodied Visions, an exhibition featuring three interactive installations exploring the technical infrastructure for imaging and reflecting on the (dis)embodied experiences in the digital age. …

Towards Machine Proficiency With Semantic Underspecification, Zachary S. Gottesman

Dartmouth College Master’s Theses

Human natural language communication frequently relies on extra-linguistic information to fill in gaps in the linguistic signal left by semantic underspecification, or the omission of details that can be inferred from prior knowledge or other modalities. Underspecification is particularly common in conversations between acquaintances, since these interlocutors share context. Underspecification is a key and beneficial feature of natural language that improves efficiency, although it can cause communication to fail if it is not resolved correctly. For language models to communicate effectively and in a human-like fashion, they must learn how to recognize and utilize underspecified language. This thesis argues that …

Latent Auto-Recursive Composition Engine: A Generative System For Creative Expression In Human-Ai Collaboration, Yenkai Huang

Computer Science Senior Theses

This thesis investigates the shifting boundaries of art in the era of Generative AI, crit-
ically examining the essence of art and the legitimacy of AI-generated works. Despite
significant advancements in the quality and accessibility of art through generative
AI, such creations frequently encounter skepticism regarding their status as authentic
art. To address this skepticism, the study explores the role of creative agency in var-
ious generative AI workflows and introduces an ”artist-in-the-loop” system tailored
for image generation models like Stable Diffusion. This system aims to deepen the
artist’s engagement and understanding of the creative process. Additionally, a novel
tool, …

Simulating Cross-Scale Solid-Fluid Interaction Phenomena, Jinyuan Liu

Dartmouth College Ph.D Dissertations

Solid-fluid interactions are ubiquitous in nature, and accurate simulation methods are essential for realistic animation, industrial design, and engineering analysis. Com- pared to large-scale coupling phenomena, simulating fine-scale interactions poses extra challenges due to factors such as surface tension, material wettability, and geometric complexity. In this thesis, we pursue novel methodologies to accurately model in- terfacial dynamics between surface-tension fluids and codimensional solids, involving capillary interactions, controllable wettability, and robust contact behaviors. Our ini- tial approach involves developing a novel three-way coupling method, which utilizes a thin liquid membrane, modelled as a simplicial mesh, to facilitate accurate momen- tum transfer, …

We Need A “Building Inspector For Iot” When Smart Homes Are Sold, Timothy J. Pierson, Cesar Arguello, Beatrice Perez, Wondimu Zegeye, Kevin Kornegay, Carl A. Gunter

Dartmouth Scholarship

Internet of Things (IoT) devices left behind when a home is sold create security and privacy concerns for both prior and new residents. We envision a specialized “building inspector for IoT” to help securely facilitate transfer of the home.

Toward The Integration Of Behavioral Sensing And Artificial Intelligence, Subigya K. Nepal

Dartmouth College Ph.D Dissertations

The integration of behavioral sensing and Artificial Intelligence (AI) has increasingly proven invaluable across various domains, offering profound insights into human behavior, enhancing mental health monitoring, and optimizing workplace productivity. This thesis presents five pivotal studies that employ smartphone, wearable, and laptop-based sensing to explore and push the boundaries of what these technologies can achieve in real-world settings. This body of work explores the innovative and practical applications of AI and behavioral sensing to capture and analyze data for diverse purposes. The first part of the thesis comprises longitudinal studies on behavioral sensing, providing a detailed, long-term view of how …

Towards Scalable Autonomous Underwater Construction With Free-Floating Robots, Samuel Eric Lensgraf

Dartmouth College Ph.D Dissertations

This thesis presents the first free-floating autonomous underwater construction system. Our system built structures weighing up to 100Kg (75Kg in water). Our robot builds structures made of standard cinder blocks and custom designed interlocking cement blocks. It is the first construction robot that uses active buoyancy compensation to efficiently transport building materials. It is also the first construction robot that can reconfigure visual fiducial markers on a foundation during the construction process to expand its working area.

Underwater construction is a challenging problem for free-floating robots. Currents can buffet the robot, and visibility conditions can change. We focus on achieving …

Automated Cinematographer For Vr Viewing Experiences, Zihan Wu

Dartmouth College Master’s Theses

As the virtual reality (VR) industry continues to evolve, the question of how to effectively capture VR experiences for an audience remains a challenge. The predominant method of showcasing VR applications through first-person recordings lacks cinematic interest, failing to capture other viewpoints and the essence of the moment. Meanwhile, manually setting up cameras and editing videos requires technical expertise on behalf of the user. In this paper, we propose the use of machine learning (ML) to automatically select the most compelling predefined viewpoint in a VR environment, at any given moment. Our models, trained on actor motion and voice volume, …

3-D Reconstruction For Underwater Robots With A Monocular Camera And Lights, Monika Roznere

Dartmouth College Ph.D Dissertations

Before a robot can act, it must perceive its environment. Though, this is not a simple task when considering the challenges in underwater domains -- poor visibility conditions, limited sensor configurations, and lack of readily accessible localization. Underwater robots have, nevertheless, improved dramatically with more extensive sensor and navigation equipment. Robot and sensor use have enabled us to explore all reaches of our oceans. On the other hand, these same robots are not easily accessible or transferable to many practical tasks, including fishery management, infrastructure maintenance, disaster response, site conservation, and ecological surveys. There is a growing need for robots …

Advancing Mobile Sensing In Dynamic Environments, Weichen Wang

Dartmouth College Ph.D Dissertations

This thesis presents a comprehensive exploration of enhancing mobile sensing capabilities to address various aspects of human behavior, mental health, personality, social functioning and beyond. We redesign the StudentLife app to improve its sensing efficiency and dependability, enabling support for multi-year-long studies. By adopting new app design, this study addresses the technical challenges of continuous sensing and enhances system robustness. The work is organized into several key studies that collectively aim to expand the scope of mobile sensing in diverse and complex environments.

The first study broadens the scope of mobile sensing to assess personality traits, exploring the potential of …

Exploring Tokenization Techniques To Optimize Patch-Based Time-Series Transformers, Gabriel L. Asher

Computer Science Senior Theses

Transformer architectures have revolutionized deep learning, impacting natural language processing and computer vision. Recently, PatchTST has advanced long-term time-series forecasting by embedding patches of time-steps to use as tokens for transformers. This study examines and seeks to enhance PatchTST's embedding techniques. Using eight benchmark datasets, we explore explore novel token embedding techniques. To this end, we introduce several PatchTST variants, which alter the embedding methods of the original paper. These variants consist of the following architectural changes: using CNNs to embed inputs to tokens, embedding an aggregate measure like the mean, max, or sum of a patch, adding the exponential …

On Adaptivity And Randomness For Streaming Algorithms, Manuel Stoeckl

Dartmouth College Ph.D Dissertations

A streaming algorithm has a limited amount of memory and reads a long sequence (data stream) of input elements, one by one, and computes an output depending on the input. Such algorithms may be used in an online fashion, producing a sequence of intermediate outputs corresponding to the prefixes of the data stream. Adversarially robust streaming algorithms are required to give correct outputs with a desired probability even when the data stream is adaptively generated by an adversary that can see all intermediate outputs of the algorithm. This thesis binds together research on a variety of problems related to the …

Design, Analysis, And Drop Assembly Of Interlocking Rigid Bodies, Amy K. Sniffen

Dartmouth College Ph.D Dissertations

This work presents a system of interlocking blocks that can be used to build a wide variety of structures. The blocks slide together to form structures that interlock geometrically like a puzzle to form semi-permanent structures without the need for cement or friction lock. The blocks are designed to be easy to fabricate, assemble, and disassemble. Contributions of the block designs include a novel interlocking joint structure; the joints are wedge-shaped, allowing for error mitigation during assembly and allowing structures to be assembled without jamming even if there is manufacturing error. We introduce planar, 3D, and volumetric designs using these …

Deep Learning Approaches For Cancer Prognosis Prediction Using Histopathological, Omics, And Clinical Data, Shuai Jiang

Dartmouth College Ph.D Dissertations

Accurate prediction of patient outcomes is crucial for shared clinical decision-making, treatment planning, and patients' psychological adjustment. Histopathological features of cancer, including tumor size, lymph node involvement, and metastasis, are commonly incorporated into survival prediction models, underscoring the prognostic value of whole slide images (WSIs). Concurrently, studies have highlighted the significance of omics data, such as transcriptomics, in providing valuable insights into cancer prognosis.

The emerging deep learning methods have brought new opportunities in biomedical informatics. Despite a growing body of studies on the application of deep learning methods for predicting prognosis using WSIs, the results are varied, primarily due …

Poster, Performed: Understanding Public Opinions Of Authorship In Generative Artificial Intelligence Models Via Analogy, Wylie Z. Kasai

Dartmouth College Master’s Theses

Over the last decade, generative artificial intelligence models have advanced significantly and provided the public with several tools to create new works of art. However, the true authorship of these works has been debated due to their training on web-scraped data. Serving as an analogy to these larger models, Poster, Performed is an interactive artificial intelligence exhibition project that uses image assets submitted by the public to create poster compositions with custom image processing algorithms. During the course of a four-day exhibition, visitors were asked to identify the exhibition’s primary artist from five options: (1) participants who submitted image assets, …

(Meta-)Physical Artworks: Digital Augmentation In Art Observation, Macy A. Toppan

Dartmouth College Master’s Theses

Augmented art— the subgenre of art that incorporates physical and digital artwork— is a rapidly growing field driven by advancing technology and a new generation for whom that tech is a given. Yet the presence of media like augmented and virtual reality in exhibition remains a controversial subject. Rather than focusing on the many theoretical debates about whether digital pieces can qualify as "good" art, we study it in practice through the eyes of the casual art observer. This paper highlights the audience in a within-participant study that asked viewers to take in a physical sculpture intentionally built with virtual …

Understanding Data Through The Lens Of Topology, Quang Truong

Dartmouth College Master’s Theses

Machine learning depends on the ability to learn insightful representations from data. Topology of data offers a rich source of information for constructing such representations, yet its potential remains under-explored by the broader machine learning community. This work investigates the power of applied topology through two complementary projects: Topological Message Passing with Path Complexes and Persistent Homology for Anomaly Detection. In the first project, we extend the topological message passing framework by introducing a novel approach centered on path complexes, where paths form the fundamental building blocks. Our theoretical analysis demonstrates that this model generalizes existing topological deep learning and …

Enhancing Terrain Creation In Unity With A Hybrid Modular Tool: Integrating Procedural Generation And Manual Input For Optimized Design Flexibility And Efficiency, Kewen Huang

Dartmouth College Master’s Theses

Digital terrain creation in Unity, especially for games, typically requires extensive manual effort, which is time-consuming and inefficient. Although procedural generation offers a systematic alternative, it often lacks the precision needed for specific design requirements, such as exact path or water body placements. This study introduces a novel modular tool that integrates manual input capabilities with automated procedural generation, aiming to combine the efficiency of procedural techniques with the precision of manual methods. The tool is designed for use within Unity, allowing for detailed customization and adjustments. Comprehensive user testing was conducted with 21 participants. The effectiveness of the tool …

Advancing Clinical Bacterial Diagnosis: Gram-Stained Whole-Slide Image Classification With Attention-Based Deep Learning, Jack Mcmahon

Computer Science Senior Theses

We introduce a new method for the classification of Gram-stained WSIs. As a test for the diagnosis of blood infections, Gram stains are highly relevant to informing patient treatment. Rapid analysis of Gram stains has been shown to be positively associated with better clinical outcomes, indicating the need for better tools to aid in automatic Gram stain analysis. To date, this area of research has been underexplored, with previous studies relying on the manual patch-level annotation of WSIs to generate training data. This is the first application of a transformer-based model to Gram-stain WSI classification, an approach that is far …

Consistent Monte Carlo Methods For Non-Linear Applications In Light Transport, Zackary T. Misso

Dartmouth College Ph.D Dissertations

The study of light transport focuses on describing the propagation of light from emitters to sensors through accurately describing the interactions light can undergo with everything in between. Physically-based rendering is the process of applying the laws of light transport to formulate practical algorithms which simulate the flow of light for the purpose of synthesizing images of virtual environments.

Unfortunately, there are very few interesting scene configurations which can be computed analytically. Instead, modern solutions predominantly rely on Monte Carlo integration to stochastically estimate the transfer of light since the process is both unbiased and consistent. Meaning, it is expected …

Mitigating Safety Issues In Pre-Trained Language Models: A Model-Centric Approach Leveraging Interpretation Methods, Weicheng Ma

Dartmouth College Ph.D Dissertations

Pre-trained language models (PLMs), like GPT-4, which powers ChatGPT, face various safety issues, including biased responses and a lack of alignment with users' backgrounds and expectations. These problems threaten their sociability and public application. Present strategies for addressing these safety concerns primarily involve data-driven approaches, requiring extensive human effort in data annotation and substantial training resources. Research indicates that the nature of these safety issues evolves over time, necessitating continual updates to data and model re-training—an approach that is both resource-intensive and time-consuming. This thesis introduces a novel, model-centric strategy for understanding and mitigating the safety issues of PLMs by …

Scalable Methods For Resource-Constrained Adaptive Sampling, Kizito Masaba

Dartmouth College Ph.D Dissertations

As the global community confronts the pressing issues of climate change, the importance of environment monitoring cannot be overstated. This process is essential in identifying and tracking critical environmental trends to facilitate efficient and effective conservation efforts. Traditionally, scientists perform this task using hand-held, in-situ instruments. With the recent robot advancements, this task can be fully automated by applying multi-robot systems to a task referred to as multi-robot adaptive sampling. However, the cost of purchasing and operating robot systems for this application are still prohibitive due to various environmental, technological, and logistical constraints. Some of the outstanding constraints to the …

Random Walk Methods For Geometry Representation Agnostic Transport, Dario R. Seyb

Dartmouth College Ph.D Dissertations

In computer graphics, we use geometry representations to model a wide range of virtual scenes—from the fantastical worlds shown in animated movies to intricate mechanical parts.
These representations provide the context for transport problems—light transport is used to produce images of virtual scenes and diffusive transport to simulate distributions of quantities like heat.

There are many types of representations each with their own advantages.
For example, explicit ones make it easy to directly manipulate surfaces, while implicit representations allow for intuitive modeling by non-technical users and straightforward integration into machine learning systems.
Unfortunately, many algorithms that work on these digital …

Disentangling Cyclic Causality: An Instance-Based Framework For Causal Discovery, Chase A. Yakaboski

Dartmouth College Ph.D Dissertations

Correlation does not imply causation" is one of the fundamental principles taught in science, emphasizing that associations between variables do not necessarily indicate causality. Yet, over the past three decades, extensive research has begun to challenge this perspective by developing sophisticated methods to differentiate causal from correlative relationships. This research suggests that correlations often involve a blend of confounded and causal interactions, which, given certain assumptions, can be disentangled to uncover actionable insights and deepen our understanding of physical, biological, and societal systems.

Accurately discovering causal relationships from data amidst cyclic dynamics remains a challenging open problem in causality research. …