Graphics and Human Computer Interfaces Commons^™

A Symbolic Music Transformer For Real-Time Expressive Performance And Improvisation, Arnav Shirodkar

Senior Projects Fall 2023

With the widespread proliferation of AI technology, deep architectures — many of which are based on neural networks — have been incredibly successful in a variety of different research areas and applications. Within the relatively new domain of Music Information Retrieval (MIR), deep neural networks have also been successful for a variety of tasks, including tempo estimation, beat detection, genre classification, and more. Drawing inspiration from projects like George E. Lewis's Voyager and Al Biles's GenJam, two pioneering endeavors in human-computer interaction, this project attempts to tackle the problem of expressive music generation and seeks to create a Symbolic Music …

Entering The Dance Input/Output Machine, Antonio James Martinez

Senior Projects Spring 2023

My goal for this project is to provide an exploration into the intersection of Computer Science and Dance. Although there are many avenues of exploration at this intersection, I decide to focus on the topic of movement, specifically the idea of movement data. With this idea, we break it apart into two subtopics: movement input and output. Throughout this project, we mainly focus on the side of input, uncovering the nuance of movement language and the information that comes with it to understand the process of motion capture. We also demonstrate the use of movement input and how others may …

Reed Log: Application For Oboists, Michał Cieślik

Senior Projects Spring 2023

Senior Project submitted to The Division of Science, Mathematics and Computing of Bard College.

Wisdom Of Nature: Finding Tao In Water, Ziyu Xu

Senior Projects Fall 2022

Senior Project submitted to The Division of Arts of Bard College.

A New Way To Make Music: Processing Digital Audio In Virtual Reality, Gavin E. Payne

Senior Projects Spring 2022

The work of this project attempts to provide new methods of creating music with technology. The product, Fields, is a functional piece of virtual reality software, providing users an immersive and interactive set of tools used to build and design instruments in a modular manner. Each virtual tool is analogous to musical hardware such as guitar pedals, synthesizers, or samplers, and can be thought of as an effect or instrument on its own. Specific configurations of these virtual audio effects can then be played to produce music, and then even saved by the user to load up and play with …

The Use Of Virtual Manipulatives In Teaching Sorting Algorithms, Olivia Witanowska

Senior Projects Fall 2020

This project builds an online tool for users to practice tracing sorting algorithms on a virtual set of cards. Sorting algorithms are crucial to computer science. Visualization of such algorithms can aid in cementing the concepts. The purpose of a virtual manipulative is to create a similar effect of a physical manipulative but on a digital platform so that it is more accessible than its physical alternative. This project is motivated by the educational adjustments needed to be made during the 2020 Covid-19 pandemic. By building off of a previous Deck of Cards project, an algorithm to check a user’s …

The Impact Of Live Coding Within An Educational And Performance Setting, Alexus Renee Foster

Senior Projects Spring 2020

For the past three semesters at Bard, live coding has become my newest form of creative expression and performance. This method of coding involves either creating on the spot from scratch or editing pre-existing code in a real time manner. There is no real set structure or steps that must be followed, however, one rule must always be followed: show your code. In the classroom, live coding occurs when the professor demonstrates some algorithm by displaying the program on a projector for the entire class to observe. During musical performances, the same improvisational nature of live coding is also present, …

Mouse Vs. Machine: The Game, Cafferty Aiko Frattarelli

Senior Projects Spring 2017

Many modern video games built by big name companies are coded by a group of people together using, and possibly modifying, an already designed game engine. These games usually have another group of people creating the artwork. In this project, I coded and designed a video game from scratch, as well as created all the artwork used in the game. The player controls a mouse character who fights a variety of monsters. In order to create the complexity of the game, I implement basic neural networks as the enemy artificial intelligence, i.e. the decision making process of the enemy. It …

Beyond Homographies: Exploration And Analysis Of Image Warping For Projection In A Dome, Kai Joseph Malowany

Senior Projects Spring 2017

The goal of this project is to provide multiple approaches for warping a flat image tofit the curvature of a geodesic dome, to be presented as an immersive, Augmented Reality (AR) environment. This project looks to develop an algorithmic method of warping any image to fit perspective distortion for a dome-like surface. Despite fairly common usage in planetarium methods and other such shows, there is very little documented method that would allow for the warping of images to fit a curved projection surface. The methods will be explored include using Processing, OpenCV, and fisheye image filters. In addition to the …

Content-Aware Image Resizing, Race Darwin Morel

Senior Projects Spring 2017

The purpose of this project is to implement and explore the use of seam carving — a tool used to select and remove “seams” of low-importance pixels from an image in order to reduce its height or width. I also cover the process of seam insertion, creating new seams of pixels to increase the image’s size rather than reducing it. Using these content-aware algorithms, I investigate the process of intelligently resizing an image. Using edge detection, dynamic programming, and pixel manipulation, I push the limits of seam carving and attempt to quantify the qualitative concept of salience.

Thinking Outside The Box: Computing 3d Volume In 2d, Alexandra D. Morris

Senior Projects Fall 2017

This project explores how to compute 3D volume of cardboard boxes in 2D without a calibrated camera. Computer vision techniques to obtain 3D volume typically require camera calibration, the standard method for mapping 3D points to 2D. We created our own solution that doesn’t rely on camera calibration and obtains the areas of each box with unknown dimensions with the help of a chessboard pattern placed on each box side. The solution is a proportion that given the box area in pixels, chessboard pattern in pixels, and the chessboard pattern in inches, determines the box area in inches. We tested …

Radical Recognition In Off-Line Handwritten Chinese Characters Using Non-Negative Matrix Factorization, Xiangying Shuai

Senior Projects Spring 2016

In the past decade, handwritten Chinese character recognition has received renewed interest with the emergence of touch screen devices. Other popular applications include on-line Chinese character dictionary look-up and visual translation in mobile phone applications. Due to the complex structure of Chinese characters, this classification task is not exactly an easy one, as it involves knowledge from mathematics, computer science, and linguistics.

Given a large image database of handwritten character data, the goal of my senior project is to use Non-Negative Matrix Factorization (NMF), a recent method for finding a suitable representation (parts-based representation) of image data, to detect specific …

Optimizing Website Design Through The Application Of An Interactive Genetic Algorithm, Elijah Patton Mensch

Senior Projects Spring 2016

The goal of this project was to determine the efficacy and practicality of “optimizing” the design of a webpage through the application of an interactive genetic algorithm. Software was created to display a “population” of mutable designs, collect user feedback as a measure of fitness, and apply genetic operations in an ongoing evolutionary process. By tracking the prevalence of design parameters over multiple generations and evaluating their associated “fitness” values, it was possible to judge the overall performance of the algorithm when applied to this unique problem space.

Branching Boogaloo: Botanical Adventures In Multi-Mediated Morphologies, Diana Marie Ruggiero

Senior Projects Spring 2016

FormaLeaf is a software interface for exploring leaf morphology using parallel string rewriting grammars called L-systems. Scanned images of dicotyledonous angiosperm leaves removed from plants around Bard’s campus are displayed on the left and analyzed using the computer vision library OpenCV. Morphometrical information and terminological labels are reported in a side-panel. “Slider mode” allows the user to control the structural template and growth parameters of the generated L-system leaf displayed on the right. “Vision mode” shows the input and generated leaves as the computer ‘sees’ them. “Search mode” attempts to automatically produce a formally defined graphical representation of the input …

Evaluation Of Interfaces For Senior Citizens: Bigscreenlive, Eldy And Pointerware, Bella Manoim

Senior Projects Spring 2011

Senior Project submitted to The Division of Science, Mathematics, and Computing of Bard College.