Human-Computer Interaction Commons^™

From Retrieval To Generation: Building And Evaluating An Ai Accompanist For Piano Duets With An Anticipatory Music Transformer, Sai Ruthvik Uppala

Masters Theses

Systems that accompany a live musician, such as ACCompanion, work by retrieval: they hold a written accompaniment and stretch its timing to follow the soloist, so they can only accompany music whose second part already exists as a score. This thesis asks whether that second part can instead be generated, and specifically whether a machine learning model can write an accompaniment for a piece whose score it has never seen. A player performs the primo, the melody; a model produces the secondo, the accompaniment; and a score follower places the generated notes against the live performance. If this works, a …

The Self-Aware Room: A Framework For Operational Self-Awareness In Evolvable Blended Environments, David B. Smith

Publications and Research

The Self-Aware Room (SAR) is a room-scale research environment developed within the larger Balanced Blended Space and Blended Reality Performance System research trajectory. Rather than treating the room as a conventional “smart” environment composed of fixed automation technologies, SAR approaches it as an evolvable blended environment made from physical, virtual, conceptual, sensory, computational, and performative relationships. Its defining feature is not any particular sensor, model, or output device, but the set of transformations through which physical activity becomes structured observation, bounded representation, interpreted state, governed decision, and mediated response.

This paper develops the conceptual and methodological foundations of SAR as …