Graphics and Human Computer Interfaces Commons^™

The Kruger Collection Reimagined: A Case Study In 3d Scanning And Interactive Exhibit Design, Annissa Davis

Department of Anthropology: Theses and Student Research

This thesis examines the use of 3D modeling in museum exhibition to create exploratory exhibits that facilitate unique relationships between the visitors and the collection beyond what is provided by the collection’s in person counterparts. Typical use of 3D modeling in museums is currently often representative rather than exploratory. By employing a Digital Humanities lens to approach the development of a digital exhibition utilizing 3D technology and interactive elements created in a video game engine (Unity), this thesis project evaluates these potential new relationships. Using the Eloise Kruger Collection of Miniatures as a case study, the following text details the …

Terry Riley's "In C" For Mobile Ensemble, David B. Wetzel, Griffin Moe, George K. Thiruvathukal

Computer Science: Faculty Publications and Other Works

This workshop presents a mobile-friendly Web Audio application for a “technology ensemble play-along” of Terry Riley’s 1964 composition In C. Attendees will join in a reading of In C using available web-enabled devices as musical instruments. We hope to demonstrate an accessible music-technology experience that relies on face-to-face interaction within a shared space. In this all-electronic implementation, no special musical or technical expertise is required.

What Does One Billion Dollars Look Like?: Visualizing Extreme Wealth, William Mahoney Luckman

Dissertations, Theses, and Capstone Projects

The word “billion” is a mathematical abstraction related to “big,” but it is difficult to understand the vast difference in value between one million and one billion; even harder to understand the vast difference in purchasing power between one billion dollars, and the average U.S. yearly income. Perhaps most difficult to conceive of is what that purchasing power and huge mass of capital translates to in terms of power. This project blends design, text, facts, and figures into an interactive narrative website that helps the user better understand their position in relation to extreme wealth: https://whatdoesonebilliondollarslooklike.website/

The site incorporates …

Digitizing Delphi: Educating Audiences Through Virtual Reconstruction, Kate Koury

The Journal of Purdue Undergraduate Research

Implementing a 3D model into a virtual space allows the general public to engage critically with archaeological processes. There are many unseen decisions that go into reconstructing an ancient temple. Analysis of available materials and techniques, predictions of how objects were used, decisions of what sources to reference, puzzle piecing broken remains together, and even educated guesses used to fill gaps in information often go unobserved by the public. This work will educate users about those choices by allowing the side-by-side comparison of conflicting theories on the reconstruction of the Tholos at Delphi, which is an ideal site because of …

Are Academia And Industry Listening To Each Other? A Citation Analysis Of Ux Research Methods Resources, Abigail Bakke, Leonard Dibono

English Department Publications

Technical and Professional Communication (TPC) has been facing concerns of viability, in both its relationship with industry and its ability to build a relevant and valid body of research. TPC’s disconnection with industry may be reflected in its relationship to UX as well, despite both fields’ shared values. To better understand how TPC and User Experience (UX) are relating to each other, we conducted a citation analysis of a sample of SIGDOC papers and a sample of Nielsen Norman Group (NN/g) practitioner articles focused on research methods. The SIGDOC papers tended to cite TPC sources, while the NN/g articles cited …

Dung Dkar Cloak: Exploring Soft Interfaces For Sonic Interactions, Judit Eszter Kárpáti, Esteban De La Torre

Textile Society of America: Symposium Proceedings

The importance of crossmodal interaction within the contemporary cultural, technological and scientific panorama has evidently gained significant attention due to its remarkable advantages in creating a meaningful, interwoven, and integrated experience. The use and recontextualization of textiles in such exploratory quest into the human senses has proven to be critical. Computational science, algorithmic logic and digital devices have always been rooted and closely interwoven with textile crafts and practices. Recent technological advancements have further combined technology and textile, generating interactive textile surfaces, constructing endless possibilities for multisensorial experiences. In this presentation we will examine how we can weave a sensitive …

Poster, Performed: Understanding Public Opinions Of Authorship In Generative Artificial Intelligence Models Via Analogy, Wylie Z. Kasai

Dartmouth College Master’s Theses

Over the last decade, generative artificial intelligence models have advanced significantly and provided the public with several tools to create new works of art. However, the true authorship of these works has been debated due to their training on web-scraped data. Serving as an analogy to these larger models, Poster, Performed is an interactive artificial intelligence exhibition project that uses image assets submitted by the public to create poster compositions with custom image processing algorithms. During the course of a four-day exhibition, visitors were asked to identify the exhibition’s primary artist from five options: (1) participants who submitted image assets, …

(Meta-)Physical Artworks: Digital Augmentation In Art Observation, Macy A. Toppan

Dartmouth College Master’s Theses

Augmented art— the subgenre of art that incorporates physical and digital artwork— is a rapidly growing field driven by advancing technology and a new generation for whom that tech is a given. Yet the presence of media like augmented and virtual reality in exhibition remains a controversial subject. Rather than focusing on the many theoretical debates about whether digital pieces can qualify as "good" art, we study it in practice through the eyes of the casual art observer. This paper highlights the audience in a within-participant study that asked viewers to take in a physical sculpture intentionally built with virtual …

Reducing Food Scarcity: The Benefits Of Urban Farming, S.A. Claudell, Emilio Mejia

Journal of Nonprofit Innovation

Urban farming can enhance the lives of communities and help reduce food scarcity. This paper presents a conceptual prototype of an efficient urban farming community that can be scaled for a single apartment building or an entire community across all global geoeconomics regions, including densely populated cities and rural, developing towns and communities. When deployed in coordination with smart crop choices, local farm support, and efficient transportation then the result isn’t just sustainability, but also increasing fresh produce accessibility, optimizing nutritional value, eliminating the use of ‘forever chemicals’, reducing transportation costs, and fostering global environmental benefits.

Imagine Doris, who is …

Triple Helix: Ai-Artist-Audience Collaboration In A Performative Art Experience, Xuedan Zou

Dartmouth College Master’s Theses

Imagine an art exhibition that morphs its content according to the audience’s experience like a chameleon, reflecting the audience’s mind and culture and turning the artist’s exhibition into the viewer’s. But when the viewers leave, the work fades back to the creator’s original work and waits for the next audience. In this project, my team introduced an interactive exhibition called "Triple Helix," where audience members were provided the opportunity to alter the artworks created by the artist, thus imbuing them with their own perspectives. This interactive exhibition was held at three physical-locations and online, and a comprehensive user study was …

Clueless: Revolutionizing Sustainable Fashion And Combating Overconsumption, Tanya Ravichandran

Graphic Communication

“Clueless” revolutionizes sustainable fashion by combating wardrobe overconsumption and the industry’s carbon footprint, using AI to suggest personalized outfits from existing wardrobes tailored to weather and wear history. It enhances user engagement through features like outfit ‘shuffle’ and provides insights into wardrobe utilization and carbon impact.

It’s more than an app; it’s a step towards a greener wardrobe and a healthier planet.

Performative Mixing For Immersive Audio, Brian A. Elizondo

LSU Doctoral Dissertations

Immersive multichannel audio can be produced with specialized setups of loudspeakers, often surrounding the audience. These setups can feature as few as four loudspeakers or more than 300. Performative mixing in these environments requires a bespoke solution offering intuitive gestural control. Beyond the usual faders for gain control, advancements in multichannel sound demand interfaces capable of quickly positioning sounds between channels. The Quad Cartesian Positioner is such a solution in the form of a Eurorack module for surround mixing for use in live or studio performances.

Diffusion/mixing methods for live multichannel immersive music often rely on the repurposing of hardware …

Evocative And Provocative Image-Making In The Age Of Generative Ai, Julian Kilker

Tradition Innovations in Arts, Design, and Media Higher Education

Editorial for inaugural AI-focused special issue of Tradition-Innovations in Arts, Design, and Media Higher Education, published under the auspices of the Alliance for the Arts in Research Universities (a2ru). Discusses three articles by five authors in this issue: (1) Choreographing Shadows: Interdisciplinary collaboration to orchestrate ethical image-making by Mark Burchick and Diana Pasulka; (2) Giving Up Control: Hybrid AI-augmented workflows for image-making by Joshua Vermillion; and (3) Hands are Hard: Unlearning how we talk about machine learning in the arts by Adam Hyland and Oscar Keyes.

Editing this special issue explored several key questions: What does “innovation” mean when …

Balanced Blended Space: Proposing A Universal Theoretical Framework For Combinative Reality, David Smith, Frederick Bianchi

Publications and Research

In today's fragmented societies, a unified framework for communication and collaboration across different realities is crucial. We introduce Balanced Blended Space (BBS) as a framework for describing combinative reality, encompassing virtual, physical, and conceptual realms, all intrinsically connected. Interactions within these environments shape our perceptual space. This paper outlines key axiomatic assumptions, criteria for a universal framework, and fundamental terminology. We identify deep symmetries enabling the BBS framework, including Cognitive and Computational Symmetry, Physical and Virtual Symmetry, Mediation Pathway Symmetry, Space-Time Symmetry, and Sensory Symmetry. We propose tests to determine its viability, emphasizing virtual intelligence as a collaborative partner. We …

Balanced Blended Space: Foundational Human–Ai Dialogues In A Symmetry-Based Mediation Framework, David Smith

Publications and Research

This working paper documents the early development of the Balanced Blended Space (BBS) framework through a series of iterative interactions between a cognitive agent (human researcher) and a computational agent (AI system) conducted in 2023. The work is motivated by the need for a universal theoretical model capable of describing the integration of physical, virtual, and conceptual spaces, particularly in response to increasing fragmentation across contemporary communication systems.

BBS is proposed as a symmetry-based mediation framework in which relationships between domains—such as physical and virtual space, cognition and computation, and multiple sensory modalities—are treated as structurally equivalent and mappable. Central …

Expressive Marks: Art In The Age Of Augmented Reality, Carson G. Levine

Dartmouth College Master’s Theses

Augmented reality (AR) and non-fungible tokens (NFTs) introduce new considerations for the long-standing debate of what it means for digital art to be “real.” However, the ability to create AR experiences is limited to those who are technically skilled or who can afford to consult someone else. This paper addresses the need for an accessible tool that enables artists of all technical backgrounds to expressively create marks in AR. The solution includes a mobile application called CrayonAR. The system was designed to be modular, minimal, and physically engaging, and was developed in Unity using ARFoundation and Firebase Storage and Realtime …

Artificial: A Study On The Use Of Artificial Intelligence In Art, Hayden Ernst

Theses/Capstones/Creative Projects

In the past three to five years there have been significant improvements made in AI due to improvements in computing capacity, the collection and use of big data, and an increase in public interest and funding for research. Programs such as ChatGPT, DALL•E, and Midjourney have also gained tremendous popularity in a relatively short amount of time. This led me to this project in which I aimed to gain a deeper understanding of these art generator AI and where they fit into art as a whole. My goal was to give recommendations to museums and exhibits in Omaha on what …

Procedural City Generation With Combined Architectures For Real-Time Visualization, Griffin Poyck

All Theses

The work and research of this paper sought to build upon traditional city generation and simulation in creating a tool that both realistically simulates cities and their prominent features and also creates aesthetic and artistically rich cities using assets that combine several contemporary or near contemporary architectural styles. The major city features simulated are the surrounding terrain, road networks, individual buildings, and building placement. The tools used to both create and integrate these features were created in Houdini with Unreal Engine 5 as the intended final destination. This research was influenced by the city, town, and road networking of Ghost …

Visualizing Literary Narratives With A Graph-Centered Approach., Meg Ermer

Campus Research Month

The art of storytelling is multifaceted and nonlinear, involving multiple characters, themes, and symbols while often jumping between the present and past. While media forms such as novels can encapsulate these complexities, it is often difficult to visualize a narrative in an easy-to-understand format. Our contribution is a graph-based system to let users organize and visualize those narratives. Events and characters are represented as nodes and their relationships are represented as edges. Neo4J is used as a database management system to store the graph and to run queries on it, and Streamlit and Pyvis are used to represent the database …

Robert X House Collection, Dan Bonenberger, Brooke Boyst, Franklin Haywood, Carrie Malas, Jaclyn Panter, Ian Tomashik, Laura Waskiwicz, Taylor Williams, Austin Martin

Digital Heritage Preservation Collection

This collection examines the Robert X House at 18827 Keystone Street in Detroit, Michigan, a significant site in the history of the Nation of Islam and the broader narrative of Black empowerment and civil rights in mid-20th century America. Originally built in 1951 as a modest Federal Housing Administration (FHA) minimum ranch-style home, the property was purchased by Robert Davenport (later known as Robert X), an influential leader in the Nation of Islam. The house became a hub for religious instruction, community-building, and activism.

Robert X, a former boxer and musician, became a prominent figure in Detroit’s Nation of Islam …

Object-Oriented Creative Coding For Digital Art Students, Dale E. Parson

Computer Science and Information Technology Faculty

An introductory course in creative graphical coding for both computer science and digital art majors need not be watered down. The availability of an excellent Java-based framework including an IDE, debugger, and high-level class and function library avoids potentially problematic mathematics and device-control demands by encapsulating them within the library. Students can add or modify a few lines of code and then run them from the IDE without explicit compilation steps or tool changes, immediately seeing the results of initial coding or bug fixes in the form of animated graphical objects. Incremental introduction of object-oriented mechanisms within the course such …

Safe Space: To Help Minimize Cyberbullying And Support Social Well-Being, Eiman Rana

CISLA Senior Integrative Projects

The perverseness of cyberbullying as a growing and serious form of abuse with the potential for harm among children and youth needs to be recognized. In a resource-limited setting such as South Asia where youth have very little access to counseling within schools, the implications for mental health should be recognized. This research study explores whether our youth is capable of using technology in the right way to minimize cyberbullying and support social well-being.

Index Terms - Cyberbullying, Social Well-being, User Experience Design, and Usability Study.

The Implementation Of Augmented Reality And Low Latency Protocols In Musical Instrumental Collaborations, Qixiao Zhu

Honors Theses

Past projects involving musical software have been completely virtual, while these software do well in entertainment and education, there is the question of whether these software are playable to the same extent as physical musical instruments. The software presented in this paper, "AR Jam", utilizes various software and hardware tools to form a networked mixed reality system for the users to play music on. The intention of this project is to seek new ways to explore more playable musical instruments in the digital world. The paper presents the software's implementation, challenges such as optimization problems of the synthesizer, and the …

Exploration Of Digital Synthesis, Angelo Indre

Williams Honors College, Honors Research Projects

“An Exploration of Digital Synthesis” is a comprehensive investigation into the world of digital audio and music production. The paper explores the fundamental concepts of sound synthesis, including MIDI, virtual instruments (VSTs), and the JUCE framework. The central focus of the paper is the implementation of a custom synthesizer, which serves as a case study for the practical application of digital synthesis. The paper addresses the key question of how to create a functioning synthesizer from scratch, providing detailed insights into the programming and design process. Overall, the paper represents a significant contribution to the fields of digital audio and …

The Message Design Of Raiders Of The Lost Ark On The Atari 2600 & A Fan’S Map, Quick Start, And Strategy Guide, Miguel Ramlatchan, William I. Ramlatchan

Distance Learning Faculty & Staff Books

The message design and human performance technology in video games, especially early video games have always been fascinating to me. From an instructional design perspective, the capabilities of the technology of the classic game consoles required a careful balance of achievable objectives, cognitive task analysis, guided problem solving, and message design. Raiders on the Atari is an excellent example of this balance. It is an epic adventure game, spanning 13+ distinct areas, with an inventory of items, where those hard to find items had to be used by the player to solve problems during their quest (and who would have …

Protocol For An Ehub As An Systemic Intervention For Homeless Shelter Staff And Resident Psychosocial And Behavioral Needs, Celeste Sangiorgio, Cory Crane, Cassandra Berbery, Caroline Easton

Frameless

Homeless shelter performance is presently operationalized as shelter success in linking homeless individuals to housing; however, there is a cluster of individuals with co-occurring serious mental health issues who engage in chronic and episodic re-entry into homeless shelters. Persistent and chronically mentally ill individuals who re-enter shelters increase demands on staff, who are inadequately trained to de- escalate, manage their internal distress, and connect these homeless residents to appropriate services. This protocol outlines an alternative intervention mechanism for shelters that targets a key, untreated pathway where staff and resident symptoms and skills are linked to shelter performance. We propose that …

Real-Time Illumination Capture And Rendering On Mobile Devices, Snehal Padhye, James A. Ferwerda

Frameless

We present our efforts to develop methods for rendering 3D objects on mobile devices using real-world dynamic illumination from the user’s environment. To achieve this, we use the front and back cameras on the mobile device to estimate the light distribution in the environment in real time. We then create a dynamic illumination map and render the object at interactive rates in a browser on the device using a web-based graphics API. This project achieves one of the goals of our related work on realistic visualization of virtual objects: to make virtual objects appear to be situated within the scene …

Mixed Reality Prototype Device Showcase: Using Smart Glasses To Enhance Language Access, Aaron Parker, Connor Switenky, Roshan Mathew, Wendy Dannels

Frameless

While the use of American Sign Language (ASL) interpreters and real-time captioning significantly increases deaf individuals’ ability to participate in a wide variety of functions, there are some limitations. The major problem is that current ways of providing communication and information access to deaf people require them to split their attention between the visual focus of the specific content and the interpreter/captioning display. At any given point in time, deaf people are forced to decide what explanation to miss with subsequent effects on topic comprehension and perceptions of the interaction and environments.

Vr Sound Mapping: Make Sound Accessible For Dhh People In Virtual Reality Environments, Ziming Li, Roshan Peiris

Frameless

In-game audio plays an important role in enhancing the sense of reality and immersion in the gaming experience. In many games, sounds are also used to provide notifications and clues, which are essential to the gameplay. However, in this case, the deaf and hard of hearing (DHH) players may fail to access the information conveyed by sounds, which degrades their gaming experience (Jain et al. 2021).

Ar Fantasia: An Augmented Reality Musical Experience, Joe Geigel, Yunn-Shan Ma, Juilee Decker

Frameless

In 1940, Walt Disney Pictures released their third full length animated feature film, the classic film Fantasia. The concept and challenge behind Fantasia was simple: To merge music and visuals, using the media of animation, to provide an integrated backdrop for, and interpretation of, classical music. The complete film consisted of eight such animated sequences, each providing a visual landscape as a setting for a classical musical piece (Granata 2002).