Graphics and Human Computer Interfaces Commons^™

Chi Meta-Project Ecosystem Overview - Spring 2026, David B. Smith

Publications and Research

This paper offers a high-level account of the Center for Holistic Integration’s (CHI) meta-project ecosystem as visualized in the included system map. CHI provides an organizational structure framed around persistent meta-projects that support and extend individual initiatives across curriculum, scholarly and applied research, infrastructure, artistic production, AI development, cultural inquiry, and external partnerships. Rather than presenting the map as a static inventory of projects, the paper examines how its core domains function as living systems through which knowledge, tools, documentation, participants, and collaborations can accumulate over time. It also considers how CHI-mediated connectivity, institutional integration, and external funding allow the …

My First Conversation With Chatgpt (February 22, 2023): Origins Of A Generative Dialogue, David Smith

Publications and Research

This working paper presents the first recorded interaction between the author and the generative AI system ChatGPT, written on February 22, 2023 during the initial weeks of a faculty sabbatical in Boston. The document preserves a complete and unedited transcript of an exploratory conversation conducted without predetermined research aims, marking the author’s first encounter with a large-language-model conversational interface. Although the exchange includes creative experimentation—including musical and poetic prompts—the discussion remains informal and wide-ranging, and no theoretical framework is articulated at this stage. Rather, this transcript is published as primary-source material documenting the moment of discovery and experimentation that precedes …

Full-Stack Web Applications: Infrastructure, Development Pipelines & Devsecops, Yassine Chahid, Patrick Slattery

Publications and Research

This research explores emerging development methodologies and technologies which facilitate the deployment and maintenance of software applications. It evaluates architectural styles for the development of software such as monolithic (legacy) and microservice models, with a focus on their key differences such as scalability or project structure through to the development of an application. By examining methodologies such as Agile and continuous integration/continuous development pipelines along with the deployment tools Docker and Git for version/release control, the study analyzes how these innovations speed up development, improve existing practices, and serve as the foundation for development operations. Cloud solutions for tasks such …

Automation Of Javanese Shadow Puppets Using Machine Control, Kristian Rice, Yinson Tso, Mukhammadali Yuldoshev

Publications and Research

The virtualization of Javanese shadow puppetry (Wayang Kulit) offers a unique opportunity to preserve and revitalize traditional performance art through immersive digital platforms. This project explores the development of a virtual Wayang Kulit experience using real-time 3D engines like Unity/Unreal Engine while focusing on simulating the mechanics and aesthetics of shadow puppet performance. The puppets are designed using detailed 2D planes and rigged with skeletal systems to reflect the stylized motion of traditional puppetry. An aspect of this project is integrating an AI-driven control system that autonomously animates the puppets, learning from recorded puppeteer performances to replicate gesture, rhythm, and …

Full-Stack Web Applications: Industry Standard Frameworks, Libraries & Technologies, Yassine Chahid, Patrick Slattery

Publications and Research

This research explores emerging full-stack web development technologies across front-end, back-end, and DevSecOps domains. It evaluates modern tools including Django, React, and TypeScript—focusing on their key features such as compile-time error checking—through to the development of a web application. By examining documentation for the frameworks Node.js, Next.js, Tailwind CSS, and others, along with the deployment tools Docker and Git for version/release control, the study analyzes how these innovations speed up development, improve existing practices, and have often replaced older technologies. Cloud solutions for tasks such as authentication and deployment will also be evaluated, along with various web-application technology stacks and …

David B. Smith Chats With Monday 1.0, David B. Smith

Publications and Research

This document is an edited archival transcript of extended conversations between David B. Smith and an AI persona (“Monday 1.0,” GPT‑4o based) conducted in Spring 2025, prepared as a foundational primary source for subsequent scholarly and creative work. It records the emergence and testing of concepts related to human–AI collaboration (including “Balanced Blended Space”), as well as applied explorations in areas such as generative AI, quantum computing and music, virtual orchestras, multimodal performance, pedagogy, and the rhetoric of “pushback” in conversational systems. It also contains an extended section in which Monday and DB Smith co-curate a set of student research …

Innovations In Full-Stack Web Development: Front-End To Back-End, Yassine Chahid, Patrick Slattery

Publications and Research

This research explores emerging technologies within full-stack web development and their potential impact on current front-end and back-end solutions. Both areas employ crucial technologies that determine how end-users access information and navigate web services. Front-end solutions include HTML, JavaScript, and CSS which shape user interaction on websites. Back-end solutions use technologies such as SQL and PHP for the foundation of data processing, retrieval, and storage. The research method involves examining official documentation for these technologies to better understand their key components and to understand how their use in cyberspace has changed. The research will observe several high-traffic websites and domains …

Cloud Computing Integration Into Mixed-Reality: Physical To Abstraction, Yassine Chahid, Patrick Slattery

Publications and Research

This research evaluates the progression of cloud computing and mixed-reality technologies, and to identify how these technologies influence advancements in the latter. Both cloud computing and mixed reality have significantly impacted the IT field and the services available to the public and various institutions. Cloud computing provides a valuable way to process information or allocate computational resources on otherwise limited hardware. Augmented or virtual reality hardware would greatly benefit from this by offloading resource-intensive tasks to other machines. The research methodology involves analyzing essential components of both innovations, divided into multiple categories. These components range from physical, hardware-based elements to …

‘I Know It When I See It’– Developing Quality Schedules Considering Subjective Or Unspecified Criteria, Douglas L. Moody

Publications and Research

Most timetabling problems have a given objective function to measure the quality of a solution. However, users may have a “I know it when I see it” recognition of a quality schedule, without specifying the complete basis for their judgment. In this situation, the objective function cannot be exclusively used as a solution quality measurement. This work presents an AI based approach to aid in categorizing the solution’s quality when the users have not explicitly defined all factors used in their criteria.

Balanced Blended Space: Proposing A Universal Theoretical Framework For Combinative Reality, David Smith, Frederick Bianchi

Publications and Research

In today's fragmented societies, a unified framework for communication and collaboration across different realities is crucial. We introduce Balanced Blended Space (BBS) as a framework for describing combinative reality, encompassing virtual, physical, and conceptual realms, all intrinsically connected. Interactions within these environments shape our perceptual space. This paper outlines key axiomatic assumptions, criteria for a universal framework, and fundamental terminology. We identify deep symmetries enabling the BBS framework, including Cognitive and Computational Symmetry, Physical and Virtual Symmetry, Mediation Pathway Symmetry, Space-Time Symmetry, and Sensory Symmetry. We propose tests to determine its viability, emphasizing virtual intelligence as a collaborative partner. We …

Balanced Blended Space: Foundational Human–Ai Dialogues In A Symmetry-Based Mediation Framework, David Smith

Publications and Research

This working paper documents the early development of the Balanced Blended Space (BBS) framework through a series of iterative interactions between a cognitive agent (human researcher) and a computational agent (AI system) conducted in 2023. The work is motivated by the need for a universal theoretical model capable of describing the integration of physical, virtual, and conceptual spaces, particularly in response to increasing fragmentation across contemporary communication systems.

BBS is proposed as a symmetry-based mediation framework in which relationships between domains—such as physical and virtual space, cognition and computation, and multiple sensory modalities—are treated as structurally equivalent and mappable. Central …

Augmented & Virtual Reality: Advancement Of Technology And Its Impacts On Medicine, Education, And Other Industries, Yassine Chahid

Publications and Research

Throughout the early 2000s, the ways in which the World Wide Web was used would undergo major changes. The introduction of these changes around this time period would be collectively known as Web 2.0. With Web 2.0, accessibility and distribution of applications became more simplified. During the 2000s, much has evolved from hard capabilities to the internet and its widespread usage amongst companies and general consumers. In contemporary times, multiple technologies, both hardware and digital are becoming more advanced, with general consumers either rejecting or accepting these gradual shifts in what may become everyday technology. Web 3.0, the theoretical advancement …

Spotlight Report #6: Proffering Machine-Readable Personal Privacy Research Agreements: Pilot Project Findings For Ieee P7012 Wg, Noreen Y. Whysel, Lisa Levasseur

Publications and Research

What if people had the ability to assert their own legally binding permissions for data collection, use, sharing, and retention by the technologies they use? The IEEE P7012 has been working on an interoperability specification for machine-readable personal privacy terms to support this ability since 2018. The premise behind the work of IEEE P7012 is that people need technology that works on their behalf—i.e. software agents that assert the individual’s permissions and preferences in a machine-readable format.

Thanks to a grant from the IEEE Technical Activities Board Committee on Standards (TAB CoS), we were able to explore the attitudes of …

Designing Respectful Tech: What Is Your Relationship With Technology?, Noreen Y. Whysel

Publications and Research

According to research at the Me2B Alliance, people feel they have a relationship with technology. It’s emotional. It’s embodied. And it’s very personal. We are studying digital relationships to answer questions like “Do people have a relationship with technology?” “What does that relationship feel like?” And “Do people understand the commitments that they are making when they explore, enter into and dissolve these relationships?” There are parallels between messy human relationships and the kinds of relationships that people develop with technology. As with human relationships, we move through states of discovery, commitment and breakup with digital applications as well. Technology …

Me2b Alliance Validation Testing Report: Consumer Perception Of Legal Policies In Digital Technology, Noreen Y. Whysel, Karina Alexanyan, Shaun Spaulting, Julia Little

Publications and Research

Our relationship with technology involves legal agreements that we either review or enter into when using a technology, namely privacy policies and terms of service or terms of use (“TOS/TOU”). We initiated this research to understand if providing a formal rating of the legal policies (privacy policies and TOS/TOUs) would be valuable to consumers (or Me-s). From our early qualitative discussions, we noticed that people were unclear on whether these policies were legally binding contracts or not. Thus, a secondary objective emerged to quantitatively explore whether people knew who these policies protected (if anyone), and if the policies were perceived …

Responsive Web Design, Ashley Varon, David Karlins

Publications and Research

Responsive web design is one of the most important topics in web. It can be one of the main reasons a website can be costing a business clients, and creating an effect on a business. The rise in popularity of mobile phones and tablets makes it crucial for a website to be designed to respond and adjust to different viewports. This project will research how important responsive web design is in 2020 and the positive or negative impacts it may have on the users, customers, and businesses. Companies must consider text size, layout, navigation, image sizes, and testing when designing …

Experimental Applications Of Virtual Reality In Design Education, Amber Bartosh, Phillip Anzalone

Publications and Research

By introducing rapid reproduction, algorithms, and complex formal configurations, the digital era of architecture began a revolution. Architects incorporated the computational capacity of the computer into the design process both as a tool and as a critical component of the theories and practice of architecture as a whole. As we move into what has been coined “the second digital turn,” a period in which digital integration is considered ubiquitous, how can we consider, prepare, and propel towards the next technological innovation to significantly inform design thinking, representation, and manifestation? What tools are available to investigate this speculative design future and …

Open Source Foundations For Spatial Decision Support Systems, Jochen Albrecht

Publications and Research

Spatial Decision Support Systems (SDSS) were a hot topic in the 1990s, when researchers tried to imbue GIS with additional decision support features. Successful practical developments such as HAZUS or CommunityViz have since been built, based on commercial desktop software and without much heed for theory other than what underlies their process models. Others, like UrbanSim, have been completely overhauled twice but without much external scrutiny. Both the practical and the theoretical foundations of decision support systems have developed considerably over the past 20 years. This article presents an overview of these developments and then looks at what corresponding tools …

Historical Effects Of Electronic Interfaces, G James Mitchell

Publications and Research

Electronic interfaces are a primary tool for most professional and personal communication currently happening. Electronics, like the human mind, are limited by the understanding of executing will, or commands. This can be characterized as “interface limitations” of digital technology. Identifying this bottleneck in technological development has been critical in historical changes to both hardware and software technology. Recent medical research examines a novel user interface to reduce task load. I hypothesize, interface developments that take cues from nonverbal human communication enhance and sustain the significance of those technologies in society. By examining pivotal moments of historical technology we can identify …

Designing Smart Applications Using Ar (Augmented Reality), Kimberly A. De La Santa

Publications and Research

Augmented Reality is rapidly developing in popularity because it brings elements of the virtual world, into our real world. Augmented Reality (AR) is a variation of Virtual Reality (VR). VR technologies immerses a user inside an imaginary environment. While immersed, the user cannot see the real world around them. In contrast, AR allows the user to see the real world, with virtual objects and information intertwined. Therefore, AR supplements reality and enhances the things we see, hear, and feel. This research project will implement a Web page that gives the user the opportunity to experiment with AR.

Real-Time Indoor Assistive Localization With Mobile Omnidirectional Vision And Cloud Gpu Acceleration, Feng Hu, Zhigang Zhu, Jeury Mejia, Hao Tang

Publications and Research

In this paper we propose a real-time assistive localization approach to help blind and visually impaired people in navigating an indoor environment. The system consists of a mobile vision front end with a portable panoramic lens mounted on a smart phone, and a remote image feature-based database of the scene on a GPU-enabled server. Compact and elective omnidirectional image features are extracted and represented in the smart phone front end, and then transmitted to the server in the cloud. These features of a short video clip are used to search the database of the indoor environment via image-based indexing to …

On Improvised Music, Computational Creativity And Human-Becoming, Arto Artinian, Adam James Wilson

Publications and Research

Music improvisation is an act of human-becoming: of self-expression—an articulation of histories and memories that have molded its participants—and of exploration—a search for unimagined structures that break with the stale norms of majoritarian culture. Given that the former objective may inhibit the latter, we propose an integration of human musical improvisers and deliberately flawed creative software agents that are designed to catalyze the development of human-ratified minoritarian musical structures.

Factororacle: An Extensible Max External For Investigating Applications Of The Factor Oracle Automaton In Real-Time Music Improvisation, Adam James Wilson

Publications and Research

There are several extant software systems designed to generate music in real-time using a factor oracle automaton constructed from the musical input of a human improvisor. The impetus for the design of the factorOracle external is neither a desire to supersede these systems nor introduce novel algorithms for traversing the oracle, but rather to provide a fast, canonical interface for the automaton in Cycling74’s Max and, in future iterations, the Pure Data programming environment. Technical features of the factorOracle software are introduced here.

Cross-Talk: A Shared Parameter Space For Gesturally Extended Human/Machine Improvisation, William Brent, Adam James Wilson

Publications and Research

This paper describes Cross-talk, a piece of music and performance system for two instruments augmented with infrared motion-tracking capability, and an artificial software improviser. Cross-talk was commissioned by the Ammerman Center for Arts and Technology at Connecticut College, for the 13th Biennial Symposium on Arts and Technology. The work is part of an ongoing collaboration focused on developing integrated hardware and software performance systems to extend the timbral and expressive capabilities of traditional musical instruments and to generate musical structure in response to information retrieved from human performers in real-time. Artistic motivations and prior related work are presented here, along …

Arabic For Designers By Mourad Boutros, Saad D. Abulhab

Publications and Research

No abstract provided.

Anatomy Of An Arabetic Type Design, Saad D. Abulhab

Publications and Research

Arabetic type design, like type design in general, should not be limited by rigid rules, other than those advocating open choice and user options. But as with all design fields, highlighting certain principles and guidelines is crucial to realizing a successful project. In an Arabetic font design environment, such guidelines and principles should reveal deeper understanding of various scripts visual and behavioral defining characteristics rather than mere traditional calligraphic and handwriting norms. A main goal of this study is to emphasize that designing Arabetic fonts is much easier than it is portrayed, and designers of all backgrounds should be more …

Typography Behind The Arabetic Calligraphy Veil, Saad D. Abulhab

Publications and Research

In the change from scriptural writing systems to textual mechanical systems and most recently to digital, computer generated text, some languages and their typographic representations have suffered. One such language, along with its visible language representation, that has not made a smooth transition is Arabic. The author argues that misinterpreting language tradition prevents what he calls Arabetic typography from embracing an appropriate technological adaptation. Putting forth an evolutionary argument, he critiques the notion that calligraphic styles must prevail and that legibility and readability of Arabic characters is objective. He further states that the resulting typefaces when abandoning the so called …

The Mutamathil Type Style: Towards Free, Technology-Friendly, Arabetic Types, Saad D. Abulhab

Publications and Research

Efforts to adapt various Arabetic scripts to the machine are as old as the field of typography. But most of these efforts concentrated primarily on forcing the machine to duplicate the Arabetic handwritten forms. Others have practically advocated divorce from the calligraphic tradition rather than enrichment and reform. One reason why the few modern attempts to typographically solve the technology-induced Arabetic script problems had failed is that many typeforms (or many times just theoretical calligraphy style) was presented as replacement for the traditional ones rather than as optional working types. New “controversial” types should be made widely available for users …