Computer Engineering Commons^™

Real-Time Illumination Capture And Rendering On Mobile Devices, Snehal Padhye, James A. Ferwerda

Frameless

We present our efforts to develop methods for rendering 3D objects on mobile devices using real-world dynamic illumination from the user’s environment. To achieve this, we use the front and back cameras on the mobile device to estimate the light distribution in the environment in real time. We then create a dynamic illumination map and render the object at interactive rates in a browser on the device using a web-based graphics API. This project achieves one of the goals of our related work on realistic visualization of virtual objects: to make virtual objects appear to be situated within the scene …

Mixed Reality Prototype Device Showcase: Using Smart Glasses To Enhance Language Access, Aaron Parker, Connor Switenky, Roshan Mathew, Wendy Dannels

Frameless

While the use of American Sign Language (ASL) interpreters and real-time captioning significantly increases deaf individuals’ ability to participate in a wide variety of functions, there are some limitations. The major problem is that current ways of providing communication and information access to deaf people require them to split their attention between the visual focus of the specific content and the interpreter/captioning display. At any given point in time, deaf people are forced to decide what explanation to miss with subsequent effects on topic comprehension and perceptions of the interaction and environments.

Novel 360-Degree Camera, Ian Gauger, Andrew Kurtz, Zakariya Niazi

Frameless

Circle Optics is developing novel technology for low-parallax, real time, panoramic image capture using an integrated array of multiple adjacent polygonal-edged cameras. This technology can be optimized and deployed for a variety of markets, including cinematic VR. Circle Optics’ existing prototype, Hydra Alpha, will be demonstrated.

Warehouse And Logistics: Smart Picking With Vuzix Smart Glasses, Elise Hemink

Frameless

Vuzix is an industry leader in augmented reality (AR) technology. We provide innovative products to an array of industries, a few being defense, security, enterprise, and consumers. Our AR technology provides a perfect balance of engagement in the digital and real worlds thanks to their innovative optics, AI apps and 5G capability.

Creating A Virtual Reality Experience In Service To A Non-Profit Agency, Frank Deese, Susan Lakin, Isabelle Anderson

Frameless

In the summer of 2018, RIT Professors Susan Lakin and Frank Deese discussed with the principal officers of the Society for the Protection and Care of Children (SPCC) in Rochester how the new technology of Virtual Reality might be used to not only impart information to viewers, but generate empathy for those receiving services from the organization as well as those performing those services. Their ultimate goal was to create an experience that could be viewed with VR headsets at fundraising events and on a website using low-cost Google Cardboard.

Exploring The Psychological Consequences Of Distances In Virtual Reality, Gary D. Jacobs

Frameless

This presentation will examine common concepts of traveling between formalized spaces inside virtual reality (VR) experiences.

The common method for traveling in virtual reality is to click on an area or trigger and be transported to that location. These “teleportations”, however, remove the notion of distances from our virtual worlds. This is akin to a magic wand that eliminates the consequences of travel in VR. Often heralded as a boon for the virtual worlds we can create, wherein we can travel to far away lands without lag in time and without effort on the part of the participant. We posit …

Vr Sound Mapping: Make Sound Accessible For Dhh People In Virtual Reality Environments, Ziming Li, Roshan Peiris

Frameless

In-game audio plays an important role in enhancing the sense of reality and immersion in the gaming experience. In many games, sounds are also used to provide notifications and clues which are essential to the gameplay. However, in this case, the DHH (deaf and hard of hearing) players may fail to access the information conveyed by sounds, which degrades their gaming experience (Jain et al. 2021).

Projection-Based Ar For Hearing Parent-Deaf Child Communication, Victor N. Antony, Adira Blumenthal, Ziyue Qiu, Ashely Tenesaca, Wanyin Hu, Zhen Bai

Frameless

Deaf infants born to hearing parents are at risk of language deprivation due to lack of sign language fluency and subpar parent-child communication. We present a projection-based Augmented Reality (AR) prototype designed to improve parent-child communication and American Sign Language (ASL) acquisition. Our system aims to non-intrusively augment play episodes by projecting just-in-time and context-aware ASL equivalents extracted from nursery rhymes being sung by parents. This paper presents the initial implementation of the prototype .

Eye Tracking In Virtual Reality For Educational Technology Research, Jorge Bacca-Acosta, Julian Tejada

Frameless

No abstract provided.

Designing Blended Experiences: Laugh Traders Design Fiction, Brian J. Okeefe

Frameless

The increasing ubiquity of interactions that involve complementary digital content, physical objects, and spaces, brings about new challenges for designers. There is a need to embed designs in legacy systems, whether those are existing physical structures or existing digital platforms. Traditional approaches to product design, interaction design, and user experience design often do not take this new context into account. Many systems do not consider how designers produce new digital and physical experiences that work harmoniously, while supporting new interactions and relationships with people (Imaz and Benyon 2007; Jetter, Geyer, Schwarz & Reiterer 2012). To address this, we propose the …

Story Guided Virtual Cultural Heritage Applications, Selma Rizvic

Journal of Interactive Humanities

Virtual cultural heritage applications, particularly virtual museums, nowadays include various forms of storytelling. Every object, site or artifact is better perceived and understood through the adjoining story. Interactive applications naturally request the storytelling to become interactive as well. This paper describes the concepts of interactive digital storytelling in our virtual museums and cultural heritage presentations and discusses their advantages and drawbacks recognized through user evaluation. We used digital stories not only to introduce visitors with the context and information on the objects, but also to enhance their navigation through virtual environments with purpose of learning and perceiving maximum amount of …