Open Access. Powered by Scholars. Published by Universities.®

Physical Sciences and Mathematics Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 13 of 13

Full-Text Articles in Physical Sciences and Mathematics

Towards An In-Vehicle Sonically-Enhanced Gesture Control Interface: A Pilot Study, Jason Sterkenburg, Steven Landry, Myounghoon Jeon, Joshua Johnson Apr 2018

Towards An In-Vehicle Sonically-Enhanced Gesture Control Interface: A Pilot Study, Jason Sterkenburg, Steven Landry, Myounghoon Jeon, Joshua Johnson

Myounghoon Jeon (Philart)

A pilot study was conducted to explore the potential of sonically-enhanced gestures as controls for future in-vehicle information systems (IVIS). Four concept menu systems were developed using a LEAP Motion and Pure Data: (1) 2x2 with auditory feedback, (2) 2x2 without auditory feedback, (3) 4x4 with auditory feedback, and (4) 4x4 without auditory feedback. Seven participants drove in a simulator while completing simple target-acquisition tasks using each of the four prototype systems. Driving performance and eye glance behavior were collected as well as subjective ratings of workload and system preference. Results from driving performance and eye tracking measures strongly indicate …


Tempo-Fit Heart Rate App: Using Heart Rate Sonification As Exercise Performance Feedback, Steven Landry, Yuanjing Sun, Darnishia L. Slade, Myounghoon Jeon Apr 2018

Tempo-Fit Heart Rate App: Using Heart Rate Sonification As Exercise Performance Feedback, Steven Landry, Yuanjing Sun, Darnishia L. Slade, Myounghoon Jeon

Myounghoon Jeon (Philart)

Physical inactivity is a worldwide issue causing a variety of health problems. Exploring novel ways to encourage people to engage in physical activity is a topic at the forefront of research for countless stakeholders. Based upon a review of the literature, a pilot study, and exit interviews, we propose an app prototype that utilizes music tempo manipulation to guide users into a target heart rate zone during an exercise session. A study was conducted with 26 participants in a fifteen-minute cycling session using different sonification mappings and combinations of audiovisual feedback based on the user's current heart rate. Results suggest …


Robotic Motion Learning Framework To Promote Social Engagement, Rachel Burns, Myounghoon Jeon, Chung Hyuk Park Apr 2018

Robotic Motion Learning Framework To Promote Social Engagement, Rachel Burns, Myounghoon Jeon, Chung Hyuk Park

Myounghoon Jeon (Philart)

Abstract Imitation is a powerful component of communication between people, and it poses an important implication in improving the quality of interaction in the field of human–robot interaction (HRI). This paper discusses a novel framework designed to improve human–robot interaction through robotic imitation of a participant’s gestures. In our experiment, a humanoid robotic agent socializes with and plays games with a participant. For the experimental group, the robot additionally imitates one of the participant’s novel gestures during a play session. We hypothesize that the robot’s use of imitation will increase the participant’s openness towards engaging with the robot. Experimental results …


Robotic Arts: Current Practices, Potentials, And Implications, Myounghoon "Philart" Jeon Apr 2018

Robotic Arts: Current Practices, Potentials, And Implications, Myounghoon "Philart" Jeon

Myounghoon Jeon (Philart)

Given that the origin of the “robot” comes from efforts to create a worker to help people, there has been relatively little research on making a robot for non-work purposes. However, some researchers have explored robotic arts since Leonardo da Vinci. Many questions can be posed regarding the potentials of robotic arts: (1) Is there anything we can call machine-creativity? (2) Can robots improvise artworks on the fly? and (3) Can art robots pass the Turing test? To ponder these questions and see the current status quo of robotic arts, the present paper surveys the contributions of robotics in diverse …


Regulating Drivers’ Aggressiveness By Sonifying Emotional Data, Maryam Fakhrhosseini, Paul Kirby, Myounghoon Jeon Apr 2018

Regulating Drivers’ Aggressiveness By Sonifying Emotional Data, Maryam Fakhrhosseini, Paul Kirby, Myounghoon Jeon

Myounghoon Jeon (Philart)

There have been efforts within the area of cognitive and behavioral sciences to mitigate drivers’ emotion to decrease the associated traffic accidents, injuries, fatalities, and property damage. In this study, we targeted aggressive drivers and try to regulate their emotion through sonifying their emotional data. Results are discussed with an affect regulation model and future research.


Participatory Design Research Methodologies: A Case Study In Dancer Sonification, Steven Landry, Myounghoon Jeon Apr 2018

Participatory Design Research Methodologies: A Case Study In Dancer Sonification, Steven Landry, Myounghoon Jeon

Myounghoon Jeon (Philart)

Given that embodied interaction is widespread in Human-Computer Interaction, interests on the importance of body movements and emotions are gradually increasing. The present paper describes our process of designing and testing a dancer sonification system using a participatory design research methodology. The end goal of the dancer sonification project is to have dancers generate aesthetically pleasing music in real-time based on their dance gestures, instead of dancing to pre-recorded music. The generated music should reflect both the kinetic activities and affective contents of the dancer’s movement. To accomplish these goals, expert dancers and musicians were recruited as domain experts in …


Musical Robots For Children With Asd Using A Client-Server Architecture, Ruimin Zhang, Jaclyn Barnes, Joseph Ryan, Myounghoon Jeon, Chung Hyuk Park, Ayanna Howard Apr 2018

Musical Robots For Children With Asd Using A Client-Server Architecture, Ruimin Zhang, Jaclyn Barnes, Joseph Ryan, Myounghoon Jeon, Chung Hyuk Park, Ayanna Howard

Myounghoon Jeon (Philart)

People with Autistic Spectrum Disorders (ASD) are known to have difficulty recognizing and expressing emotions, which affects their social integration. Leveraging the recent advances in interactive robot and music therapy approaches, and integrating both, we have designed musical robots that can facilitate social and emotional interactions of children with ASD. Robots communicate with children with ASD while detecting their emotional states and physical activities and then, make real-time sonification based on the interaction data. Given that we envision the use of multiple robots with children, we have adopted a client-server architecture. Each robot and sensing device plays a role as …


Listen To Your Drive: Sonification Architecture And Strategies For Driver State And Performance, Steven Landry, David Tascarella, Myounghoon Jeon, Maryam Fakhrhosseini Apr 2018

Listen To Your Drive: Sonification Architecture And Strategies For Driver State And Performance, Steven Landry, David Tascarella, Myounghoon Jeon, Maryam Fakhrhosseini

Myounghoon Jeon (Philart)

Driving is mainly a visual task, leaving other sensory channels open for additional information communication. As the level of automation increases in vehicles, monitoring the state and performance of the driver and vehicle shifts from the secondary to primary task. Auditory channels provide the flexibility to display a wide variety of information to the driver without increasing the workload of driving task. It is important to identify types of auditory displays and sonification strategies that provide integral information necessary for the driving task, and not overload the driver with unnecessary or intrusive data. To this end, we have developed an …


Lifemusic: Reflection Of Life Memories By Data Sonification, Ridwan Ahmed Khan, Ram K. Avvari, Katherine Wiykovics, Pooja Ranay, Myounghoon Jeon Apr 2018

Lifemusic: Reflection Of Life Memories By Data Sonification, Ridwan Ahmed Khan, Ram K. Avvari, Katherine Wiykovics, Pooja Ranay, Myounghoon Jeon

Myounghoon Jeon (Philart)

Memorable life events are important to form the present selfimage. Looking back on these memories provides an opportunity to ruminate meaning of life and envision future. Integrating the life-log concept and auditory graphs, we have implemented a mobile application, "LifeMusic", which helps people reflect their memories by listening to their life event sonifcation that is synchronous to these memories. Reflecting the life events through LifeMusic can relieve users of the present and have them journey to the past moments and thus, they can keep balance of emotions in the present life. In the current paper, we describe the implementation and …


Influences Of Visual And Auditory Displays On Aimed Movements Using Air Gesture Controls, Jason Sterkenburg, Steven Landry, Myounghoon Jeon Apr 2018

Influences Of Visual And Auditory Displays On Aimed Movements Using Air Gesture Controls, Jason Sterkenburg, Steven Landry, Myounghoon Jeon

Myounghoon Jeon (Philart)

With the proliferation of technologies operated via in-air hand movements, e.g. virtual/augmented reality, in-vehicle infotainment systems, and large public information displays, there remains an open question about if/how auditory displays can be used effectively to facilitate eyes-free aimed movements. We conducted a within-subjects study, similar to a Fitts paradigm study, in which 24 participants completed simple aimed movements to acquire targets of varying sizes and distances. Participants completed these aimed movements for six conditions – each presenting a unique combination of visual and auditory displays. Results showed participants were generally faster to make selections when using visual displays compared to …


Anger Effects On Driver Situation Awareness And Driving Performance, Myounghoon Jeon, Bruce N. Walker, Thomas M. Gable Apr 2018

Anger Effects On Driver Situation Awareness And Driving Performance, Myounghoon Jeon, Bruce N. Walker, Thomas M. Gable

Myounghoon Jeon (Philart)

Research has suggested that emotional states have critical effects on various cognitive processes, which are important components of situation awareness (Endsley, 1995b). Evidence from driving studies has also emphasized the importance of driver situation awareness for performance and safety. However, to date, little research has investigated the relationship between emotional effects and driver situation awareness. In our experiment, 30 undergraduates drove in a simulator after induction of either anger or neutral affect. Results showed that an induced angry state can degrade driver situation awareness as well as driving performance as compared to a neutral state. However, the angry state did …


A Survey On Hardware And Software Solutions For Multimodal Wearable Assistive Devices Targeting The Visually Impaired, Adam Caspo, György Wersényi, Myounghoon Jeon Apr 2018

A Survey On Hardware And Software Solutions For Multimodal Wearable Assistive Devices Targeting The Visually Impaired, Adam Caspo, György Wersényi, Myounghoon Jeon

Myounghoon Jeon (Philart)

The market penetration of user-centric assistive devices has rapidly increased in the past decades. Growth in computational power, accessibility, and "cognitive" device capabilities have been accompanied by significant reductions in weight, size, and price, as a result of which mobile and wearable equipment are becoming part of our everyday life. In this context, a key focus of development has been on rehabilitation engineering and on developing assistive technologies targeting people with various disabilities, including hearing loss, visual impairments and others. Applications range from simple health monitoring such as sport activity trackers, through medical applications including sensory (e.g. hearing) aids and …


17 Human-Car Confluence: “Socially-Inspired Driving Mechanisms”, Andreas Riener, Myounghoon Jeon, Alois Ferscha Apr 2018

17 Human-Car Confluence: “Socially-Inspired Driving Mechanisms”, Andreas Riener, Myounghoon Jeon, Alois Ferscha

Myounghoon Jeon (Philart)

With self-driving vehicles announced for the 2020s, today’s challenges in Intelligent Transportation Systems (ITS) lie in problems related to negotiation and decision making in (spontaneously formed) car collectives. Due to the close coupling and interconnectedness of the involved driver-vehicle entities, effects on the local level induced by cognitive capacities, behavioral patterns, and the social context of drivers, would directly cause changes on the macro scale. To illustrate, a driver’s fatigue or emotion can influence a local driver-vehicle feedback loop, which is directly translated into his or her driving style, and, in turn, can affect driving styles of all nearby drivers. …