Graphics and Human Computer Interfaces Commons^™

Seeing Eye To Eye: A Machine Learning Approach To Automated Saccade Analysis, Maigh Attre

Honors Scholar Theses

Abnormal ocular motility is a common manifestation of many underlying pathologies particularly those that are neurological. Dynamics of saccades, when the eye rapidly changes its point of fixation, have been characterized for many neurological disorders including concussions, traumatic brain injuries (TBI), and Parkinson’s disease. However, widespread saccade analysis for diagnostic and research purposes requires the recognition of certain eye movement parameters. Key information such as velocity and duration must be determined from data based on a wide set of patients’ characteristics that may range in eye shapes and iris, hair and skin pigmentation [36]. Previous work on saccade analysis has …

A Virtual Reality System For Practicing Conversation Skills For Children With Autism, Natalia Stewart Rosenfield, Kathleen Lamkin, Jennifer Re, Kendra Day, Louanne E. Boyd, Erik J. Linstead

Engineering Faculty Articles and Research

We describe a virtual reality environment, Bob’s Fish Shop, which provides a system where users diagnosed with Autism Spectrum Disorder (ASD) can practice social interactions in a safe and controlled environment. A case study is presented which suggests such an environment can provide the opportunity for users to build the skills necessary to carry out a conversation without the fear of negative social consequences present in the physical world. Through the repetition and analysis of these virtual interactions, users can improve social and conversational understanding.

Designing Interactive Virtual Environments With Feedback In Health Applications., Yi Li

Electronic Theses and Dissertations

One of the most important factors to influence user experience in human-computer interaction is the user emotional reaction. Interactive environments including serious games that are responsive to user emotions improve their effectiveness and user satisfactions. Testing and training for user emotional competence is meaningful in healthcare field, which has motivated us to analyze immersive affective games using emotional feedbacks. In this dissertation, a systematic model of designing interactive environment is presented, which consists of three essential modules: affect modeling, affect recognition, and affect control. In order to collect data for analysis and construct these modules, a series of experiments were …

Using Virtual Reality To Improve Sitting Balance, Alice Kay Barnes

Graduate Theses/Dissertations

This thesis focuses on using virtual reality (VR) to enhance sitting balance and core strength. It is a study in how to create a VR exercise program which is interesting enough to keep players/patients motivated, but comfortable to play and not overwhelming to the senses. The software used for this study was written with the hope that a later version of it might be used with occupational/physical therapy patients one day. For this master’s thesis, the initial testing has been done with healthy volunteers. The software incorporates what developers know thus far about designing for VR, and it is hoped …

We Are Alfred: Empathy Learned Through A Medical Education Virtual Reality Project, Barbara Swartzlander, Elizabeth Dyer, Marilyn R. Gugliucci

Library Services Faculty Posters

Poster describing project collaboration among University of New England (UNE) librarians and College of Osteopathic Medicine (COM) faculty, whose goal was to adopt technology which will teach UNECOM students to be empathic with older adults and familiarize medical students with information resources from the NIH/NLM related to older adult health. Technology tested was the Alfred Lab developed by Embodied Labs. First year medical students were required to complete the ‘We Are Alfred’ virtual reality module and a pre and post assessment. Descriptive statistics were applied to finite questions on pre and post assessments, and content analysis on open ended answers. …

Older Adult Health: National Library Of Medicine Resources For Health Care Providers And For Patients And Families, Elizabeth Dyer, Barbara Swartzlander, Marilyn R. Gugliucci, Laura Taylor

Library Services Faculty Publications

This list of resources was designed to complement a project funded by the National Network of Libraries of Medicine (NN/LM) New England Region (NER) entitled “Empathy Learned Through an Extended Medical Education Virtual Reality Project." The project used a virtual reality (VR) experience for 1st year medical students developed by Embodied Labs. The interactive “Alfred Lab” immerses users in the story of a 74-year-old patient who has macular degeneration and hearing loss, allowing users to experience these conditions from the patient’s perspective as he interacts with his family and doctor.

A System To Monitor Cognitive Workload In Naturalistic High-Motion Environments, Bethany K. Bracken, Seth Elkin-Frankston, Noa Palmon, Michael Farry, Blaise De B Frederick

H-Workload 2017: Models and Applications (Works in Progress)

Across many careers, individuals face alternating periods of high and low attention and cognitive workload can impair cognitive function and undermine job performance. We have designed and are developing an unobtrusive system to Monitor, Extract, and Decode Indicators of Cognitive Workload (MEDIC) in naturalistic, high-motion environments. MEDIC is designed to warn individuals, teammates, or supervisors when steps should be taken to augment cognitive readiness. We first designed and manufactured a forehead sensor device that includes a custom fNIRS sensor and a three-axis accelerometer designed to be mounted on the inside of a baseball cap or headband, or standard issue gear …

Towards A Not Obtrusive Low Cost Biosystem To Assess Risk Perception In Workplace Through Stress Detection, Emanuele Bellini, Serena Benevenuti, Chiara Batistini

H-Workload 2017: Models and Applications (Works in Progress)

The main aim of the article is to build a method to assess risk perception in real time in order to early detect and prevent risk behaviors and possible human errors. To this end, the relation between mental workload and stress as critical factors affecting risk perception has been investigated. In particular the mental-physical activation generated by an increment of the workload has the effect of reducing the resources needed to perceive risk increasing the worker vulnerability. The complexity of the stress phenomenon suggested the adoption of an integrated view. The Functional Model has been adopted to for its holistic …

A Pilot Study Into Bio-Behavioural Measurements On Air Traffic Controllers In Remote Tower Operations, Tanja Bos, Rolf Zon, Eszter Furedi, Dezso Dudas, Daniel Rohacs

H-Workload 2017: Models and Applications (Works in Progress)

What is the impact of shifting to remote tower operations on the Air Traffic Controller? In the joint HungaroControl-Netherlands Aerospace Centre NLR pilot project an assessment of bio-behaviour on three air traffic controllers was made in a remote tower and conventional tower. The research is motivated by HungaroControl’s plans in shifting to remote tower operations at Budapest airport in the upcoming years. This pilot project is considered a feasibility study to investigate if an eye tracker and a heart rate sensor can be used to derive workload, the controllers’ division of attention over information elements, and scanning strategies in two …

A Systems Approach To Predicting And Measuring Workload In Rail Traffic Management Systems, Joanna Evans

H-Workload 2017: Models and Applications (Works in Progress)

The introduction of systems such as Traffic Management (TM) will result in a number of changes in how the railway is managed for operations and maintenance staff such as, an increase in collaborative working styles and shared responsibilities. In order to react to these changing operational demands and user needs, TM workstation designs need to have greater flexibility and be configurable to support the information requirements for each specific role as well as support each role during different scenarios. Although this flexibility in system design has the potential to enhance performance, it increases the complexity of measuring operator workload. The …

Distress And Worry As Mediators In The Relationship Between Psychosocial Risks And Upper Body Musculosketal Complaints In Highly Automated Manufacturing, Fiona Wixted, Leonard O'Sullivan

H-Workload 2017: Models and Applications (Works in Progress)

As a result of an upward trend in automation, the requirement for supervisory monitoring and consequently, cognitive demand has increased in automated manufacturing. The incidence of musculoskeletal disorders has also increased in the manufacturing sector. A model was developed based on survey data to test if distress and worry mediate the relationship between psychosocial factors (job control, cognitive demand, social isolation and skill discretion), stress states and upper body musculoskeletal complaints in highly automated manufacturing companies (n=235). Cognitive demand was shown to be related to higher distress in employees. The data raise the question about the link between job control …

Petrochemical Plant Console Operator Workload:The Issues, David A. Strobhar

H-Workload 2017: Models and Applications (Works in Progress)

The console operators of certain petrochemical processes must maintain high levels of performance during process upsets or endanger personnel safety and the environment. Mismanagement of an upset can result in explosions, fires, and the release of hazardous chemicals to the environment. The change in workload from steady state to upset operation is significant, with alarms and control changes that are of an order of magnitude. This paper describes the state of console activity in process plants, particularly the increase with key upsets. Quantitative data on the nature of the console operator’s position, its workload during normal operation, and the requirements …

Towards A Continuous Assessment Of Cognitive Workload For Smartphone Multitasking Users, Angel Jimenez-Molina, Hernan Lira

H-Workload 2017: Models and Applications (Works in Progress)

The intermeshing of Smartphone interactions and daily activities depletes the availability of cognitive resources. This excessive demand may lead to several undesirable cognitive states, which can be avoided by continuously assessing the user cognitive workload. Recently, many attempts have emerged to assess this workload by using psycho physiological signals. This paper provides evidence that it is possible to train models that accurately identify in short time windows such cognitive workload by processing heart rate and blood oxygen saturation signals. This assessment could be applied in Smartphone notification delivery, interface adaptations or cognitive capabilities evaluation.

A Workload-Centered Perspective On Reduced Crew Operations In Commercial Aviation, Daniela Schmid

H-Workload 2017: Models and Applications (Works in Progress)

Mental workload of a pilot, in short workload, depends on various characteristics of different accumulated tasks on the flight deck. Exogenous task demands and endogenous supply of attentional or information processing resources determine workload [1]. Performance is expect to drop if the demand exceeds the available resources of the pilot. Expertise and experience modulate the endogenous sup- ply of resources like perceiving, updating memory, planing, making a decision, and executing and processing a response. Subsequently, workload manifests in performance variables, subjective experience, and physiological parameters [2]. This is how we can summarize workload very brie y to introduce a model …

Reducing Peak Workload In The Cockpit: A Human In The Loop Simulation Evaluating New Runway Selection Tool, Tanja Bos, Rolf Zon, Wilfred Rouwhorst

H-Workload 2017: Models and Applications (Works in Progress)

In efforts to increase safety and reduce peak workload situations in the cockpit, a tool with a different interaction style was developed for use in case of a runway change instructed by Air Traffic Control during approach. In an experiment a workload comparison was made between the new tool and the conventional cockpit. Workload was measured by means of a self-rating after each experiment run, as well as eye blink frequency during each run. Results show that the self-rated workload decreases with the new tool for one of the two crew members and the blink frequency suggests a workload decrease …

Managing Operator Mental Workload With Standards Based Decision Support, Maurice Wilkins

H-Workload 2017: Models and Applications (Works in Progress)

H-Workload 2017: The first international symposium on human mental workload, Dublin Institute of Technology, Dublin, Ireland, June 28-30.

Facing Human Workload: The Resilient Ego: A Psychoanalytic Point Of View, Glauco Maria Genga, Maria Gabriella Pediconii

H-Workload 2017: Models and Applications (Works in Progress)

The paper aims to show new connections among Human Factors, Human Workload and Resilience. We intend: 1) to highlight the role of subject in facing the human workload, inflected as demanding tasks and emergency situations; 2) to show how psychoanalysis can provide novel insights, not only into human errors, but also into human resilience. They have a common denominator, at least in part: the role of subjective contributions even in demanding situations. Human workload includes a work for satisfaction. We recall also the case study of US Airways Flight 1549 water landing (the so called “Miracle on the Hudson”), which …

System Identification Of Motion Artifact: Noise In Eeg Headsets From Locomotion, Kaela Shea, James Tung

H-Workload 2017: Models and Applications (Works in Progress)

Fall prevention for geriatric populations is a growing concern among clinicians and researchers due to severe risk of morbidity and loss of independence. Emerging evidence has demonstrated that mental workload while walking influences gait stability and the risk for falling. Electroencephalography (EEG) presents a potential method to provide objective measures of mental workload, particularly during daily activities. Noise introduced to the EEG signal during motion, however, is restrictive. The study presented in the following paper isolates EEG signal noise attained from gait for a commercially accessible EEG system, the "Emotiv" Time and spectral system identification techniques were applied to model …

Online Measuring Of Available Resources, Enrique Munoz-De-Escalona, José Juan Canas

H-Workload 2017: Models and Applications (Works in Progress)

This paper present a proposal for measuring available mental resources during the accomplishment of a task. Our proposal consists in measuring emotions provoked by perceived self-efficacy in the execution of the task. Self-efficacy is one of the most important factors that affect the resources that a person puts at the disposal of the execution of the task. When a person perceives that he/she is not being effective he/she will activate more resources to improve his performance. This self-efficacy will be reflected in the emotions that the person experiences. A good efficacy will provoke positive emotions and a bad efficacy negative …

An Iterative Bézier Method For Fitting Beta-Sheet Component Of A Cryo-Em Density Map, Michael Poteat, Jing He

Computer Science Faculty Publications

Cryo-electron microscopy (Cryo-EM) is a powerful technique to produce 3-dimensional density maps for large molecular complexes. Although many atomic structures have been solved from cryo-EM density maps, it is challenging to derive atomic structures when the resolution of density maps is not sufficiently high. Geometrical shape representation of secondary structural components in a medium-resolution density map enhances modeling of atomic structures. We compare two methods in producing surface representation of the β-sheet component of a density map. Given a 3-dimensional volume of β-sheet that is segmented from a density map, the performance of a polynomial fitting was compared with that …

A Pilot Study Of Comparison Gesture Analysis In Motion Driven Video Games, Fabrizio Valerio Covone, Brian Vaughan, Charlie Cullen

Conference Papers

This study investigates whether there are significant differences in the gestures made by gamers and non-gamers whilst playing commercial games that employ gesture inputs. Specifically, the study focuses on testing a prototype of multimodal capture tool that we used to obtain real-time audio, video and skeletal gesture data. Additionally, we developed an experimental design framework for the acquisition of spatio-temporal gesture data and analysed the vector magnitude of a gesture to compare the relative displacement of each participant whilst playing a game.

Patient Engagement In The Medical Facility Waiting Room Using Gamified Healthcare Information Delivery, Raheel Hassan, Nathan W. Twyman, Fiona Fui-Hoon Nah, Keng Siau

Research Collection School Of Computing and Information Systems

This study explores the proposition that medical facility waiting rooms are an opportune setting to engage with and educate patients while they are waiting for care. In collaboration with emergency department (ED) personnel, we developed ER Hero, a tablet-based application for waiting rooms that introduces patients to ED professionals and operations through mini-games and story-like interaction. We evaluated this prototype with human participants to determine how well it performed when compared to paper-based information disclosure presenting the same information. Participants using the application exhibited increased ED knowledge, decreased nervousness, and increased interest. The gamified application outperformed a paper-based approach on …

2016-01-A3dsrinp-Csc-Sta-Cmb-522-Bps-542, Raymond Pulver, Neal Buxton, Xiaodong Wang, John Lucci, Jean Yves Hervé, Lenore Martin

Bioinformatics Software Design Projects

Cholesterol is carried and transported through bloodstream by lipoproteins. There are two types of lipoproteins: low density lipoprotein, or LDL, and high density lipoprotein, or HDL. LDL cholesterol is considered “bad” cholesterol because it can form plaque and hard deposit leading to arteries clog and make them less flexible. Heart attack or stroke will happen if the hard deposit blocks a narrowed artery. HDL cholesterol helps to remove LDL from the artery back to the liver.

Traditionally, particle counts of LDL and HDL plays an important role to understanding and prediction of heart disease risk. But recently research suggested that …

An Exploration Of The Effectiveness Of The Use Of Communication Apps Through Mobile Devices On Children With Autism Spectrum Disorders (Asd), Miriam O Sullivan

Theses

Autism Spectrum Disorder (ASD) is a complex neurological disorder which impacts on people in three primary areas: communication skills, social skills and behaviour skills. The diagnosis of ASD continues to rise with an estimated 1 in 100 receiving diagnoses of ASD in Ireland. There are many interventions promoted on a regular basis that claim positive effects on the basis of empirical research. However, the claims made by such studies are sometimes a little at odds with the level of methodological rigour and/or sample size employed. The research available is based on small scale international studies (America, Canada and Australia); however, …

Patient Portals: Achieving Technology Acceptance And Meaningful Use In Independent Physician-Managed Practices, Kimberly W. Bartholomew

CCAC Theses and Dissertations

As the bulk of medical health records shift from paper-based file systems to electronic formats, the promise of the transformation process called healthcare reform included adding efficiencies to medical practice workflows, lower costs, improved quality of care and most important, and the freeing of patient information from traditional propriety silos. With this incoming largess of protected health information data now viewable through online patient portals, patients can be empowered to become educated and active in their own health care decisions, but only if they have admission to their information. A digital divide currently exists in many medical practices where only …

Developing A Bilingual, Computer-Tailored, Hpv Vaccination Promotion Intervention Targeting Latino Parents, Angela Chia-Chen Chen, Ashish Amresh

Publications

In this paper we present an innovative, computer-tailored application aimed at increasing Latino parents' intention to vaccinate their adolescent children against Human Papilloma Virus (HPV). HPV infection is the most common sexually transmitted infection in the United States. Latinas have the highest age-adjusted incidence rate for HPV-associated cervical cancer compared with their counterparts in other racial/ethnic groups. HPV vaccines offer hope against HPV-associated diseases. Because parental consent is required for children under age 18 to receive t h e HPV vaccination in most U. S. states, parents' attitudes and intention to have their children vaccinated are keys for promoting HPV …

Interactive Cause And Effect Comic-Book Storytelling For Improving Nutrition Outcomes In Children, Ashish Amresh, Madhumita Sinha, Rebecca Birr, Rahul Salla

Publications

Obesity among children and adolescents is increasingly becoming a major public health problem. Poverty and lower socio-economic status as well as lack of parental awareness regarding a balanced diet and adequate exercise all contribute towards childhood obesity. Unfortunately minority children have been especially vulnerable, among them inner-city Latino children continue to have the highest incidence rates of overweight and obesity; hence targeted intervention for this population group is of paramount importance. Access and affordability of smartphones and mobile internet devices provide an opportunity to create nutrition education interventions that can significantly impact and change attitude and knowledge regarding healthy diet …

Physio@Home: Exploring Visual Guidance And Feedback Techniques For Physiotherapy Exercises, Richard Tang, Xing-Dong Yang, Scott Bateman, Joaquim Jorge, Anthony Tang

Research Collection School Of Computing and Information Systems

Physiotherapy patients exercising at home alone are at risk of re-injury since they do not have corrective guidance from a therapist. To explore solutions to this problem, we designed Physio@Home, a prototype that guides people through pre-recorded physiotherapy exercises using realtime visual guides and multi-camera views. Our design addresses several aspects of corrective guidance, including: plane and range of movement, joint positions and angles, and extent of movement. We evaluated our design, comparing how closely people could follow exercise movements under various feedback conditions. Participants were most accurate when using our visual guide and multi-views. We provide suggestions for exercise …

Seniors With Diabetes-Investigation Of The Impact Of Semantic Auditory Distractions On The Usability Of A Blood Glucose Tracking Mobile Application, Jose A. Rivera Rodriguez

CCAC Theses and Dissertations

Diabetes is the seventh leading cause of death in the United States. With the population rapidly aging, it is expected that 1 out of 3 Americans will have diabetes by 2050. Mobile devices and mobile applications have the potential to contribute to diabetes self-care by allowing users to manage their diabetes by keeping track of their blood glucose levels. Usability is important for systems that help people self-manage conditions such as diabetes. Age and diabetes-related cognitive decline might intensify the impact of usability issues for the users who need these mobile applications the most. As highlighted by usability researchers, the …

Choice Of Human–Computer Interaction Mode In Stroke Rehabilitation, Hossein Mousavi Hondori, Maryam Khademi, Lucy Dodakian, Alison Mackenzie, Cristina V. Lopes, Steven C. Cramer

Physical Therapy Faculty Articles and Research

Background and Objective. Advances in technology are providing new forms of human–computer interaction. The current study examined one form of human–computer interaction, augmented reality (AR), whereby subjects train in the real-world workspace with virtual objects projected by the computer. Motor performances were compared with those obtained while subjects used a traditional human–computer interaction, that is, a personal computer (PC) with a mouse. Methods. Patients used goal-directed arm movements to play AR and PC versions of the Fruit Ninja video game. The 2 versions required the same arm movements to control the game but had different cognitive demands. With …