Graphics and Human Computer Interfaces Commons^™

Using Eeg-Validated Music Emotion Recognition Techniques To Classify Multi-Genre Popular Music For Therapeutic Purposes, Dejoy Shastikk Kumaran

The International Student Science Fair 2018

Music is observed to possess significant beneficial effects to human mental health, especially for patients undergoing therapy and older adults. Prior research focusing on machine recognition of the emotion music induces by classifying low-level music features has utilized subjective annotation to label data for classification. We validate this approach by using an electroencephalography-based approach to cross-check the predictions of music emotion made with the predictions from low-level music feature data as well as collected subjective annotation data. Collecting 8-channel EEG data from 10 participants listening to segments of 40 songs from 5 different genres, we obtain a subject-independent classification accuracy …

Improving Asynchronous Advantage Actor Critic With A More Intelligent Exploration Strategy, James B. Holliday

Graduate Theses and Dissertations

We propose a simple and efficient modification to the Asynchronous Advantage Actor Critic (A3C)

algorithm that improves training. In 2016 Google’s DeepMind set a new standard for state-of-theart

reinforcement learning performance with the introduction of the A3C algorithm. The goal of

this research is to show that A3C can be improved by the use of a new novel exploration strategy we

call “Follow then Forage Exploration” (FFE). FFE forces the agents to follow the best known path

at the beginning of a training episode and then later in the episode the agent is forced to “forage”

and explores randomly. In …

Speech Emotion Recognition Using Convolutional Neural Networks, Somayeh Shahsavarani

School of Computing: Dissertations, Theses, and Student Research

Automatic speech recognition is an active field of study in artificial intelligence and machine learning whose aim is to generate machines that communicate with people via speech. Speech is an information-rich signal that contains paralinguistic information as well as linguistic information. Emotion is one key instance of paralinguistic information that is, in part, conveyed by speech. Developing machines that understand paralinguistic information, such as emotion, facilitates the human-machine communication as it makes the communication more clear and natural. In the current study, the efficacy of convolutional neural networks in recognition of speech emotions has been investigated. Wide-band spectrograms of the …

The Way You Move: The Effect Of A Robot Surrogate Movement In Remote Collaboration, Martin Feick, Lora Oehlberg, Anthony Tang, André Miede, Ehud Sharlin

Research Collection School Of Computing and Information Systems

In this paper, we discuss the role of the movement trajectory and velocity enabled by our tele-robotic system (ReMa) for remote collaboration on physical tasks. Our system reproduces changes in object orientation and position at a remote location using a humanoid robotic arm. However, even minor kinematics differences between robot and human arm can result in awkward or exaggerated robot movements. As a result, user communication with the robotic system can become less efficient, less fluent and more time intensive.

Decreasing Occlusion And Increasing Explanation In Interactive Visual Knowledge Discovery, Abdulrahman Ahmed Gharawi

All Master's Theses

Lack of explanation and occlusion are the major problems for interactive visual knowledge discovery, machine learning and data mining in multidimensional data. This thesis proposes a hybrid method that combines visual and analytical means to deal with these problems. This method, denoted as FSP, uses visualization of n-D data in 2-D in a set of Shifted Paired Coordinates (SPC). SPC for n-D data consists of n/2 pairs of Cartesian coordinates that are shifted relative to each other to avoid their overlap. Each n-D point is represented as a directed graph in SPC. It is shown that the FSP method simplifies …

Dictionary Learning With Structured Noise, Pan Zhou, Cong Fang, Zhouchen Lin, Chao Zhang, Y. Edward Chang

Research Collection School Of Computing and Information Systems

Recently, lots of dictionary learning methods have been proposed and successfully applied. However, many of them assume that the noise in data is drawn from Gaussian or Laplacian distribution and therefore they typically adopt the 2 or 1 norm to characterize these two kinds of noise, respectively. Since this assumption is inconsistent with the real cases, the performance of these methods is limited. In this paper, we propose a novel dictionary learning with structured noise (DLSN) method for handling noisy data. We decompose the original data into three parts: clean data, structured noise, and Gaussian noise, and then characterize them …

On Improvised Music, Computational Creativity And Human-Becoming, Arto Artinian, Adam James Wilson

Publications and Research

Music improvisation is an act of human-becoming: of self-expression—an articulation of histories and memories that have molded its participants—and of exploration—a search for unimagined structures that break with the stale norms of majoritarian culture. Given that the former objective may inhibit the latter, we propose an integration of human musical improvisers and deliberately flawed creative software agents that are designed to catalyze the development of human-ratified minoritarian musical structures.

Ancr—An Adaptive Network Coding Routing Scheme For Wsns With Different-Success-Rate Links †, Xiang Ji, Anwen Wang, Chunyu Li, Chun Ma, Yao Peng, Dajin Wang, Qingyi Hua, Feng Chen, Dingyi Fang

Department of Computer Science Faculty Scholarship and Creative Works

As the underlying infrastructure of the Internet of Things (IoT), wireless sensor networks (WSNs) have been widely used in many applications. Network coding is a technique in WSNs to combine multiple channels of data in one transmission, wherever possible, to save node’s energy as well as increase the network throughput. So far most works on network coding are based on two assumptions to determine coding opportunities: (1) All the links in the network have the same transmission success rate; (2) Each link is bidirectional, and has the same transmission success rate on both ways. However, these assumptions may not be …

Formresnet: Formatted Residual Learning For Image Restoration, Jianbo Jiao, Wei-Chih Tu, Shengfeng He

Research Collection School Of Computing and Information Systems

In this paper, we propose a deep CNN to tackle the image restoration problem by learning the structured residual. Previous deep learning based methods directly learn the mapping from corrupted images to clean images, and may suffer from the gradient exploding/vanishing problems of deep neural networks. We propose to address the image restoration problem by learning the structured details and recovering the latent clean image together, from the shared information between the corrupted image and the latent image. In addition, instead of learning the pure difference (corruption), we propose to add a 'residual formatting layer' to format the residual to …

Learning To Hallucinate Face Images Via Component Generation And Enhancement, Yibing Song, Jiawei Zhang, Shengfeng He, Linchao Bao, Qingxiong Yang

Research Collection School Of Computing and Information Systems

We propose a two-stage method for face hallucination. First, we generate facial components of the input image using CNNs. These components represent the basic facial structures. Second, we synthesize fine-grained facial structures from high resolution training images. The details of these structures are transferred into facial components for enhancement. Therefore, we generate facial components to approximate ground truth global appearance in the first stage and enhance them through recovering details in the second stage. The experiments demonstrate that our method performs favorably against state-of-the-art methods.

Measuring Presence In A Police Use Of Force Simulation, Dharmesh Rajendra Desai

LSU New Orleans Theses and Dissertations

We have designed a simulation that can be used to train police officers. Digital simulations are more cost-effective than a human role play. Use of force decisions are complex and made quickly, so there is a need for better training and innovative methods. Using this simulation, we are measuring the degree of presence that a human experience in a virtual environment. More presence implies better training. Participants are divided into two groups in which one group performs the experiment using a screen, keyboard, and mouse, and another uses virtual reality controls. In this experiment, we use subjective measurements and physiological …

Curiosity: Emergent Behavior Through Interacting Multi-Level Predictions, Douglas S. Blank, Lisa Meeden, James Marshall

Computer Science Faculty Research and Scholarship

Over the past 15 years our research group has been exploring models of developmental robotics and curiosity. Our research is based on the premise that intelligent behavior arises through emergent interactions between opposing forces in an open-ended, task-independent environment. In an initial experiment we constructed a recurrent neural network model where self-motivation was "an emergent property generated by the competing pressures that arise in attempting to balance predictability and novelty". The system first focused on its error, then learned to successfully predict its error, and finally became habituated to what caused the error. This process of focusing, learning, and habituating …

Investigating Trust And Trust Recovery In Human-Robot Interactions, Abigail L. Thomson

Celebration of Learning

As artificial intelligence and robotics continue to advance and be used in increasingly different functions and situations, it is important to look at how these new technologies will be used. An important factor in how a new resource will be used is how much it is trusted. This experiment was conducted to examine people’s trust in a robotic assistant when completing a task, how mistakes affect this trust, and if the levels of trust exhibited with a robot assistant were significantly different than if the assistant were human. The task was to watch a computer simulation of the three-cup monte …

Music Feature Matching Using Computer Vision Algorithms, Mason Hollis

Computer Science and Computer Engineering Undergraduate Honors Theses

This paper seeks to establish the validity and potential benefits of using existing computer vision techniques on audio samples rather than traditional images in order to consistently and accurately identify a song of origin from a short audio clip of potentially noisy sound. To do this, the audio sample is first converted to a spectrogram image, which is used to generate SURF features. These features are compared against a database of features, which have been previously generated in a similar fashion, in order to find the best match. This algorithm has been implemented in a system that can run as …

Feature Learning Via Partial Differential Equation With Applications To Face Recognition, Cong Fang, Zhenyu Zhao, Pan Zhou, Zhouchen Lin

Research Collection School Of Computing and Information Systems

Feature learning is a critical step in pattern recognition, such as image classification. However, most of the existing methods cannot extract features that are discriminative and at the same time invariant under some transforms. This limits the classification performance, especially in the case of small training sets. To address this issue, in this paper we propose a novel Partial Differential Equation (PDE) based method for feature learning. The feature learned by our PDE is discriminative, also translationally and rotationally invariant, and robust to illumination variation. To our best knowledge, this is the first work that applies PDE to feature learning …

A System To Monitor Cognitive Workload In Naturalistic High-Motion Environments, Bethany K. Bracken, Seth Elkin-Frankston, Noa Palmon, Michael Farry, Blaise De B Frederick

H-Workload 2017: Models and Applications (Works in Progress)

Across many careers, individuals face alternating periods of high and low attention and cognitive workload can impair cognitive function and undermine job performance. We have designed and are developing an unobtrusive system to Monitor, Extract, and Decode Indicators of Cognitive Workload (MEDIC) in naturalistic, high-motion environments. MEDIC is designed to warn individuals, teammates, or supervisors when steps should be taken to augment cognitive readiness. We first designed and manufactured a forehead sensor device that includes a custom fNIRS sensor and a three-axis accelerometer designed to be mounted on the inside of a baseball cap or headband, or standard issue gear …

Towards A Not Obtrusive Low Cost Biosystem To Assess Risk Perception In Workplace Through Stress Detection, Emanuele Bellini, Serena Benevenuti, Chiara Batistini

H-Workload 2017: Models and Applications (Works in Progress)

The main aim of the article is to build a method to assess risk perception in real time in order to early detect and prevent risk behaviors and possible human errors. To this end, the relation between mental workload and stress as critical factors affecting risk perception has been investigated. In particular the mental-physical activation generated by an increment of the workload has the effect of reducing the resources needed to perceive risk increasing the worker vulnerability. The complexity of the stress phenomenon suggested the adoption of an integrated view. The Functional Model has been adopted to for its holistic …

A Systems Approach To Predicting And Measuring Workload In Rail Traffic Management Systems, Joanna Evans

H-Workload 2017: Models and Applications (Works in Progress)

The introduction of systems such as Traffic Management (TM) will result in a number of changes in how the railway is managed for operations and maintenance staff such as, an increase in collaborative working styles and shared responsibilities. In order to react to these changing operational demands and user needs, TM workstation designs need to have greater flexibility and be configurable to support the information requirements for each specific role as well as support each role during different scenarios. Although this flexibility in system design has the potential to enhance performance, it increases the complexity of measuring operator workload. The …

Distress And Worry As Mediators In The Relationship Between Psychosocial Risks And Upper Body Musculosketal Complaints In Highly Automated Manufacturing, Fiona Wixted, Leonard O'Sullivan

H-Workload 2017: Models and Applications (Works in Progress)

As a result of an upward trend in automation, the requirement for supervisory monitoring and consequently, cognitive demand has increased in automated manufacturing. The incidence of musculoskeletal disorders has also increased in the manufacturing sector. A model was developed based on survey data to test if distress and worry mediate the relationship between psychosocial factors (job control, cognitive demand, social isolation and skill discretion), stress states and upper body musculoskeletal complaints in highly automated manufacturing companies (n=235). Cognitive demand was shown to be related to higher distress in employees. The data raise the question about the link between job control …

Petrochemical Plant Console Operator Workload:The Issues, David A. Strobhar

H-Workload 2017: Models and Applications (Works in Progress)

The console operators of certain petrochemical processes must maintain high levels of performance during process upsets or endanger personnel safety and the environment. Mismanagement of an upset can result in explosions, fires, and the release of hazardous chemicals to the environment. The change in workload from steady state to upset operation is significant, with alarms and control changes that are of an order of magnitude. This paper describes the state of console activity in process plants, particularly the increase with key upsets. Quantitative data on the nature of the console operator’s position, its workload during normal operation, and the requirements …

Towards A Continuous Assessment Of Cognitive Workload For Smartphone Multitasking Users, Angel Jimenez-Molina, Hernan Lira

H-Workload 2017: Models and Applications (Works in Progress)

The intermeshing of Smartphone interactions and daily activities depletes the availability of cognitive resources. This excessive demand may lead to several undesirable cognitive states, which can be avoided by continuously assessing the user cognitive workload. Recently, many attempts have emerged to assess this workload by using psycho physiological signals. This paper provides evidence that it is possible to train models that accurately identify in short time windows such cognitive workload by processing heart rate and blood oxygen saturation signals. This assessment could be applied in Smartphone notification delivery, interface adaptations or cognitive capabilities evaluation.

A Workload-Centered Perspective On Reduced Crew Operations In Commercial Aviation, Daniela Schmid

H-Workload 2017: Models and Applications (Works in Progress)

Mental workload of a pilot, in short workload, depends on various characteristics of different accumulated tasks on the flight deck. Exogenous task demands and endogenous supply of attentional or information processing resources determine workload [1]. Performance is expect to drop if the demand exceeds the available resources of the pilot. Expertise and experience modulate the endogenous sup- ply of resources like perceiving, updating memory, planing, making a decision, and executing and processing a response. Subsequently, workload manifests in performance variables, subjective experience, and physiological parameters [2]. This is how we can summarize workload very brie y to introduce a model …

Reducing Peak Workload In The Cockpit: A Human In The Loop Simulation Evaluating New Runway Selection Tool, Tanja Bos, Rolf Zon, Wilfred Rouwhorst

H-Workload 2017: Models and Applications (Works in Progress)

In efforts to increase safety and reduce peak workload situations in the cockpit, a tool with a different interaction style was developed for use in case of a runway change instructed by Air Traffic Control during approach. In an experiment a workload comparison was made between the new tool and the conventional cockpit. Workload was measured by means of a self-rating after each experiment run, as well as eye blink frequency during each run. Results show that the self-rated workload decreases with the new tool for one of the two crew members and the blink frequency suggests a workload decrease …

Smart Workload Balancing, Ferdinand Coster

H-Workload 2017: Models and Applications (Works in Progress)

The cognitive workload of operators working with automated systems should neither be too high nor too low. A static level of automation is unable to cope with systems that produce large fluctuations in cognitive workload, therefore a method for adaptive automation is proposed that could balance workload by intelligently choosing what to automate and when. To this end the concept of the Cognitive Workload Value factor is introduced, which takes into account both workload and situation awareness. This initial work introduces a possible framework for categorizing and using different workload and situation awareness measures.

Managing Operator Mental Workload With Standards Based Decision Support, Maurice Wilkins

H-Workload 2017: Models and Applications (Works in Progress)

H-Workload 2017: The first international symposium on human mental workload, Dublin Institute of Technology, Dublin, Ireland, June 28-30.

Facing Human Workload: The Resilient Ego: A Psychoanalytic Point Of View, Glauco Maria Genga, Maria Gabriella Pediconii

H-Workload 2017: Models and Applications (Works in Progress)

The paper aims to show new connections among Human Factors, Human Workload and Resilience. We intend: 1) to highlight the role of subject in facing the human workload, inflected as demanding tasks and emergency situations; 2) to show how psychoanalysis can provide novel insights, not only into human errors, but also into human resilience. They have a common denominator, at least in part: the role of subjective contributions even in demanding situations. Human workload includes a work for satisfaction. We recall also the case study of US Airways Flight 1549 water landing (the so called “Miracle on the Hudson”), which …

System Identification Of Motion Artifact: Noise In Eeg Headsets From Locomotion, Kaela Shea, James Tung

H-Workload 2017: Models and Applications (Works in Progress)

Fall prevention for geriatric populations is a growing concern among clinicians and researchers due to severe risk of morbidity and loss of independence. Emerging evidence has demonstrated that mental workload while walking influences gait stability and the risk for falling. Electroencephalography (EEG) presents a potential method to provide objective measures of mental workload, particularly during daily activities. Noise introduced to the EEG signal during motion, however, is restrictive. The study presented in the following paper isolates EEG signal noise attained from gait for a commercially accessible EEG system, the "Emotiv" Time and spectral system identification techniques were applied to model …

Online Measuring Of Available Resources, Enrique Munoz-De-Escalona, José Juan Canas

H-Workload 2017: Models and Applications (Works in Progress)

This paper present a proposal for measuring available mental resources during the accomplishment of a task. Our proposal consists in measuring emotions provoked by perceived self-efficacy in the execution of the task. Self-efficacy is one of the most important factors that affect the resources that a person puts at the disposal of the execution of the task. When a person perceives that he/she is not being effective he/she will activate more resources to improve his performance. This self-efficacy will be reflected in the emotions that the person experiences. A good efficacy will provoke positive emotions and a bad efficacy negative …

A Validated Description Of How Crew Manage Flight Operations For Two-Pilot And Reduced Crew Operations, Nick Mcdonnell, Alison Kay, Margaret Ryan, Rabea Morrison, Rolf Zon

H-Workload 2017: Models and Applications (Works in Progress)

This research provides a rich validated description of how crew manage workload for both two-pilot and reduced crew operations. It outlines flight operations modelling, operational narratives, requirements and scenarios validated with expert advisers from the EU-FP7 ACROSS Project. The crew are considered to be the managers of the operation who receive integrated technical support to help them manage flight operations across of three configurations i.e. 1) standard two-crew configuration, 2) reduced crew under normal operations 3) reduced-crew under non-normal operations developed within the FP7 EU-funded ACROSS (Advanced Cockpit for the Reduction Of Stress and Workload) project.

Automatic Assessment Of Environmental Hazards For Fall Prevention Using Smart-Cameras, Jeffrey Kutchka

Graduate Theses and Dissertations

As technology advances in the field of Computer Vision, new applications will emerge. One device that has emerged is the smart-camera, a camera attached to an embedded system that can perform routines a regular camera could not, such as object or event detection. In this thesis we describe a smart-camera system we designed, implemented, and evaluated for fall prevention monitoring of at-risk people while in bed, whether it be for a hospital patient, nursing home resident, or at home elderly resident. The camera will give a nurse or caregiver environmental awareness of the at-risk person and notify them when that …