Artificial Intelligence and Robotics Commons^™

Representing And Inferring Mental Workload Via Defeasible Reasoning: A Comparison With The Nasa Task Load Index And The Workload Profile, Lucas Middeldorf Rizzo, Luca Longo

Conference papers

The NASA Task Load Index (NASA − TLX) and the Workload Profile (WP) are likely the most employed instruments for subjective mental workload (MWL) measurement. Numerous areas have made use of these methods for assessing human performance and thusly improving the design of systems and tasks. Unfortunately, MWL is still a vague concept, with different definitions and no universal measure. This research investigates the use of defeasible reasoning to represent and assess MWL. Reasoning is defeasible when a conclusion, supported by a set of premises, can be retracted in the light of new information. In this empirical study, this type …

Towards A Continuous Assessment Of Cognitive Workload For Smartphone Multitasking Users, Angel Jimenez-Molina, Hernan Lira

H-Workload 2017: Models and Applications (Works in Progress)

The intermeshing of Smartphone interactions and daily activities depletes the availability of cognitive resources. This excessive demand may lead to several undesirable cognitive states, which can be avoided by continuously assessing the user cognitive workload. Recently, many attempts have emerged to assess this workload by using psycho physiological signals. This paper provides evidence that it is possible to train models that accurately identify in short time windows such cognitive workload by processing heart rate and blood oxygen saturation signals. This assessment could be applied in Smartphone notification delivery, interface adaptations or cognitive capabilities evaluation.

Human Performance Modelling In Manufacturing: Mental Workload And Task Complexity, Maria Chiara Leva, Lorenzo Comberti, Micaela Demichela, Rebecca Duane

H-Workload 2017: Models and Applications (Works in Progress)

No abstract provided.

Distress And Worry As Mediators In The Relationship Between Psychosocial Risks And Upper Body Musculosketal Complaints In Highly Automated Manufacturing, Fiona Wixted, Leonard O'Sullivan

H-Workload 2017: Models and Applications (Works in Progress)

As a result of an upward trend in automation, the requirement for supervisory monitoring and consequently, cognitive demand has increased in automated manufacturing. The incidence of musculoskeletal disorders has also increased in the manufacturing sector. A model was developed based on survey data to test if distress and worry mediate the relationship between psychosocial factors (job control, cognitive demand, social isolation and skill discretion), stress states and upper body musculoskeletal complaints in highly automated manufacturing companies (n=235). Cognitive demand was shown to be related to higher distress in employees. The data raise the question about the link between job control …

Managing Operator Mental Workload With Standards Based Decision Support, Maurice Wilkins

H-Workload 2017: Models and Applications (Works in Progress)

H-Workload 2017: The first international symposium on human mental workload, Dublin Institute of Technology, Dublin, Ireland, June 28-30.

Smart Workload Balancing, Ferdinand Coster

H-Workload 2017: Models and Applications (Works in Progress)

The cognitive workload of operators working with automated systems should neither be too high nor too low. A static level of automation is unable to cope with systems that produce large fluctuations in cognitive workload, therefore a method for adaptive automation is proposed that could balance workload by intelligently choosing what to automate and when. To this end the concept of the Cognitive Workload Value factor is introduced, which takes into account both workload and situation awareness. This initial work introduces a possible framework for categorizing and using different workload and situation awareness measures.

Facing Human Workload: The Resilient Ego: A Psychoanalytic Point Of View, Glauco Maria Genga, Maria Gabriella Pediconii

H-Workload 2017: Models and Applications (Works in Progress)

The paper aims to show new connections among Human Factors, Human Workload and Resilience. We intend: 1) to highlight the role of subject in facing the human workload, inflected as demanding tasks and emergency situations; 2) to show how psychoanalysis can provide novel insights, not only into human errors, but also into human resilience. They have a common denominator, at least in part: the role of subjective contributions even in demanding situations. Human workload includes a work for satisfaction. We recall also the case study of US Airways Flight 1549 water landing (the so called “Miracle on the Hudson”), which …

A Validated Description Of How Crew Manage Flight Operations For Two-Pilot And Reduced Crew Operations, Nick Mcdonnell, Alison Kay, Margaret Ryan, Rabea Morrison, Rolf Zon

H-Workload 2017: Models and Applications (Works in Progress)

This research provides a rich validated description of how crew manage workload for both two-pilot and reduced crew operations. It outlines flight operations modelling, operational narratives, requirements and scenarios validated with expert advisers from the EU-FP7 ACROSS Project. The crew are considered to be the managers of the operation who receive integrated technical support to help them manage flight operations across of three configurations i.e. 1) standard two-crew configuration, 2) reduced crew under normal operations 3) reduced-crew under non-normal operations developed within the FP7 EU-funded ACROSS (Advanced Cockpit for the Reduction Of Stress and Workload) project.

Petrochemical Plant Console Operator Workload:The Issues, David A. Strobhar

H-Workload 2017: Models and Applications (Works in Progress)

The console operators of certain petrochemical processes must maintain high levels of performance during process upsets or endanger personnel safety and the environment. Mismanagement of an upset can result in explosions, fires, and the release of hazardous chemicals to the environment. The change in workload from steady state to upset operation is significant, with alarms and control changes that are of an order of magnitude. This paper describes the state of console activity in process plants, particularly the increase with key upsets. Quantitative data on the nature of the console operator’s position, its workload during normal operation, and the requirements …

Argumentation For Knowledge Representation, Conflict Resolution, Defeasible Inference And Its Integration With Machine Learning, Luca Longo

Conference papers

Modern machine Learning is devoted to the construction of algorithms and computational procedures that can automatically improve with experience and learn from data. Defeasible argumentation has emerged as sub-topic of artificial intelligence aimed at formalising common-sense qualitative reasoning. The former is an inductive approach for inference while the latter is deductive, each one having advantages and limitations. A great challenge for theoretical and applied research in AI is their integration. The first aim of this chapter is to provide readers informally with the basic notions of defeasible and non-monotonic reasoning. It then describes argumentation theory, a paradigm for implementing defeasible …

Towards A Deep Learning-Based Activity Discovery System, Eoin Rogers, John D. Kelleher, Robert J. Ross

Conference papers

Activity discovery is a challenging machine learning problem where we seek to uncover new or altered behavioural patterns in sensor data. In this paper we motivate and introduce a novel approach to activity discovery based on modern deep learning techniques. We hypothesise that our proposed approach can deal with interleaved datasets in a more intelligent manner than most existing AD methods. We also build upon prior work building hierarchies of activities that capture the inherent ag- gregate nature of complex activities and show how this could plausibly be adapted to work with the deep learning technique we present. Finally, we …

Techno-Apocalypse: Technology, Religion, And Ideology In Bryan Singer’S H+, Edward Brennan

Books/Book chapters

This essay critically analyses the digital series H+. In the near future, adults who can afford them, have replaced tablets and cell phones with nanotechnology implants. The H+ implant acts as a medical diagnostic and can overlay the user's senses with a computer interface. The apocalypse comes in the form of a computer virus which infects the H+ network and instantly kills one third of humanity. The series represents the anxiety and religiosity that surrounds the possible social consequences of digital technology. It also explores the tensions and intersections between technology and faith. This essay makes the case, however, that …

Using Topic Modelling Algorithms For Hierarchical Activity Discovery, Eoin Rogers, John D. Kelleher, Robert J. Ross

Conference papers

Activity discovery is the unsupervised process of discovering patterns in data produced from sensor networks that are monitoring the behaviour of human subjects. Improvements in activity discovery may simplify the training of activity recognition models by enabling the automated annotation of datasets and also the construction of systems that can detect and highlight deviations from normal behaviour. With this in mind, we propose an approach to activity discovery based on topic modelling techniques, and evaluate it on a dataset that mimics complex, interleaved sensor data in the real world. We also propose a means for discovering hierarchies of aggregated activities …

Harnessing The Power Of Text Mining For The Detection Of Abusive Content In Social Media, Hao Chen, Susan Mckeever, Sarah Jane Delany

Conference papers

Abstract The issues of cyberbullying and online harassment have gained considerable coverage in the last number of years. Social media providers need to be able to detect abusive content both accurately and efficiently in order to protect their users. Our aim is to investigate the application of core text mining techniques for the automatic detection of abusive content across a range of social media sources include blogs, forums, media-sharing, Q&A and chat - using datasets from Twitter, YouTube, MySpace, Kongregate, Formspring and Slashdot. Using supervised machine learning, we compare alternative text representations and dimension reduction approaches, including feature selection and …

Reformulation Strategies Of Repeated References In The Context Of Robot Perception Errors In Situated Dialogue, Niels Schütte, John D. Kelleher, Brian Mac Namee

Conference papers

We performed an experiment in which human participants interacted through a natural language dialogue interface with a simulated robot to fulfil a series of object manipulation tasks. We introduced errors into the robot’s perception, and observed the resulting problems in the dialogues and their resolutions. We then introduced different methods for the user to request information about the robot’s understanding of the environment. In this work, we describe the effects that the robot’s perceptual errors and the information request options available to the participant had on the reformulation of the referring expressions the participants used when resolving a unsuccessful reference.

A Defeasible Reasoning Framework For Human Mental Workload Representation And Assessment, Luca Longo

Conference papers

Human mental workload (MWL) has gained importance in the last few decades as an important design concept. It is a multifaceted complex construct mainly applied in cognitive sciences and has been defined in many different ways. Although measuring MWL has potential advantages in interaction and interface design, its formalisation as an operational and computational construct has not sufficiently been addressed. This research contributes to the body of knowledge by providing an extensible framework built upon defeasible reasoning, and implemented with argumentation theory (AT), in which MWL can be better defined, measured, analysed, explained and applied in different human–computer interactive contexts. …

Multi-Valued Argumentation Frameworks, Pierpaolo Dondio

Conference papers

In this paper we explore how the seminal Dung’s abstract argumentation framework can be extended to handle arguments containing gradual concepts. We allow arguments to have a degree of truth associated with them and we investigate the degree of truth to which each argument can be considered accepted, rejected and undecided by an abstract argumentation semantics. We propose a truth-compositional recursive computation, and we discuss examples using the major multi-valued logics such as Godel’s, Zadeh’s and Łukasiewicz's logic. The findings are a contribution in the field of non-monotonic approximate reasoning and they also represent a well-grounded proposal towards the introduction …

Towards A Computational Analysis Of Probabilistic Argumentation Frameworks, Pierpaolo Dondio

Articles

In this paper we analyze probabilistic argumentation frameworks (PAFs), defined as an extension of Dung abstract argumentation frameworks in which each argument n is asserted with a probability p(n). The debate around PAFs has so far centered on their theoretical definition and basic properties. This work contributes to their computational analysis by proposing a first recursive algorithm to compute the probability of acceptance of each argument under grounded and preferred semantics, and by studying the behavior of PAFs with respect to reinstatement, cycles and changes in argument structure. The computational tools proposed may provide strategic information for agents selecting the …

Exploring Customer Specific Kpi Selection Strategies For An Adaptive Time Critical User Interface, Ingo Keck, Robert J. Ross

Conference papers

Rapid growth in the number of measures available to describe customer-organization relationships has presented a serious challenge for Business Intelligence (BI) interface developers as they attempt to provide business users with key customer information without requiring users to painstakingly sift through many interface windows and layers. In this paper we introduce a prototype Intelligent User Interface that we have deployed to partially address this issue. The interface builds on machine learning techniques to construct a ranking model of Key Performance Indicators (KPIs) that are used to select and present the most important customer metrics that can be made available to …

A Comparison Of Evidence Fusion Rules For Situation Recognition In Sensor-Based Environments, Susan Mckeever, Juan Ye

Conference papers

Dempster-Shafer (DS) theory, and its associated Dempster rule of combination, has been widely used to determine belief based on uncertain evi-dence sources. Variations to the original Dempster rule of combination have appeared in the literature to support particular scenarios where unreliable results may result from the use of original DS theory. While theoretical explanations of the rule variations are explained, there is a lack of empirical comparisons of the DS theory and its variations against real data sets. In this work, we examine several variations to DS theory. Using two real-world sensor data sets, we com-pare the performance of DS …

Computing The Grounded Semantics In All The Subgraphs Of An Argumentation Framework: An Empirical Evaluation, Pierpaolo Dondio

Articles

Given an argumentation framework – with a finite set of arguments and the attack relation identifying the graph – we study how the grounded labelling of a generic argument a varies in all the subgraphs of . Since this is an intractable problem of above-polynomial complexity, we present two non-naïve algorithms to find the set of all the subgraphs where the grounded semantic assigns to argument a specific label . We report the results of a series of empirical tests over graphs of increasing complexity. The value of researching the above problem is two-fold. First, knowing how an argument behaves …

Drift Detection Using Uncertainty Distribution Divergence, Patrick Lindstrom, Brian Mac Namee, Sarah Jane Delany

Articles

Data generated from naturally occurring processes tends to be non-stationary. For example, seasonal and gradual changes in climate data and sudden changes in financial data. In machine learning the degradation in classifier performance due to such changes in the data is known as concept drift and there are many approaches to detecting and handling it.

Most approaches to detecting concept drift, however, make the assumption that true classes for test examples will be available at no cost shortly after classification and base the detection of concept drift on measures relying on these labels. The high labelling cost in many domains …

Improving Performance By Re-Rating In The Dynamic Estimation Of Rater Reliability, Alexey Tarasov, Sarah Jane Delany, Brian Macnamee

Conference papers

Nowadays crowdsourcing is widely used in supervised machine learning to facilitate the collection of ratings for unlabelled training sets. In order to get good quality results it is worth rejecting results from noisy/unreliable raters, as soon as they are discovered. Many techniques for filtering unreliable raters rely on the presentation of training instances to the raters identified as most accurate to date. Early in the process, the true rater reliabilities are not known and unreliable raters may be used as a result. This paper explores improving the quality of ratings for train- ing instances by performing re-rating. The re-rating relies …

Concept Drift Datasets, Patrick Lindstrom

Doctoral

This zip file contains the datasets used in the PhD thesis:

Lindstrom, P., 2013. Handling Concept Drift in the Context of Expensive Labels. Technological University Dublin. For more information about the datasets please see the README file and the aforementioned thesis.

Trust And Reputation For Successful Software Self-Organisation, Pierpaolo Dondio, Jean Marc Seigneur

Books/Book Chapters

Abstract An increasing number of dynamic software evolution approaches is com- monly based on integrating or utilising new pieces of software. This requires reso- lution of issues such as ensuring awareness of newly available software pieces and selection of most appropriate software pieces to use. Other chapters in this book dis- cuss dynamic software evolution focusing primarily on awareness, integration and utilisation of new software pieces, paying less attention on how selection among different software pieces is made. The selection issue is quite important since in the increasingly dynamic software world quite a few new software pieces occur over time, …

Profiling Instances In Noise Reduction, Sarah Jane Delany, Nicola Segata, Brian Macnamee

Articles

The dependency on the quality of the training data has led to significant work in noise reduction for instance-based learning algorithms. This paper presents an empirical evaluation of current noise reduction techniques, not just from the perspective of their comparative performance, but from the perspective of investigating the types of instances that they focus on for re- moval. A novel instance profiling technique known as RDCL profiling allows the structure of a training set to be analysed at the instance level cate- gorising each instance based on modelling their local competence properties. This profiling approach o↵ers the opportunity of investigating …

Sms Spam Filtering: Methods And Data, Sarah Jane Delany, Mark Buckley, Derek Greene

Articles

Mobile or SMS spam is a real and growing problem primarily due to the availability of very cheap bulk pre-pay SMS packages and the fact that SMS engenders higher response rates as it is a trusted and personal service. SMS spam filtering is a relatively new task which inherits many issues and solu- tions from email spam filtering. However it poses its own specific challenges. This paper motivates work on filtering SMS spam and reviews recent devel- opments in SMS spam filtering. The paper also discusses the issues with data collection and availability for furthering research in this area, analyses …

Drift Detection Using Uncertainty Distribution Divergence, Patrick Lindstrom, Brian Mac Namee, Sarah Jane Delany

Conference papers

Concept drift is believed to be prevalent inmost data gathered from naturally occurring processes andthus warrants research by the machine learning community.There are a myriad of approaches to concept drift handlingwhich have been shown to handle concept drift with varyingdegrees of success.

However, most approaches make the keyassumption that the labelled data will be available at nolabelling cost shortly after classification, an assumption whichis often violated. The high labelling cost in many domainsprovides a strong motivation to reduce the number of labelledinstances required to handle concept drift. Explicit detectionapproaches that do not require labelled instances to detectconcept drift show great …

A Novel Methodology For Evaluating User Interfaces In Health Care, Luca Longo, Bridget Kane

Conference papers

A pilot study is reported to identify an improved method of evaluating digital user interfaces in health care. Experience and developments from the aviation industry and the NASA-TLX mental workload assessment tools are applied in conjunction with Nielsen heuristics for evaluating an Electronic Health Record System in an Irish hospital. The NASA-TLX performs subjective workload assessments on operators working with various human-computer systems. Results suggest that depending on the cognitive workload and the working context of users, the usability will differ for the same digital interface. We conclude that incorporating the NASA-TLX with Nielsen's heuristics offers a more reliable method …

Recognition Situations Using Extended Dempster-Shafer Theory, Susan Mckeever

Other resources

Weiser’s [111] vision of pervasive computing describes a world where technology seamlessly integrates into the environment, automatically responding to peoples’ needs. Underpinning this vision is the ability of systems to automatically track the situation of a person. The task of situation recognition is critical and complex: noisy and unreliable sensor data, dynamic situations, unpredictable human behaviour and changes in the environment all contribute to the complexity. No single recognition technique is suitable in all environments. Factors such as availability of training data, ability to deal with uncertain information and transparency to the user will determine which technique to use in …