Operations Research, Systems Engineering and Industrial Engineering Commons^™

Designing Explainable Ai To Improve Human-Ai Team Performance: A Medical Stakeholder-Driven Scoping Review, Harishankar V. Subramanian, Casey I. Canfield, Daniel Burton Shank

Engineering Management and Systems Engineering Faculty Research & Creative Works

The rise of complex AI systems in healthcare and other sectors has led to a growing area of research called Explainable AI (XAI) designed to increase transparency. In this area, quantitative and qualitative studies focus on improving user trust and task performance by providing system- and prediction-level XAI features. We analyze stakeholder engagement events (interviews and workshops) on the use of AI for kidney transplantation. From this we identify themes which we use to frame a scoping literature review on current XAI features. The stakeholder engagement process lasted over nine months covering three stakeholder group's workflows, determining where AI could …

A Study Of Group Effectiveness In A Virtual Reality Environment., Dalton Clay Sparks

Electronic Theses and Dissertations

Virtual Reality (VR) technology has revolutionized the study of team effectiveness, yet many studies in this domain lack a comprehensive approach, focusing narrowly on performance metrics. This thesis investigates VR team effectiveness by integrating traditional Team Effectiveness frameworks with VR-specific dynamics. Utilizing Data Envelopment Analysis (DEA) and Group Style Inventory (GSI), this study assesses teams within a VR environment, specifically a multiplayer submarine simulation game, IronWolfVR. Fifteen groups, totaling 45 participants, were observed for their collaborative gameplay, incorporating physiological measures (Heart Rate and Electrodermal Activity), team coordination dynamics, and various survey-based assessments (demographics, System Usability Scale, Simulator Sickness Questionnaire, and …

Don’T Touch That Dial: Psychological Reactance, Transparency, And User Acceptance Of Smart Thermostat Setting Changes, Matthew Heatherly, Denise A. Baker, Casey I. Canfield

Psychological Science Faculty Research & Creative Works

Automation inherently removes a certain amount of user control. If perceived as a loss of freedom, users may experience psychological reactance, which is a motivational state that can lead a person to engage in behaviors to reassert their freedom. In an online experiment, participants set up and communicated with a hypothetical smart thermostat. Participants read notifications about a change in the thermostat's setting. Phrasing of notifications was altered across three dimensions: strength of authoritative language, deviation of temperature change from preferences, and whether or not the reason for the change was transparent. Authoritative language, temperatures outside the user's preferences, and …

A Generalizable Method And Case Application For Development And Use Of The Aviation Systems – Trust Survey (As-Ts)., Jamison Hicks

Theses and Dissertations

Automated systems are integral in the development of modern aircraft, especially for complex military aircraft. Pilot Trust in Automation (TIA) in these systems is vital for optimizing the pilot-vehicle interface and ensuring pilots use the systems appropriately to complete required tasks.

The objective of this research was to develop and validate a TIA scale and survey methodology to identify and mitigate trust deficiencies with automated systems for use in Army Aviation testing. There is currently no standard TIA assessment methodology for U.S. Army aviation pilots that identifies trust deficiencies and potential mitigations.

A comprehensive literature review was conducted to identify …

Rattus Norvegicus As A Biological Detector Of Clandestine Remains And The Use Of Ultrasonic Vocalizations As A Locating Mechanism, Gabrielle M. Johnston

Master's Theses

In investigations, locating missing persons and clandestine remains are imperative. One way that first responder and police agencies can search for the remains is by using cadaver dogs as biological detectors. Cadaver dogs are typically used due to their olfactory sensitivity and ability to detect low concentrations of volatile organic compounds produced by biological remains. Cadaver dogs are typically chosen for their stamina, agility, and olfactory sensitivity. However, what is not taken into account often is the size of the animal and the expense of maintaining and training the animal. Cadaver dogs are typically large breeds that cannot fit in …

Human Psychology Factors Influencing Agile Team Autonomy In Post-Pandemic Remote Software Organizations, Ravikiran Kalluri

Engineering Management & Systems Engineering Theses & Dissertations

Agile project management methods are gaining in popularity in the software industry as software development teams are being asked to be adaptive to market needs and resilient to change and uncertainty. With increasing market uncertainty, global competition, and time-to-market pressure, it is becoming a challenge to develop an innovative product and deliver it on-time without the opportunity that comes from team autonomy to experiment and learn from failures in a remote workplace. To resolve this challenge, it is critical to understand the myriad human psychological factors in play that influence Agile team autonomy in a remote work environment.

The role …

Trace Dna Detection Using Diamond Dye: A Recovery Technique To Yield More Dna, Leah Davis

Master's Theses

This study aspires to find a new screening approach to trace DNA recovery techniques to yield a higher quantity of trace DNA from larger items of evidence. It takes the path of visualizing trace DNA on items of evidence with potential DNA so analysts can swab a more localized area rather than attempting to recover trace DNA through the general swabbing technique currently used for trace DNA recovery. The first and second parts consisted of observing trace DNA interaction with Diamond Dye on porous and non-porous surfaces.

The third part involved applying the Diamond Dye solution by spraying it onto …

A Comparison Of Nonverbal And Paraverbal Behaviors In Simulated And Virtual Patient Encounters, Sarah Powers, Mark W. Scerbo, Matthew Pacailler, Macy Kisiel, Baillie Hirst, Ginger S. Watson, Lauren Hamel, Fred Kron

Modeling, Simulation and Visualization Student Capstone Conference

The present study assessed whether trainees display similar nonverbal and paraverbal behaviors when interacting with a simulated (SP) and virtual patient (VP). Sixty second slices of time following four interactions were rated for the presence and frequency of three nonverbal and paraverbal behaviors. Results revealed that students exhibited fewer behaviors in the VP interaction, possibly due to differences social inhibition or fidelity between the two formats.

Investigating Collaborative Explainable Ai (Cxai)/Social Forum As An Explainable Ai (Xai) Method In Autonomous Driving (Ad), Tauseef Ibne Mamun

Dissertations, Master's Theses and Master's Reports

Explainable AI (XAI) systems primarily focus on algorithms, integrating additional information into AI decisions and classifications to enhance user or developer comprehension of the system's behavior. These systems often incorporate untested concepts of explainability, lacking grounding in the cognitive and educational psychology literature (S. T. Mueller et al., 2021). Consequently, their effectiveness may be limited, as they may address problems that real users don't encounter or provide information that users do not seek.

In contrast, an alternative approach called Collaborative XAI (CXAI), as proposed by S. Mueller et al (2021), emphasizes generating explanations without relying solely on algorithms. CXAI centers …

A Qualitative Look Into Repair Practices, Jumana Labib

Undergraduate Student Research Internships Conference

This research poster is based on a working research paper which moves beyond the traditional scope of repair and examines the Right to Repair movement from a smaller, more personal lens by detailing the 6 categorical impediments as dubbed by Dr. Alissa Centivany (design, law, economic/business strategy, material asymmetry, informational asymmetry, and social impediments) have continuously inhibited repair and affected repair practices, which has consequently had larger implications (environmental, economic, social, etc.) on ourselves, our objects, and our world. The poster builds upon my research from last year (see "The Right to Repair: (Re)building a better future"), this time pulling …

Transdisciplinarity In Experience Design: A Global Survey Of Higher Ed Programs In Exd/Xd, Yvonne Houy

Creative Collaborations

In our age of ubiquitous devices and digital media it is the perceived value of the end-to-end experience that brings people to a place. Designing inspiring and emotionally engaging end-to-end experiences requires experts in a wide range of disciplines committed to an interdisciplinary collaboration that can arrive at transdisciplinary design - the sum becomes greater than its parts.

Civil engineering, hospitality, business, psychology, digital User Experience (UX) design, and experience data analysis need to be seamless integrated with the fine and performing arts and design fields:

• Architecture, interior, landscape and sound design actively engage the senses.

• Graphic and fine arts …

  ---

  Go to article

Human Ergonomic Simulation To Support The Design Of An Exoskeleton For Lashing/De-Lashing Operations Of Containers Cargo, Francesco Longo, Antonio Padovano, Vittorio Solina, Virginia D' Augusta, Stefan Venzl, Roberto Calbi, Michele Bartuni, Ornella Anastasi, Rafael Diaz

VMASC Publications

Lashing and de-lashing operations of containers cargo on board containerships are considered as quite strenuous activities in which operators are required to work continuously over a 6 or 8 hours shift with very limited break. This is mostly because containerships need to leave the port as soon as possible and containers loading and unloading operations must be executed with very high productivity (stay moored in a port is a totally unproductive time for a ship and a loss-making business for a shipping company). Operators performing lashing and de-lashing operations are subjected to intense ergonomic stress and uncomfortable working postures. To …

Precursors Of Email Response To Cybersecurity Scenarios: Factor Exploration And Scale Development, Miguel A. Toro-Jarrin, Pilar Pazos-Lago, Miguel Padilla

Engineering Management & Systems Engineering Faculty Publications

In the last decade, information security research has further expanded to include human factors as key elements of the organization's cybersecurity infrastructure. Numerous factors from several theories have been explored to explain and predict the multitude of information security-related behaviors in organizations. Lately, there has been a call for the study of specific cybersecurity behaviors in contextualized scenarios that reflect specific and realistic situations of a potential cyber-attack. This paper focuses on precursors of email response in situations that can be the origin of cybersecurity incidents in organizations (i.e., phishing attacks, ransomware, etc.). This study explores participants' intentions to follow …

A Primer On The Human Readiness Level Scale (Ansi/Hfes 400-2021), Kelly Steelman, Holly Handley, Katie Plant (Ed.), Gesa Praetorius (Ed.)

Engineering Management & Systems Engineering Faculty Publications

"The Human Readiness Level (HRL) Scale is a simple 9-level scale for evaluating, tracking, and communicating the readiness of a technology for safe and effective human use. It is modeled after the well-established Technology Readiness Level (TRL) framework that is used throughout the government and industry to communicate the maturity of a technology and to support decision making about technology acquisition. Here we (1) introduce the ANSI/HFES 400-2021 Standard that defines the HRL scale and (2) provide concrete examples of evaluation activities to support the application of HRLs in the development of automated driving systems."

Reducing Kidney Discard With Artificial Intelligence Decision Support: The Need For A Transdisciplinary Systems Approach, Richard Threlkeld, Lirim Ashiku, Casey I. Canfield, Daniel Burton Shank, Mark A. Schnitzler, Krista L. Lentine, David A. Axelrod, Anil Choudary Reddy Battineni, Henry Randall, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

Purpose of Review: A transdisciplinary systems approach to the design of an artificial intelligence (AI) decision support system can more effectively address the limitations of AI systems. By incorporating stakeholder input early in the process, the final product is more likely to improve decision-making and effectively reduce kidney discard.

Recent Findings: Kidney discard is a complex problem that will require increased coordination between transplant stakeholders. An AI decision support system has significant potential, but there are challenges associated with overfitting, poor explainability, and inadequate trust. A transdisciplinary approach provides a holistic perspective that incorporates expertise from engineering, social science, and …

The Maritime Domain Awareness Center– A Human-Centered Design Approach, Gary Gomez

Political Science & Geography Faculty Publications

This paper contends that Maritime Domain Awareness Center (MDAC) design should be a holistic approach integrating established knowledge about human factors, decision making, cognitive tasks, complexity science, and human information interaction. The design effort should not be primarily a technology effort that focuses on computer screens, information feeds, display technologies, or user interfaces. The existence of a room with access to vast amounts of information and wall-to-wall video screens of ships, aircraft, weather data, and other regional information does not necessarily correlate to possessing situation awareness. Fundamental principles of human-centered information design should guide MDAC design and technology selection, and …

Sustaining Continuous Improvement In Public Sector Services Through Double Loop Learning, Chris Buckell Msc, Mairi Macintyre Assoc. Prof.

International Conference on Lean Six Sigma

Abstract

Purpose: Public Service Organisations (PSOs) are facing continuing funding challenges and increased pressure to maintain and improve service delivery with fewer resources. One response, with the promise of improving efficiency rather than cutting services, has been to implement Continuous Improvement (CI) but success has been sporadic and unpredictable. The well documented and pervasive CI methodologies in PSOs, including Lean and Six Sigma, have general agreement across practitioners and scholars alike, thus the reasons behind their potted success must lie elsewhere, in the culture or the environment perhaps? This work explores the wider contextual issues of CI implementation with the …

The Effects Of At-Home Remote Work Environments On Human Cognitive Performance And Work Task Performance Based On Current Societal Conditions, Angela Arias

Doctoral Dissertations and Master's Theses

Home-based remote work systems present a unique set of cognitive performance and work task performance challenges to employees without remote work experience. The COVID-19 pandemic forced companies into transforming their work system structures, and their employee roles, without the preparation or education of the dynamics that surround home-based remote work systems. This thesis benefits the Human Factors community by investigating the effects of at-home remote-based work environments on cognitive performance, and work task performance, of employees who currently work remotely from home. A multimethod approach was employed to carry out this research. A survey was administered to home-based remote employees, …

Authentication Schemes' Impact On Working Memory, Janine D. Mator

Psychology Theses & Dissertations

Authentication is the process by which a computing system validates a user’s identity. Although this process is necessary for system security, users view authentication as a frequent disruption to their primary tasks. During this disruption, primary task information must be actively maintained in working memory. As a result, primary task information stored in working memory is at risk of being lost or corrupted while users authenticate. For over two decades, researchers have focused on developing more memorable passwords by replacing alphanumeric text with visual graphics (Biddle et al., 2012). However, very little attention has been given to the impact authentication …

Fuzzy Cognitive Map-Based Knowledge Representation Of Hazardous Industrial Operations, Francesco Longo, Antonio Padovano, Letizia Nicoletti, Caterina Fusto, Mohaiad Elbasheer, Rafael Diaz

VMASC Publications

Hazardous industrial operations are highly stochastic, still human-dependent, and risky. Operators working in such an environment must understand the complex interrelation between several factors contributing to safe and effective operations. Therefore, being able to predict the effects of their actions on provoking or mitigating possible accidents is crucial. This study aims to utilize fuzzy cognitive maps (FCM) to model the expert’s reasoning about occupational health and safety (OHS) in confined space. This knowledge is used by operators to build their mental models. The developed FCM displays all the possible incidents of a confined space and links these incidents with all …

Adaptive Task Allocation In Automated Vehicles, Skye Taylor, Bin Hu, Jing Chen

Psychology: Interdisciplinary Research in Behavioral Sciences of Transportation Issues

Adaptive task allocation is used in many human-machine systems and has been proven to improve operators’ monitoring and/or performance with automated systems. However, there is little knowledge surrounding the benefits of adaptive task allocation in automated vehicles. In this study, participants were presented with media depicting driving scenarios of both low and high workload at two levels of automation. The participants reported which tasks they felt comfortable allocating to themselves or to the automated system in each driving scenario, as well as whether they would conduct the task allocation manually or have the automated system automatically allocate the tasks. The …

Human Factors, Ergonomics And Industry 4.0 In The Oil & Gas Industry: A Bibliometric Analysis, Francesco Longo, Antonio Padovano, Lucia Gazzaneo, Jessica Frangella, Rafael Diaz

VMASC Publications

Over the last few years, the Human Factors and Ergonomics (HF/E) discipline has significantly benefited from new human-centric engineered digital solutions of the 4.0 industrial age. Technologies are creating new socio-technical interactions between human and machine that minimize the risk of design-induced human errors and have largely contributed to remarkable improvements in terms of process safety, productivity, quality, and workers’ well-being. However, despite the Oil&Gas (O&G) sector is one of the most hazardous environments where human error can have severe consequences, Industry 4.0 aspects are still scarcely integrated with HF/E. This paper calls for a holistic understanding of the changing …

Integrating The First Person View And The Third Person View Using A Connected Vr-Mr System For Pilot Training, Chang-Geun Oh, Kwanghee Lee, Myunghoon Oh

Journal of Aviation/Aerospace Education & Research

Virtual reality (VR)-based flight simulator provides pilots the enhanced reality from the first-person view. Mixed reality (MR) technology generates effective 3D graphics. The users who wear the MR headset can walk around the 3D graphics to see all its 360 degrees of vertical and horizontal aspects maintaining the consciousness of real space. A VR flight simulator and an MR application were connected to create the capability of both first-person view and third-person view for a comprehensive pilot training system. This system provided users the capability to monitor the aircraft progress along the planned path from the third-person view as well …

Emotional Intelligence And Safety Citizenship Among Army Aviators, Zachary T. Dugger, Bernadette Mccrory

International Journal of Aviation, Aeronautics, and Aerospace

The purpose of this study was to develop an understanding of the relationship between trait emotional intelligence and safety citizenship among United States Army aviators. The study includes analysis of survey responses from 29 individual aviators. Regression analysis was performed to evaluate the relationship between safety citizenship, emotional intelligence, and 15 emotional intelligence facets. Results indicate a significant association (F(1,28) = 15.45; p = 0.001) between safety citizenship and emotional intelligence, and between safety citizenship and 3 emotional intelligence facets: Adaptability (F(1,25) = 23.91; p < 0.001), Self Esteem (F(1,25) = 10.75; p = 0.003), and Optimism (F(1,25) = 8.71; p = …

Interactive Agent-Based Simulation For Experimentation: A Case Study With Cooperatve Game Theory, Andrew J. Collins, Sheida Etemadidavan

Engineering Management & Systems Engineering Faculty Publications

Incorporating human behavior is a current challenge for agent-based modeling and simulation (ABMS). Human behavior includes many different aspects depending on the scenario considered. The scenario context of this paper is strategic coalition formation, which is traditionally modeled using cooperative game theory, but we use ABMS instead; as such, it needs to be validated. One approach to validation is to compare the recorded behavior of humans to what was observed in our simulation. We suggest that using an interactive simulation is a good approach to collecting the necessary human behavior data because the humans would be playing in precisely the …

A Markov Chain Approach For Forecasting Progression Of Opioid Addiction, Abhijit Gosavi, Susan L. Murray, N. Karagiannis

Engineering Management and Systems Engineering Faculty Research & Creative Works

The U.S. is currently facing an opioid crisis. Naltrexone is a common treatment for drug addiction; it reduces the desire to take opiates. However, addicts often stop treatment or continue to use opioids while in treatment. This results in increased fatalities and associated costs. A Markov-chain model is presented to analyze the progression of opioid addiction to assist the medical community in developing appropriate treatments. The model includes patients who continue opiate use while on naltrexone (blocked patients) and those who use opiates after missing naltrexone doses (unblocked patients). The other types of patients are abstinent (the best-case scenario) and …

Communicating Uncertain Information From Deep Learning Models In Human Machine Teams, Harishankar V. Subramanian, Casey I. Canfield, Daniel Burton Shank, Luke Andrews, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

The role of human-machine teams in society is increasing, as big data and computing power explode. One popular approach to AI is deep learning, which is useful for classification, feature identification, and predictive modeling. However, deep learning models often suffer from inadequate transparency and poor explainability. One aspect of human systems integration is the design of interfaces that support human decision-making. AI models have multiple types of uncertainty embedded, which may be difficult for users to understand. Humans that use these tools need to understand how much they should trust the AI. This study evaluates one simple approach for communicating …

Human Error In Commercial Fishing Vessel Accidents: An Investigation Using The Human Factors Analysis And Classification System, Peter J. Zohorsky

Engineering Management & Systems Engineering Theses & Dissertations

The commercial fishing industry is frequently described as one of the most hazardous occupations in the United States. The objective, to maximize the catch, is routinely challenged by a variety of elements due to the environment, the vessel, the crew, and several external considerations and how they interact with each other. The analysis of fishing vessel accidents can be complicated due to the diverse nature of the industry, including the species caught, the type and size of boat that is employed, how far travelled from their homeport, and the adequacy of the support organizations ensuring safe and uninterrupted operations. This …

How Does Robotic Surgery Influence Communication, Leadership, And Team Outcomes? A Multimethod Examination., Jordan E. Rogers

Doctoral Dissertations and Master's Theses

The practice of delivering surgical care has evolved to be less invasive to the patients undergoing surgery. Minimally-invasive surgery can be practiced through traditional laparoscopic methods as well as with robotic technology that displaces the surgeon from the operating table. Robotic surgery has been cited to be safer and more effective than traditional laparoscopic surgery; however, little research has endeavored to investigate the role of surgical modality upon aspects of teamwork. This dissertation contributes to the human factors and teamwork literature by evaluating how surgical modality may influence communication, shared leadership, and team outcomes. Multiple methods were employed to study …

Effects Of Transparency And Haze On Trust And Performance During A Full Motion Video Analysis Task, Sarah C. Leibner

Psychology Theses & Dissertations

Automation is pervasive across all task domains, but its adoption poses unique challenges within the intelligence, surveillance, and reconnaissance (ISR) domain. When users are unable to establish optimal levels of trust in the automation, task accuracy, speed, and automation usage suffer (Chung & Wark, 2016). Degraded visual environments (DVEs) are a particular problem in ISR; however, their specific effects on trust and task performance are still open to investigation (Narayanaswami, Gandhe, & Mehra, 2010). Research suggests that transparency of automation is necessary for users to accurately calibrate trust levels (Lyons et al., 2017). Chen et al. (2014) proposed three levels …