Operations Research, Systems Engineering and Industrial Engineering Commons^™

Designing Explainable Ai To Improve Human-Ai Team Performance: A Medical Stakeholder-Driven Scoping Review, Harishankar V. Subramanian, Casey I. Canfield, Daniel Burton Shank

Engineering Management and Systems Engineering Faculty Research & Creative Works

The rise of complex AI systems in healthcare and other sectors has led to a growing area of research called Explainable AI (XAI) designed to increase transparency. In this area, quantitative and qualitative studies focus on improving user trust and task performance by providing system- and prediction-level XAI features. We analyze stakeholder engagement events (interviews and workshops) on the use of AI for kidney transplantation. From this we identify themes which we use to frame a scoping literature review on current XAI features. The stakeholder engagement process lasted over nine months covering three stakeholder group's workflows, determining where AI could …

Don’T Touch That Dial: Psychological Reactance, Transparency, And User Acceptance Of Smart Thermostat Setting Changes, Matthew Heatherly, Denise A. Baker, Casey I. Canfield

Psychological Science Faculty Research & Creative Works

Automation inherently removes a certain amount of user control. If perceived as a loss of freedom, users may experience psychological reactance, which is a motivational state that can lead a person to engage in behaviors to reassert their freedom. In an online experiment, participants set up and communicated with a hypothetical smart thermostat. Participants read notifications about a change in the thermostat's setting. Phrasing of notifications was altered across three dimensions: strength of authoritative language, deviation of temperature change from preferences, and whether or not the reason for the change was transparent. Authoritative language, temperatures outside the user's preferences, and …

A Primer On The Human Readiness Level Scale (Ansi/Hfes 400-2021), Kelly Steelman, Holly Handley, Katie Plant (Ed.), Gesa Praetorius (Ed.)

Engineering Management & Systems Engineering Faculty Publications

"The Human Readiness Level (HRL) Scale is a simple 9-level scale for evaluating, tracking, and communicating the readiness of a technology for safe and effective human use. It is modeled after the well-established Technology Readiness Level (TRL) framework that is used throughout the government and industry to communicate the maturity of a technology and to support decision making about technology acquisition. Here we (1) introduce the ANSI/HFES 400-2021 Standard that defines the HRL scale and (2) provide concrete examples of evaluation activities to support the application of HRLs in the development of automated driving systems."

Precursors Of Email Response To Cybersecurity Scenarios: Factor Exploration And Scale Development, Miguel A. Toro-Jarrin, Pilar Pazos-Lago, Miguel Padilla

Engineering Management & Systems Engineering Faculty Publications

In the last decade, information security research has further expanded to include human factors as key elements of the organization's cybersecurity infrastructure. Numerous factors from several theories have been explored to explain and predict the multitude of information security-related behaviors in organizations. Lately, there has been a call for the study of specific cybersecurity behaviors in contextualized scenarios that reflect specific and realistic situations of a potential cyber-attack. This paper focuses on precursors of email response in situations that can be the origin of cybersecurity incidents in organizations (i.e., phishing attacks, ransomware, etc.). This study explores participants' intentions to follow …

Human Ergonomic Simulation To Support The Design Of An Exoskeleton For Lashing/De-Lashing Operations Of Containers Cargo, Francesco Longo, Antonio Padovano, Vittorio Solina, Virginia D' Augusta, Stefan Venzl, Roberto Calbi, Michele Bartuni, Ornella Anastasi, Rafael Diaz

VMASC Publications

Lashing and de-lashing operations of containers cargo on board containerships are considered as quite strenuous activities in which operators are required to work continuously over a 6 or 8 hours shift with very limited break. This is mostly because containerships need to leave the port as soon as possible and containers loading and unloading operations must be executed with very high productivity (stay moored in a port is a totally unproductive time for a ship and a loss-making business for a shipping company). Operators performing lashing and de-lashing operations are subjected to intense ergonomic stress and uncomfortable working postures. To …

Reducing Kidney Discard With Artificial Intelligence Decision Support: The Need For A Transdisciplinary Systems Approach, Richard Threlkeld, Lirim Ashiku, Casey I. Canfield, Daniel Burton Shank, Mark A. Schnitzler, Krista L. Lentine, David A. Axelrod, Anil Choudary Reddy Battineni, Henry Randall, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

Purpose of Review: A transdisciplinary systems approach to the design of an artificial intelligence (AI) decision support system can more effectively address the limitations of AI systems. By incorporating stakeholder input early in the process, the final product is more likely to improve decision-making and effectively reduce kidney discard.

Recent Findings: Kidney discard is a complex problem that will require increased coordination between transplant stakeholders. An AI decision support system has significant potential, but there are challenges associated with overfitting, poor explainability, and inadequate trust. A transdisciplinary approach provides a holistic perspective that incorporates expertise from engineering, social science, and …

The Maritime Domain Awareness Center– A Human-Centered Design Approach, Gary Gomez

Political Science & Geography Faculty Publications

This paper contends that Maritime Domain Awareness Center (MDAC) design should be a holistic approach integrating established knowledge about human factors, decision making, cognitive tasks, complexity science, and human information interaction. The design effort should not be primarily a technology effort that focuses on computer screens, information feeds, display technologies, or user interfaces. The existence of a room with access to vast amounts of information and wall-to-wall video screens of ships, aircraft, weather data, and other regional information does not necessarily correlate to possessing situation awareness. Fundamental principles of human-centered information design should guide MDAC design and technology selection, and …

Fuzzy Cognitive Map-Based Knowledge Representation Of Hazardous Industrial Operations, Francesco Longo, Antonio Padovano, Letizia Nicoletti, Caterina Fusto, Mohaiad Elbasheer, Rafael Diaz

VMASC Publications

Hazardous industrial operations are highly stochastic, still human-dependent, and risky. Operators working in such an environment must understand the complex interrelation between several factors contributing to safe and effective operations. Therefore, being able to predict the effects of their actions on provoking or mitigating possible accidents is crucial. This study aims to utilize fuzzy cognitive maps (FCM) to model the expert’s reasoning about occupational health and safety (OHS) in confined space. This knowledge is used by operators to build their mental models. The developed FCM displays all the possible incidents of a confined space and links these incidents with all …

Human Factors, Ergonomics And Industry 4.0 In The Oil & Gas Industry: A Bibliometric Analysis, Francesco Longo, Antonio Padovano, Lucia Gazzaneo, Jessica Frangella, Rafael Diaz

VMASC Publications

Over the last few years, the Human Factors and Ergonomics (HF/E) discipline has significantly benefited from new human-centric engineered digital solutions of the 4.0 industrial age. Technologies are creating new socio-technical interactions between human and machine that minimize the risk of design-induced human errors and have largely contributed to remarkable improvements in terms of process safety, productivity, quality, and workers’ well-being. However, despite the Oil&Gas (O&G) sector is one of the most hazardous environments where human error can have severe consequences, Industry 4.0 aspects are still scarcely integrated with HF/E. This paper calls for a holistic understanding of the changing …

Interactive Agent-Based Simulation For Experimentation: A Case Study With Cooperatve Game Theory, Andrew J. Collins, Sheida Etemadidavan

Engineering Management & Systems Engineering Faculty Publications

Incorporating human behavior is a current challenge for agent-based modeling and simulation (ABMS). Human behavior includes many different aspects depending on the scenario considered. The scenario context of this paper is strategic coalition formation, which is traditionally modeled using cooperative game theory, but we use ABMS instead; as such, it needs to be validated. One approach to validation is to compare the recorded behavior of humans to what was observed in our simulation. We suggest that using an interactive simulation is a good approach to collecting the necessary human behavior data because the humans would be playing in precisely the …

A Markov Chain Approach For Forecasting Progression Of Opioid Addiction, Abhijit Gosavi, Susan L. Murray, N. Karagiannis

Engineering Management and Systems Engineering Faculty Research & Creative Works

The U.S. is currently facing an opioid crisis. Naltrexone is a common treatment for drug addiction; it reduces the desire to take opiates. However, addicts often stop treatment or continue to use opioids while in treatment. This results in increased fatalities and associated costs. A Markov-chain model is presented to analyze the progression of opioid addiction to assist the medical community in developing appropriate treatments. The model includes patients who continue opiate use while on naltrexone (blocked patients) and those who use opiates after missing naltrexone doses (unblocked patients). The other types of patients are abstinent (the best-case scenario) and …

Communicating Uncertain Information From Deep Learning Models In Human Machine Teams, Harishankar V. Subramanian, Casey I. Canfield, Daniel Burton Shank, Luke Andrews, Cihan H. Dagli

Engineering Management and Systems Engineering Faculty Research & Creative Works

The role of human-machine teams in society is increasing, as big data and computing power explode. One popular approach to AI is deep learning, which is useful for classification, feature identification, and predictive modeling. However, deep learning models often suffer from inadequate transparency and poor explainability. One aspect of human systems integration is the design of interfaces that support human decision-making. AI models have multiple types of uncertainty embedded, which may be difficult for users to understand. Humans that use these tools need to understand how much they should trust the AI. This study evaluates one simple approach for communicating …

Evaluation Of Suas Education And Training Tools, Brent Terwilliger, Scott Burgess, James Solti, Kristine Kiernan, Christian Janke, Andrew Shepherd

Publications

The wide distribution and demographic composition of students seeking small unmanned aircraft system (sUAS) education presents a need to fully understand the capabilities, limitations, and dependencies of effective training tools. Concepts, practices, and technologies associated with modeling and simulation, immersive gaming, augmented and mixed-reality, and remote operation have demonstrated efficacy to support engaged student learning and objective satisfaction. Identification and comparison of key attributes critical to an aviation educational framework, such as competency-based training, enables educational designers to identify those tools with the highest potential to support successful learning. A series of factors, such as system performance, regulatory compliance, environmental …

Evaluation Of The Effectiveness Of A Gaze-Based Training Intervention On Latent Hazard Anticipation Skills For Young Drivers: A Driving Simulator Study, Yusuke Yamani, Pinar Biçaksiz, Dakota B. Palmer, Nathan Hatfield, Siby Samuel

Psychology Faculty Publications

A PC-based training program (Road Awareness and Perception Training or RAPT; Pradhan et al., 2009), proven effective for improving young novice drivers' hazard anticipation skills, did not fully maximize the hazard anticipation performance of young drivers despite the use of similar anticipation scenarios in both, the training and the evaluation drives. The current driving simulator experiment examined the additive effects of expert eye movement videos following RAPT training on young drivers' hazard anticipation performance compared to video-only and RAPT-only conditions. The study employed a between-subject design in which 36 young participants (aged 18-21) were equally and randomly assigned to one …

A Three-Year Study Of Adult Undergraduate Engineering Students, Maria-Isabel Carnasciali, Shannon Ciston, Tressa Kay Mikel, Aida Marie Morales, Sanya Sehgal, Melissa L. Whitson

Engineering and Applied Science Education Faculty Publications

Adult learners belong to a large group of individuals for whom lifelong learning is both a desire and a necessity and for whom career changes are or will be the norm. This topic is not exclusive to engineering, but impacts many STEM professionals. Adult learners also include those who may have significant family responsibilities, medical issues, work obligations, returning veterans/active service military people, or those who lack financial resources to commit to fulltime studies. While online education opportunities may fill some of the gaps, acquiring an identity as a professional in a field or discipline grows with personal connections. The …

The Issues And Complexities Surrounding The Future Of Long Duration Spaceflight, Solomon Miiro

Graduate Student Works

The Comprehensive Exam put forward by this proposal is intended to address the learning objectives covered by the Master of Aeronautical Science Degree with specializations in Aviation Aerospace Safety Systems and some limited aspects in Human Factors in Aviation Systems. This will be accomplished by researching the following topics: effects of long duration spaceflight on crew performance and functioning and the steps that should be taken to enable long term spaceflight mission crews in lieu of accomplishing important missions; a human factor analysis should current human-machine design interfaces be enhanced to make manual rendezvous and docking in space easier to …

Creative Confidence In Organizational Knowledge Creation: A Synthesis Of The Literature, Elnaz Dario, Rafael Landaeta, Resit Unal, E.H. Ng. (Ed.), B. Nepal (Ed.), E. Schott (Ed.)

Engineering Management & Systems Engineering Faculty Publications

Creative confidence is a newly rising topic in the innovation study area. In a world where creativity has become a vital source of knowledge creation, not believing in one's own creative capacity could be a barrier. At the organizational level, many good ideas are disappearing before ever being written down or shared. Organizations may lose talented people who have great creative potential by either not giving them the opportunity to express their creative ideas or due to a lack of confidence from the employee side, in sharing these ideas. This paper will contribute to the research stream on the role …

Blended Classes: Expectations Vs. Reality, Susan L. Murray, Julie Phelps, Kelly L. Jones

Engineering Management and Systems Engineering Faculty Research & Creative Works

Blended courses, also called hybrid, have a portion of the course taught face-to-face in a classroom, and at least one-third of the course work is online. Some instructors consider this format to be "the best of both worlds." Students receive the personal contact and interaction with the instructor during the classroom portion. They also have flexibility in the pace, access, and repetition of the online content. In this paper, we explore 49 graduate students' expectations for a required operations management course that was delivered in a blended format. The same students were also surveyed at the completion of the course …

Design, Programming, And User-Experience, Kaila G. Manca

Honors Scholar Theses

This thesis is a culmination of my individualized major in Human-Computer Interaction. As such, it showcases my knowledge of design, computer engineering, user-experience research, and puts into practice my background in psychology, com- munications, and neuroscience.

I provided full-service design and development for a web application to be used by the Digital Media and Design Department and their students.This process involved several iterations of user-experience research, testing, concepting, branding and strategy, ideation, and design. It lead to two products.

The first product is full-scale development and optimization of the web appli- cation.The web application adheres to best practices. It was …

Human System Engineering Applications From Distracted Driving Simulations, Holly A.H. Handley, Cansu Kandemir, S. Long (Ed.), E.-H. Ng (Ed.), C. Downing (Ed.)

Engineering Management & Systems Engineering Faculty Publications

Most of the studies to explore the impact of distracted driving have been descriptive in nature; i.e. the research is conducted in naturalistic settings to evaluate the performance of the driver with and without distracters. However simulation models can also be used that predict the workload for driving tasks. Using concepts from process modeling, baseline models of driving tasks can be created for different driving sequences that include the associated fine motor, visual and cognitive human resources. These models can then be used to evaluate incidents of workload overload caused by different distracters, from both the internal and external vehicle …

Educating The Professional Engineer Of 2020: The Changing Licensure Requirements, Susan L. Murray, Terri M. Lynch-Caris

Engineering Management and Systems Engineering Faculty Research & Creative Works

Engineering education programs would be well served to align their curricula and program outcomes to the Fundamentals of Engineering (FE) Exam and Professional Engineer (PE) Exam specifications. These exams are required steps in the process of becoming a licensed engineer in most states. NCEES (the National Council of Examiners for Engineering and Surveying) is a national nonprofit organization dedicated to advancing professional licensure for engineers and surveyors. It develops, administers, and scores these examinations used for engineering licensure. Starting in 2011, NCEES held survey-creation meetings with diverse teams to develop a draft survey containing the subjects in each discipline and …

Electronic Flashcards As A Tool To Improve Exam Readiness, Susan L. Murray, Julie Phelps

Engineering Management and Systems Engineering Faculty Research & Creative Works

Many college classes have basic information that must be learned before students can master the more complex application and analysis of advanced ideas in the class. Students often struggle with identifying and learning these facts, terms, and principles. This paper reports on a project that evaluated the use of electronic flashcards in two undergraduate engineering classes. The study materials (online flashcards) were developed in conjunction with the university's Educational Technology Office.

Effects Of Visual Interaction Methods On Simulated Unmanned Aircraft Operator Situational Awareness, Brent A. Terwilliger

Publications

The limited field of view of static egocentric visual displays employed in unmanned aircraft controls introduces the soda straw effect on operators, which significantly affects their ability to capture and maintain situational awareness by not depicting peripheral visual data. The problem with insufficient operator situational awareness is the resulting increased potential for error and oversight during operation of unmanned aircraft, leading to accidents and mishaps costing United States taxpayers between $4 million to $54 million per year. The purpose of this quantitative experimental completely randomized design study was to examine and compare use of dynamic eyepoint to static visual interaction …

Using Social Networking Game To Teach Operations Research And Management Science Fundamental Concepts, Ivan G. Guardiola, Susan L. Murray, Elizabeth A. Cudney

Engineering Management and Systems Engineering Faculty Research & Creative Works

This paper presents our experience using the popular game FarmVille by Zynga® to teach the fundamentals of linear programming and integer programming concepts to undergraduate students in an introductory operations research course. FarmVille is a popular game within the social networking website Facebook®. A month-long contest was introduced amongst the students with the goal to be the best individual farmer by striving to reach high levels of revenue, experience, and aesthetic appeal of their own unique farm. The contest is to demonstrate the concepts of problem formulation, solution methods, multiple and competing objectives, implementation of policy, and reformulation. The students …

Strategies For Using Technology When Grading Problem-Based Classes, Susan L. Murray, Ruwen Qin, Ivan G. Guardiola, Abhijit Gosavi

Engineering Management and Systems Engineering Faculty Research & Creative Works

More and more work is being done today using technology. Email and digital drop boxes are useful tools for professors; however the challenge comes when one is teaching a quantitative class. The issue of using technology to manage work in a quantitative class is increasing as more engineering programs embrace distance education. In this paper we will review the advantages and disadvantages of several methods of collecting, grading, and returning homework assignments to students. The techniques considered include faxing, PDF grading using a Wacom Tablet, and various email approaches. Student survey results are also included in the paper.

Using Abet Assessment Requirements As A Catalyst For Change: Enhancing And Streamlining The Engineering Management Undergraduate Program At Missouri S&T, Stephen A. Raper, Susan L. Murray, Christa Moll Weisbrook, William Daughton

Engineering Management and Systems Engineering Faculty Research & Creative Works

The Engineering Management (EM) undergraduate degree program at Missouri University of Science & Technology (formerly University of Missouri-Rolla) was the first program of its kind. The program started over 40 years ago and it is one of only five ABET accredited undergraduate EM programs [1]. The initial degree program included a senior year of management courses in conjunction with three years of courses in common engineering disciplines such as mechanical, electrical, and civil engineering. In the 1990s the program underwent a major restructure and students combined core engineering management classes with an emphasis area inside the department. Industrial, manufacturing, packaging, …

What New Faculty Need To Know, But Don't Know To Ask, Susan L. Murray, Elizabeth A. Cudney, Suzanna Long, Katie Grantham

Engineering Management and Systems Engineering Faculty Research & Creative Works

A smooth transition to life at an academic institution and the surrounding community is essential to the professional careers of new faculty members. The transition begins during the hiring process and startup package negotiations. Once at an institution, aspects of academia including teaching, proposal writing, and the tenure process inevitably generate issues and concerns for new faculty members. Research has shown that mentoring new faculty members early in their academic career can have significant impact on professional success. This is especially true at a research-based institution where the demands of funded scholarship add an extra level of complexity. A survey …

Encouraging Lifelong Learning For Engineering Management Undergraduates, Susan L. Murray, Stephen A. Raper

Engineering Management and Systems Engineering Faculty Research & Creative Works

The current ABET guidelines place an emphasis on life-long learning for our undergraduate students. What is life-long learning? How can we encourage students to consider global issues, current events, or even anything "that isn't going to be on the next test"? In this paper we present survey results evaluating habits of undergraduate students entering an engineering management program and seniors related to life-long learning including attending professional society meetings, reading trade publications, reading business related books, and other learning outside of the classroom activities. This paper also presents a two semester effort to increase life-long learning activities among undergraduate engineering …

Efficacy Of Virtual Models In A Production Systems Course, Lawrence Whitman, Barbara Chaparro

Publications

Wichita State University has developed an integrated set of virtual reality models of an aircraft assembly line. These models are intended to provide students an ‘artifact’ of industrial and manufacturing engineering by providing a realistic environment for initial learning and application. By utilizing a virtual model of the line, students are able to view the process and interrogate the process details, make changes and observe the effects, and gain a better understanding of the concepts and their interrelationships. This paper presents the method used to assess if virtual models (computer models of a real factory) lead to: improved perception of …

Leadership In Student Distance Education Teams, Leroy Cox, Susan L. Murray, David Spurlock

Engineering Management and Systems Engineering Faculty Research & Creative Works

Interactive video technology has become a widely used medium for education. A prominent implementation of this technology, interactive distance learning, involves groups of students at local and remote sites connected by audio and video teleconferencing. This approach has made the task of delivering vital undergraduate and graduate engineering courses to distributed audiences much easier. As this approach has permeated more curricula, distance education instructors have increasingly assigned projects that require distance learners to work together as an element of the final course grade. This trend presents an interesting opportunity for researchers to understand the nature of interactions among course participants …