Cognitive Science Commons^™

Causation Analysis Of Crane-Related Accident Reports By Utilizing Chatgpt And Complex Networks, Yifan Wang, Junyu Chen, Bo Xiao, Shane T. Mueller, Jingjing Guo

Michigan Tech Publications

This study integrates ChatGPT and complex network (CN) techniques into an accident analysis framework designed to reduce manual effort in accident causation analysis. The proposed framework supports construction stakeholders in extracting causal factors (CFs) from accident reports and identifying both critical CFs and key causal paths. A multistep research design was adopted to develop and validate this novel framework for analyzing crane-related construction accident reports using ChatGPT and CN techniques. First, ChatGPT was prompted to extract CFs from a database of crane-related accident reports. Second, evaluation metrics and an expert questionnaire survey were developed to assess ChatGPT’s performance in CF …

Usefulness Of Current Patient-Reported Outcome Scales For Acl Injury: A Mixed-Methods Evaluation Of Stakeholder-Perceived Utility Of Specific Constructs And Items Across The Rehabilitation Timeline, Erich Petushek, Jed A. Diekfuss, Joseph D. Lamplot, Anne-Inger Mørtvedt, Lauren C. Hoey, Kevin Heo, Camryn B. Petit, Kim D. Barber Foss, Shayla M. Warren, Alexis B. Slutsky-Ganesh, Charles D. Kenyon, April L. Mcpherson, Michael E. Biller, Michael Newsome, Brian Jennings, John W. Xerogeanes, Gregory D. Myer

Michigan Tech Publications

BACKGROUND: Numerous patient-reported outcome measures (PROMs) have been used in patients with anterior cruciate ligament reconstruction (ACLR), often with overlapping constructs of interest and limited content validity. Inefficient scale application increases burden and diminishes overall usefulness for both the patient and practitioner. PURPOSE: To isolate specific PROM items across a diverse set of constructs that patients and practitioners perceive as having the greatest value at various stages of recovery and return to sport (RTS) in patients after ACLR. STUDY DESIGN: Cross-sectional study. METHODS: A combined 77 stakeholders participated in this 2-phase mixed-methods investigation. In phase 1, a total of 27 …

Exploring Usability In Exercise Interventions: From Conceptualization To Measurement And Application, Anne Inger Mørtvedt

Dissertations, Master's Theses and Master's Reports

Exercise interventions hold promise for preventing and treating numerous conditions, diseases, and injuries. However, these interventions will only be effective if they are being used. Unfortunately, uptake and adherence to prescribed exercise and physical activity guidelines are insufficient. Some reasons for this include lack of knowledge, resources, flexibility, and enjoyment. Exercise program developers need to not only consider the effectiveness of the program during the development phase, but also involve end-users and receive feedback on program usability to determine likelihood of uptake and adoption. Usability testing can be used to detect barriers to use and implementation likelihood but has not …

Understanding Subtle Gender Bias Recognition Among Witnesses In A Stem Undergraduate Context, Darnishia Lashalle Morris

Dissertations, Master's Theses and Master's Reports

This dissertation builds on knowledge of how witnesses recognize subtle gender bias (often referred to as gendered microaggressions) in a STEM undergraduate context. This body of work provides a better understanding of the implications of observing these events of subtle bias and the role that recognition plays in providing opportunities to adopt stereotype defying behaviors. The impressions and influences on both witnesses who belong to the marginalized group (target witnesses) and those in majority groups (non-target witnesses) were examined. Three interrelated studies explored how recognition might disrupt the cyclic impact of subtle gender bias when participants witness collaborative STEM team …

Enhancing Students’ User Experience With A Code Critiquer, Laura E. Albrant

Dissertations, Master's Theses and Master's Reports

This thesis explores the role of human factors in the realm of code critiquers and students’ experiences with them. Across three studies, the work utilized Design Thinking to improve the user experience of WebTA for introductory engineering students learning MATLAB. The first two studies gathered observational and interview data to empathize, define, and ideate a new user interface (UI). Said UI was prototyped and then tested with the third study. Overall, the surveys’ data suggests that most students found the new design to be more appealing, useful, and purposeful; however, there is still plenty of room for improvement. Additionally, analysis …

“Minimum Necessary Rigor” In Empirically Evaluating Human–Ai Work Systems, Gary Klein, Robert R. Hoffman, William J. Clancey, Shane Mueller, Florian Jentsch, Mohammadreza Jalaeian

Michigan Tech Publications

The development of AI systems represents a significant investment of funds and time. Assessment is necessary in order to determine whether that investment has paid off. Empirical evaluation of systems in which humans and AI systems act interdependently to accomplish tasks must provide convincing empirical evidence that the work system is learnable and that the technology is usable and useful. We argue that the assessment of human–AI (HAI) systems must be effective but must also be efficient. Bench testing of a prototype of an HAI system cannot require extensive series of large-scale experiments with complex designs. Some of the constraints …

Allograft Anterior Cruciate Ligament Reconstruction Fails At A Greater Rate In Patients Younger Than 34 Years, Camryn B. Petit, Jed A. Diekfuss, Shayla M. Warren, Kim D. Barber Foss, Melanie Valencia, Staci M. Thomas, Erich Petushek, Spero G. Karas, Kyle E. Hammond, Mathew W. Pombo, Sameh A. Labib, Timothy S. Maughon, Bryan J. Whitfield, Gregory D. Myer, John W. Xerogeanes, Joseph D. Lamplot

Michigan Tech Publications, Part 1

Purpose: The purposes of this study were to characterize the secondary anterior cruciate ligament (ACL) injury rates after primary allograft anterior cruciate ligament reconstruction (ACLR) and to identify the age cut-score at which the risk of allograft failure decreases. Methods: All patients who underwent primary ACLR within a single orthopaedic department between January 2005 and April 2020 were contacted at a minimum of 2 years post-ACLR to complete a survey regarding complications experienced post-surgery, activity level, and perceptions of knee health. Patients were excluded for incidence of previous ACLR (ipsilateral or contralateral) and/or age younger than 14 years. Relative proportions …

Increasing The Value Of Xai For Users: A Psychological Perspective, Robert R. Hoffman, Timothy Miller, Gary Klein, Shane T. Mueller, William J. Clancey

Michigan Tech Publications, Part 1

This paper summarizes the psychological insights and related design challenges that have emerged in the field of Explainable AI (XAI). This summary is organized as a set of principles, some of which have recently been instantiated in XAI research. The primary aspects of implementation to which the principles refer are the design and evaluation stages of XAI system development, that is, principles concerning the design of explanations and the design of experiments for evaluating the performance of XAI systems. The principles can serve as guidance, to ensure that AI systems are human-centered and effectively assist people in solving difficult problems.

The Plausibility Transition Model For Sensemaking, Gary Klein, Mohammadreza Jalaeian, Robert R. Hoffman, Shane T. Mueller

Michigan Tech Publications, Part 1

When people make plausibility judgments about an assertion, an event, or a piece of evidence, they are gauging whether it makes sense that the event could transpire as it did. Therefore, we can treat plausibility judgments as a part of sensemaking. In this paper, we review the research literature, presenting the different ways that plausibility has been defined and measured. Then we describe the naturalistic research that allowed us to model how plausibility judgments are engaged during the sensemaking process. The model is based on an analysis of 23 cases in which people tried to make sense of complex situations. …

The Plausibility Transition Model For Sensemaking, Gary Klein, Mohammadreza Jalaeian, Robert R. Hoffman, Shane Mueller

Michigan Tech Publications, Part 1

When people make plausibility judgments about an assertion, an event, or a piece of evidence, they are gauging whether it makes sense that the event could transpire as it did. Therefore, we can treat plausibility judgments as a part of sensemaking. In this paper, we review the research literature, presenting the different ways that plausibility has been defined and measured. Then we describe the naturalistic research that allowed us to model how plausibility judgments are engaged during the sensemaking process. The model is based on an analysis of 23 cases in which people tried to make sense of complex situations. …

Evaluating Machine-Generated Explanations: A “Scorecard” Method For Xai Measurement Science, Robert R. Hoffman, Mohammadreza Jalaeian, Connor Tate, Gary Klein, Shane T. Mueller

Michigan Tech Publications, Part 1

Introduction: Many Explainable AI (XAI) systems provide explanations that are just clues or hints about the computational models-Such things as feature lists, decision trees, or saliency images. However, a user might want answers to deeper questions such as How does it work?, Why did it do that instead of something else? What things can it get wrong? How might XAI system developers evaluate existing XAI systems with regard to the depth of support they provide for the user's sensemaking? How might XAI system developers shape new XAI systems so as to support the user's sensemaking? What might be a useful …

Executive Functions And Psychopathology Dimensions In Deficit And Non-Deficit Schizophrenia, Maksymilian Bielecki, Ernest Tyburski, Piotr Plichta, Monika Mak, Jolanta Kucharska-Mazur, Piotr Podwalski, Katarzyna Rek-Owodziń, Katarzyna Waszczuk, Leszek Sagan, Shane Mueller, Anna Michalczyk, Błażej Misiak, Jerzy Samochowiec

Michigan Tech Publications, Part 1

This study: (a) compared executive functions between deficit (DS) and non-deficit schizophrenia (NDS) patients and healthy controls (HC), controlling premorbid IQ and level of education; (b) compared executive functions in DS and NDS patients, controlling premorbid IQ and psychopathological symptoms; and (c) estimated relationships between clinical factors, psychopathological symptoms, and executive functions using structural equation modelling. Participants were 29 DS patients, 44 NDS patients, and 39 HC. Executive functions were measured with the Mazes Subtest, Spatial Span Subtest, Letter Number Span Test, Color Trail Test, and Berg Card Sorting Test. Psychopathological symptoms were evaluated with the Positive and Negative Syndrome …

Measures For Explainable Ai: Explanation Goodness, User Satisfaction, Mental Models, Curiosity, Trust, And Human-Ai Performance, Robert R. Hoffman, Shane Mueller, Gary Klein, Jordan Litman

Michigan Tech Publications, Part 1

If a user is presented an AI system that portends to explain how it works, how do we know whether the explanation works and the user has achieved a pragmatic understanding of the AI? This question entails some key concepts of measurement such as explanation goodness and trust. We present methods for enabling developers and researchers to: (1) Assess the a priori goodness of explanations, (2) Assess users' satisfaction with explanations, (3) Reveal user's mental model of an AI system, (4) Assess user's curiosity or need for explanations, (5) Assess whether the user's trust and reliance on the AI are …

Types Of Questions Teachers Ask To Engage Students In Making Sense Of A Student Contribution, Nishat B. Alam

Dissertations, Master's Theses and Master's Reports

In the student-centered classroom, a teacher’s interpretation and response to student mathematical contributions plays an important role to shape and direct students’ opportunities for sense-making. This research used a scenario-based survey questionnaire to examine what types of questions middle and high school mathematics teachers indicate they would ask to engage students in making sense of a high-leverage student mathematical contribution and their reasoning about why particular questions are or are not productive. From the results, it could be concluded that teachers asked more productive questions after seeing a set of possible questions. Their beliefs about the productivity of the questions …

Explicit Rule Learning: A Cognitive Tutorial Method To Train Users Of Artificial Intelligence/Machine Learning Systems, Anne Linja

Dissertations, Master's Theses and Master's Reports

Today’s intelligent software systems, such as Artificial Intelligence/Machine Learning systems, are sophisticated, complicated, sometimes complex systems. In order to effectively interact with these systems, novice users need to have a certain level of understanding. An awareness of a system’s underlying principles, rationale, logic, and goals can enhance the synergistic human-machine interaction. It also benefits the user to know when they can trust the systems’ output, and to discern boundary conditions that might change the output. The purpose of this research is to empirically test the viability of a Cognitive Tutorial approach, called Explicit Rule Learning. Several approaches have been used …

Investigating Collaborative Explainable Ai (Cxai)/Social Forum As An Explainable Ai (Xai) Method In Autonomous Driving (Ad), Tauseef Ibne Mamun

Dissertations, Master's Theses and Master's Reports

Explainable AI (XAI) systems primarily focus on algorithms, integrating additional information into AI decisions and classifications to enhance user or developer comprehension of the system's behavior. These systems often incorporate untested concepts of explainability, lacking grounding in the cognitive and educational psychology literature (S. T. Mueller et al., 2021). Consequently, their effectiveness may be limited, as they may address problems that real users don't encounter or provide information that users do not seek.

In contrast, an alternative approach called Collaborative XAI (CXAI), as proposed by S. Mueller et al (2021), emphasizes generating explanations without relying solely on algorithms. CXAI centers …

Making Scientific Information Usable: Development And Assessment Of A Novel Intervention To Boost Healthy Lifestyle Decision-Making, Brittany Nelson

Dissertations, Master's Theses and Master's Reports

Context—Improving diet can reduce the risk of chronic health conditions such as cancer and heart disease. However, people continue to make poor dietary health decisions. A novel intervention based on the science of behavior change and incorporating Human-Centered Design (HCD) methodology is needed to boost informed dietary decision-making.

Objective—This research presents a Behavior Change Wheel (BCW), Human-Centered Design (HCD) approach to develop a novel high-usability video intervention that will increase informed decision-making for whole-grain dietary decisions. The intervention will target college students, improving habits that can carry on throughout later adulthood.

Design—Study 1 consisted of preliminary data …

When Self-Driving Fails: Evaluating Social Media Posts Regarding Problems And Misconceptions About Tesla’S Fsd Mode, Anne Linja, Tauseef Mamun, Shane Mueller

Michigan Tech Publications, Part 1

With the recent deployment of the latest generation of Tesla’s Full Self-Driving (FSD) mode, consumers are using semi-autonomous vehicles in both highway and residential driving for the first time. As a result, drivers are facing complex and unanticipated situations with an unproven technology, which is a central challenge for cooperative cognition. One way to support cooperative cognition in such situations is to inform and educate the user about potential limitations. Because these limitations are not always easily discovered, users have turned to the internet and social media to document their experiences, seek answers to questions they have, provide advice on …

Inconsistent Seduction: Addressing Confounds And Methodological Issues In The Study Of The Seductive Detail Effect, Kay L. Tislar, Kelly S. Steelman

Michigan Tech Publications, Part 1

Introduction: The inclusion of interesting but irrelevant details in instructional materials may interfere with recall and application of the core content. Although this seductive detail effect is well researched, recent research highlights factors that may influence the effect size.

Objectives: The current study discusses confounds and methodological issues in the study of seductive details and outlines strategies for over coming them. These practices were then applied in a study that examined the role of learning objectives on the seductive detail effect.

Met hods: Seductive details were selected on the basis of interest and importance level and matched forword count and …

Kiss Goodbye To The ‘Kissing Knees’: No Association Between Frontal Plane Inward Knee Motion And Risk Of Future Non-Contact Acl Injury In Elite Female Athletes, Agnethe Nilstad, Erich Petushek, Kam Ming Mok, Roald Bahr, Tron Krosshaug

Michigan Tech Publications, Part 1

The aim of this study was to investigate if frontal plane knee and hip control in single-leg squats or vertical drop jumps with an overhead target were associated with future non-contact anterior cruciate ligament (ACL) injury in elite female athletes. Of the 429 handball and 451 football athletes (age 21.5 ± 4.0 years, height 169.6 ± 6.4 cm, body weight 67.1 ± 8.0 kg), 722 non-injured and 56 non-contact ACL injured participants were eligible for analysis. We calculated lateral pelvic tilt, frontal plane knee projection angle, medial knee position, and side-to-side asymmetry in these from 2D videos recorded at baseline, …

Online Retirement Planning Training: The Effects Of Usability On Cognitive Load And Retirement Planning Activity Levels, Natasha Hardy

Dissertations, Master's Theses and Master's Reports

The shift from defined benefit to defined contribution retirement plans for the current generation of retiree planners, Generation X, has placed the onus on individuals to gather, comprehend, and utilize complex financial information in order to plan their own retirement. Low savings rates and retirement planning activity indicate that individuals are not up to the challenge. This research investigates the interplay of three facets of cognitive load, usability, tech and retirement anxiety and the effects of a usability intervention on retirement planning activity levels.

Study 1 used semi-structured interviews and cognitive task analysis to explore themes of computer and retirement …

Investigating The Impact Of Online Human Collaboration In Explanation Of Ai Systems, Tauseef Ibne Mamun

Dissertations, Master's Theses and Master's Reports

An important subdomain in research on Human-Artificial Intelligence interaction is Explainable AI (XAI). XAI aims to improve human understanding and trust in machine intelligence and automation by providing users with visualizations and other information explaining the AI’s decisions, actions, or plans and thereby to establish justified trust and reliance. XAI systems have primarily used algorithmic approaches designed to generate explanations automatically that help understanding underlying information about decisions and establish justified trust and reliance, but an alternate that may augment these systems is to take advantage of the fact that user understanding of AI systems often develops through self-explanation (Mueller …

Time To Start Training: A Review Of Cognitive Research In Sport And Bridging The Gap From Academia To The Field, Patrick Belling, Paul Ward

Michigan Tech Publications, Part 1

Research demonstrates the importance of perceptual-cognitive skills, such as pattern matching, anticipation, and decision making in numerous sports, including badminton [1], baseball [2], basketball [3], handball [4], rugby [5], soccer [6], squash [7], tennis [8], and volleyball [9]. While other factors may be important (e.g., visual search patterns), the accuracy and/or speed with which athletes anticipate their opponent's intentions and/or decide on an appropriate course of action, as assessed on representative tasks have been shown to be the best predictors of skilled performance in the field [10]. Moreover, several studies indicate that these skills can be improved and transfer to …