Does Visualization Enhance Complex Problem Solving? The Effect Of Causal Mapping On Performance In The Computer-Based Microworld Tailorshop, Michael Öllinger, Stephanie Hammon, Michael Von Grundherr, Joachim Funke
Dec 2014
Does Visualization Enhance Complex Problem Solving? The Effect Of Causal Mapping On Performance In The Computer-Based Microworld Tailorshop, Michael Öllinger, Stephanie Hammon, Michael Von Grundherr, Joachim Funke
Joachim Funke
Causal mapping is often recognized as a technique to support strategic decisions and actions in complex problem situations. Such drawing of causal structures is supposed to particularly foster the understanding of the interaction of the various system elements and to further encourage holistic thinking. It builds on the idea that humans make use of mental maps to represent their environment and to make predictions about it. However, a profound theoretical underpinning and empirical research of the effects of causal mapping on problem solving is missing. This study compares a causal mapping approach with more common problem solving techniques utilizing the …
Computer-Based Assessment Of Complex Problem Solving: Concept, Implementation, And Application, Samuel Greiff, Daniel V. Holt, Sascha Wüstenberg, Frank Goldhammer, Joachim Funke
Dec 2012
Computer-Based Assessment Of Complex Problem Solving: Concept, Implementation, And Application, Samuel Greiff, Daniel V. Holt, Sascha Wüstenberg, Frank Goldhammer, Joachim Funke
Joachim Funke
Complex Problem Solving (CPS) skills are essential to successfully deal with environments that change dynamically and involve a large number of interconnected and partially unknown causal influences. The increasing importance of such skills in the 21st century requires appropriate assessment and intervention methods, which in turn rely on adequate item construction, delivery, and scoring. The lack of assessment tools, however, has slowed down research on and understanding of CPS. This paper first presents the MicroDYN framework for assessing CPS, which is based on linear structural equation systems with input and output variables and opaque relations among them. Second, a versatile …
A Decomposition Approach For A New Test-Scenario In Complex Problem Solving, Michael Engelhart, Joachim Funke, Sebastian Sager
Jun 2012
A Decomposition Approach For A New Test-Scenario In Complex Problem Solving, Michael Engelhart, Joachim Funke, Sebastian Sager
Joachim Funke
Over the last years, psychological research has increasingly used computer-supported tests, especially in the analysis of complex human decision making and problem solving. The approach is to use computer-based test scenarios and to evaluate the performance of participants and correlate it to certain attributes, such as the participant's capacity to regulate emotions. However, two important questions can only be answered with the help of modern optimization methodology. The first one considers an analysis of the exact situations and decisions that led to a bad or good overall performance of test persons. The second important question concerns performance, as the choices …
Complex Problem Solving: More Than Reasoning?, Sascha Wüstenberg, Samuel Greiff, Joachim Funke
Dec 2011
Complex Problem Solving: More Than Reasoning?, Sascha Wüstenberg, Samuel Greiff, Joachim Funke
Joachim Funke
This study investigates the internal structure and construct validity of Complex Problem Solving (CPS), which is measured by a Multiple-Item-Approach. It is tested, if (a) three facets of CPS – rule identification (adequateness of strategies), rule knowledge (generated knowledge) and rule application (ability to control a system) – can be empirically distinguished, how (b) reasoning is related to these CPS-facets and if (c) CPS shows incremental validity in predicting school grade point average (GPA) beyond reasoning. N=222 university students completed MicroDYN, a computer-based CPS test and Ravens Advanced Progressive Matrices. Analysis including structural equation models showed that a 2-dimensionsal model …
Dynamic Problem Solving: A New Assessment Perspective, Samuel Greiff, Sascha Wüstenberg, Joachim Funke
Dec 2011
Dynamic Problem Solving: A New Assessment Perspective, Samuel Greiff, Sascha Wüstenberg, Joachim Funke
Joachim Funke
This article addresses two unsolved measurement issues in dynamic problem solving (DPS) research: (a) unsystematic construction of DPS tests making a comparison of results obtained in different studies difficult and (b) use of time-intensive single tasks leading to severe reliability problems. To solve these issues, the MicroDYN approach is presented, which combines (a) the formal framework of linear structural equation models as a systematic way to construct tasks with (b) multiple and independent tasks to increase reliability. Results indicated that the assumed measurement model that comprised three dimensions, information retrieval, model building, and forecasting, fitted the data well (n = …
Measuring Performance In A Complex Problem Solving Task: Reliability And Validity Of The Tailorshop Simulation, Daniel Danner, Dirk Hagemann, Daniel V. Holt, Marieke Hager, Andrea Schankin, Sascha Wüstenberg, Joachim Funke
Dec 2010
Measuring Performance In A Complex Problem Solving Task: Reliability And Validity Of The Tailorshop Simulation, Daniel Danner, Dirk Hagemann, Daniel V. Holt, Marieke Hager, Andrea Schankin, Sascha Wüstenberg, Joachim Funke
Joachim Funke
The Tailorshop simulation is a computer based complex problem solving task in which participants have to lead a fictional company for twelve months. The present study investigated if the performance in the Tailorshop simulation can be measured reliably and validly. The participants were 156 employees from different companies. Structural equation models were used to test tau-congeneric and tau-equivalent measurement models. The results indicate that the trends of the total capital between the second and the twelfth month are reliable measurements. Furthermore, this measure can predict real-life job performance ratings by superiors and is associated with the performance in another complex …
Beyond Iq. A Latent State-Trait Analysis Of General Intelligence, Dynamic Decision Making, And Implicit Learning, Daniel Danner, Dirk Hagemann, Andrea Schankin, Marieke Hager, Joachim Funke
Dec 2010
Beyond Iq. A Latent State-Trait Analysis Of General Intelligence, Dynamic Decision Making, And Implicit Learning, Daniel Danner, Dirk Hagemann, Andrea Schankin, Marieke Hager, Joachim Funke
Joachim Funke
The present study investigated cognitive performance measures beyond IQ. In particular, we investigated the psychometric properties of dynamic decision making variables and implicit learning variables and their relation with general intelligence and professional success. N=173 employees from different companies and occupational groups completed two standard intelligence tests, two dynamic decision making tasks, and two implicit learning tasks at two measurement occasions. We used structural equation models to test latent-state-trait measurement models and the relation between constructs. The results suggest that dynamic decision making and implicit learning are substantially related with general intelligence. Furthermore, general intelligence is the best predictor for …
Optimization As An Analysis Tool For Human Complex Decision Making, Sebastian Sager, Carola M. Barth, Holger Diedam, Michael Engelhart, Joachim Funke
Dec 2010
Optimization As An Analysis Tool For Human Complex Decision Making, Sebastian Sager, Carola M. Barth, Holger Diedam, Michael Engelhart, Joachim Funke
Joachim Funke
We present a problem class of mixed-integer nonlinear programs (MINLPs) with nonconvex continuous relaxations which stem from economic test scenarios that are used in the analysis of human complex problem solving. In a round-based scenario participants hold an executive function. A posteriori a performance indicator is calculated and correlated to personal measures such as intelligence, working memory, or emotion regulation. Altogether, we investigate 2088 optimization problems that differ in size and initial conditions, based on real-world experimental data from 12 rounds of 174 participants. The goals are twofold. First, from the optimal solutions we gain additional insight into a complex …
Finite State Automata: Dynamic Task Environments In Problem Solving Research, Axel Buchner, Joachim Funke
Dec 1992
Finite State Automata: Dynamic Task Environments In Problem Solving Research, Axel Buchner, Joachim Funke
Joachim Funke
This paper presents a new research paradigm for analysing human learning in dynamic task environments based on the theory of finite-state automata. Some of the advantages of the approach are outlined. (1) It is possible to design classes of formally well-described dynamic task environments instead of idiosyncratic microworlds that are difficult if not impossible to compare. (2) The approach suggests assumptions about the mental representation of a discrete dynamic system. (3) The finite-state automata formalism suggests systematic and appropriate diagnostic procedures. (4) Using finite-state automata to design dynamic task environments, one does not have to give up the "ecological validity" …
