Education Commons^™

Assessing The Role Of Biology Undergraduates' Metacognitive Calibration And Neural Activity During Model-Based Reasoning, Mei Grace Behrendt

College of Education and Human Sciences: Dissertations, Theses, and Student Research

Metacognition refers to the critical awareness of or ability to monitor, regulate, control, and sequence of one's thoughts and performance. There is limited research that examines the relationship between metacognition and (a) academic performance and (b) general cognition among undergraduates. Moreover, there is an even greater paucity of literature that focuses more specifically on undergraduate biology students’ neural activity in relation to their metacognition.

This study aimed to examine the relationship between undergraduate life sciences students' metacognitive calibration, i.e., their capacity to self-evaluate their own performance, and their behavioral performance and brain activity during a biological error reasoning task. Thirty-four …

Persistent Miscalibration For Low And High Achievers Despite Practice Test Feedback In An Introductory Biology Course, Jennifer L. Osterhage

Biology Faculty Publications

Students' ability to accurately judge their knowledge is crucial for effective learning. However, students' perception of their current knowledge is often misaligned with their actual performance. The relationship between learners' perception of their performance and their actual performance on a task is defined as calibration. Previous studies have shown significant student miscalibration in an introductory biology course: students' predicted exam scores were, on average, significantly higher than their actual scores. The goal of this study was to determine whether completion of a practice test before exams would result in better performance and calibration. The hypothesis was that students who completed …

Investigating The Fit Of The Generalized Graded Unfolding Model (Ggum) When Calibrated To Irt Generated Data From Dominance And Ideal Point Models, Abdulla Alzarouni

College of Education and Human Sciences: Dissertations, Theses, and Student Research

The assessment of model fit in latent trait modelling, better known as item response theory (IRT), is an integral part of model testing if one is to make valid inferences about the estimated parameters and their properties based on the selected IRT model. Though important, the assessment of model fit has been less utilized in IRT research than it should. For example, there have been less research investigating fit for polytomous dominance models such the Graded Response Model (GRM), and to a lesser extent ideal point models such as the Generalized Graded Unfolding Models (GGUM), both in its dichotomous and …

Managing Course Consistency Across Multi-Campus, Multi-Modal Systems, David A. Line, Stephen Pyle

Academic Chairpersons Conference Proceedings

Course standardization within multi-campus systems and between online and on-campus courses is critical for educational consistency, continual improvement, management of curricula and accreditation. This best practice presentation will review two calibration efforts undertaken by the authors at their respective Universities. Methodologies incorporated, systems developed and issues encountered will be discussed.

Supplemental Instruction, Calibration, And Self-Efficacy: A Path Model Analysis, Jennifer Leigh Grimm

Educational Leadership & Workforce Development Theses & Dissertations

Many students preparing for careers in the fields of science, technology, engineering, and mathematics (STEM) are unable to persist past entry-level courses to complete their college degrees. As a result, many higher education institutions have implemented intervention programs, like Supplemental Instruction (SI), to help students master course content and gain the self-regulated learning (SRL) behaviors necessary for success in challenging STEM courses. Numerous studies have demonstrated that SI attendance is correlated with improved course grades; however, few studies have examined the effect of SI attendance on students’ SRL behaviors, like self-efficacy and calibration, which may explain students’ academic achievement throughout …

Developmental Math Students' Calibrated Judgments Of Learning, Brian Lindley Jones

Theses and Dissertations

Calibrated Judgments of Learning (CJOL) represent the degree to which students' judgments of learning (JOL) relate to their actual learning. Although a substantial amount of research has been conducted on calibration and JOL in various domains of psychology, only a growing number of studies have begun to address the use of CJOL in applied educational settings. This study investigated the use of CJOL in university developmental math courses. Study participants included 185 men and 100 women with ages ranging from 18 to 61 years (M = 23.48, SD = 5.95). Study results indicate that these developmental math students were fairly …

The Role Of Calibration Bias And Performance Feedback In Achievement Goal Regulation, Krista R. Muis, Philip H. Winne, John Ranellucci

Publications and Research

Do achievement goals change across time in response to performance feedback? Does goal orientation relate to calibration of estimated to actual achievement? We studied these issues over three tasks spanning a semester-long course where ninety-nine undergraduates received feedback about performance on each task. Learners were consistently and quite substantially biased in estimating performance with bias inversely related to actual performance. Goal orientation was not stable across time as a function of task, and it varied in some tasks in relation to calibration accuracy. These findings demonstrate goal orientations are sensitive to task and feedback. Moreover, goal orientation had varying and …

Am I Able To Predict How I Will Do? Examining Calibration In An Undergraduate Biology Course, Trisha A. Turner

Theses and Dissertations--Educational, School, and Counseling Psychology

Students who are self-regulated are more likely to succeed academically, whereas students who have deficiencies in their learning have been recognized as having a lack of metacognitive awareness (Valdez, 2013; Zimmerman, 2002). If students are metacognitively unaware in large introductory courses, they may have difficulty knowing when to self-regulate and modify their learning (Lin & Zabrucky, 1998; Stone, 2000). One manner in which researchers have assessed students’ metacognitive awareness is by asking students to estimate how they think they will do on tasks compared to their actual performance, known as calibration. The purpose of this study was to examine students’ …

Toward Better Training In Peer Assessment: Does Calibration Help?, Yang Song, Zhewei Hu, Edward F. Gehringer, Julia Morris, Jennifer Kidd, Stacie Ringleb

Teaching & Learning Faculty Publications

For peer assessments to be helpful, student reviewers need to submit reviews of good quality. This requires certain training or guidance from teaching staff, lest reviewers read each other's work uncritically, and assign good scores but offer few suggestions. One approach to improving the review quality is calibration. Calibration refers to comparing students' individual reviews to a standard—usually a review done by teaching staff on the same reviewed artifact. In this paper, we categorize two modes of calibration for peer assessment and discuss our experience with both of them in a pilot study with Expertiza system.

Akurasi Metode Kalibrasi Fixed Parameter: Studi Pada Perangkat Ujian Nasional Mata Pelajaran Matematika, Dina Huriaty, Djemari Mardapi

Jurnal Penelitian dan Evaluasi Pendidikan

Penelitian ini bertujuan untuk (1) mengidentifikasi karakteristik butir-butir tes pada perangkat soal ujian nasional mata pelajaran Matematika tingkat SMP tahun pelajaran 2009/2010 yang dikalibrasi dengan metode kalibrasi fixed parameter, dan (2) mengetahui metode kalibrasi fixed parameter yang paling akurat di antara metode NWU-OEM (no prior weights updating and one expectation-maximization cycle), NWU-MEM (no prior weights updating and multiple expectation-maximization cycles), OWU-OEM (one prior weights updating and one expectation-maximization cycle), OWU-MEM (one prior weights updating and multiple expectation-maximization cycles), dan MWU-MEM (multiple weights updating and multiple expectation-maximization cycles). Penelitian ini …

Interpreting, Stephanie Jo Kent

Doctoral Dissertations

What do community interpreting for the Deaf in western societies, conference interpreting for the European Parliament, and language brokering in international management have in common? Academic research and professional training have historically emphasized the linguistic and cognitive challenges of interpreting, neglecting or ignoring the social aspects that structure communication. All forms of interpreting are inherently social; they involve relationships among at least three people and two languages. The contexts explored here, American Sign Language/English interpreting and spoken language interpreting within the European Parliament, show that simultaneous interpreting involves attitudes, norms and values about intercultural communication that overemphasize information and discount …

Enhancing Self-Monitoring And Self-Reflection Through A Self-Regulatory Skills Intervention Embedded In A Middle School Mathematics Curriculum, Gregory Digiacomo

Dissertations, Theses, and Capstone Projects

The purpose of this study was to investigate the effects of a self-regulatory strategy intervention designed to improve participants' calibration accuracy, self-regulatory skills, and math achievement. Monitoring and self-reflection processes were the main focus of this intervention as they are key processes in many well-validated models of self-regulated learning and have been found to impact academic achievement and overall self-regulatory skill (Bol et al., 2010; Dunlosky & Rawson, 2011; Hacker et al., 2008; Nietfeld et al., 2005). The participants were 30 sixth and seventh grade students who were learning about probability as part of their normal math curriculum during the …

The Effect Of Self-Regulated Learning Strategy Training And Question Generation On Metacognitive Awareness And Achievement Among College Students Enrolled In Science Courses, Derrick L. Wilkins

STEMPS Theses & Dissertations

Transitioning from high school students to college students can be a difficult task for students who do not know how to regulate their own study processes. Literature in the areas of metacognition, self-regulated learning (SRL), and question generation suggest a correlation between metacognitive awareness, SRL, and achievement. The present study was guided by efforts to improve college students' achievement by promoting generative learning strategies and metacognitive awareness. Fifty-one undergraduate students enrolled in a general education biology course at a southeastern university participated in this three-week experimental study. The researcher used the Metacognitive Self-Regulation Scale of the Motivated Strategies for Learning …

Generative Learning Strategy Use And Self-Regulatory Prompting In Digital Text, Alan J. Reid, Gary R. Morrison

STEMPS Faculty Publications

The digital revolution is shifting print-based textbooks to digital text, and it has afforded the opportunity to incorporate meaningful learning strategies and otherwise separate metacognitive activities directly into these texts as embedded support. A sample of 89 undergraduates read a digital, expository text on the basics of photography. The treatment prompted the reader with selfregulatory questions and embedded a generative strategy, paraphrasing, and confirmed previous research on the relationships between prior knowledge and level of self-regulation on reading comprehension.

A one-way between subjects ANOVA revealed significance for the level of self-regulation on comprehension-level items and for the level of prior …

Global And Criteria Based Judgments Of An Undergraduate Exit Writing Examination, Katrice Alexandria Hawthorne

Teaching & Learning Theses & Dissertations

The effect of a calibration strategy requiring students to predict and postdict their scores on a writing exam was investigated. The utility of rubric-referenced calibration and the interaction between achievement and self-efficacy on calibration accuracy were also explored. Five hundred ninety six undergraduate students enrolled in an urban, comprehensive, public university participated. Students were assigned to one of three calibration conditions: (1) a global condition (overall judgments only), (2) a global and criteria condition (a general rubric), or (3) a global and detailed criteria condition (a detailed rubric). Students in all three conditions provided global calibrations before and after the …

Improving Metacomprehension And Calibration Accuracy Through Embedded Cognitive And Metacognitive Strategy Prompts, Alan J. Reid

STEMPS Theses & Dissertations

A societal shift from print-based to digital texts has afforded the ability to embed reader support within an instructional text. Numerous factors make eBooks an attractive option for colleges and universities, though undergraduates consistently reaffirm a preference for print-based materials. Given that many undergraduates arrive to college with a deficiency in reading comprehension skills and metacognitive awareness, digital text is able to offer an additional layer of support. A sample population of college undergraduates (N = 80) read an expository text on the basics of photography in the form of a fill-in field PDF. The most robust treatment (mixed) read …

Can Practice Calibrating By Test Topic Improve Public School Students' Calibration Accuracy And Performance On Tests?, Rose M. Riggs

Teaching & Learning Theses & Dissertations

The effect of a calibration strategy requiring students to predict their scores for each topic on a high stakes test was investigated. The utility of self-efficacy towards predicting achievement and calibration accuracy was also explored. One hundred and ten sixth grade math students enrolled in an urban middle school participated. Students were assigned to either a calibration practice group or a no practice condition. Students in the practice condition completed a self-efficacy scale specific to math at the beginning of the study. They also practiced making predictions for each topic on each of three tests over a three month period …

Enhancing The Calibration Accuracy Of Adult Learners: A Multifaceted Intervention, Antonio P. Gutierrez

UNLV Theses, Dissertations, Professional Papers, and Capstones

The present study employs the Nelson and Narens Model of Metacognition (NNMM) to examine the influence of metacognitive strategy training and extrinsic incentives on performance, level of confidence, and the calibration accuracy of undergraduate students' metacognitive judgments within a pretest/posttest experimental design. Calibration of performance is crucial because it allows learners to engage in appropriate comprehension monitoring during a learning episode. As metacognition implies, those individuals who are better calibrators can more adequately adapt to the demands of the situation (monitoring), and thereby better prepare for learning episodes that are similar in format or content (control). Consequently, this aids in …

A Comparison Of Bias In Four Measures Of Monitoring Accuracy, Fred Kuch

UNLV Theses, Dissertations, Professional Papers, and Capstones

Typically in calibration research, subjects perform a task and make a judgment about the success of the task. Accurate findings help subjects improve self-calibration. In addition, researchers rely on the accuracy of findings to make inferences about underlying metacognitive processes. Consequently, it is important that the measures used to assess monitoring accuracy are as free of bias as possible. Bias indicates whether an observed value of monitoring accuracy over- or underestimates the true value.

This study examined gamma and three other viable statistics, d', C, and the G Index, currently used to measure monitoring accuracy. Using Monte Carlo simulation techniques, …

G03-1511 Calibration Of Sprayers (Also Seeders), Robert N. Klein

University of Nebraska-Lincoln Extension: Historical Materials

Applying the correct rate of a product is an important part of obtaining good results with both seeders and pesticide sprayers. With seeders too little seed reduces crop yields and increases weeds while too much seed increases cost and may reduce yields. With a pesticide application, too little product can mean poor control, while too much can mean crop injury, extra costs, and possible residue on the crop and/or carryover. This NebGuide discusses the various methods for calibrating sprayers and seeders and related application information.

G95-1267 Manure Applicator Calibration, Richard K. Koelsch

University of Nebraska-Lincoln Extension: Historical Materials

Calibration methods for manure spreaders are discussed here.

Applying manure to land often is considered a waste disposal process rather than a fertilization process. Applying manure as a waste product is causing growing concerns about groundwater and surface water contamiantion. Increasing commercial fertilizer costs and regulatory mandates will encourage application of manure as a nutrient source in the future.

G88-865 Fine Tuning A Sprayer Wih The "Ounce" Calibration Method, Robert Grisso, Robert N. Klein

University of Nebraska-Lincoln Extension: Historical Materials

This NebGuide discusses guidelines to quickly evaluate the performance of a sprayer. Sprayer calibration, nozzle discharge and speed checks are evaluated with minimal calculations. Tractor-mounted, pull-type, pick-up mounted and self-propelled pesticide application equipment are available from numerous sources. pesticide costs, potential crop damage, unsatisfactory control and environmental concerns make correct application important. Proper calibration to ensure accurate application must be a primary management consideration for both farmers and custom applicators. Application equipment users also should know proper application methods, chemical effects on equipment and correct cleaning and storage procedures of liquid sprayers.