Open Access. Powered by Scholars. Published by Universities.®

Educational Assessment, Evaluation, and Research Commons

Open Access. Powered by Scholars. Published by Universities.®

Articles 1 - 9 of 9

Full-Text Articles in Educational Assessment, Evaluation, and Research

The Predictive Validity Of The Gre Across Graduate Outcomes: A Meta-Analysis Of Trends Over Time, David F. Feldon, Kaylee Litson, Brinleigh Cahoon, Zhang Feng, Andrew Walker, Colby Tofel-Grehl Mar 2023

The Predictive Validity Of The Gre Across Graduate Outcomes: A Meta-Analysis Of Trends Over Time, David F. Feldon, Kaylee Litson, Brinleigh Cahoon, Zhang Feng, Andrew Walker, Colby Tofel-Grehl

Instructional Technology and Learning Sciences Faculty Publications

This meta-analysis assesses the predictive validity of the Graduate Record Examination (GRE) across outcome variables, including grade point average, for graduate students. In addition to aggregate effects, this paper also assessed changes in observed effects over time as related to increasing diversity in the graduate student population and as a function of gender and racial/ethnic composition of study samples. Framed using a lens of critical whiteness, this analysis examined n = 1,744 individual effects across k = 208 studies. Overall, 61.6% of reported effects were nonsignificant (i.e. no predictive value of GRE scores on student outcomes). Further, the magnitude of …


Impact Of Scaffolding Characteristics And Study Quality On Learner Outcomes In Stem Education: A Meta-Analysis, Brian Belland, Andrew Walker, M. Olsen, Heather Leary Mar 2012

Impact Of Scaffolding Characteristics And Study Quality On Learner Outcomes In Stem Education: A Meta-Analysis, Brian Belland, Andrew Walker, M. Olsen, Heather Leary

Heather Leary, Ph.D.

This paper employs meta-analysis to determine the impact of scaffold characteristics and study and assessment instrument quality on cognitive student outcomes in science, technology, engineering, and mathematics education at the K-12, college, graduate, and adult levels. Studies were coded for necessary information for effect size calculation, contextual information, threats to internal and external validity, and assessment instrument validity and reliability. Results indicate (a) scaffolding positively impacts student learning (g = 0.53), (b) studies with zero threats to internal validity had lower effect sizes than studies with two threats, (c) studies with one threat to external validity had higher effect sizes …


Self-Directed Learning In Problem-Based Learning: A Meta-Analysis, Heather Leary, Andrew Walker, Brett E. Shelton Mar 2012

Self-Directed Learning In Problem-Based Learning: A Meta-Analysis, Heather Leary, Andrew Walker, Brett E. Shelton

Heather Leary, Ph.D.

This paper presents a meta-analysis focused on self-directed learning in problem-based learning when compared with a traditional learning approach. A total of 75 outcomes from 38 studies were used in the analysis which resulted in a statistically significant overall medium effect size of g = 0.45, favoring problem-based learning. Subgroup analyses conducted focused on four aspects of self-directed learning. Both personal autonomy (g = 0.51, z(47) = 6.4, p = 0.01) and independent pursuit of learning (g = 0.66, z(2) = 3.49, p = 0.01) report statistically significant positive effect sizes. Three of eight disciplines reported statistically significant effect sizes …


A Meta-Analysis Of Problem-Based Learning Corrected For Attenuation, And Accounting For Internal Threats, Brian Belland, Andrew Walker, Heather Leary, Yu-Chun Kuo, Gulfidan Can Apr 2010

A Meta-Analysis Of Problem-Based Learning Corrected For Attenuation, And Accounting For Internal Threats, Brian Belland, Andrew Walker, Heather Leary, Yu-Chun Kuo, Gulfidan Can

Heather Leary, Ph.D.

No abstract provided.


Rich Visual Media Meta-Analyses For Learning: An Approach At Meta-Synthesis, Heather Leary, Brett Shelton, Andrew Walker Apr 2010

Rich Visual Media Meta-Analyses For Learning: An Approach At Meta-Synthesis, Heather Leary, Brett Shelton, Andrew Walker

Heather Leary, Ph.D.

No abstract provided.


Expert Versus Novice Tutors: Impacts On Student Outcomes In Problem Based Learning, Heather Leary, Andrew Walker, Brett E. Shelton, M. Harrison Fitt Oct 2009

Expert Versus Novice Tutors: Impacts On Student Outcomes In Problem Based Learning, Heather Leary, Andrew Walker, Brett E. Shelton, M. Harrison Fitt

Heather Leary, Ph.D.

Problem based learning (PBL) is well known for the large amount of literature in Medical Education (Savery & Duffy, 1995). An essential part of PBL is the role of the tutor. With inconsistencies in the definition of an effective tutor, a systematic review of the literature in all disciplines is necessary. Meta-analysis (Cooper & Hedges, 1994) was used to investigate both content expertise and facilitator training of PBL tutors as moderators of student learning outcomes.


Expert Versus Novice Tutors: Impacts On Student Outcomes In Problem-Based Learning, Heather Leary, Andrew Walker, M. Fitt, Brett Shelton Mar 2009

Expert Versus Novice Tutors: Impacts On Student Outcomes In Problem-Based Learning, Heather Leary, Andrew Walker, M. Fitt, Brett Shelton

Heather Leary, Ph.D.

The tutor is an essential part of problem based learning (PBL). However, tutor characteristics and role are inconsistent. Meta-analysis was used to investigate both the role and training of PBL tutors as moderators of student learning. Weighted effect sizes were calculated on student outcomes with a modest favorable overall effect size for PBL; a vote count shows favorable results as well. Results indicate a mixture of peers and instructors do best when compared to peers and instructors alone. Tutor training appears to make a difference by itself, but when considered with tutor background, tutor training does not appear to moderate …


A Problem Based Learning Meta Analysis: Differences Across Problem Types, Implementation Types, Disciplines, And Assessment Levels, Andrew Walker, Heather Leary Mar 2009

A Problem Based Learning Meta Analysis: Differences Across Problem Types, Implementation Types, Disciplines, And Assessment Levels, Andrew Walker, Heather Leary

Heather Leary, Ph.D.

Problem based learning (PBL) in its most current form originated in Medical Education but has since been used in a variety of disciplines (Savery & Duffy, 1995) at a variety of educational levels (Savery, 2006). Although recent meta analyses have been conducted (Dochy, Segers, Van den Bossche, & Gijbels, 2003; Gijbels, Dochy, Van den Bossche, & Segers, 2005) that attempted to go beyond medical education, they found only one study in economics and were unable to explain large portions of the variance across results. This work builds upon their efforts as a meta-analysis that crosses disciplines as well as categorizes …


A Problem Based Learning Meta Analysis: Differences Across Problem Types, Implementation Types, Disciplines, And Assessment Levels, Andrew Walker, Heather Leary Jan 2009

A Problem Based Learning Meta Analysis: Differences Across Problem Types, Implementation Types, Disciplines, And Assessment Levels, Andrew Walker, Heather Leary

Instructional Technology and Learning Sciences Faculty Publications

Problem based learning (PBL) in its most current form originated in Medical Education but has since been used in a variety of disciplines (Savery & Duffy, 1995) at a variety of educational levels (Savery, 2006). Although recent meta analyses have been conducted (Dochy, Segers, Van den Bossche, & Gijbels, 2003; Gijbels, Dochy, Van den Bossche, & Segers, 2005) that attempted to go beyond medical education, they found only one study in economics and were unable to explain large portions of the variance across results. This work builds upon their efforts as a meta-analysis that crosses disciplines as well as categorizes …