Education Commons^™

The Question Of School Resources And Student Achievement: A History And Reconsideration, Larry Hedges, Terri D. Pigott, Joshua Polanin, Ann Marie Ryan, Charles Tocci, Ryan T. Williams

Terri Pigott

One question posed continually over the past century of education research is to what extent school resources affect student outcomes. From the turn of the century to the present, a diverse set of actors, including politicians, physicians, and researchers from a number of disciplines, have studied whether and how money that is provided for schools translates into increased student achievement. The authors discuss the historical origins of the question of whether school resources relate to student achievement, and report the results of a meta- analysis of studies examining that relationship. They find that policymakers, researchers, and other stakeholders have addressed …

The Question Of School Resources And Student Achievement: A History And Reconsideration, Larry Hedges, Terri D. Pigott, Joshua Polanin, Ann Marie Ryan, Charles Tocci, Ryan T. Williams

Charles Tocci

One question posed continually over the past century of education research is to what extent school resources affect student outcomes. From the turn of the century to the present, a diverse set of actors, including politicians, physicians, and researchers from a number of disciplines, have studied whether and how money that is provided for schools translates into increased student achievement. The authors discuss the historical origins of the question of whether school resources relate to student achievement, and report the results of a meta- analysis of studies examining that relationship. They find that policymakers, researchers, and other stakeholders have addressed …

The Question Of School Resources And Student Achievement: A History And Reconsideration, Larry Hedges, Terri D. Pigott, Joshua Polanin, Ann Marie Ryan, Charles Tocci, Ryan T. Williams

Ann Marie Ryan, PhD

One question posed continually over the past century of education research is to what extent school resources affect student outcomes. From the turn of the century to the present, a diverse set of actors, including politicians, physicians, and researchers from a number of disciplines, have studied whether and how money that is provided for schools translates into increased student achievement. The authors discuss the historical origins of the question of whether school resources relate to student achievement, and report the results of a meta- analysis of studies examining that relationship. They find that policymakers, researchers, and other stakeholders have addressed …

Applying An Alternative Mathematics Pedagogy For Students With Weak Mathematics: Meta-Analysis Of Alternative Pedagogies, Warren Lake, Margie Wallin, Geoff Woolcott, Wendy Boyd, Alan Foster, Christos Markopoulos, Bill E. Boyd

Dr Wendy Boyd

Student mathematics performance and the need for work-ready graduates to be mathematics-competent is a core issue for many universities. While both student and teacher are responsible for learning outcomes, there is a need to explicitly acknowledge the weak mathematics foundation of many university students. A systematic literature review was undertaken of identified innovations and/or interventions that may lead to improvement in student outcomes for university mathematics-based units of study. The review revealed the importance of understanding the foundations of student performance in higher education mathematics learning, especially in first year. Pre-university mathematics skills were identified as significant in student retention …

Applying An Alternative Mathematics Pedagogy For Students With Weak Mathematics: Meta-Analysis Of Alternative Pedagogies, Warren Lake, Margie Wallin, Geoff Woolcott, Wendy Boyd, Alan Foster, Christos Markopoulos, Bill E. Boyd

Dr Geoff Woolcott

Student mathematics performance and the need for work-ready graduates to be mathematics-competent is a core issue for many universities. While both student and teacher are responsible for learning outcomes, there is a need to explicitly acknowledge the weak mathematics foundation of many university students. A systematic literature review was undertaken of identified innovations and/or interventions that may lead to improvement in student outcomes for university mathematics-based units of study. The review revealed the importance of understanding the foundations of student performance in higher education mathematics learning, especially in first year. Pre-university mathematics skills were identified as significant in student retention …

Meta-Analysis Of Type I Error Rates For Detecting Differential Item Functioning With Logistic Regression And Mantel-Haenszel In Monte Carlo Studies, Eva Van De Water Ph. D.

Eva Van De Water

Differential item functioning (DIF) occurs when individuals from different groups who have equal levels of a latent trait fail to earn commensurate scores on a testing instrument. Type I error occurs when DIF-detection methods result in unbiased items being excluded from the test while a Type II error occurs when biased items remain on the test after DIF-detection methods have been employed. Both errors create potential issues of injustice amongst examinees and can result in costly and protracted legal action. The purpose of this research was to evaluate two methods for detecting DIF: logistic regression (LR) and Mantel-Haenszel (MH).

To …

Characterizing And Predicting The Multi-Faceted Nature Of Quality In Educational Web Resources, Philipp Wetzler, Steve Bethard, Heather Leary, Kirsten Butcher, Soheil Danesh, Jin Zhao, James Martin, Tamara Sumner

Heather Leary, Ph.D.

Efficient learning from web resources can depend on accurately assessing the quality of each resource. We present a methodology for developing computational models of quality that can assist users in assessing web resources. The methodology consists of four steps: 1) a meta-analysis of previous studies to decompose quality into high-level dimensions and low-level indicators, 2) an expert study to identify the key low-level indicators of quality in the target domain, 3) human annotation to provide a collection of example resources where the presence or absence of quality indicators has been tagged, and 4) training of a machine learning model to …

Self-Directed Learning In Problem-Based Learning Versus Traditional Lecture-Based Learning: A Meta-Analysis, Heather Leary

Heather Leary, Ph.D.

Problem-based learning is a student-centered, inquiry-based approach that builds problem-solving skills. Reviews of problem-based learning, as compared to traditional lecture-based learning, report modest positive gains in cognitive outcomes. Many metaanalyses have been conducted to analyze the effectiveness of problem-based learning, but none have examined self-directed learning in the context of problem-based learning. The purpose of this study was to conduct a meta-analysis across all disciplines examining the extent to which problem-based learning engenders self-directed learning compared to a lecture-based approach. This study used a random effects model meta-analysis using 75 outcomes from 38 studies. Results indicated a statistically significant, z(74) …

Impact Of Scaffolding Characteristics And Study Quality On Learner Outcomes In Stem Education: A Meta-Analysis, Brian Belland, Andrew Walker, M. Olsen, Heather Leary

Heather Leary, Ph.D.

This paper employs meta-analysis to determine the impact of scaffold characteristics and study and assessment instrument quality on cognitive student outcomes in science, technology, engineering, and mathematics education at the K-12, college, graduate, and adult levels. Studies were coded for necessary information for effect size calculation, contextual information, threats to internal and external validity, and assessment instrument validity and reliability. Results indicate (a) scaffolding positively impacts student learning (g = 0.53), (b) studies with zero threats to internal validity had lower effect sizes than studies with two threats, (c) studies with one threat to external validity had higher effect sizes …

Self-Directed Learning In Problem-Based Learning: A Meta-Analysis, Heather Leary, Andrew Walker, Brett E. Shelton

Heather Leary, Ph.D.

This paper presents a meta-analysis focused on self-directed learning in problem-based learning when compared with a traditional learning approach. A total of 75 outcomes from 38 studies were used in the analysis which resulted in a statistically significant overall medium effect size of g = 0.45, favoring problem-based learning. Subgroup analyses conducted focused on four aspects of self-directed learning. Both personal autonomy (g = 0.51, z(47) = 6.4, p = 0.01) and independent pursuit of learning (g = 0.66, z(2) = 3.49, p = 0.01) report statistically significant positive effect sizes. Three of eight disciplines reported statistically significant effect sizes …

A Reliability Generalization Of The Overexcitability Questionnaire-Two (Oeqii), Russell Warne

Russell T Warne

Reliability generalization (RG) is a meta-analysis that combines and synthesizes reliability coefficients from different studies to ascertain the average observed reliability across studies. An RG study was conducted on previously reported data from 16 samples of the Overexcitability Questionnaire–Two (OEQII) with a combined N of 5,275. Cronbach’s alpha was found to be consistently higher on all OEQII subscales when scale variance was high and the sample consisted of adults. Sample size, gender composition of the sample, number of items from the subscale used, and location of sample (United States or a different county) had varying effects on observed alpha levels …

Retesting In Selection: A Meta-Analysis Of Practice Effects For Tests Of Cognitive Ability, John P. Hausknecht, Jane A. Halpert, Nicole T. Di Paolo, Meghan O. Moriarty Gerrard

John Hausknecht

Previous studies indicate that as many as 25-50% of applicants in organizational and educational settings are retested with measures of cognitive ability. Researchers have shown that practice effects are found across measurement occasions such that scores improve when these applicants retest. This study uses meta-analysis to summarize the results of 50 studies of practice effects for tests of cognitive ability. Results from 107 samples and 134,436 participants revealed an adjusted overall effect size of .26. Moderator analyses indicated that effects were larger when practice was accompanied by test coaching, and when identical forms were used. Additional research is needed to …

A Meta-Analysis Of Problem-Based Learning Corrected For Attenuation, And Accounting For Internal Threats, Brian Belland, Andrew Walker, Heather Leary, Yu-Chun Kuo, Gulfidan Can

Heather Leary, Ph.D.

No abstract provided.

Rich Visual Media Meta-Analyses For Learning: An Approach At Meta-Synthesis, Heather Leary, Brett Shelton, Andrew Walker

Heather Leary, Ph.D.

No abstract provided.

Determining Best Practices And Interventions In Special Education, Lucinda S. Spaulding

Lucinda S. Spaulding

A current critical issue in special education is no longer the assurance of access but the assurance of intervention effectiveness. Determining which practices and interventions are most effective and efficient for ensuring optimal student achievement is a fundamental concern of special education teachers in this era of accountability. In this discussion I examine three designs commonly used in special education research (experimental research designs, meta-analyses, and narrative research syntheses) and their utility and appropriateness for determining the efficacy of classroom practices and interventions.

Expert Versus Novice Tutors: Impacts On Student Outcomes In Problem Based Learning, Heather Leary, Andrew Walker, Brett E. Shelton, M. Harrison Fitt

Heather Leary, Ph.D.

Problem based learning (PBL) is well known for the large amount of literature in Medical Education (Savery & Duffy, 1995). An essential part of PBL is the role of the tutor. With inconsistencies in the definition of an effective tutor, a systematic review of the literature in all disciplines is necessary. Meta-analysis (Cooper & Hedges, 1994) was used to investigate both content expertise and facilitator training of PBL tutors as moderators of student learning outcomes.

Best Practices And Interventions In Special Education: How Do We Know What Works?, Lucinda S, Spaulding

Lucinda S. Spaulding

The critical issue in special education today is no longer the assurance of access, but rather, the assurance of effectiveness. Determining which practices and interventions are most effective and efficient for ensuring optimal student achievement is a fundamental concern of special education teachers in this era of accountability. In this discussion I examine three designs commonly used in special education research (experimental research designs, meta-analyses, and narrative research syntheses) and their utility and appropriateness for determining the efficacy of classroom practices and interventions.

Expert Versus Novice Tutors: Impacts On Student Outcomes In Problem-Based Learning, Heather Leary, Andrew Walker, M. Fitt, Brett Shelton

Heather Leary, Ph.D.

The tutor is an essential part of problem based learning (PBL). However, tutor characteristics and role are inconsistent. Meta-analysis was used to investigate both the role and training of PBL tutors as moderators of student learning. Weighted effect sizes were calculated on student outcomes with a modest favorable overall effect size for PBL; a vote count shows favorable results as well. Results indicate a mixture of peers and instructors do best when compared to peers and instructors alone. Tutor training appears to make a difference by itself, but when considered with tutor background, tutor training does not appear to moderate …

A Problem Based Learning Meta Analysis: Differences Across Problem Types, Implementation Types, Disciplines, And Assessment Levels, Andrew Walker, Heather Leary

Heather Leary, Ph.D.

Problem based learning (PBL) in its most current form originated in Medical Education but has since been used in a variety of disciplines (Savery & Duffy, 1995) at a variety of educational levels (Savery, 2006). Although recent meta analyses have been conducted (Dochy, Segers, Van den Bossche, & Gijbels, 2003; Gijbels, Dochy, Van den Bossche, & Segers, 2005) that attempted to go beyond medical education, they found only one study in economics and were unable to explain large portions of the variance across results. This work builds upon their efforts as a meta-analysis that crosses disciplines as well as categorizes …

Retesting In Selection: A Meta-Analysis Of Practice Effects For Tests Of Cognitive Ability, John P. Hausknecht, Jane A. Halpert, Nicole T. Di Paolo, Meghan O. Moriarty Gerrard

Jane Halpert

Previous studies indicate that as many as 25-50% of applicants in organizational and educational settings are retested with measures of cognitive ability. Researchers have shown that practice effects are found across measurement occasions such that scores improve when these applicants retest. This study uses meta-analysis to summarize the results of 50 studies of practice effects for tests of cognitive ability. Results from 107 samples and 134,436 participants revealed an adjusted overall effect size of .26. Moderator analyses indicated that effects were larger when practice was accompanied by test coaching, and when identical forms were used. Additional research is needed to …

Problem-Based Learning: A Meta-Analytic Review Of Problem And Implementation Types Across Disciplines And Educational Levels, Andrew Walker, Heather Leary

Heather Leary, Ph.D.

No abstract provided.