Education Commons^™

Breaking Up The Grade, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

To make grading more meaningful, course grades should reflect a range of distinct criteria that make up student learning.

What Do Grades Mean? Variation In Grading Criteria In American College And University Courses, Anastasiya A. Lipnevich, Thomas R. Guskey, Dana M. Murano, Jeffrey K. Smith

Educational, School, and Counseling Psychology Faculty Publications

This study examined differences in the criteria used by college and university instructors in the United States to assign course grades. Two hundred and fifty course syllabi (159 from universities and 91 from four-year colleges) developed by randomly selected instructors from five academic disciplines (education, maths, science, psychology, and English) were examined to determine the extent to which instructors employed different criteria in assigning course grades in introductory-level courses. Sources of variation in grade assignment included the use of product versus process criteria, the prevalence of using performance exams, and the framing criteria for grades. Differences between institution types and …

Policy Storms At The Central Office: Conflicting Narratives Of Racial Equity And Segregation At School Committee Meetings, Serena M. Wilcox

Educational Policy Studies and Evaluation Faculty Publications

This article reports findings from a multiyear critical ethnography that examined race talk dilemmas of school leaders at the central office at a small urban school district to understand why racialized educational policies and practices still persist against African American students. This study takes a structural approach to investigating the impact that race talk has on educational policymaking at the local district level. The guiding research question in this paper examines how we can understand educational reform and policy implementation and the unintended consequences of those interventions through the local from a historical context.

The Dark Side Of Assessment Literacy: Avoiding The Perils Of Accountability, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

Educational measurement and evaluation experts generally agree that increasing stakeholders’ assessment literacy will yield a variety of positive benefits, especially broadening the range of assessment formats teachers use to measure students’ mastery of high level, more cognitively complex learning outcomes. But in the context of education accountability as currently structured in American schools, such efforts also may lead teachers to become more sophisticated in test preparation activities and to narrow both their instruction and classroom assessment practices specifically to enhance students’ performance on prescribed, annual high-stakes accountability assessments. This article explains why that is so, describes the process by which …

When Your Plate Is Already Full: Efficient And Meaningful Outcomes Assessment For Busy Law Schools, Melissa N. Henke

Law Faculty Scholarly Articles

The American Bar Association (ABA) accreditation standards involving outcome-based assessment are a game changer for legal education. The standards reaffirm the importance of providing students with formative feedback throughout their course of study to assess and improve student learning. The standards also require law schools to evaluate their effectiveness, and to do so from the perspective of student performance within the institution’s program of study. The relevant question is no longer what are law schools teaching their students, but instead, what are students learning from law schools in terms of the knowledge, skills, and values that are essential for those …

Interpreting Average Effect Sizes: Never A Center Without A Spread, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

School leaders today are making important decisions regarding education innovations based on published average effect sizes, even though few understand exactly how effect sizes are calculated or what they mean. This article explains how average effect sizes are determined in meta-analyses and the importance of including measures of variability with any average effect size. By considering the variation in effect sizes among studies of the same innovation, education leaders can make better decisions about innovations and greatly increase the likelihood of achieving optimal results from implementation.

Grades Versus Comments: Research On Student Feedback, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

Are comments on student work superior to grades? It depends.

How Traditional Grading Contribute To Student Inequities And How To Fix It, Laura J. Link, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

Grades have long been identified by those in the measurement community as prime examples of unreliable measurement (Brookhart, 1994; Stiggins, Frisbie, & Griswold, 1989). What one teacher considers in calculating students’ grades may differ greatly from another teacher (Guskey & Link, 2019; McMillan, 2001; McMillan, Myran, & Workman, 2002). A major factor contributing to the unreliability of grades is teachers’ inclusion of aspects of students’ behavior in the grades they assign. Despite the recommendation of experts to separate behavior from academic achievement in formulating students’ grades, teachers at all grade levels typically include student behavior as a contributing factor in …

Choice Without Inclusion?: Comparing The Intensity Of Racial Segregation In Charters And Public Schools At The Local, State And National Levels, Julian Vasquez Heilig, T. Jameson Brewer, Yohuru Williams

Educational Policy Studies and Evaluation Faculty Publications

We conduct descriptive and inferential analyses of publicly available Common Core of Data (CCD) to examine segregation at the local, state, and national levels. Nationally, we find that higher percentages of charter students of every race attend intensely segregated schools. The highest levels of racial isolation are at the primary level for public and middle level for charters. We find that double segregation by race and class is higher in charter schools. Charters are more likely to be segregated, even when controlling for local ethnoracial demographics. A majority of states have at least half of Blacks and a third of …

Main And Regional Campus Assessments Of Applicants To A Rural Physician Leadership Program: A Generalizability Analysis, Terry D. Stratton, Clarence Kreiter, Carol L. Elam

Behavioral Science Faculty Publications

While the selection of qualified applicants often relies, in part, on scores generated from a medical school pre-admission interview (MSPI), the growth of regional medical campuses (RMCs) – many with specialized rural tracks, programs, or missions – has challenged schools to accommodate a wider range of stakeholder input. This study examines the reliabilities of main (urban) and regional (rural) campus interviewers’ assessments of applicants to a Rural Physician Leadership Program (RPLP) located in the southeastern United States.

Data from RPLP applicants completing MSPIs on two campuses from 2009-2017 (n = 232) were examined in a generalizability analysis. In two separate …

Opportunities For Self-Evaluation Increase Student Calibration In An Introductory Biology Course, Jennifer L. Osterhage, Ellen Usher, Trisha A. Douin, William M. Bailey

Biology Faculty Publications

Accurate self-evaluation is critical for learning. Calibration describes the relationship between learners’ perception of their performance and their actual performance on a task. Here, we describe two studies aimed at assessing and improving student calibration in a first-semester introductory biology course at a 4-year public institution. Study 1 investigated students’ (n = 310) calibration (the difference between estimated and actual exam performance) across one semester. Students were significantly miscalibrated for the first exam: their predicted scores were, on average, significantly higher than their actual scores. The lowest-performing students had the most inaccurate estimates. Calibration improved with each exam. By …

A Multi-Institutional Analysis Of Instructional Beliefs And Practices In Gateway Courses To The Sciences, Joseph J. Ferrare

Educational Policy Studies and Evaluation Faculty Publications

This paper builds on previous studies of instructional practice in science, technology, engineering, and mathematics courses by reporting findings from a study of the relationship between instructors’ beliefs about teaching and learning and their observed classroom practices. Data collection took place across six institutions of higher education and included in-depth interviews with 71 instructors and more than 140 hours of classroom observations using the Teaching Dimensions Observation Protocol. Thematic coding of interviews identified 31 distinct beliefs that instructors held about the ways students best learn introductory concepts and skills in these courses. Cluster analysis of the observation data suggested that …

The Forgotten Element Of Instructional Leadership: Grading, Thomas R. Guskey, Laura J. Link

Educational, School, and Counseling Psychology Faculty Publications

Getting the school team coordinated on grading and reporting policies—and the purpose of grading—is too often overlooked in instructional leadership.

Exploring The Factors Teachers Consider In Determining Students’ Grades, Thomas R. Guskey, Laura J. Link

Educational, School, and Counseling Psychology Faculty Publications

The purpose of this study was to investigate the specific factors teachers consider when assigning students’ report card grades. Data were gathered from 943 K-12 teachers from five school districts in a southeastern state in the United States who completed the Teachers’ Grading Practices Survey. Analyses focused on how teachers weigh different factors in determining report card grades, and if these factors and weights differ among teachers who teach at different grade levels and have different amounts of classroom experience. Results revealed statistically significant differences among teachers at different grade levels but no differences associated with teachers’ years of …

A Low-Intensity, Hybrid Design Between A "Traditional" And A "Course-Based" Research Experience Yields Positive Outcomes For Science Undergraduate Freshmen And Shows Potential For Large-Scale Application, Thushani Rodrigo-Peiris, Lin Xiang, Vincent M. Cassone

Biology Faculty Publications

Based on positive student outcomes, providing research experiences from early undergraduate years is recommended for science, technology, engineering, and mathematics (STEM) majors. To this end, we designed a novel research experience called the “STEMCats Research Experience” (SRE) for a cohort of 119 second-semester freshmen with diverse college preparatory levels, demographics, and academic majors. The SRE targeted student outcomes of enhancing retention in STEM majors, STEM competency development, and STEM academic performance. It was designed as a hybrid of features from apprenticeship-based traditional undergraduate research experience and course-based undergraduate research experience designs, considering five factors: 1) an authentic research experience, 2) …

A Growth Curve Analysis Of Mandatory Student Athletics Fees, Willis A. Jones, Michael J. Rudolph, Michael Brown

Educational Policy Studies and Evaluation Faculty Publications

This study used growth curve modeling to estimate the growth trajectory of mandatory student athletics fees at public NCAA Division I universities from 2004–2016. We specifically focused on three measures of athletics fees; total athletics fees, athletics fees per FTE, and athletics fees as a percentage of total student costs. We found that in general the growth trajectory of athletics fees was positive, but that the rate of growth has declined over the years. We also found that on average less than 5% of student costs are directly attributable to athletics fees and that the growth trajectory of athletics fees …

Evaluating Preexisting Qualitative Research Data For Secondary Analysis, Victoria Sherif

Educational Leadership Studies Faculty Publications

In this article, I explore the nature of secondary analysis and provide a brief history of the method. Qualitative secondary analysis is a relatively under-used method in education and the social sciences, often due to the lack of easily accessible, relevant, trustworthy, and complete data. I address some of the potentials and limitations that influence its use and explore criteria for assessing the quality and sufficiency of preexisting qualitative research data. Qualitative secondary analysis has important implications for qualitative researchers, students and practitioners interested in generating new knowledge via unobtrusive, reliable, valid, and time/cost effective research through the wider use …

Dental Students' Skills Assessments: Comparisons Of Daily Clinical Grades And Clinical And Laboratory Assessments, Elizangela Bertoli, Kristy Pepper Lawson, Susan S. Bishop

Oral Health Practice Faculty Publications

The aim of this study was to compare the daily clinical grades of third-year dental students during routine clinical activities involving direct and indirect operative procedures to clinical and laboratory assessments. The authors compared students’ daily clinical grades to graded clinical assessments and compared daily clinical grades to laboratory assessments at one U.S. dental school. A total of 50 third-year students (participation rate: 98%) participated in this study during the school year of 2014–15. The study analyzed the students’ daily clinical grades and graded assessments during regular clinical activities and two laboratory examinations. The results found no statistically significant differences …

School Choice In Indianapolis: Effects Of Charter, Magnet, Private, And Traditional Public Schools, Mark Borends, R. Joseph Waddington

Educational Policy Studies and Evaluation Faculty Publications

School choice researchers are often limited to comparing one type of choice with another (e.g., charter schools vs. traditional public schools). One area researchers have not examined is the effects of different school types within the same urban region. We fill this gap by analyzing longitudinal data for students (grades 3–8) in Indianapolis, using student fixed effects models to estimate the impacts of students switching from a traditional public school to a charter, magnet, Catholic, or other private school. We find that students experience no differences in their achievement gains after transferring from a traditional public school to a charter …

Does Pre-Assessment Work?, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

Educators must understand the purpose, form, and content of pre-assessments to reap their potential benefits.

Analysis Of Campus Accessibility At The University Of Kentucky, Molly Mathistad

Lewis Honors College Capstone Collection

The paper reviews the accessibility satisfaction ratings and suggestions provided by University of Kentucky (UK) students who live with disabilities. A detailed survey was distributed to all students registered with the UK Disability Resource Center (DRC), inquiring about individual satisfaction with campus aspects such as the DRC, utilized accommodations, campus environment, student and faculty sensitivity, and the potential benefit of accommodation space(s) around campus. Participants listed dozens of potential solutions to problems which they and others face on campus daily, all of which are detailed in results sections of the paper. The most commonly mentioned issues included faculty sensitivity training, …

[Review Of] Pedagogues And Protesters: The Harvard College Student Diary Of Stephen Peabody, 1767-1768. Edited By Conrad Edick Wright., John R. Thelin

Educational Policy Studies and Evaluation Faculty Publications

No abstract provided.

A Century Of Grading Research: Meaning And Value In The Most Common Educational Measure, Susan M. Brookhart, Thomas R. Guskey, Alex J. Bowers, James H. Mcmillan, Jeffrey K. Smith, Lisa F. Smith, Michael T. Stevens, Megan E. Welsh

Educational, School, and Counseling Psychology Faculty Publications

Grading refers to the symbols assigned to individual pieces of student work or to composite measures of student performance on report cards. This review of over 100 years of research on grading considers five types of studies: (a) early studies of the reliability of grades, (b) quantitative studies of the composition of K–12 report card grades, (c) survey and interview studies of teachers’ perceptions of grades, (d) studies of standards-based grading, and (e) grading in higher education. Early 20th-century studies generally condemned teachers’ grades as unreliable. More recent studies of the relationships of grades to tested achievement and survey studies …

Setting A Standard For Chemistry Education In The Next Generation: A Retrosynthetic Analysis, Gregory T. Rushton, Andrew Dewar, Herman E. Ray, Brett A. Criswell, Lisa Shah

Science, Technology, Engineering, and Mathematics (STEM) Education Faculty Publications

A diverse and highly qualified chemistry teaching workforce is critical for preparing equally diverse, qualified STEM professionals. Here, we analyze National Center for Education Statistics (NCES) Schools and Staffing Survey (SASS) data to provide a demographic comparison of the U.S. secondary chemistry teaching population in high-needs and non-high-needs public schools as well as private schools during the 2011–2012 academic year. Our analysis reveals that the chemistry teaching workforce is predominantly white and significantly lacks in-field degrees or certification across school types, though high-needs and private schools are most affected by this lack of teacher qualification. Given these results, we attempt …

Has The Elite Foundation Agenda Spread Beyond The Gates? An Organizational Network Analysis Of Nonmajor Philanthropic Giving In K-12 Education, Joseph J. Ferrare, Katherine Reynolds

Educational Policy Studies and Evaluation Faculty Publications

Previous research focusing on major philanthropic foundations suggests that these actors have collectively converged around a set of jurisdictional challengers promoting market-based education reforms. Using correspondence analysis, network analysis, and geographic information science, this article empirically tests whether this convergence has permeated to less prominent foundations and their grantees, or if these foundations are pursuing alternative organizational strategies to shape K–12 outcomes. The analysis draws from a sample of 15 nonmajor foundations and their 1,069 grantees serving some aspect of K–12 education in 2010. We find that nonmajor foundations have adopted some elements of major foundations’ organizational strategies to influence …

Intergenerational Education Mobility Trends By Race And Gender In The United States, Joseph J. Ferrare

Educational Policy Studies and Evaluation Faculty Publications

Researchers have examined racial and gender patterns of intergenerational education mobility, but less attention has been given to the ways that race and gender interact to further shape these relationships. Based on data from the General Social Survey, this study examined the trajectories of education mobility among Blacks and Whites by gender over the past century. Ordinary least squares and logistic regression models revealed three noteworthy patterns. First, Black men and women have closed substantial gaps with their White counterparts in intergenerational education mobility. At relatively low levels of parental education, these gains have been experienced equally among Black men …

Grading: Why You Should Trust Your Judgment, Thomas R. Guskey, Lee Ann Jung

Educational, School, and Counseling Psychology Faculty Publications

Although computerized grading programs have advantages, teachers’ judgment has been shown to be more reliable.

Pre-Assessment: Promises And Cautions, Thomas R. Guskey, Jay Mctighe

Educational, School, and Counseling Psychology Faculty Publications

To ensure that pre-assessment is worth the time and effort, keep these principles in mind.

Do College Rankings Matter? Examining The Influence Of “America’S Best Black Colleges” On Hbcu Undergraduate Admissions, Willis A. Jones

Educational Policy Studies and Evaluation Faculty Publications

College rankings have become a ubiquitous part of American higher education. As the popularity of rankings has increased, so have the number of research studies attempting to better understand the impact rankings have on college/university admissions outcomes. In the past, these studies have focused almost exclusively on elite national universities and liberal arts colleges. This study broadens research in this area by examining how the introduction of U.S. News and World Report’s “America’s Best Black Colleges” section influenced undergraduate admissions among historically black colleges and universities (HBCUs). The findings suggest that college rankings have little correlation with admissions outcomes …

Planning Professional Learning, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

With backward planning, schools can ensure that they choose professional development activities aligned with their most important goals.