Digital Commons Network^™

Interpreting Average Effect Sizes: Never A Center Without A Spread, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

School leaders today are making important decisions regarding education innovations based on published average effect sizes, even though few understand exactly how effect sizes are calculated or what they mean. This article explains how average effect sizes are determined in meta-analyses and the importance of including measures of variability with any average effect size. By considering the variation in effect sizes among studies of the same innovation, education leaders can make better decisions about innovations and greatly increase the likelihood of achieving optimal results from implementation.

General Education Learning Outcomes And Demographic Correlates In University Students In Hong Kong, Lu Yu, Daniel T. L. Shek, Xiaoqin Zhu

Pediatrics Faculty Publications

Although there are studies showing that higher education would benefit university students, empirical research that comprehensively assesses student general education learning outcomes and related demographic correlates based on longitudinal data is minimal, especially in the Chinese context. To address the research gaps, the present study was conducted to investigate learning outcomes amongst university students in one university in Hong Kong based on a four-year longitudinal design (N = 460). Four dimensions of student general education learning outcomes were measured, including effective reasoning and problem solving, leadership, moral character, and integration of learning. Results suggested a U-shaped pattern of student …

Grades Versus Comments: Research On Student Feedback, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

Are comments on student work superior to grades? It depends.

How Traditional Grading Contribute To Student Inequities And How To Fix It, Laura J. Link, Thomas R. Guskey

Educational, School, and Counseling Psychology Faculty Publications

Grades have long been identified by those in the measurement community as prime examples of unreliable measurement (Brookhart, 1994; Stiggins, Frisbie, & Griswold, 1989). What one teacher considers in calculating students’ grades may differ greatly from another teacher (Guskey & Link, 2019; McMillan, 2001; McMillan, Myran, & Workman, 2002). A major factor contributing to the unreliability of grades is teachers’ inclusion of aspects of students’ behavior in the grades they assign. Despite the recommendation of experts to separate behavior from academic achievement in formulating students’ grades, teachers at all grade levels typically include student behavior as a contributing factor in …

Choice Without Inclusion?: Comparing The Intensity Of Racial Segregation In Charters And Public Schools At The Local, State And National Levels, Julian Vasquez Heilig, T. Jameson Brewer, Yohuru Williams

Educational Policy Studies and Evaluation Faculty Publications

We conduct descriptive and inferential analyses of publicly available Common Core of Data (CCD) to examine segregation at the local, state, and national levels. Nationally, we find that higher percentages of charter students of every race attend intensely segregated schools. The highest levels of racial isolation are at the primary level for public and middle level for charters. We find that double segregation by race and class is higher in charter schools. Charters are more likely to be segregated, even when controlling for local ethnoracial demographics. A majority of states have at least half of Blacks and a third of …

Kentucky School Districts As Educational Bright Spots, Michael T. Childress

CBER Research Report

Every year a select group of Kentucky school districts perform better than expected on measures of educational achievement. These measures include things like the percentage of elementary students who achieve proficiency or distinguished in reading, or the proportion of less‐advantaged middle school students who show a similar level of competency on the math assessment.

There are wide differences in the learning environments, finances, and student outcomes among and within Kentucky’s 173 school districts. This is not surprising given that the largest school district in the state, Jefferson County, has 97,000 students and 165 schools, while the smallest, West Point Independent …

Main And Regional Campus Assessments Of Applicants To A Rural Physician Leadership Program: A Generalizability Analysis, Terry D. Stratton, Clarence Kreiter, Carol L. Elam

Behavioral Science Faculty Publications

While the selection of qualified applicants often relies, in part, on scores generated from a medical school pre-admission interview (MSPI), the growth of regional medical campuses (RMCs) – many with specialized rural tracks, programs, or missions – has challenged schools to accommodate a wider range of stakeholder input. This study examines the reliabilities of main (urban) and regional (rural) campus interviewers’ assessments of applicants to a Rural Physician Leadership Program (RPLP) located in the southeastern United States.

Data from RPLP applicants completing MSPIs on two campuses from 2009-2017 (n = 232) were examined in a generalizability analysis. In two separate …

Developing Numeracy And Problem-Solving Skills By Overcoming Learning Bottlenecks, Anita Lee-Post

Marketing & Supply Chain Faculty Publications

Purpose The purpose of this paper is to present an educational approach to elevating problem-solving and numeracy competencies of business undergraduates to meet workplace demand. The approach is grounded in the theory of constraints following the Decoding the Discipline model. The authors investigated a cognitive bottleneck involving problem modeling and an affective bottleneck concerning low self-efficacy of numeracy and designed specific interventions to address both bottlenecks simultaneously. The authors implemented the proposed approach in an introductory level analytics course in business operations.

Design/methodology/approachThe authors use an empirical study to evaluate the effectiveness of the proposed approach in addressing deficiency in …

A Multi-Institutional Analysis Of Instructional Beliefs And Practices In Gateway Courses To The Sciences, Joseph J. Ferrare

Educational Policy Studies and Evaluation Faculty Publications

This paper builds on previous studies of instructional practice in science, technology, engineering, and mathematics courses by reporting findings from a study of the relationship between instructors’ beliefs about teaching and learning and their observed classroom practices. Data collection took place across six institutions of higher education and included in-depth interviews with 71 instructors and more than 140 hours of classroom observations using the Teaching Dimensions Observation Protocol. Thematic coding of interviews identified 31 distinct beliefs that instructors held about the ways students best learn introductory concepts and skills in these courses. Cluster analysis of the observation data suggested that …

Opportunities For Self-Evaluation Increase Student Calibration In An Introductory Biology Course, Jennifer L. Osterhage, Ellen Usher, Trisha A. Douin, William M. Bailey

Biology Faculty Publications

Accurate self-evaluation is critical for learning. Calibration describes the relationship between learners’ perception of their performance and their actual performance on a task. Here, we describe two studies aimed at assessing and improving student calibration in a first-semester introductory biology course at a 4-year public institution. Study 1 investigated students’ (n = 310) calibration (the difference between estimated and actual exam performance) across one semester. Students were significantly miscalibrated for the first exam: their predicted scores were, on average, significantly higher than their actual scores. The lowest-performing students had the most inaccurate estimates. Calibration improved with each exam. By …

Evaluation Of The Project P.A.T.H.S. In Mainland China: Findings Based On Student Diaries, Daniel T. L. Shek, Xiaoqin Zhu, Janet T. Y. Leung, Tak Yan Lee, Florence K. Y. Wu

Pediatrics Faculty Publications

Objectives: Based on 859 student diaries, the present study evaluated a positive youth development program entitled “Tin Ka Ping (TKP) Positive Adolescent Training through Holistic Social programs (P.A.T.H.S.) ” project implemented in mainland China during the 2015–2016 academic year. Method: To understand the perceived effectiveness of the students, the study analyzed quantitative as well as qualitative data derived from the student diaries. Results: The students held very positive views toward the program and the implementers. The narratives of the students also showed that they perceived improvement in the intrapersonal, interpersonal, familial, and societal domains after joining the program. Conclusion: In …

Integrative Approaches To The Undergraduate Public Health Major Curriculum: Strengths, Challenges, And Examples, Marc T. Kiviniemi, Sarahmona M. Przybyla

Health, Behavior & Society Faculty Publications

Many “first generation” undergraduate public health degree programs were designed based on “siloed” course structures centered around subunits in the discipline (e.g., Introduction to Epidemiology, Introduction to Environmental Health) that may be meaningful primarily to experts in the field. An alternative to the siloed approach is an integrative curricular design, in which courses are designed around meaningful thematic units (e.g., explaining public health problems, asking and answering scientific questions in public health), with an emphasis on drawing connections between knowledge from different but complementary disciplinary areas as a means to improve student learning and retention. The integrative approach shifts the …

Design And Investigation Of Cooperative, Scaffolded Wiki Learning Activities In An Online Graduate-Level Course, Kun Huang

Curriculum and Instruction Faculty Publications

Informed by the literature on community of inquiry, wikis in education, and scaffolding in technology-supported learning environments, this study reports the design, implementation, and investigation of wiki-supported cooperative learning activities in an online graduate-level theories class. The investigation of emerging research questions revealed students’ participation patterns in the wiki learning activities, the relationship between their participation and course performance, and the students’ experiences with the scaffolding strategies designed to support their cooperative activities. The study offers implications for designing and scaffolding wiki-based cooperative learning.

Development And Validation Of The Awareness Of Privilege And Oppression Scale-2, Michael James Mcclellan, Lori Patricia Montross-Thomas, Pamela Remer, Yoshie Nakai, Addison D. Monroe

Educational, School, and Counseling Psychology Faculty Publications

The two studies presented describe the revision process that led to the development of the Awareness of Privilege and Oppression Scale–2 (APOS-2) and efforts to evaluate the new measure’s reliability and construct validity. In Study 1, a 26-item measure was developed from data gathered from a sample of 484 undergraduate students. An exploratory factor analysis suggested a four-factor solution made up of awareness of racism, sexism, heterosexism, and classism was appropriate. In Study 2, confirmatory factor analysis suggested the proposed hierarchical four-factor solution was the best available fit of the data using a second sample of 520 undergraduate students. The …

The Forgotten Element Of Instructional Leadership: Grading, Thomas R. Guskey, Laura J. Link

Educational, School, and Counseling Psychology Faculty Publications

Getting the school team coordinated on grading and reporting policies—and the purpose of grading—is too often overlooked in instructional leadership.

Open Educational Resources And Research Data Management: A Very Brief Overview, Adrian K. Ho

Library Presentations

This is a brief overview of open educational resources and research data management. It also addresses the increasing importance of these services in academic and research libraries.

Advising Experiences Among First-Year International Doctoral Students, Nina Marijanović, Jungmin Lee

Educational Policy Studies and Evaluation Faculty Publications

The purpose of this qualitative study was to understand how international graduate students in their first-year of doctoral study selected their faculty advisor and how this selection process influenced their advising relationship. Our results found that a majority of students in our sample were assigned to an interim advisor and most reported a positive advising experience. However, disquieting patterns emerged from the data: low frequency of advisor-advisee interaction, occurrences of mismatching between advisor-advisee, and an unknowingness of how to engage with one’s faculty advisor. Our study adds to the literature focusing on international students by shedding a light on nuanced …

Using Social Network Analysis To Assess Professional Network Development Among AgeSw Pre-Dissertation Fellowship Program Participants, Rebecca L. Mauldin, Jennifer C. Greenfield, Nancy Kusmal, Noelle L. Fields, Staphanie P. Wladkowski, Allison Gibson

Social Work Faculty Publications

Professional networks are important for the success of doctoral students and early career faculty members, yet there is little research about what types of experiences help emerging scholars develop these networks. Social network analysis may be an ideal method for studying the effectiveness of training programs in nurturing network development among emerging scholars. We describe one application of this method, which was used to examine the professional networks formed through participation in the Association of Gerontological Education in Social Work (AGESW)’s Pre-Dissertation Fellowship Program (PDFP). Alumni (n = 12) from the first three cohorts of the program (2010–2012) reported …

The History Of Latino Students At The University Of Kentucky, 1865-2019, Daniela Gamez Salgado

Oswald Research and Creativity Competition

The purpose of this research project, prompted by the Office for Institutional Diversity, was to comprehensively collect the first draft of the history of Latino students at the University of Kentucky from 1865 through 2019. Digital and physical archival research, participant observation, and interviews were conducted in the process of understanding and analyzing the evolution of this historically underserved community. The extensive implications of this collection will serve as a formalized foundation that will further indicate the changing needs of the Latino community on campus. This collection of history also legitimizes the experiences of students of Latin American descent at …

Live Ambience And Homestead Away From Home: Social Media Use And Dependency By Visiting Chinese Students In The United States, Zixue Tai, Jue Lu, Fengbin Hu

Journalism and Media Faculty Publications

This study investigates social media dependency relations among Chinese college students during their three-month study abroad sojourn in the United States. Data were collected using a multimethod approach of ethnography, field observation, and in-depth interviews. Inspired by the lens of media system dependency (MSD) theory, the analysis focuses on the diverse goals and motivations that drive student behavior in social media engagement, as well as various contextual factors leading students to adapt and transition to the U.S. social networking sites (SNS), and the subsequent outcomes. The findings indicate that task-driven and assignment-centered goals dominate social media use, and that multidimensional …

Exploring The Factors Teachers Consider In Determining Students’ Grades, Thomas R. Guskey, Laura J. Link

Educational, School, and Counseling Psychology Faculty Publications

The purpose of this study was to investigate the specific factors teachers consider when assigning students’ report card grades. Data were gathered from 943 K-12 teachers from five school districts in a southeastern state in the United States who completed the Teachers’ Grading Practices Survey. Analyses focused on how teachers weigh different factors in determining report card grades, and if these factors and weights differ among teachers who teach at different grade levels and have different amounts of classroom experience. Results revealed statistically significant differences among teachers at different grade levels but no differences associated with teachers’ years of …